-- Logs begin at Sat 2022-05-07 20:01:27 UTC, end at Sat 2022-05-07 23:01:58 UTC. -- May 07 21:28:56.930656 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... May 07 21:28:56.939161 ncdv-master-1 devstack@keystone.service[91061]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 07 21:28:56.941741 ncdv-master-1 devstack@keystone.service[91061]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 7 21:28:56 2022] *** May 07 21:28:56.941741 ncdv-master-1 devstack@keystone.service[91061]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 07 21:28:56.941741 ncdv-master-1 devstack@keystone.service[91061]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 07 21:28:56.941741 ncdv-master-1 devstack@keystone.service[91061]: nodename: ncdv-master-1 May 07 21:28:56.941741 ncdv-master-1 devstack@keystone.service[91061]: machine: x86_64 May 07 21:28:56.941741 ncdv-master-1 devstack@keystone.service[91061]: clock source: unix May 07 21:28:56.941741 ncdv-master-1 devstack@keystone.service[91061]: pcre jit disabled May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: detected number of CPU cores: 4 May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: current working directory: / May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: detected binary path: /usr/bin/uwsgi-core May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: your processes number limit is 47680 May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: your memory page size is 4096 bytes May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: detected max file descriptor number: 2048 May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: lock engine: pthread robust mutexes May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: thunder lock: enabled May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 07 21:28:56.942179 ncdv-master-1 devstack@keystone.service[91061]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 07 21:28:56.992519 ncdv-master-1 devstack@keystone.service[91061]: Python main interpreter initialized at 0x5559e22bf9c0 May 07 21:28:56.992519 ncdv-master-1 devstack@keystone.service[91061]: python threads support enabled May 07 21:28:56.992519 ncdv-master-1 devstack@keystone.service[91061]: your server socket listen backlog is limited to 100 connections May 07 21:28:56.992519 ncdv-master-1 devstack@keystone.service[91061]: your mercy for graceful operations on workers is 90 seconds May 07 21:28:56.992885 ncdv-master-1 devstack@keystone.service[91061]: mapped 403077 bytes (393 KB) for 2 cores May 07 21:28:56.992985 ncdv-master-1 devstack@keystone.service[91061]: *** Operational MODE: preforking *** May 07 21:28:56.993247 ncdv-master-1 devstack@keystone.service[91061]: *** uWSGI is running in multiple interpreter mode *** May 07 21:28:56.993247 ncdv-master-1 devstack@keystone.service[91061]: spawned uWSGI master process (pid: 91061) May 07 21:28:56.993444 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. May 07 21:28:56.997767 ncdv-master-1 devstack@keystone.service[91061]: spawned uWSGI worker 1 (pid: 91075, cores: 1) May 07 21:28:56.997767 ncdv-master-1 devstack@keystone.service[91061]: spawned uWSGI worker 2 (pid: 91076, cores: 1) May 07 21:28:56.997767 ncdv-master-1 devstack@keystone.service[91061]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 07 21:29:02.828382 ncdv-master-1 devstack@keystone.service[91076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:29:02.828382 ncdv-master-1 devstack@keystone.service[91076]: from cryptography.utils import int_from_bytes May 07 21:29:02.829167 ncdv-master-1 devstack@keystone.service[91075]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:29:02.829167 ncdv-master-1 devstack@keystone.service[91075]: from cryptography.utils import int_from_bytes May 07 21:29:02.829568 ncdv-master-1 devstack@keystone.service[91076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:29:02.829568 ncdv-master-1 devstack@keystone.service[91076]: from cryptography.utils import int_from_bytes May 07 21:29:02.829690 ncdv-master-1 devstack@keystone.service[91075]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 07 21:29:02.829690 ncdv-master-1 devstack@keystone.service[91075]: from cryptography.utils import int_from_bytes May 07 21:29:02.878609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 07 21:29:02.878949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 07 21:29:02.879037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] command line args: [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 07 21:29:02.879266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 07 21:29:02.879375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 07 21:29:02.879445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ================================================================================ {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 07 21:29:02.879514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 07 21:29:02.879681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] admin_token = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.879765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] command line args: [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 07 21:29:02.879954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] config_dir = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 07 21:29:02.880127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ================================================================================ {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 07 21:29:02.880193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] config_source = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] admin_token = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] debug = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] config_dir = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.880958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] config_source = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.881156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] debug = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.881298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] list_limit = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] log_config_append = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.882931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.883002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] log_dir = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.883235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] log_file = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.883325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.883395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.883555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.883699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.883791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.884081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] list_limit = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.884340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.884340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.884951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] log_config_append = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.885226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.885463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.885463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] log_dir = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.885923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.886095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] log_file = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.886289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.890878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.891068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.891235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.891382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.891553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.891698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.891833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.891833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.892103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.892233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.892905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.893069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.893216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.893354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.893354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.893623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.893754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.893754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] publish_errors = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.894982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.895113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.895255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.895255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.895505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.895641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] standard_threads = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.895770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] publish_errors = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.895910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.896097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.896229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.896358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.896486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.896627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.896758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] use_journal = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.896758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] use_json = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] use_stderr = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] use_syslog = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] standard_threads = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.897939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.898068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.898208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.898343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.898343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] use_journal = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.898593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.898728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] use_json = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.898921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.899068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] use_stderr = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.899068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] use_syslog = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.899321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.899450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 07 21:29:02.899584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.899721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.899853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.899981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.900110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.900238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.900367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.900576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.900709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.900849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.900985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.901114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.901249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.901387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.901517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.901645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.901774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.901910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.902040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.902177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.902307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.902307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.903700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.903700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.904090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.904328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.904528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.904698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.904892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.905086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.905311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.905514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.905684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.905877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.906071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.906264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.906467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.906696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.906881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.907076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.907270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.907463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.907655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.907655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.908766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.908963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.909157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.909322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.909456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.909644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.909777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.909944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.910078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.910208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.910337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.910539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.910708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.910864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.911936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.912107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.912242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.912378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.912507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.912636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.912764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.912900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.913968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.914103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.914242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.914378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.914516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.914676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.914863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.915098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.915264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.915394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.915546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.915676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.915804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.915932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.916061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.916189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.916326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.916455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.916618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.916757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.916995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.917160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.917303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.917444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.917575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.917705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.917835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.917964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.918105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.918237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.918366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.918496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.918626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.918762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.918936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.919134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.919282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.919421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.919553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.919683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.919813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.919951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.920096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.920235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.920366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.920496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.920626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.920765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.920908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.921950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.922079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.922323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.922475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.922617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.922755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.922947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.923089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.923220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.923349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.923490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.923621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.923756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.923893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.924024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.924239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.924379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.924510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.924641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.924771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.924900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.925967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.926211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.926340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.926469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.926469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.926722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.926913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.927052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.927188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.927319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.927456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.927596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.927738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.927869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.928940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.929969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.930105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.930314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.930448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.930592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] auth.external = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.930724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.930920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.931064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.931197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.931329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.931458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.931596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.931738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] auth.password = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.931738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] auth.token = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] auth.external = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.932963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.933095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.933225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.933364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] auth.password = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.933495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.933637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] auth.token = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.933769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.933899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.934039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] credential.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.934179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.934321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.934461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.934461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.934983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.935123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.935256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.935387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.935530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.935663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.935793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.935924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] credential.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.936989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.937131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.937263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.937393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.937530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.937663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.937793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.937932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.938065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.938205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.938336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.938466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.938599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.938742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.938909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.939981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.940122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.940253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.940455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.940589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.940721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.940852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.940982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.941112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.941251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.941383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.941513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.941643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.941775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.941916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.942056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.942187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.942317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.942455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.942587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.942754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.942923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.943063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.943195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.943325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.943455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.943592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.943733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.943886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.944022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.944153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.944283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.944413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.944570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.944775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.944942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.945077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.945208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.945350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.945483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.945614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.945756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.945888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.946999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.947133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.947264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.947395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.947525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.947666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.947805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.947944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.948076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.948208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.948339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.948470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.948609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.948741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.948872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.949955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.950087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.950226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.950359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.950490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.950621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.950751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.950944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.951088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.951223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.951369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.951501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.951632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.951770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.951911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.952977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.953108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.953249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.953381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.953520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.953652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.953792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.953926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.954056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.954186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.954326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.954459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.954589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.954720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.955389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.955532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.955675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.955809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.955939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.956070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.956206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.956338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.956478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.956610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.956741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.956871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.957936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.958076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.958208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.958345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.958477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.958609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.958807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.958967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.959109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.959258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.959396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.959535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.959681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.959820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.959959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.960096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.960234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.960371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.960517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.960658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.960796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.960933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.961070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.961217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.961364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.961502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.961641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.961779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.961916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.962054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.962199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.962338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.962476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.962614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.962752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.962913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.963063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.963212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.963611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.963754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.963892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.964030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.964177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.964316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.964454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.964591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.964728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.964866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.965998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.966136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.966278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.966415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.966553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.966698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.966884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.967029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.967166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.967315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.967452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.967663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.967805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.967944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.968082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.968219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.968356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.968502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.968641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.968779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.968916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.969054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.969192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.969356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.969496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.969634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.969771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.969908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.970046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.970192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] role.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.970330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.970549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] role.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.971208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.971347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.971485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.971635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.971774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.971924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.972062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.972200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.972409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] role.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.972590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.972739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] role.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.972878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.973016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.973152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.973291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.973436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.973581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.973724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.973873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.974011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.974149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.974295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.974434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.974572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.974715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.974878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.975033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.975174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.975313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.975313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.975581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.975730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.975876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.976021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.976160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.976299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.976437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.976575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.976721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.976721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.977067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.977237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.977377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.977514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.977670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.977810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.977948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.978085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.978222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.978360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.978505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.978645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.979944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.980104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.980244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.980383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.980535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.980677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.980845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.980990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.981128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.981266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.981413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.981553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.981691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.981830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.981968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.982106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.982252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.982390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.982528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.982678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.982852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.983990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.984128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.984267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.984412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.984554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.984712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.984852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.984989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.985127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.985266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.985404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.985550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.985689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.985829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.985967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.986129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.986274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.986427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.986567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.986716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.986880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.987020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.987158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.987307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.connection = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.987456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.987607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.987756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.987897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.988035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.988173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.988310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.988456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.988606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.988745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.988745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.connection = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.989987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.990125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.990272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.990411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.990560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.990698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.990698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.990982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.991132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.991272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.991410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.991548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.991685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.991823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.992304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 07 21:29:02.993446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 07 21:29:02.997987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:02.998223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:02.998490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:02.999546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:02.999784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.000013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.007069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.008583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.036378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.036605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.037551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.037786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.089497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.089796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.141463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.141761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.141919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.142070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.207573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.207804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.207986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.208143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.208291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.208434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.208591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.208745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.208887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.209027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.209233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.209233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.232143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.232398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.232557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.232711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.232859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.233020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.233190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.233340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.233484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.233627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.233768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.233918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.234060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.234060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.246955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.247630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.260284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.260579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.260778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.260778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.261047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.261188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.261343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.261485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.261627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.261767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.261919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.262067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.262208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.262208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 07 21:29:03.278926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.279138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 07 21:29:03.279415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.279568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.279710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 07 21:29:03.279850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 07 21:29:03.279989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.280140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.280140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 07 21:29:03.280417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.280556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.280694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.280833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.280981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.281129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.281129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.292105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.292383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.292532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.292701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.292845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.292987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.293127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.293321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.301827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.302208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.305136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.305414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.305568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.305741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.305885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.306026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.306167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.306308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.306447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.306597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.306741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.306925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.307067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.307208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.307372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.307515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.307664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.307805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.307945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.308094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.308236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.308236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.334383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.334691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.336039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.336321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.336472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.336613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.341915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.342138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.342301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.342530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.342679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.342839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.350445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.350667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.350883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.351075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.355243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.355515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.355668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.355821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.355973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.356114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.356253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.356393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.356588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.356734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.356874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.357014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.357153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.357301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.357441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.357441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.376357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.376634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.376830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.377089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.381218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.381670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.385378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.385782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.387767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.388173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.390828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.393185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.394488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.396853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.398173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.398472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.398758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.399065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.399345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.399638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.400535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.400830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.401107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.401383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.401653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.401937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.419413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.419699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.419964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.420225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.421881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.422164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.422427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.422686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.428751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.430491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.430780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.431388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.433125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.433396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.434867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.435146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.435421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.435697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.435970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.436611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.436887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.437171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.437446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.437717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.449492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.449767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.450042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.450318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.450694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.450992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.451270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.451514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.451786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.452067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.452350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.452722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.453003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.453276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.469832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.473705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.477028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.478749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.480374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.480657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.480952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.481933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.485241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.488816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.489134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.490434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.490899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.492531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.492806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.493095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.493659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.493938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.495442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.495722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.500439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.502067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.505225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.505319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.505502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.505591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.505783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.507111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.507398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.513643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.513927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.514200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.514468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.514732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.515130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.515403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.515673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.515950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.516212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.516473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.516726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.516893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.517039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.517190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.517371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.517518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.525246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 07 21:29:03.525530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.525804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.526073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.526339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.526705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.527011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.527293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.527569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.527838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.528103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.528370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.528630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.528905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 07 21:29:03.556044 ncdv-master-1 devstack@keystone.service[91075]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559e22bf9c0 pid: 91075 (default app) May 07 21:29:03.559454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9c5b-b031-4b9b-b19d-be90a2846372 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:03.559743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9c5b-b031-4b9b-b19d-be90a2846372 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:03.560019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9c5b-b031-4b9b-b19d-be90a2846372 None None] PATH_INFO: `/v3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:03.566392 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Sat May 7 21:29:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:03.568613 ncdv-master-1 devstack@keystone.service[91076]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559e22bf9c0 pid: 91076 (default app) May 07 21:29:11.730649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8291bb-52b4-4639-b700-caeb8f2e1714 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:11.731255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8291bb-52b4-4639-b700-caeb8f2e1714 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:11.731255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8291bb-52b4-4639-b700-caeb8f2e1714 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:11.732603 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:11.740072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:11.740454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:11.740622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:11.771222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG oslo_db.sqlalchemy.engines [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:29:11.956259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG passlib.handlers.bcrypt [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91076) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 07 21:29:11.956681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG passlib.handlers.bcrypt [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91076) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 07 21:29:12.012702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:12.014260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:12.136409 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1/3] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 07 21:29:12.294060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8291bb-52b4-4639-b700-caeb8f2e1714 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:12.327773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG oslo_db.sqlalchemy.engines [None req-cf8291bb-52b4-4639-b700-caeb8f2e1714 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91075) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 07 21:29:12.454656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8291bb-52b4-4639-b700-caeb8f2e1714 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:12.458989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb8a4b-0718-4ea4-84e1-02a31af76311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:12.459647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8a4b-0718-4ea4-84e1-02a31af76311 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:12.459933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8a4b-0718-4ea4-84e1-02a31af76311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:12.460211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8a4b-0718-4ea4-84e1-02a31af76311 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:12.468685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb8a4b-0718-4ea4-84e1-02a31af76311 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:12.520431 ncdv-master-1 devstack@keystone.service[91075]: WARNING keystone.common.rbac_enforcer.enforcer [None req-17bb8a4b-0718-4ea4-84e1-02a31af76311 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 07 21:29:12.520777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb8a4b-0718-4ea4-84e1-02a31af76311 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:12.530034 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3/4] 10.222.0.32 () {58 vars in 1324 bytes} [Sat May 7 21:29:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 21:29:12.536904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:12.551928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24574e07-7979-466e-91ee-e14cafe70a39 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:12.556392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75927a0-c07f-43d5-8027-df4448d39c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:12.557516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75927a0-c07f-43d5-8027-df4448d39c59 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:12.557801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75927a0-c07f-43d5-8027-df4448d39c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:12.558078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75927a0-c07f-43d5-8027-df4448d39c59 admin admin] PATH_INFO: `/v3/projects/e2f828af0706465883131e16cb564d05` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:12.559758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75927a0-c07f-43d5-8027-df4448d39c59 admin admin] RBAC: Authorizing `identity:get_project(project_id=e2f828af0706465883131e16cb564d05)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:12.612441 ncdv-master-1 devstack@keystone.service[91076]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d75927a0-c07f-43d5-8027-df4448d39c59 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 07 21:29:12.612782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75927a0-c07f-43d5-8027-df4448d39c59 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:12.617442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2/5] 10.222.0.32 () {56 vars in 1207 bytes} [Sat May 7 21:29:12 2022] GET /identity/v3/projects/e2f828af0706465883131e16cb564d05 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:14.936067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed340d5-8ae1-4528-8222-1f486a1f45f5 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:14.936607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed340d5-8ae1-4528-8222-1f486a1f45f5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:14.936607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed340d5-8ae1-4528-8222-1f486a1f45f5 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:14.941271 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4/6] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:14.946579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939534a-cfac-4419-a88f-5601c4e6b4b1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:14.947000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939534a-cfac-4419-a88f-5601c4e6b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:14.947164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939534a-cfac-4419-a88f-5601c4e6b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:14.966106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d939534a-cfac-4419-a88f-5601c4e6b4b1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:14.967698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d939534a-cfac-4419-a88f-5601c4e6b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:14.975575 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3/7] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 07 21:29:14.999200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed340d5-8ae1-4528-8222-1f486a1f45f5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:15.011525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed340d5-8ae1-4528-8222-1f486a1f45f5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:15.015691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7779d9a-51ab-4726-a5e6-19f1bb4022ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:15.016314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779d9a-51ab-4726-a5e6-19f1bb4022ff admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:15.016597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779d9a-51ab-4726-a5e6-19f1bb4022ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:15.016874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7779d9a-51ab-4726-a5e6-19f1bb4022ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:15.024342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7779d9a-51ab-4726-a5e6-19f1bb4022ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:15.026123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7779d9a-51ab-4726-a5e6-19f1bb4022ff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:15.034520 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1324 bytes} [Sat May 7 21:29:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:29:15.039706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939534a-cfac-4419-a88f-5601c4e6b4b1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:15.049045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939534a-cfac-4419-a88f-5601c4e6b4b1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:15.053394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d20e3-b398-480a-b182-42ad9f65288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:15.054237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d20e3-b398-480a-b182-42ad9f65288f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:15.054521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d20e3-b398-480a-b182-42ad9f65288f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:15.055116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d20e3-b398-480a-b182-42ad9f65288f admin admin] PATH_INFO: `/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:15.056513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d20e3-b398-480a-b182-42ad9f65288f admin admin] RBAC: Authorizing `identity:get_user(user_id=9c1ef8221c9c4d4fa45130c3a58da61e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:15.058347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d20e3-b398-480a-b182-42ad9f65288f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:15.059936 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4/9] 10.222.0.32 () {56 vars in 1198 bytes} [Sat May 7 21:29:15 2022] GET /identity/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:17.419255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888d84-1deb-4aed-89b7-8f182b9ea83b None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:17.419784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888d84-1deb-4aed-89b7-8f182b9ea83b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:17.419880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22888d84-1deb-4aed-89b7-8f182b9ea83b None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:17.421163 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:17.426491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d87c0-9a4f-40d3-8759-ba5a8008bd97 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:17.426967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d87c0-9a4f-40d3-8759-ba5a8008bd97 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:17.427064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d87c0-9a4f-40d3-8759-ba5a8008bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:17.428037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b76c-da7b-4680-b646-e0a189c30520 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:17.428330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b76c-da7b-4680-b646-e0a189c30520 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:17.428615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37b76c-da7b-4680-b646-e0a189c30520 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:17.429831 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 7/11] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:17.435120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:17.435411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:17.435698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:17.443321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0e9d87c0-9a4f-40d3-8759-ba5a8008bd97 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:17.444507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e9d87c0-9a4f-40d3-8759-ba5a8008bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:17.476147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG passlib.handlers.bcrypt [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91075) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 07 21:29:17.476512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG passlib.handlers.bcrypt [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91075) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 07 21:29:17.521263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 5/12] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:17.523147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:17.524975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:17.548032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d87c0-9a4f-40d3-8759-ba5a8008bd97 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:17.621346 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 8/13] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:17.643196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d87c0-9a4f-40d3-8759-ba5a8008bd97 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:17.645366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:17.676929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:17.677718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:17.678003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:17.678280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:17.689047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:17.700157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:17.701184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:17.702356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 6/14] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:29:17.707051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:17.741494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177dcc2-4a4c-4da3-b864-71200f3a09d8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:17.773157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:17.774039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:17.774323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:17.774595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:17.800653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274eecf-59ee-4488-82ab-da467b323d95 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:17.831330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:17.831981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:17.832266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:17.832541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:17.833279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:17.833584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:17.835011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:17.839570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:17.841089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:17.846995 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 7/15] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:17.852480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:17.934441 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 9/16] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:29:17.940898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:18.043663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66dd61-80c3-4e59-a446-d8ca8d4ad84e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:18.059088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cf4a1-de07-4073-9e1f-690cb3722fdc None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:18.075622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:18.076406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:18.076687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:18.076962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:18.091115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:18.091959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:18.092243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:18.092521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] PATH_INFO: `/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:18.093689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1ef8221c9c4d4fa45130c3a58da61e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:18.094975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:18.095188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:18.096435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:18.096975 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 8/17] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:17 2022] GET /identity/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:18.102127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:29:18.116995 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:18.118002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:18.118958 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:29:18.118958 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:29:18.118958 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:29:18.118958 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:18.118958 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:29:18.123871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:18.197495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfc273-5ae1-4d3c-8fc2-c7d89505b145 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:18.219790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8deb15b-c918-4861-b3af-4586565296ce None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:18.229483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:18.230274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:18.230561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:18.230876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:18.232075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:18.233549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:18.235188 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:18.241449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:18.252739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3870b-cf15-40e3-86b4-6683a37296fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:18.253402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3870b-cf15-40e3-86b4-6683a37296fa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:18.253691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3870b-cf15-40e3-86b4-6683a37296fa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:18.253966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3870b-cf15-40e3-86b4-6683a37296fa None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:18.254680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3870b-cf15-40e3-86b4-6683a37296fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:18.255014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3870b-cf15-40e3-86b4-6683a37296fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:18.256402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3870b-cf15-40e3-86b4-6683a37296fa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:18.273085 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:18.341813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa731e-b095-4263-9fd7-462c928b20f4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:18.375543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0545a-28fd-404a-8377-81a9dffab8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:18.376712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0545a-28fd-404a-8377-81a9dffab8f6 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:18.376998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0545a-28fd-404a-8377-81a9dffab8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:18.377276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0545a-28fd-404a-8377-81a9dffab8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:18.378118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0545a-28fd-404a-8377-81a9dffab8f6 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.domain.id=default, user.id=9c1ef8221c9c4d4fa45130c3a58da61e) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:18.378428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0545a-28fd-404a-8377-81a9dffab8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:18.379954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0545a-28fd-404a-8377-81a9dffab8f6 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:18.387483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1322 bytes} [Sat May 7 21:29:18 2022] GET /identity/v3/role_assignments?user.id=9c1ef8221c9c4d4fa45130c3a58da61e&scope.domain.id=default&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:21.344864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542057-eecc-4091-92c2-0a69b5695927 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.344864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542057-eecc-4091-92c2-0a69b5695927 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.344864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0542057-eecc-4091-92c2-0a69b5695927 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.345999 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:21.350058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73901-25ad-4b32-acd1-3a6857aea9c3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.350872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73901-25ad-4b32-acd1-3a6857aea9c3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.351367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff73901-25ad-4b32-acd1-3a6857aea9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.371278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5ff73901-25ad-4b32-acd1-3a6857aea9c3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:21.372798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ff73901-25ad-4b32-acd1-3a6857aea9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:21.377972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722819e3-e1d6-43e7-aec7-19152e62950d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.377972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722819e3-e1d6-43e7-aec7-19152e62950d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.377972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722819e3-e1d6-43e7-aec7-19152e62950d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.378591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 13/23] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:21.384093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43dd3-b007-40e0-8f27-39b16acc33c3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.384620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43dd3-b007-40e0-8f27-39b16acc33c3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.385114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b43dd3-b007-40e0-8f27-39b16acc33c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.419780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b0b43dd3-b007-40e0-8f27-39b16acc33c3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:21.421400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0b43dd3-b007-40e0-8f27-39b16acc33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:21.458884 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 11/24] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:21.502720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff73901-25ad-4b32-acd1-3a6857aea9c3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:21.557571 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 14/25] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:21.590614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43dd3-b007-40e0-8f27-39b16acc33c3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:21.650088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff73901-25ad-4b32-acd1-3a6857aea9c3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:21.700757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:21.701816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.702269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.702690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.725342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:21.733284 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:21.734299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:21.735263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:21.748326 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 12/26] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:29:21.754449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:21.875791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfed80-e52a-4e39-ade6-76452a952866 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:21.915506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f11043-1a5a-4b74-86a9-e2d0b052b7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:21.916444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11043-1a5a-4b74-86a9-e2d0b052b7a2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.917017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11043-1a5a-4b74-86a9-e2d0b052b7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.917465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f11043-1a5a-4b74-86a9-e2d0b052b7a2 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.918360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11043-1a5a-4b74-86a9-e2d0b052b7a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:21.918614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b43dd3-b007-40e0-8f27-39b16acc33c3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:21.919004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11043-1a5a-4b74-86a9-e2d0b052b7a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:21.920553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f11043-1a5a-4b74-86a9-e2d0b052b7a2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:21.933932 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 13/27] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:21.935592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec440-1bf3-47d5-a675-8809695ed664 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.936025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec440-1bf3-47d5-a675-8809695ed664 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.936454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ec440-1bf3-47d5-a675-8809695ed664 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.942189 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 14/28] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:21.943631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e806-e721-4f15-988f-30534a8f769b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.944120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e806-e721-4f15-988f-30534a8f769b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.944571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74e806-e721-4f15-988f-30534a8f769b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.946535 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 15/29] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:21.947571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74e806-e721-4f15-988f-30534a8f769b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:21.957290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465a52-fabe-4cd3-bc38-e1a3171b7552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:21.957945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465a52-fabe-4cd3-bc38-e1a3171b7552 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:21.958234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465a52-fabe-4cd3-bc38-e1a3171b7552 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:21.958511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465a52-fabe-4cd3-bc38-e1a3171b7552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:21.972299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50465a52-fabe-4cd3-bc38-e1a3171b7552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:21.973810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50465a52-fabe-4cd3-bc38-e1a3171b7552 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-50465a52-fabe-4cd3-bc38-e1a3171b7552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:29:21.995960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:21.996922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:21.998192 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:29:21.998192 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:29:21.998192 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:29:21.998192 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:21.998192 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 15/30] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:21.998743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45dc8-c525-46fe-af7c-741a6a72831b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.003114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45dc8-c525-46fe-af7c-741a6a72831b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.003708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45dc8-c525-46fe-af7c-741a6a72831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.026610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fca45dc8-c525-46fe-af7c-741a6a72831b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:22.028142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fca45dc8-c525-46fe-af7c-741a6a72831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:22.083995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74e806-e721-4f15-988f-30534a8f769b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:22.102901 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 16/31] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:22.104644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bc38c-049b-4200-9feb-3ddc23a7a853 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.105186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bc38c-049b-4200-9feb-3ddc23a7a853 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.105665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bc38c-049b-4200-9feb-3ddc23a7a853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.121051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:22.122824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.122824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.123008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] PATH_INFO: `/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.124169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1ef8221c9c4d4fa45130c3a58da61e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:22.126700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:22.128447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 16/32] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:21 2022] GET /identity/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:22.129258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:22.133944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ae9bc38c-049b-4200-9feb-3ddc23a7a853 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:22.135800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ae9bc38c-049b-4200-9feb-3ddc23a7a853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:22.222806 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 17/33] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:22.223686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bc38c-049b-4200-9feb-3ddc23a7a853 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:22.259721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b247df-ff6a-4f73-b724-130fbd3be2a3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:22.293645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:22.294404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.294594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.294911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.296348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:22.296348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:22.297326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:22.316123 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 17/34] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:22.316968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:22.327524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bc38c-049b-4200-9feb-3ddc23a7a853 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:22.363002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:22.363911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.364268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.364623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.366179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:22.367788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:22.369619 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 18/35] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:22.370437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:22.427107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535562b5-de12-4fc8-97e4-ab58da9dce49 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:22.465065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:22.465736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.466019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.466428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.467054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:22.468432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:22.469167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09295376-9c83-4e30-951f-50de75a84cdb None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:22.504139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20248f4-6924-4108-b452-4ce9e9453f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:22.504813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20248f4-6924-4108-b452-4ce9e9453f3d None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.505225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20248f4-6924-4108-b452-4ce9e9453f3d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.505500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20248f4-6924-4108-b452-4ce9e9453f3d None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.506235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20248f4-6924-4108-b452-4ce9e9453f3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:22.507642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20248f4-6924-4108-b452-4ce9e9453f3d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:22.594938 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 18/36] 10.222.0.32 () {60 vars in 1131 bytes} [Sat May 7 21:29:22 2022] POST /identity/v3/roles => generated 219 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:22.599991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:22.640997 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1131 bytes} [Sat May 7 21:29:22 2022] POST /identity/v3/roles => generated 225 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:22.652772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7c13-c712-48ee-ac60-433b0a8fa6db None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.653212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7c13-c712-48ee-ac60-433b0a8fa6db None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.653809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7c13-c712-48ee-ac60-433b0a8fa6db None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.655091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 20/38] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:22 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:22.655919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7c13-c712-48ee-ac60-433b0a8fa6db None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:22.730678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e537a-2820-4914-9d44-e3d458b83a67 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:22.776301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cb2c9-4324-479e-8ddc-0ae557b19638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:22.777887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb2c9-4324-479e-8ddc-0ae557b19638 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.778373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb2c9-4324-479e-8ddc-0ae557b19638 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.778856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cb2c9-4324-479e-8ddc-0ae557b19638 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.779882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cb2c9-4324-479e-8ddc-0ae557b19638 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:22.783170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cb2c9-4324-479e-8ddc-0ae557b19638 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:22.821854 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:29:22 2022] POST /identity/v3/projects => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:22.824616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064d819-294a-4bec-a0ae-803c9a013ce0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.825175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064d819-294a-4bec-a0ae-803c9a013ce0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.825678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064d819-294a-4bec-a0ae-803c9a013ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.852306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3064d819-294a-4bec-a0ae-803c9a013ce0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:22.856141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3064d819-294a-4bec-a0ae-803c9a013ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:22.891429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7c13-c712-48ee-ac60-433b0a8fa6db None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:22.953201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:22.954864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.955169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.955459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] PATH_INFO: `/v3/domains/default/users/9c1ef8221c9c4d4fa45130c3a58da61e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.959071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9c1ef8221c9c4d4fa45130c3a58da61e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:22.960993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:22.962720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 20/40] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:22.968405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab8701-239f-42a2-96b8-8aa6f56074e7 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.968807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab8701-239f-42a2-96b8-8aa6f56074e7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.969229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab8701-239f-42a2-96b8-8aa6f56074e7 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:22.971558 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 21/41] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:22.978901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761b5a8-b2c4-4305-9612-1647661b06c3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:22.979202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761b5a8-b2c4-4305-9612-1647661b06c3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:22.979591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 21/42] 10.222.0.32 () {58 vars in 1361 bytes} [Sat May 7 21:29:22 2022] PUT /identity/v3/domains/default/users/9c1ef8221c9c4d4fa45130c3a58da61e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:22.979706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761b5a8-b2c4-4305-9612-1647661b06c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:23.007432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:23.013370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2761b5a8-b2c4-4305-9612-1647661b06c3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:23.014589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2761b5a8-b2c4-4305-9612-1647661b06c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:23.123655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 22/43] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:23.152528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761b5a8-b2c4-4305-9612-1647661b06c3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:23.157595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3772f4-5968-4e83-b3c4-0e6be82f8619 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:23.213723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:23.214415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:23.214706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:23.215029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:23.215821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:23.217247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:23.232152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1131 bytes} [Sat May 7 21:29:23 2022] POST /identity/v3/roles => generated 223 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:29:23.280145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761b5a8-b2c4-4305-9612-1647661b06c3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:23.316611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1a7b5-70a1-44fc-9c0a-781628ac57a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:23.317442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1a7b5-70a1-44fc-9c0a-781628ac57a0 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:23.317733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1a7b5-70a1-44fc-9c0a-781628ac57a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:23.318015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1a7b5-70a1-44fc-9c0a-781628ac57a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:23.319346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1a7b5-70a1-44fc-9c0a-781628ac57a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:23.320872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1a7b5-70a1-44fc-9c0a-781628ac57a0 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:23.322844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 23/45] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:23.328411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:23.432903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3d05c-f9f5-44dc-88df-971405be7557 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:23.467256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b5edd-3ede-4040-938d-ba89baee43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:23.467935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b5edd-3ede-4040-938d-ba89baee43e4 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:23.468226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b5edd-3ede-4040-938d-ba89baee43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:23.468508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b5edd-3ede-4040-938d-ba89baee43e4 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:23.469237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b5edd-3ede-4040-938d-ba89baee43e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:23.471295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b5edd-3ede-4040-938d-ba89baee43e4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:23.497599 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:29:23 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:25.343444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b60ec-9bea-454e-b544-709a5e496507 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:25.343954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b60ec-9bea-454e-b544-709a5e496507 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:25.344037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b60ec-9bea-454e-b544-709a5e496507 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:25.345382 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:25.350885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd76332-8492-4f59-9080-7c1894538de8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:25.351314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd76332-8492-4f59-9080-7c1894538de8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:25.351580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd76332-8492-4f59-9080-7c1894538de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:25.368181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3bd76332-8492-4f59-9080-7c1894538de8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:25.369680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3bd76332-8492-4f59-9080-7c1894538de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:25.433084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:25.457822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b60ec-9bea-454e-b544-709a5e496507 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:25.554122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b60ec-9bea-454e-b544-709a5e496507 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:25.586653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:25.587504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:25.588053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:25.588338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:25.600722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:25.608985 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:25.610019 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:25.610820 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 25/49] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:25.616815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd76332-8492-4f59-9080-7c1894538de8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:25.714878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd76332-8492-4f59-9080-7c1894538de8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:25.746697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af455ff-4e49-4942-b8d3-37dc34111ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:25.747398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af455ff-4e49-4942-b8d3-37dc34111ca9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:25.747684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af455ff-4e49-4942-b8d3-37dc34111ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:25.747961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af455ff-4e49-4942-b8d3-37dc34111ca9 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:25.748710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af455ff-4e49-4942-b8d3-37dc34111ca9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:25.749016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af455ff-4e49-4942-b8d3-37dc34111ca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:25.750413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af455ff-4e49-4942-b8d3-37dc34111ca9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:25.761859 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 25/50] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:25.767888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:25.798944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f1e7-a373-431c-a098-c59b968438c8 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:25.799246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f1e7-a373-431c-a098-c59b968438c8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:25.799532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41f1e7-a373-431c-a098-c59b968438c8 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:25.800903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 26/51] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:25.806215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386b73f-c9f9-46be-9aee-3204bb57dfd0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:25.806509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386b73f-c9f9-46be-9aee-3204bb57dfd0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:25.806817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386b73f-c9f9-46be-9aee-3204bb57dfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:25.823118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e386b73f-c9f9-46be-9aee-3204bb57dfd0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:25.824332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e386b73f-c9f9-46be-9aee-3204bb57dfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:25.866096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9ad3e-b060-4437-a15a-0ae1f32386d9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:25.890992 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 27/52] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:25.898281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:25.899175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:25.899462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:25.899742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] PATH_INFO: `/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:25.900921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] RBAC: Authorizing `identity:get_user(user_id=9c1ef8221c9c4d4fa45130c3a58da61e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:25.902390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:25.904048 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:25 2022] GET /identity/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:25.909364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386b73f-c9f9-46be-9aee-3204bb57dfd0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:25.914746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:26.011666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386b73f-c9f9-46be-9aee-3204bb57dfd0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:26.014937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9fc54-32e3-4b20-85e8-f98cd995732a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:26.043550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:26.044336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:26.044618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:26.044888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:26.046043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:26.046610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:26.047432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:26.047543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:26.047724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:26.048654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:26.049692 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 28/54] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:26.049923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:26.051504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:26.053106 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:26.055444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:26.058248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:26.154589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842b603-4ccb-4d03-af7e-0084711ca01c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:26.157018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7beb9-2ac1-42e7-8a9e-a3061021c1b3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:26.186584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f91759-a597-4d06-83c0-b33edf91a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:26.187287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f91759-a597-4d06-83c0-b33edf91a15f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:26.187577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f91759-a597-4d06-83c0-b33edf91a15f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:26.187860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f91759-a597-4d06-83c0-b33edf91a15f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:26.188680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f91759-a597-4d06-83c0-b33edf91a15f None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.domain.id=default, user.id=9c1ef8221c9c4d4fa45130c3a58da61e) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:26.188783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cda497-b2c9-4bf1-86e6-4e421c4a3943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:26.188990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f91759-a597-4d06-83c0-b33edf91a15f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:26.189385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda497-b2c9-4bf1-86e6-4e421c4a3943 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:26.189676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda497-b2c9-4bf1-86e6-4e421c4a3943 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:26.189955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cda497-b2c9-4bf1-86e6-4e421c4a3943 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:26.190431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f91759-a597-4d06-83c0-b33edf91a15f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:26.190658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cda497-b2c9-4bf1-86e6-4e421c4a3943 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:26.192137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cda497-b2c9-4bf1-86e6-4e421c4a3943 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:26.198470 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 29/56] 10.222.0.32 () {56 vars in 1322 bytes} [Sat May 7 21:29:26 2022] GET /identity/v3/role_assignments?user.id=9c1ef8221c9c4d4fa45130c3a58da61e&scope.domain.id=default&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:26.223000 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 28/57] 10.222.0.32 () {60 vars in 1140 bytes} [Sat May 7 21:29:26 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:29:28.520021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562704e-84ad-41d1-8984-fd6ff39d77c3 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:28.520544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562704e-84ad-41d1-8984-fd6ff39d77c3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:28.520637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562704e-84ad-41d1-8984-fd6ff39d77c3 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:28.521938 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 30/58] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:28.527381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8019e-151e-467d-a2ed-0cb19f52551d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:28.527792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8019e-151e-467d-a2ed-0cb19f52551d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:28.527942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8019e-151e-467d-a2ed-0cb19f52551d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:28.544491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4cf8019e-151e-467d-a2ed-0cb19f52551d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:28.545668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4cf8019e-151e-467d-a2ed-0cb19f52551d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:28.607210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 29/59] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:28.631606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562704e-84ad-41d1-8984-fd6ff39d77c3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:28.728767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562704e-84ad-41d1-8984-fd6ff39d77c3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:28.759807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5ac3a-0607-43b1-8b6d-ee893ce5ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:28.760593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ac3a-0607-43b1-8b6d-ee893ce5ba13 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:28.760883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ac3a-0607-43b1-8b6d-ee893ce5ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:28.761163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5ac3a-0607-43b1-8b6d-ee893ce5ba13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:28.762324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5ac3a-0607-43b1-8b6d-ee893ce5ba13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:28.763807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5ac3a-0607-43b1-8b6d-ee893ce5ba13 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:28.765420 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 31/60] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:28.771630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8019e-151e-467d-a2ed-0cb19f52551d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:28.863894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8019e-151e-467d-a2ed-0cb19f52551d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:28.895704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780234d-6f8f-4a11-87a6-b387099c3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:28.896366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780234d-6f8f-4a11-87a6-b387099c3ad5 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:28.896647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780234d-6f8f-4a11-87a6-b387099c3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:28.896921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780234d-6f8f-4a11-87a6-b387099c3ad5 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:28.897626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780234d-6f8f-4a11-87a6-b387099c3ad5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:28.899121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780234d-6f8f-4a11-87a6-b387099c3ad5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:28.923156 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 30/61] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:29:28 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:29:32.366426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3cb2-ffbf-4f6a-be5d-b41db5a0e334 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.367537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3cb2-ffbf-4f6a-be5d-b41db5a0e334 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.368038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f3cb2-ffbf-4f6a-be5d-b41db5a0e334 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.369732 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 32/62] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:32.376085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3754-b50e-40f6-82bd-6e680b621ca9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.377058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3754-b50e-40f6-82bd-6e680b621ca9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.377602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce3754-b50e-40f6-82bd-6e680b621ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.398693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-45ce3754-b50e-40f6-82bd-6e680b621ca9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:32.400312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45ce3754-b50e-40f6-82bd-6e680b621ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:32.487736 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 31/63] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:32.512806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3cb2-ffbf-4f6a-be5d-b41db5a0e334 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:32.611095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d26d-b897-4ec7-986c-d5d785377725 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.612272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d26d-b897-4ec7-986c-d5d785377725 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.612580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7d26d-b897-4ec7-986c-d5d785377725 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.615475 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 32/64] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:32.621271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ba49-7cf6-43d0-98f7-fdf86720620d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.621680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ba49-7cf6-43d0-98f7-fdf86720620d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.622199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ba49-7cf6-43d0-98f7-fdf86720620d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.663198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-79a1ba49-7cf6-43d0-98f7-fdf86720620d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:32.664401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-79a1ba49-7cf6-43d0-98f7-fdf86720620d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:32.700304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f3cb2-ffbf-4f6a-be5d-b41db5a0e334 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:32.772398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:32.773152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.773438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.773712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.800905 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 33/65] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:32.801509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:32.807127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a4ff6-f4d7-4c68-b2d3-94f66e86a468 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.807428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a4ff6-f4d7-4c68-b2d3-94f66e86a468 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.807721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a4ff6-f4d7-4c68-b2d3-94f66e86a468 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.809002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 34/66] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:32.812325 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:32.813749 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:32.814601 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 33/67] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:32.817195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129629-0beb-43a2-9020-b60bc52d39fb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.817195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129629-0beb-43a2-9020-b60bc52d39fb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.817195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b129629-0beb-43a2-9020-b60bc52d39fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.819880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:32.832797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6b129629-0beb-43a2-9020-b60bc52d39fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:32.833992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b129629-0beb-43a2-9020-b60bc52d39fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:32.902263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 35/68] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:32.903969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129629-0beb-43a2-9020-b60bc52d39fb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:32.954566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6063ba-e0f5-41e6-8c64-f34fa17ac9b1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:32.993121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007573-884f-4076-af23-439dc41872fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:32.993799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007573-884f-4076-af23-439dc41872fd None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:32.994092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007573-884f-4076-af23-439dc41872fd None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:32.994373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007573-884f-4076-af23-439dc41872fd None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:32.995161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007573-884f-4076-af23-439dc41872fd None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:32.995471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007573-884f-4076-af23-439dc41872fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:32.996912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91007573-884f-4076-af23-439dc41872fd None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.005501 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 34/69] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:33.007482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007573-884f-4076-af23-439dc41872fd None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.012348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b129629-0beb-43a2-9020-b60bc52d39fb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.043934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab6abc-f834-4d43-a79c-979c83f04daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.044646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab6abc-f834-4d43-a79c-979c83f04daa None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.044932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab6abc-f834-4d43-a79c-979c83f04daa None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.045210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab6abc-f834-4d43-a79c-979c83f04daa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.055170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab6abc-f834-4d43-a79c-979c83f04daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-84ab6abc-f834-4d43-a79c-979c83f04daa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:33.062930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:33.064368 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:33.070045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fbf5b-4fae-4971-97e7-04bdead59202 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.071160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fbf5b-4fae-4971-97e7-04bdead59202 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.071160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fbf5b-4fae-4971-97e7-04bdead59202 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.071160 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 37/71] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:33.071160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36933e-479a-4a07-a9c7-216c3e2b4e5f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.071160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36933e-479a-4a07-a9c7-216c3e2b4e5f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.071762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36933e-479a-4a07-a9c7-216c3e2b4e5f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.074533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 38/72] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:33.074533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36933e-479a-4a07-a9c7-216c3e2b4e5f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.103207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007573-884f-4076-af23-439dc41872fd None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.135120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.135931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.136221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.136505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.146880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:33.154868 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:33.155940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 35/73] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:33.156957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.175757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36933e-479a-4a07-a9c7-216c3e2b4e5f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.208730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4fb31-8693-4dbb-be09-860faeb60080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.209656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4fb31-8693-4dbb-be09-860faeb60080 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.209904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4fb31-8693-4dbb-be09-860faeb60080 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.210179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4fb31-8693-4dbb-be09-860faeb60080 None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.224206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4fb31-8693-4dbb-be09-860faeb60080 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.225701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4fb31-8693-4dbb-be09-860faeb60080 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.227415 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 39/74] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:33.228757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b796c8-0228-426b-952d-0eeed7a9081e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.229049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b796c8-0228-426b-952d-0eeed7a9081e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.229323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b796c8-0228-426b-952d-0eeed7a9081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.244580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-51b796c8-0228-426b-952d-0eeed7a9081e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:33.245748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-51b796c8-0228-426b-952d-0eeed7a9081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:33.253190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a9878-adb6-4615-bc83-5ca960c3f02c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.285237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d85d58-0fc1-4c53-8b2b-6610ecf8bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.285908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d58-0fc1-4c53-8b2b-6610ecf8bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.286195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d58-0fc1-4c53-8b2b-6610ecf8bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.286479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d58-0fc1-4c53-8b2b-6610ecf8bfe8 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.287256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d85d58-0fc1-4c53-8b2b-6610ecf8bfe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:33.287564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d85d58-0fc1-4c53-8b2b-6610ecf8bfe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.288961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d85d58-0fc1-4c53-8b2b-6610ecf8bfe8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.296650 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 36/75] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:33.297786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec878be-d602-4ec8-87f2-7059155f91df None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.298082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec878be-d602-4ec8-87f2-7059155f91df None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.298365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec878be-d602-4ec8-87f2-7059155f91df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.308217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 40/76] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:33.309836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b796c8-0228-426b-952d-0eeed7a9081e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.314382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1ec878be-d602-4ec8-87f2-7059155f91df None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:33.315668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1ec878be-d602-4ec8-87f2-7059155f91df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:33.379123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 37/77] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:33.380800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec878be-d602-4ec8-87f2-7059155f91df None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.403582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b796c8-0228-426b-952d-0eeed7a9081e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.436668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.437330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.437614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.437888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.438654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:33.438985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.440366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.447866 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 41/78] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:33.448638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.475668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec878be-d602-4ec8-87f2-7059155f91df None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.507063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.507705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.507984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.508255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.545730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118c98a-9fe8-4f25-bb2a-a8c34792a3b3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.571248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.572674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.577367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.578224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.578506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.578800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] PATH_INFO: `/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.579999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] RBAC: Authorizing `identity:get_user(user_id=9c1ef8221c9c4d4fa45130c3a58da61e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.581439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.583193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 42/79] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:33.583972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.665909 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 38/80] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:33.666748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.677692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4c4a0-d298-49bb-bc2f-55d91d7d0052 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.709173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.710033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.710325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.710608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.720524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:33.728090 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:33.728937 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:33.729725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 43/81] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:33.730358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.763334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7773cbe-ea9f-4c3c-bc64-206888feba10 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.795048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.795837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.796124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.796406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.798113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.799600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.801217 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 39/82] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:33.802738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.825218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e2d70c-722d-4a39-80c0-a5df55b72931 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.859384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.860766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.861048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.861330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.862507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.864012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.865633 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 44/83] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:33.866390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:33.897011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3995-87f0-4a08-bc03-f9c070dbeda1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.929911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.930565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.930883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.931166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.958489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24f1c3-c98a-45b6-8a46-e7fd87a7d91f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:33.990191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:33.991089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:33.991375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:33.991656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:33.992852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.994012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:33.994315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.995495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:33.996056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 45/84] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:33.996817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.095172 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 40/85] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:34.095907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.097842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e810b5-041a-4f58-8963-eda67ecffa44 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.130041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.130711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.131030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.131314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.132070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:34.132380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.133776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.142256 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 46/86] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:34.143093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.186984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e51d0-8e28-450b-8e59-15d3015e0bf6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.220637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.221317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.221604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.221885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.222589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.224103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.237381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341b10b-49d6-46c3-88ec-0e73677f1c28 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.248736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 41/87] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:29:34 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:34.249469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.278154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.278871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.279166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.279501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.351995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.353337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.360993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d3695-ed40-4a79-9f7d-6096281a86b0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.396926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.397586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.397880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.398160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.399032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=d4ae286683f4427bbb0fd3bca4d1021a) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:34.399360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.400857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.406716 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 42/88] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/role_assignments?user.id=d4ae286683f4427bbb0fd3bca4d1021a&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:34.406716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.470277 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 47/89] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:34.471348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.539886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff310d-3162-47ca-b84a-48de869fb748 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.593202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.595718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.596382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.596669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.598389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.599929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.601987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e15c8-42f5-4e3b-a609-d82d8d3e94a1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.602144 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 43/90] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:34.602858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.663574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.664470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.664762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.665045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.666324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.667889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.669704 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 48/91] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:34.670323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.727243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b1f2f-2fe5-47f5-a0bc-d86522124a94 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.775267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.776193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.776485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.776760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.779484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.780961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.789315 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 44/92] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:34.790147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.813779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e22dad-7bab-4b8e-b246-927bd1ef8129 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.870715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:34.871367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:34.871699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:34.871983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:34.872895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=9c1ef8221c9c4d4fa45130c3a58da61e) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:34.874363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:34.876122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:34.882099 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 49/93] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/role_assignments?user.id=9c1ef8221c9c4d4fa45130c3a58da61e&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:34.884568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:34.958020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e6323-4365-4b45-a3f7-8434dd80fbc0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:34.997545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9891e1-7b79-438a-a191-d721c7dc28ff None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:35.034932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:35.035615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:35.035902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:35.036185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:35.037029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] RBAC: Adding query filter params (role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=d4ae286683f4427bbb0fd3bca4d1021a) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:35.037345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:35.038857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:35.044445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:35.045109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:35.045393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:35.045671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:35.054354 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 50/94] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/role_assignments?user.id=d4ae286683f4427bbb0fd3bca4d1021a&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:35.137477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:35.138902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:35.281654 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 45/95] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:35.288330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:35.409999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba79e1-800b-496e-a59c-753528d50c95 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:35.443790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544407ba-2c78-4404-a231-25bfba994b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:35.444665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544407ba-2c78-4404-a231-25bfba994b12 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:35.444952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544407ba-2c78-4404-a231-25bfba994b12 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:35.445232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544407ba-2c78-4404-a231-25bfba994b12 None admin] PATH_INFO: `/v3/projects/de1d670ca5a247b5b4950973c52613d7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:35.446437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544407ba-2c78-4404-a231-25bfba994b12 None admin] RBAC: Authorizing `identity:get_project(project_id=de1d670ca5a247b5b4950973c52613d7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:35.447952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544407ba-2c78-4404-a231-25bfba994b12 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:35.449835 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 51/96] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:35 2022] GET /identity/v3/projects/de1d670ca5a247b5b4950973c52613d7 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:35.456126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:35.556800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302bb29-edc1-4951-8f14-4446d86ace96 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:35.592533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552a4ac-cb2b-4b72-92ca-5849ac5d797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:35.593781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a4ac-cb2b-4b72-92ca-5849ac5d797c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:35.594315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a4ac-cb2b-4b72-92ca-5849ac5d797c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:35.595178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a4ac-cb2b-4b72-92ca-5849ac5d797c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:35.596022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a4ac-cb2b-4b72-92ca-5849ac5d797c None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=de1d670ca5a247b5b4950973c52613d7, user.id=d4ae286683f4427bbb0fd3bca4d1021a) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:35.596337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a4ac-cb2b-4b72-92ca-5849ac5d797c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:35.597816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552a4ac-cb2b-4b72-92ca-5849ac5d797c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:35.605409 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 46/97] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:35 2022] GET /identity/v3/role_assignments?user.id=d4ae286683f4427bbb0fd3bca4d1021a&scope.project.id=de1d670ca5a247b5b4950973c52613d7&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:37.361932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5610b74-8e91-481a-8257-053b937f9a1f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:37.362489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5610b74-8e91-481a-8257-053b937f9a1f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:37.362489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5610b74-8e91-481a-8257-053b937f9a1f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:37.363875 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 52/98] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:37.369045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8d1a8-c590-4074-9d0d-79587d9a1f84 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:37.369458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8d1a8-c590-4074-9d0d-79587d9a1f84 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:37.369648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8d1a8-c590-4074-9d0d-79587d9a1f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:37.386638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7ae8d1a8-c590-4074-9d0d-79587d9a1f84 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:37.387850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7ae8d1a8-c590-4074-9d0d-79587d9a1f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:37.475324 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 47/99] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:37.497964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5610b74-8e91-481a-8257-053b937f9a1f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:37.500291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea97fd4-5f9d-495a-87bf-123deacf1ff7 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:37.500611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea97fd4-5f9d-495a-87bf-123deacf1ff7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:37.500890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea97fd4-5f9d-495a-87bf-123deacf1ff7 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:37.502238 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 48/100] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:37.528754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9af0bb-440a-4b68-bf68-9e1f50063d22 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:37.529070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9af0bb-440a-4b68-bf68-9e1f50063d22 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:37.529318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9af0bb-440a-4b68-bf68-9e1f50063d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:37.552305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ee9af0bb-440a-4b68-bf68-9e1f50063d22 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:37.553480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ee9af0bb-440a-4b68-bf68-9e1f50063d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:37.613241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5610b74-8e91-481a-8257-053b937f9a1f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:37.648226 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 49/101] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:37.660813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:37.661619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:37.661904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:37.662181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:37.681740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:37.690095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:37.691274 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:37.693235 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:37.698798 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 53/102] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:37.699012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9af0bb-440a-4b68-bf68-9e1f50063d22 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:37.699806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:37.835162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9af0bb-440a-4b68-bf68-9e1f50063d22 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:37.881198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc402fc3-6627-43d4-8920-39713b0e130c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:37.897999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:37.898692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:37.899156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:37.899441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:37.900199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:37.900550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:37.902021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:37.918225 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 50/103] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:37.924649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:37.960536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:37.961350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:37.961704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:37.961988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:37.990058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:37.997180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:37.999338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:38.001782 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 54/104] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:29:38.035406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:38.070916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280958c4-6a1d-4590-9417-dc9ee6211fe6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.107047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.107901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.108191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.108471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.109700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.111257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:38.113115 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 51/105] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:37 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:38.118619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:38.254541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957441d-0cac-4953-bc1f-0ec6a8a3db56 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.285023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767edde5-c1f1-4171-8acb-9e178827dcbe None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.319277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fac7e-444c-4ac1-95b8-3563f902349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.319954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fac7e-444c-4ac1-95b8-3563f902349e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.320247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fac7e-444c-4ac1-95b8-3563f902349e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.320529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fac7e-444c-4ac1-95b8-3563f902349e None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.321278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fac7e-444c-4ac1-95b8-3563f902349e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:38.321589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fac7e-444c-4ac1-95b8-3563f902349e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.323007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fac7e-444c-4ac1-95b8-3563f902349e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:38.343114 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 55/106] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:38.347398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca603a-7dcc-47cf-82ad-b83fdb854957 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.347699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca603a-7dcc-47cf-82ad-b83fdb854957 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.347988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca603a-7dcc-47cf-82ad-b83fdb854957 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.350322 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 56/107] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:38.352011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0dcc1-df5e-4454-b128-56f5b44822d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.353048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0dcc1-df5e-4454-b128-56f5b44822d7 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.353346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0dcc1-df5e-4454-b128-56f5b44822d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.353628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0dcc1-df5e-4454-b128-56f5b44822d7 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.355140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca603a-7dcc-47cf-82ad-b83fdb854957 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:38.358749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0dcc1-df5e-4454-b128-56f5b44822d7 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.360260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0dcc1-df5e-4454-b128-56f5b44822d7 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:38.362352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 52/108] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:38 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:38.363354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdc73d-38cd-4ece-869e-1a1cbf5e96e1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.363646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdc73d-38cd-4ece-869e-1a1cbf5e96e1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.363934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdc73d-38cd-4ece-869e-1a1cbf5e96e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.402042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3acdc73d-38cd-4ece-869e-1a1cbf5e96e1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:38.403301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3acdc73d-38cd-4ece-869e-1a1cbf5e96e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:38.512471 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 53/109] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:38.513314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdc73d-38cd-4ece-869e-1a1cbf5e96e1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:38.557223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca603a-7dcc-47cf-82ad-b83fdb854957 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.599280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.600159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.600449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.600729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] PATH_INFO: `/v3/users/0716f4982f4f4c1a9708329d4a8d7b80` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.615144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] RBAC: Authorizing `identity:get_user(user_id=0716f4982f4f4c1a9708329d4a8d7b80)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.616635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:38.617984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdc73d-38cd-4ece-869e-1a1cbf5e96e1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.618642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 57/110] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:38 2022] GET /identity/v3/users/0716f4982f4f4c1a9708329d4a8d7b80 => generated 289 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:38.619365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:38.661406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.662320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.662606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.662916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/d4ae286683f4427bbb0fd3bca4d1021a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.665161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] RBAC: Authorizing `identity:create_grant(project_id=23cdd5d7d6f642f499d34b657383781d, user_id=d4ae286683f4427bbb0fd3bca4d1021a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.667398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:38.695421 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 54/111] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:38 2022] PUT /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/d4ae286683f4427bbb0fd3bca4d1021a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:38.696279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:38.747429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2c1a2-0f2b-4b55-b9de-224522d03edf None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.803455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d5f07-1929-407a-8870-b0fea1599c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.804611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d5f07-1929-407a-8870-b0fea1599c49 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.804897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d5f07-1929-407a-8870-b0fea1599c49 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.805175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d5f07-1929-407a-8870-b0fea1599c49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.806463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d5f07-1929-407a-8870-b0fea1599c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.808738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d5f07-1929-407a-8870-b0fea1599c49 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:38.810867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 58/112] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:38.815176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3e0e-5228-430f-8b6d-e03ee84aaadf None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.815543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3e0e-5228-430f-8b6d-e03ee84aaadf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.815832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3e0e-5228-430f-8b6d-e03ee84aaadf None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.817513 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 59/113] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:38.820261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5772c-ee10-4288-bb9a-d750a7e097d9 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.820563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5772c-ee10-4288-bb9a-d750a7e097d9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.820846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5772c-ee10-4288-bb9a-d750a7e097d9 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.823914 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 60/114] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:38.824718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5772c-ee10-4288-bb9a-d750a7e097d9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:38.831242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbfd73-6e69-4c22-865e-3d1a4c1d2647 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.869364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db93c2-d2ba-4abf-8a58-697ee3cc04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.869959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db93c2-d2ba-4abf-8a58-697ee3cc04e6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.871149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db93c2-d2ba-4abf-8a58-697ee3cc04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.871149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db93c2-d2ba-4abf-8a58-697ee3cc04e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.951760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5772c-ee10-4288-bb9a-d750a7e097d9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:38.959923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db93c2-d2ba-4abf-8a58-697ee3cc04e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.961448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db93c2-d2ba-4abf-8a58-697ee3cc04e6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:38.991909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c54fa6-ecd2-48a7-806e-99f2359639be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:38.992968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54fa6-ecd2-48a7-806e-99f2359639be None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:38.993454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54fa6-ecd2-48a7-806e-99f2359639be None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:38.994021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c54fa6-ecd2-48a7-806e-99f2359639be None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:38.995042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c54fa6-ecd2-48a7-806e-99f2359639be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:38.996749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c54fa6-ecd2-48a7-806e-99f2359639be None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:39.029490 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 61/115] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:29:38 2022] POST /identity/v3/projects => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:39.031523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094b7a-42c5-4a66-b1af-f371473007b0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.032104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094b7a-42c5-4a66-b1af-f371473007b0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.032654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094b7a-42c5-4a66-b1af-f371473007b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.054014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bb094b7a-42c5-4a66-b1af-f371473007b0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:39.055850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bb094b7a-42c5-4a66-b1af-f371473007b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:39.084597 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 55/116] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:39.086041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f7445-fe70-49c2-a8f7-48b7054821b1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.086396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f7445-fe70-49c2-a8f7-48b7054821b1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.086700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f7445-fe70-49c2-a8f7-48b7054821b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.105622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d91f7445-fe70-49c2-a8f7-48b7054821b1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:39.107429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d91f7445-fe70-49c2-a8f7-48b7054821b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:39.142485 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 62/117] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:39.144465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb094b7a-42c5-4a66-b1af-f371473007b0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.229510 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 56/118] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:39.230469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f7445-fe70-49c2-a8f7-48b7054821b1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.323616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb094b7a-42c5-4a66-b1af-f371473007b0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:39.362402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f7445-fe70-49c2-a8f7-48b7054821b1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:39.366761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a8cef-292b-4c85-9df9-642b9a0b5d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:39.367644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8cef-292b-4c85-9df9-642b9a0b5d48 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.367933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8cef-292b-4c85-9df9-642b9a0b5d48 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.368214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a8cef-292b-4c85-9df9-642b9a0b5d48 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.370205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a8cef-292b-4c85-9df9-642b9a0b5d48 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:39.371729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a8cef-292b-4c85-9df9-642b9a0b5d48 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:39.373604 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 63/119] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:39.380073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3410a-1c9f-492d-a9a9-c9bb5ee746c4 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.380368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3410a-1c9f-492d-a9a9-c9bb5ee746c4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.380651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3410a-1c9f-492d-a9a9-c9bb5ee746c4 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.381940 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 64/120] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:39.382715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3410a-1c9f-492d-a9a9-c9bb5ee746c4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.408162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:39.408690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.408690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.408829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.424439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:39.429006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:39.429893 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:39.430672 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 57/121] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:39.431850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.495057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3410a-1c9f-492d-a9a9-c9bb5ee746c4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:39.530011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca6fec-0a51-44c2-9025-03273c64abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:39.530922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca6fec-0a51-44c2-9025-03273c64abcb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.531212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca6fec-0a51-44c2-9025-03273c64abcb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.531490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca6fec-0a51-44c2-9025-03273c64abcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.535584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f449f-38e1-4a98-ab9b-f1b3ff6b8172 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:39.542757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca6fec-0a51-44c2-9025-03273c64abcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-14ca6fec-0a51-44c2-9025-03273c64abcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:39.551727 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:39.552619 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:39.553392 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 65/122] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:39.555296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2f5e-e14e-4d87-8c60-626fa2836a16 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.555296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2f5e-e14e-4d87-8c60-626fa2836a16 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.555296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f2f5e-e14e-4d87-8c60-626fa2836a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.571502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:39.572172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.572462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.572747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.573285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4e9f2f5e-e14e-4d87-8c60-626fa2836a16 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:39.573799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] RBAC: Adding query filter params (role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=0716f4982f4f4c1a9708329d4a8d7b80) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:39.573950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:39.574515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4e9f2f5e-e14e-4d87-8c60-626fa2836a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:39.575558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:39.582259 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 58/123] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/role_assignments?user.id=0716f4982f4f4c1a9708329d4a8d7b80&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:39.583131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.689832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e831f41-09b1-43ab-a2d6-9c99d585d1a3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:39.704763 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 66/124] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:39.705744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2f5e-e14e-4d87-8c60-626fa2836a16 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.747640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:39.748351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.748644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.748929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.749713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:39.750026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:39.752101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:39.769437 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 59/125] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:39.770157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.821643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f2f5e-e14e-4d87-8c60-626fa2836a16 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:39.859162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:39.860396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.860796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.861110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.861866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:39.862172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:39.863755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:39.872995 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 67/126] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:39.873907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.877401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456c671-3161-472e-8dfa-b4897fd50597 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:39.912823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:39.913631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:39.913921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:39.914199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:39.925649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:39.933585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:39.935725 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 60/127] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:39.937622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:39.976833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32c089-449c-44a8-a16a-713a4d192b9f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.012446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.013376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.013661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.016336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] PATH_INFO: `/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.022106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] RBAC: Authorizing `identity:get_user(user_id=9c1ef8221c9c4d4fa45130c3a58da61e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.023561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.025275 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 68/128] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:40.026135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:40.046845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189c6e5-993c-4c82-a0f2-9838b2b4367f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.097718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.098615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.098931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.099214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.100657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.103504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.105150 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 61/129] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:39 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:40.105921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:40.158513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d859ac-a367-4bb9-acaa-f8a0022bbefa None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.199570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.199570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.199570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.200790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.200790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:40.200790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.203586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.214112 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 69/130] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:40.214112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:40.303617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dd1cf-453f-45e2-958c-9c04abb2e8f6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.340369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.341236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.341519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.341791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.343564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.345074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.346999 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 62/131] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:40 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:40.347613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:40.387752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab710188-0f81-4f5f-89c9-1348a6ac9d70 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.431470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.432330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.432619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.432911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.435135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.436578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.445798 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 70/132] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:40 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:40.445798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:40.493248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd917121-2f66-4f81-b285-181d31ec8789 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.544399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.545649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.546156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.546637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.551493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.553205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.555173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 63/133] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:40 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:40.556152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:40.562847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926e52a-253a-4b17-b7c4-39fd3fd425c5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.600139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.600978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.601278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.601617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/9c1ef8221c9c4d4fa45130c3a58da61e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.607782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] RBAC: Authorizing `identity:create_grant(project_id=23cdd5d7d6f642f499d34b657383781d, user_id=9c1ef8221c9c4d4fa45130c3a58da61e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.609320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.642802 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 71/134] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:40 2022] PUT /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/9c1ef8221c9c4d4fa45130c3a58da61e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:40.642987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:40.675359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a5fa8-b83b-4ed1-825b-d33e6f6b1559 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.716450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.717871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.718363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.720658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/d4ae286683f4427bbb0fd3bca4d1021a/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.724779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] RBAC: Authorizing `identity:create_grant(project_id=23cdd5d7d6f642f499d34b657383781d, user_id=d4ae286683f4427bbb0fd3bca4d1021a, role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.726571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.761207 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 64/135] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:40 2022] PUT /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/d4ae286683f4427bbb0fd3bca4d1021a/roles/0306acbe82504665a6348fd3f25cee0b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:40.829143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f99163-553a-4d8f-a2dd-0adafaa529fb None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:40.878808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041260a1-c66b-4058-8614-514cb38480b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:40.879690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041260a1-c66b-4058-8614-514cb38480b1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:40.879971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041260a1-c66b-4058-8614-514cb38480b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:40.880245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041260a1-c66b-4058-8614-514cb38480b1 None admin] PATH_INFO: `/v3/projects/de1d670ca5a247b5b4950973c52613d7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:40.882450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041260a1-c66b-4058-8614-514cb38480b1 None admin] RBAC: Authorizing `identity:get_project(project_id=de1d670ca5a247b5b4950973c52613d7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:40.884000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041260a1-c66b-4058-8614-514cb38480b1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:40.885832 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 72/136] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:40 2022] GET /identity/v3/projects/de1d670ca5a247b5b4950973c52613d7 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:40.891917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:41.032908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5e91f-486d-4394-bd1c-1bfd869191ad None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:41.080088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effae348-0ac6-4f47-b878-db26c88e2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:41.080926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effae348-0ac6-4f47-b878-db26c88e2930 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:41.081211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effae348-0ac6-4f47-b878-db26c88e2930 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:41.081491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effae348-0ac6-4f47-b878-db26c88e2930 None admin] PATH_INFO: `/v3/projects/de1d670ca5a247b5b4950973c52613d7/users/d4ae286683f4427bbb0fd3bca4d1021a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:41.083671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effae348-0ac6-4f47-b878-db26c88e2930 None admin] RBAC: Authorizing `identity:create_grant(project_id=de1d670ca5a247b5b4950973c52613d7, user_id=d4ae286683f4427bbb0fd3bca4d1021a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:41.085157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effae348-0ac6-4f47-b878-db26c88e2930 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:41.115756 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 65/137] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:40 2022] PUT /identity/v3/projects/de1d670ca5a247b5b4950973c52613d7/users/d4ae286683f4427bbb0fd3bca4d1021a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:41.895728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae284d44-de16-43cc-8fb1-5c19477c131f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:41.896246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae284d44-de16-43cc-8fb1-5c19477c131f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:41.896322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae284d44-de16-43cc-8fb1-5c19477c131f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:41.897632 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 73/138] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:41.903065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267512a-1065-44e0-b0e4-5d99a0110b06 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:41.903497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267512a-1065-44e0-b0e4-5d99a0110b06 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:41.903671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267512a-1065-44e0-b0e4-5d99a0110b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:41.932314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0267512a-1065-44e0-b0e4-5d99a0110b06 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:41.933516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0267512a-1065-44e0-b0e4-5d99a0110b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:42.013183 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 66/139] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:42.053082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae284d44-de16-43cc-8fb1-5c19477c131f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:42.180731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae284d44-de16-43cc-8fb1-5c19477c131f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:42.231494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac6833-f715-4a08-a0cb-2f3710f3daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:42.232314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac6833-f715-4a08-a0cb-2f3710f3daaa None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.232603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac6833-f715-4a08-a0cb-2f3710f3daaa None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.232883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac6833-f715-4a08-a0cb-2f3710f3daaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.246331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac6833-f715-4a08-a0cb-2f3710f3daaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-adac6833-f715-4a08-a0cb-2f3710f3daaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:42.254103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:42.254993 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:42.255780 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 74/140] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:42.262510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267512a-1065-44e0-b0e4-5d99a0110b06 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:42.351548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a820db3-71e3-449c-8c82-bf6ccb74dc9e None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.352445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a820db3-71e3-449c-8c82-bf6ccb74dc9e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.352976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a820db3-71e3-449c-8c82-bf6ccb74dc9e None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.354642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 75/141] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:42.362455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c089-4143-4aa6-962d-21fb77ab4a76 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.363036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c089-4143-4aa6-962d-21fb77ab4a76 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.363630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3c089-4143-4aa6-962d-21fb77ab4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.393510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fce3c089-4143-4aa6-962d-21fb77ab4a76 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:42.394745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fce3c089-4143-4aa6-962d-21fb77ab4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:42.415820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267512a-1065-44e0-b0e4-5d99a0110b06 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:42.478584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:42.479254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.479547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.479828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.480583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:42.480891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:42.482283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:42.496815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 76/142] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:42.500206 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 67/143] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:42.508147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c089-4143-4aa6-962d-21fb77ab4a76 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:42.535276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:42.660608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3c089-4143-4aa6-962d-21fb77ab4a76 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:42.695137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:42.696115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.696407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.696686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.697895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:42.699828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:42.701728 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 77/144] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:42 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:42.707646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:42.709624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc5870-aa6e-4a3b-83d5-e5282099c9cb None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:42.811498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743beb68-4f13-417b-92ee-b085cabf3609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:42.812313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743beb68-4f13-417b-92ee-b085cabf3609 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.812597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743beb68-4f13-417b-92ee-b085cabf3609 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.813503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743beb68-4f13-417b-92ee-b085cabf3609 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.814756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743beb68-4f13-417b-92ee-b085cabf3609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:42.816252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743beb68-4f13-417b-92ee-b085cabf3609 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:42.817868 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 68/145] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:42.819060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f827-6c21-47e3-9ac1-d804cec8e165 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.819346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f827-6c21-47e3-9ac1-d804cec8e165 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.819618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249f827-6c21-47e3-9ac1-d804cec8e165 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.820821 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 69/146] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:42.823245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6e782-1b77-4d21-a764-1102670b32a8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:42.830461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14617a-ec3e-467a-b8bd-6efb3bcc1689 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.830753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14617a-ec3e-467a-b8bd-6efb3bcc1689 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.831072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14617a-ec3e-467a-b8bd-6efb3bcc1689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.866364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dc14617a-ec3e-467a-b8bd-6efb3bcc1689 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:42.869910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc14617a-ec3e-467a-b8bd-6efb3bcc1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:42.891911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:42.892574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:42.892857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:42.893132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:42.963470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:42.964987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:43.017425 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 70/147] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:43.018340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14617a-ec3e-467a-b8bd-6efb3bcc1689 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:43.066135 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 78/148] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:29:43.070643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:43.174959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf406e-43e2-42da-8c41-53361cfef285 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:43.210101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:43.211217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:43.212796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:43.213284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:43.227367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:43.236157 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:43.237070 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:43.237855 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:43.240200 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 79/149] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:43.241204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:43.272938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14617a-ec3e-467a-b8bd-6efb3bcc1689 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:43.336122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:43.336758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:43.337021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:43.337312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:43.338288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:43.340018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:43.346170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e89c54-b7de-43a0-863f-b80d2fb12ba8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:43.378505 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 71/150] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:29:43 2022] POST /identity/v3/users => generated 283 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:43.379567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:43.383888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:43.385206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:43.385699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:43.386179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:43.387766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:43.389566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:43.392332 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 80/151] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:43 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:43.410470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:43.549858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32beb3ef-47f4-4e69-8c98-c4653b0fa589 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:43.586617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:43.588004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:43.588720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:43.589206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:43.589337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4727632-dbc7-44fe-971e-304394c39aa4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:43.590446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=d4ae286683f4427bbb0fd3bca4d1021a) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:43.590995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:43.592716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:43.600970 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 81/152] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:43 2022] GET /identity/v3/role_assignments?user.id=d4ae286683f4427bbb0fd3bca4d1021a&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:43.657915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:43.658605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:43.658936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:43.659220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:43.659996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:43.660306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:43.661786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:43.681493 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 72/153] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:43.687392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:43.808788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe6737-98fa-40e3-be90-259a7973728b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:43.846029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:43.847304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:43.847797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:43.848273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] PATH_INFO: `/v3/users/0716f4982f4f4c1a9708329d4a8d7b80` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:43.849812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] RBAC: Authorizing `identity:get_user(user_id=0716f4982f4f4c1a9708329d4a8d7b80)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:43.851736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:43.853731 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 82/154] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:43 2022] GET /identity/v3/users/0716f4982f4f4c1a9708329d4a8d7b80 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:43.860108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:43.990117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feff29-0fdd-49a1-b97a-48061517ac87 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:44.025664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21410295-1408-439f-a84d-4c55cd26de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:44.026532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21410295-1408-439f-a84d-4c55cd26de40 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.026844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21410295-1408-439f-a84d-4c55cd26de40 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.027130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21410295-1408-439f-a84d-4c55cd26de40 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.028346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21410295-1408-439f-a84d-4c55cd26de40 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:44.029823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21410295-1408-439f-a84d-4c55cd26de40 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:44.032526 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 73/155] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:43 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:44.038043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:44.142882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e67fc7-8126-46a6-90eb-909f372ae8e7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:44.181859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:44.182787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.183078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.183354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/0716f4982f4f4c1a9708329d4a8d7b80/roles/92f5ed5a59a04cc28b8a5f2fa6a9b44a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.185550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] RBAC: Authorizing `identity:create_grant(project_id=23cdd5d7d6f642f499d34b657383781d, user_id=0716f4982f4f4c1a9708329d4a8d7b80, role_id=92f5ed5a59a04cc28b8a5f2fa6a9b44a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:44.187145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:44.204687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e12ea-8cda-44c0-8d4f-6b13e2f9aab0 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.205194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e12ea-8cda-44c0-8d4f-6b13e2f9aab0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.205873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e12ea-8cda-44c0-8d4f-6b13e2f9aab0 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.209034 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 74/156] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:44.210826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 83/157] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:44 2022] PUT /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d/users/0716f4982f4f4c1a9708329d4a8d7b80/roles/92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:44.219418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095a84-24d2-4950-bb15-d985d923485f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.219702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095a84-24d2-4950-bb15-d985d923485f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.219989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095a84-24d2-4950-bb15-d985d923485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.246668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-78095a84-24d2-4950-bb15-d985d923485f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:44.247920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-78095a84-24d2-4950-bb15-d985d923485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:44.338848 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 75/158] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:44.364643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:44.444366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97668f2-f1fa-4416-9cee-3fedc491740b None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.444366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97668f2-f1fa-4416-9cee-3fedc491740b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.444366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97668f2-f1fa-4416-9cee-3fedc491740b None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.445388 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 76/159] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:44.451191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d4b4-73da-4ef8-8105-6feeaeebf671 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.451779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d4b4-73da-4ef8-8105-6feeaeebf671 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.452363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559d4b4-73da-4ef8-8105-6feeaeebf671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.483604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a559d4b4-73da-4ef8-8105-6feeaeebf671 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:44.484849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a559d4b4-73da-4ef8-8105-6feeaeebf671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:44.518507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ac60f-0a6c-4891-bb1d-111197d0a555 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:44.560769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:44.561586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.561865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.562138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.581745 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 77/160] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:44.583149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9cdfc-c4c1-4417-92b7-d1d9ca65d965 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.583417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:44.583540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9cdfc-c4c1-4417-92b7-d1d9ca65d965 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.583743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9cdfc-c4c1-4417-92b7-d1d9ca65d965 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.585077 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 78/161] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:44.595908 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:44.596801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:44.597606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 84/162] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:44.600446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75fedb-96e3-4c39-96ac-d08229428472 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.600446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75fedb-96e3-4c39-96ac-d08229428472 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.600446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75fedb-96e3-4c39-96ac-d08229428472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.611006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:44.623110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8d75fedb-96e3-4c39-96ac-d08229428472 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:44.624278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8d75fedb-96e3-4c39-96ac-d08229428472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:44.698935 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 79/163] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:44.699703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75fedb-96e3-4c39-96ac-d08229428472 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:44.732872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab3e6e-8fe2-4d16-b7b1-92cdb3cbca9c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:44.773409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:44.774432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.774981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.775463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.776439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:44.776949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:44.778575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:44.788375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 85/164] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:44.789517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:44.810022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75fedb-96e3-4c39-96ac-d08229428472 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:44.846927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:44.847745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.848021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.848296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.858817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:44.868299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:44.869266 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:44.870119 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 80/165] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:29:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:44.870765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:44.916335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ffb5c-6e29-432f-b677-b58959d3cebd None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:44.950488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:44.951645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:44.952137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:44.952632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:44.964658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:44.973796 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:44.974755 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:44.975588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:44.978278 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 86/166] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:44.979379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:44.988804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b1740-fb6f-4277-a191-311f19d62d28 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.023053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.023914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.024190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.024457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] PATH_INFO: `/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.025653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] RBAC: Authorizing `identity:get_user(user_id=9c1ef8221c9c4d4fa45130c3a58da61e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.027144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.029051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 81/167] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:44 2022] GET /identity/v3/users/9c1ef8221c9c4d4fa45130c3a58da61e => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:45.029829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:45.083568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe69fd-8158-46a2-b49f-5d0990864bd2 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.119951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.121000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.121504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.121993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.122992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:45.123517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.125136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.134311 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 87/168] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:29:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:45.135457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:45.135907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c764c1-d97c-45d1-a566-6bf44be7fe0f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.174712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.175436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.175715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.175985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.176736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:45.177035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.178434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.195423 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 82/169] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:45.196277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:45.241602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dd4c9-7b80-4526-baa1-06d9550e00ef None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.276117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.277141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.277647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.278124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.348313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.350233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.351628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34c16-9642-497b-b7d3-b64d0ea363cb None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.390197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.391148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.391429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.391703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.392895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.394352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.395998 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 83/170] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:45.396751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:45.452389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 88/171] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:45.454145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:45.552931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1551b-2074-437b-9f97-4e387a17e582 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.588363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766bd85-bac0-43e4-a4e1-fdceccaccacd None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.589609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.590550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.591065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.591544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.662090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.663979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.675479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.676367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.676652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.676928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] PATH_INFO: `/v3/users/d4ae286683f4427bbb0fd3bca4d1021a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.678147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] RBAC: Authorizing `identity:get_user(user_id=d4ae286683f4427bbb0fd3bca4d1021a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.679627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.681431 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 84/172] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/users/d4ae286683f4427bbb0fd3bca4d1021a => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:45.683110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:45.765554 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 89/173] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:45.767293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:45.866518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ff11a-748a-4af1-a825-625c0a19d0c9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.898457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488a183-b130-408f-bf4d-78e41cb3d24c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:45.904841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.905759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.906256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.907332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.972909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:45.973723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:45.974011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:45.974353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:45.975967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.977670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.979556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:45.981309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:45.982947 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 85/174] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:45.983720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:46.088002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 90/175] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:46.089440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:46.107719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f579b-dd4d-4596-8ec0-6a0c51901480 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:46.146575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:46.147688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:46.148078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:46.148451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:46.150055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:46.151910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:46.154276 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 86/176] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:45 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:46.156047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:46.264888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f770c-6d13-4d31-9619-42f2eb05d8d6 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:46.323759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b91de-a5a4-46a8-b274-84f78d89a43d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:46.335486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:46.336153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:46.336451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:46.336713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:46.337816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=9c1ef8221c9c4d4fa45130c3a58da61e) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:46.338129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:46.339624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:46.351333 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 91/177] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:46 2022] GET /identity/v3/role_assignments?user.id=9c1ef8221c9c4d4fa45130c3a58da61e&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:46.352175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:46.403687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:46.404484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:46.404768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:46.405045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] PATH_INFO: `/v3/projects/de1d670ca5a247b5b4950973c52613d7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:46.406345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] RBAC: Authorizing `identity:get_project(project_id=de1d670ca5a247b5b4950973c52613d7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:46.407961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:46.409928 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 87/178] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:46 2022] GET /identity/v3/projects/de1d670ca5a247b5b4950973c52613d7 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:46.415902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:46.466329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719b997-f1d9-4d80-a328-ccc15e627184 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:46.511593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3c64b-8a60-4570-b556-ebc8487f72de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:46.512274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c64b-8a60-4570-b556-ebc8487f72de None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:46.512563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c64b-8a60-4570-b556-ebc8487f72de None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:46.512845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3c64b-8a60-4570-b556-ebc8487f72de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:46.513708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3c64b-8a60-4570-b556-ebc8487f72de None admin] RBAC: Adding query filter params (role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=d4ae286683f4427bbb0fd3bca4d1021a) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:46.514062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3c64b-8a60-4570-b556-ebc8487f72de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:46.517804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3c64b-8a60-4570-b556-ebc8487f72de None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:46.524736 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 92/179] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:46 2022] GET /identity/v3/role_assignments?user.id=d4ae286683f4427bbb0fd3bca4d1021a&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:46.618739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7da30-76f6-4523-98cd-35c06bcc99ce None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:46.661912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068cfad-536a-4230-9d4a-e2dee80004dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:46.662483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068cfad-536a-4230-9d4a-e2dee80004dc None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:46.662781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068cfad-536a-4230-9d4a-e2dee80004dc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:46.663064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068cfad-536a-4230-9d4a-e2dee80004dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:46.663896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068cfad-536a-4230-9d4a-e2dee80004dc None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=de1d670ca5a247b5b4950973c52613d7, user.id=d4ae286683f4427bbb0fd3bca4d1021a) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:46.664206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068cfad-536a-4230-9d4a-e2dee80004dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:46.665657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068cfad-536a-4230-9d4a-e2dee80004dc None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:46.675755 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 88/180] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:46 2022] GET /identity/v3/role_assignments?user.id=d4ae286683f4427bbb0fd3bca4d1021a&scope.project.id=de1d670ca5a247b5b4950973c52613d7&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:47.233479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd5db-db22-4894-8944-393a7cff7153 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:47.233980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd5db-db22-4894-8944-393a7cff7153 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:47.234081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd5db-db22-4894-8944-393a7cff7153 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:47.235625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 93/181] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:47.240790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9d7c-b53e-4d0f-af84-ece5f87714d7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:47.241207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9d7c-b53e-4d0f-af84-ece5f87714d7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:47.241455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace9d7c-b53e-4d0f-af84-ece5f87714d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:47.260908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2ace9d7c-b53e-4d0f-af84-ece5f87714d7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:47.262117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2ace9d7c-b53e-4d0f-af84-ece5f87714d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:47.343316 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 89/182] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:47.370123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bd5db-db22-4894-8944-393a7cff7153 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:47.479361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bd5db-db22-4894-8944-393a7cff7153 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:47.519466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:47.520277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:47.520561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:47.520839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:47.532898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:47.540770 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:47.541665 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:47.543806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 94/183] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:47.548074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9d7c-b53e-4d0f-af84-ece5f87714d7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:47.646477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace9d7c-b53e-4d0f-af84-ece5f87714d7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:47.681608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215daf97-c048-4777-a45f-7c0d83ebdb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:47.682341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215daf97-c048-4777-a45f-7c0d83ebdb41 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:47.682626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215daf97-c048-4777-a45f-7c0d83ebdb41 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:47.682955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215daf97-c048-4777-a45f-7c0d83ebdb41 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:47.683696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215daf97-c048-4777-a45f-7c0d83ebdb41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:47.683998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215daf97-c048-4777-a45f-7c0d83ebdb41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:47.685379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215daf97-c048-4777-a45f-7c0d83ebdb41 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:47.694595 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 90/184] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:47.700254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:47.708540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5305-c05e-412f-815c-87f0dd7114f4 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:47.709131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5305-c05e-412f-815c-87f0dd7114f4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:47.709634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df5305-c05e-412f-815c-87f0dd7114f4 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:47.711246 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 91/185] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:47.716612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98752-4a10-4a17-8ef2-7635250eaaf0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:47.717145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98752-4a10-4a17-8ef2-7635250eaaf0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:47.717630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c98752-4a10-4a17-8ef2-7635250eaaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:47.735135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-79c98752-4a10-4a17-8ef2-7635250eaaf0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:47.736257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-79c98752-4a10-4a17-8ef2-7635250eaaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:47.816631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30944e65-a7f6-4bf6-8bef-a48893b70961 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:47.817359 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 92/186] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:47.842053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c98752-4a10-4a17-8ef2-7635250eaaf0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:47.855470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:47.856812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:47.857307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:47.858181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] PATH_INFO: `/v3/users/a9f03d3a45a34282ad5fe4ee556269b7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:47.873706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] RBAC: Authorizing `identity:get_user(user_id=a9f03d3a45a34282ad5fe4ee556269b7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:47.875225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:47.877241 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 95/187] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:47 2022] GET /identity/v3/users/a9f03d3a45a34282ad5fe4ee556269b7 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:47.882180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:47.966802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c98752-4a10-4a17-8ef2-7635250eaaf0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.002192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.003225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.003509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.003826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.007629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620216-0f4b-49a7-9de2-cd35a573422d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.016542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:48.027434 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:48.028394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:48.029193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 93/188] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:29:48.037006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.056612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68458131-73e2-4f9c-a226-9daf71d3b0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.057847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458131-73e2-4f9c-a226-9daf71d3b0a3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.058716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458131-73e2-4f9c-a226-9daf71d3b0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.059261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458131-73e2-4f9c-a226-9daf71d3b0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.147806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6fb1-3bf1-46d8-8848-15464ff7a649 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.150937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68458131-73e2-4f9c-a226-9daf71d3b0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:48.152642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68458131-73e2-4f9c-a226-9daf71d3b0a3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:48.183415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.183833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.184113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.184388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.185133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:48.185453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:48.186916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:48.205467 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 94/189] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:48.216024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.271238 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 96/190] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:29:48.272542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c6a58-dd31-4ca5-95d8-29af6d4040a6 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.272830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c6a58-dd31-4ca5-95d8-29af6d4040a6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.273100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c6a58-dd31-4ca5-95d8-29af6d4040a6 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.274499 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 97/191] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:48.276638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c6a58-dd31-4ca5-95d8-29af6d4040a6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.327259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd658f7-8821-4dd0-a165-71fa4bd60884 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.360098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38175bdf-73f2-4ff8-baf5-09b1af2b591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.360969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38175bdf-73f2-4ff8-baf5-09b1af2b591c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.361244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38175bdf-73f2-4ff8-baf5-09b1af2b591c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.361513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38175bdf-73f2-4ff8-baf5-09b1af2b591c None admin] PATH_INFO: `/v3/users/0716f4982f4f4c1a9708329d4a8d7b80` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.362690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38175bdf-73f2-4ff8-baf5-09b1af2b591c None admin] RBAC: Authorizing `identity:get_user(user_id=0716f4982f4f4c1a9708329d4a8d7b80)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:48.364195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38175bdf-73f2-4ff8-baf5-09b1af2b591c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:48.365946 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 95/192] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/users/0716f4982f4f4c1a9708329d4a8d7b80 => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:48.367042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9864a4-8bb1-4df7-94b0-5c0feea402b7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.367322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9864a4-8bb1-4df7-94b0-5c0feea402b7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.367877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9864a4-8bb1-4df7-94b0-5c0feea402b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.383022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2a9864a4-8bb1-4df7-94b0-5c0feea402b7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:48.384188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2a9864a4-8bb1-4df7-94b0-5c0feea402b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:48.387037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c6a58-dd31-4ca5-95d8-29af6d4040a6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.419841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.420691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.420970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.421242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.423015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:48.424460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:48.426145 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 98/193] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:48.426923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.448542 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 96/194] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:48.452227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089263-0f3e-4171-b83e-2637f209e990 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.452518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089263-0f3e-4171-b83e-2637f209e990 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.452796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22089263-0f3e-4171-b83e-2637f209e990 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.454227 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 97/195] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:48.455030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089263-0f3e-4171-b83e-2637f209e990 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.526402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9d380-e398-4dab-8127-59b4d5e18baf None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.559485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22089263-0f3e-4171-b83e-2637f209e990 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.565896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.566546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.567253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.567533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.605955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e6f28-2bf6-4ef5-a694-d7e2446405c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.606603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6f28-2bf6-4ef5-a694-d7e2446405c9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.606951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6f28-2bf6-4ef5-a694-d7e2446405c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.607281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e6f28-2bf6-4ef5-a694-d7e2446405c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.608149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e6f28-2bf6-4ef5-a694-d7e2446405c9 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=a9f03d3a45a34282ad5fe4ee556269b7) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:48.608465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e6f28-2bf6-4ef5-a694-d7e2446405c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:48.611646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e6f28-2bf6-4ef5-a694-d7e2446405c9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:48.618048 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 98/196] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/role_assignments?user.id=a9f03d3a45a34282ad5fe4ee556269b7&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:48.619259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f6f80-127a-4c9a-b938-dc19c113db43 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.619541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f6f80-127a-4c9a-b938-dc19c113db43 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.619812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f6f80-127a-4c9a-b938-dc19c113db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.637191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f60f6f80-127a-4c9a-b938-dc19c113db43 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:48.638422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f60f6f80-127a-4c9a-b938-dc19c113db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:48.648666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:48.650187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:48.708839 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 99/197] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:48.710219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f6f80-127a-4c9a-b938-dc19c113db43 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.763954 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 99/198] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:48.764909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.823927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f6f80-127a-4c9a-b938-dc19c113db43 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.858895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.859841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.860133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.860447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.865718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503f002-2ae7-4544-a565-a2bf9ef0ba5b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:48.870284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:48.878392 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:48.879471 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:48.880371 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 100/199] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:48.885052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.902966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:48.903754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:48.904165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:48.904341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:48.905563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:48.907689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:48.909449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 100/200] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:48.910047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:48.995528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe10b-b32c-4060-898e-c450c9c382fc None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:49.005533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96363e5-68ed-4db6-a107-c9d75400ce35 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:49.027900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:49.028749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:49.029073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:49.029342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:49.030532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:49.032631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:49.034298 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 101/201] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:49.039906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:49.041768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:49.042437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:49.042732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:49.043022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:49.044153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:49.044153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:49.045425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:49.054014 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 101/202] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:29:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:49.055687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:49.139375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d350463-6424-41d8-8443-a567de60df93 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:49.162818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635791f-5ab1-4288-930c-f61ef75cf43c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:49.174902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:49.175579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:49.175868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:49.176132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:49.176838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:49.178425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:49.199630 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 102/203] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:29:49 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:49.200577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:49.201637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:49.202420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:49.203369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:49.203369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:49.204935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] RBAC: Adding query filter params (role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a, scope.project.id=23cdd5d7d6f642f499d34b657383781d, user.id=0716f4982f4f4c1a9708329d4a8d7b80) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:49.204935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:49.206215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:49.222878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 102/204] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:49 2022] GET /identity/v3/role_assignments?user.id=0716f4982f4f4c1a9708329d4a8d7b80&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:49.333709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb233622-44f5-459b-a620-5ef4cd768a52 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:49.376150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:49.377051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:49.377331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:49.377606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] PATH_INFO: `/v3/users/a9f03d3a45a34282ad5fe4ee556269b7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:49.378959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] RBAC: Authorizing `identity:get_user(user_id=a9f03d3a45a34282ad5fe4ee556269b7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:49.380462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:49.382459 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 103/205] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:49 2022] GET /identity/v3/users/a9f03d3a45a34282ad5fe4ee556269b7 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:49.388135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:49.494012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28eb4-09d6-4920-b84e-a36f8cf784fe None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:49.527594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:49.528239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:49.528520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:49.528795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:49.599326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:49.601155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:49.709727 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 103/206] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:29:49.715602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:49.819146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df94c44-9e6d-47cc-9a44-df2c4657a7ad None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:49.853741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abadc87-2f1f-4a8a-a8b2-e309ed08c6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:49.855050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abadc87-2f1f-4a8a-a8b2-e309ed08c6fe None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:49.855567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abadc87-2f1f-4a8a-a8b2-e309ed08c6fe None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:49.856037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abadc87-2f1f-4a8a-a8b2-e309ed08c6fe None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:49.857714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abadc87-2f1f-4a8a-a8b2-e309ed08c6fe None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:49.859670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abadc87-2f1f-4a8a-a8b2-e309ed08c6fe None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:49.861705 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 104/207] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:49 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:49.867967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:49.970468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f69f5-8862-4840-a8b5-58f08f40771e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:50.003988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8835364-a60b-4d12-b34b-f7c16136ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:50.004642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8835364-a60b-4d12-b34b-f7c16136ad1f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:50.004922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8835364-a60b-4d12-b34b-f7c16136ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:50.005193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8835364-a60b-4d12-b34b-f7c16136ad1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:50.006017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8835364-a60b-4d12-b34b-f7c16136ad1f None admin] RBAC: Adding query filter params (role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=a9f03d3a45a34282ad5fe4ee556269b7) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:50.006326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8835364-a60b-4d12-b34b-f7c16136ad1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:50.007892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8835364-a60b-4d12-b34b-f7c16136ad1f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:50.015396 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 104/208] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:49 2022] GET /identity/v3/role_assignments?user.id=a9f03d3a45a34282ad5fe4ee556269b7&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:50.982512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bfc4f-2abd-43a7-9990-48f3b7928212 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:50.983050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bfc4f-2abd-43a7-9990-48f3b7928212 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:50.983153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bfc4f-2abd-43a7-9990-48f3b7928212 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:50.985051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 105/209] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:50.990554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848cc7d-4abd-44b8-9526-0fe9f60908a5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:50.990968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848cc7d-4abd-44b8-9526-0fe9f60908a5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:50.991343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848cc7d-4abd-44b8-9526-0fe9f60908a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.008885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c848cc7d-4abd-44b8-9526-0fe9f60908a5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:51.010142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c848cc7d-4abd-44b8-9526-0fe9f60908a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:51.076432 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 105/210] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:51.100735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bfc4f-2abd-43a7-9990-48f3b7928212 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:51.209714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bfc4f-2abd-43a7-9990-48f3b7928212 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:51.250992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:51.252024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.252305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.252548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.265610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:51.274400 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:51.277243 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:51.280086 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 106/211] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:51.282878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848cc7d-4abd-44b8-9526-0fe9f60908a5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:51.389728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848cc7d-4abd-44b8-9526-0fe9f60908a5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:51.424664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:51.425345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.425627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.425907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.426656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:51.426990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:51.428384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:51.436697 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 106/212] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:51.442329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:51.543102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06880da-1a4d-495b-abd2-3791b0545dcb None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:51.579093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:51.579989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.580273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.580551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] PATH_INFO: `/v3/users/a9f03d3a45a34282ad5fe4ee556269b7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.581928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] RBAC: Authorizing `identity:get_user(user_id=a9f03d3a45a34282ad5fe4ee556269b7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:51.583479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:51.585411 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 107/213] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:51 2022] GET /identity/v3/users/a9f03d3a45a34282ad5fe4ee556269b7 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:51.591247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:51.703731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a7e0-932d-46e5-b93c-cad7cc3d1b8e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:51.738161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c7e3f0-442b-4350-861f-d378d0664196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:51.739049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e3f0-442b-4350-861f-d378d0664196 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.739337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e3f0-442b-4350-861f-d378d0664196 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.739615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7e3f0-442b-4350-861f-d378d0664196 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.740845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7e3f0-442b-4350-861f-d378d0664196 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:51.742310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c7e3f0-442b-4350-861f-d378d0664196 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:51.744054 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 107/214] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:51 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:51.749670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:51.784988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6243-13d4-4c67-ad01-9c87ba6a36da None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.785278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6243-13d4-4c67-ad01-9c87ba6a36da None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.785561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc6243-13d4-4c67-ad01-9c87ba6a36da None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.786964 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 108/215] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:51.791969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb80e3-c770-4f88-bed4-1bd6db2cbb04 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.792259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb80e3-c770-4f88-bed4-1bd6db2cbb04 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.792544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb80e3-c770-4f88-bed4-1bd6db2cbb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.809636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d5bb80e3-c770-4f88-bed4-1bd6db2cbb04 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:51.810816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d5bb80e3-c770-4f88-bed4-1bd6db2cbb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:51.868902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5f920-9f41-4172-be16-eba7c329e87c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:51.879570 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 109/216] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:51.880871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bfd33-c4e8-4ca9-aba8-3ca39a87124f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.881165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bfd33-c4e8-4ca9-aba8-3ca39a87124f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.881441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bfd33-c4e8-4ca9-aba8-3ca39a87124f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.882706 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 110/217] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:51.888197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd544b1c-c532-4f03-be60-5fcbb486ed3c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.888416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd544b1c-c532-4f03-be60-5fcbb486ed3c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.888688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd544b1c-c532-4f03-be60-5fcbb486ed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.908473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bd544b1c-c532-4f03-be60-5fcbb486ed3c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:51.909099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:51.909668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bd544b1c-c532-4f03-be60-5fcbb486ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:51.909980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:51.910265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:51.910541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/a9f03d3a45a34282ad5fe4ee556269b7/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:51.913552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1199484c3cc43c0ae54f73bf271c77d, user_id=a9f03d3a45a34282ad5fe4ee556269b7, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:51.915044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:51.930116 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 108/218] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:51 2022] PUT /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/a9f03d3a45a34282ad5fe4ee556269b7/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:51.931650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:51.991304 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 111/219] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:52.008688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd544b1c-c532-4f03-be60-5fcbb486ed3c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.047970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a931a0c-de79-43e1-8345-16971c0f01e7 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.085100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.086288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.086792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.087531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.099386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:52.107632 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:52.108618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:52.109452 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:52.114356 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 109/220] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:52.120005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.131414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd544b1c-c532-4f03-be60-5fcbb486ed3c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.174745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.175952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.176435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.176891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.178273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:52.179856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:52.182466 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 112/221] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:52.188710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.246761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ab49c-3f2e-4871-9f5a-b4b4c074aaf6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.289699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.290380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.290661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.290966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.292156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:52.292464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:52.294379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:52.304000 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 110/222] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:52.308806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd738f-8aad-4853-8b64-54c15944b8e2 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.309413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.350947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6174a4f-57db-4022-992c-d18b76f83199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.351856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6174a4f-57db-4022-992c-d18b76f83199 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.352141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6174a4f-57db-4022-992c-d18b76f83199 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.352419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6174a4f-57db-4022-992c-d18b76f83199 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.353446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6174a4f-57db-4022-992c-d18b76f83199 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:52.355451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6174a4f-57db-4022-992c-d18b76f83199 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:52.386896 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 113/223] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:29:52 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:52.395949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f23d6-a6ab-4f40-93d2-df23ea87b9cb None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.396239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f23d6-a6ab-4f40-93d2-df23ea87b9cb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.396523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f23d6-a6ab-4f40-93d2-df23ea87b9cb None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.398169 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 114/224] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:52.403854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e117-2d4c-4fd1-b602-0c637f56b2d4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.404140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e117-2d4c-4fd1-b602-0c637f56b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.404428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e117-2d4c-4fd1-b602-0c637f56b2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.426928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-70a4e117-2d4c-4fd1-b602-0c637f56b2d4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:52.429309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-70a4e117-2d4c-4fd1-b602-0c637f56b2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:52.434144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef726a-7038-4b5d-ad58-37c9adcd462b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.471633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.472629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.472915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.473190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] PATH_INFO: `/v3/users/b57aa6d610204b18a722b89e4fc148e0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.491131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=b57aa6d610204b18a722b89e4fc148e0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:52.492672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:52.494887 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 111/225] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/users/b57aa6d610204b18a722b89e4fc148e0 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:52.500717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.519962 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 115/226] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:52.543321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e117-2d4c-4fd1-b602-0c637f56b2d4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.619603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1ea31-21cc-43ba-8ad1-3d57d9900cb1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.656361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e117-2d4c-4fd1-b602-0c637f56b2d4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.662943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.663600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.663881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.664153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.694618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.695809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.696763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.697052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.712995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:52.731864 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:52.733451 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:52.736139 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 116/227] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:29:52.740897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.766594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:52.769606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:52.872351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235a5e4-55d6-4c14-99f0-ae3d3e96517d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:52.917485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:52.918161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:52.918446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:52.918724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:52.919510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:52.919816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:52.921220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:52.928893 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 112/228] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:29:52.929449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 117/229] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:52.936406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:52.936552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:53.105484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62563e73-3096-4fe2-b4e1-d0afb1ac608a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:53.125094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4a15c-776e-4096-bacf-ea4836be79ca None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:53.139862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:53.141267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:53.141548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:53.141818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:53.143064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:53.144525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:53.146555 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 113/230] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:53.151801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:53.205436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:53.206680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:53.207204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:53.207839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] PATH_INFO: `/v3/users/a9f03d3a45a34282ad5fe4ee556269b7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:53.220319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] RBAC: Authorizing `identity:get_user(user_id=a9f03d3a45a34282ad5fe4ee556269b7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:53.222214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:53.224319 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 118/231] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:52 2022] GET /identity/v3/users/a9f03d3a45a34282ad5fe4ee556269b7 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:53.230350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:53.272358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40737d82-af70-4a2c-9191-71d676ce8291 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:53.307268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:53.307928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:53.308218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:53.308494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:53.314943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=b57aa6d610204b18a722b89e4fc148e0) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:53.314943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:53.314943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:53.317638 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 114/232] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:53 2022] GET /identity/v3/role_assignments?user.id=b57aa6d610204b18a722b89e4fc148e0&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:53.370216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4b932-896a-43db-8a92-34860adc3868 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:53.413993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5aef8e-4ae3-43ef-9af0-c2c6c76b4160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:53.415153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5aef8e-4ae3-43ef-9af0-c2c6c76b4160 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:53.415585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5aef8e-4ae3-43ef-9af0-c2c6c76b4160 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:53.416011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5aef8e-4ae3-43ef-9af0-c2c6c76b4160 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:53.417413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5aef8e-4ae3-43ef-9af0-c2c6c76b4160 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:53.419126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5aef8e-4ae3-43ef-9af0-c2c6c76b4160 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:53.421446 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 119/233] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:53 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:53.428740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:53.588283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387013e9-7e33-4a66-919f-fbf4862c0df4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:53.634889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c631b-277c-4b38-b5dc-3045c772d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:53.635789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c631b-277c-4b38-b5dc-3045c772d23d None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:53.636072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c631b-277c-4b38-b5dc-3045c772d23d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:53.636404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c631b-277c-4b38-b5dc-3045c772d23d None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/a9f03d3a45a34282ad5fe4ee556269b7/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:53.638781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c631b-277c-4b38-b5dc-3045c772d23d None admin] RBAC: Authorizing `identity:create_grant(project_id=d1199484c3cc43c0ae54f73bf271c77d, user_id=a9f03d3a45a34282ad5fe4ee556269b7, role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:53.640268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c631b-277c-4b38-b5dc-3045c772d23d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:53.655203 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 115/234] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:53 2022] PUT /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/a9f03d3a45a34282ad5fe4ee556269b7/roles/0306acbe82504665a6348fd3f25cee0b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:54.662306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813ed1-b14e-4508-ba51-aaf2703bcc4b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:54.662848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813ed1-b14e-4508-ba51-aaf2703bcc4b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:54.662929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9813ed1-b14e-4508-ba51-aaf2703bcc4b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:54.664587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 120/235] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:54.669931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb10c77-6c38-457c-bd6d-d859b41f1913 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:54.670353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb10c77-6c38-457c-bd6d-d859b41f1913 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:54.670496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb10c77-6c38-457c-bd6d-d859b41f1913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:54.688210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4fb10c77-6c38-457c-bd6d-d859b41f1913 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:54.689394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4fb10c77-6c38-457c-bd6d-d859b41f1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:54.763647 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 116/236] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:54.819852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813ed1-b14e-4508-ba51-aaf2703bcc4b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:54.952674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9813ed1-b14e-4508-ba51-aaf2703bcc4b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:54.999457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:55.000289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.000576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.000851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.016137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:55.023711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:55.024608 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:55.025456 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 121/237] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:55.032547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb10c77-6c38-457c-bd6d-d859b41f1913 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:55.134928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb10c77-6c38-457c-bd6d-d859b41f1913 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:55.180689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a8778-8ac1-40db-bf82-c4b54fff1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:55.181397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a8778-8ac1-40db-bf82-c4b54fff1f5f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.181676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a8778-8ac1-40db-bf82-c4b54fff1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.181950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a8778-8ac1-40db-bf82-c4b54fff1f5f None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.182725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a8778-8ac1-40db-bf82-c4b54fff1f5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:55.183074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a8778-8ac1-40db-bf82-c4b54fff1f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:55.184543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a8778-8ac1-40db-bf82-c4b54fff1f5f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:55.200063 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 117/238] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:55.204429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:55.357644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0a53-1e73-4d9d-aa84-9543ea1ca3b7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:55.389454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227d25-9882-4892-a7b7-29d4e3467cfa None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.389815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227d25-9882-4892-a7b7-29d4e3467cfa None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.390023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d227d25-9882-4892-a7b7-29d4e3467cfa None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.395448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 118/239] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:55.402799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f269-4f05-4fd8-b637-e0a8bdb6a004 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.402799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f269-4f05-4fd8-b637-e0a8bdb6a004 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.402799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f269-4f05-4fd8-b637-e0a8bdb6a004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.414959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:55.415855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.416136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.416409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] PATH_INFO: `/v3/users/a9f03d3a45a34282ad5fe4ee556269b7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.418474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] RBAC: Authorizing `identity:get_user(user_id=a9f03d3a45a34282ad5fe4ee556269b7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:55.420004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:55.422017 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 122/240] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:55 2022] GET /identity/v3/users/a9f03d3a45a34282ad5fe4ee556269b7 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:55.427441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:55.428711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-58a7f269-4f05-4fd8-b637-e0a8bdb6a004 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:55.429907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-58a7f269-4f05-4fd8-b637-e0a8bdb6a004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:55.538208 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 119/241] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:55.547762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150211b-797f-4484-b20c-a9c47d1caf4d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.548059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150211b-797f-4484-b20c-a9c47d1caf4d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.548344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150211b-797f-4484-b20c-a9c47d1caf4d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.549694 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 120/242] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:55.565058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f6e76-58c1-475a-9a4a-11c51a7ffaf6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.565349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f6e76-58c1-475a-9a4a-11c51a7ffaf6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.565633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f6e76-58c1-475a-9a4a-11c51a7ffaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.583315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a52f6e76-58c1-475a-9a4a-11c51a7ffaf6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:55.584534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a52f6e76-58c1-475a-9a4a-11c51a7ffaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:55.592220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0028a-343b-4b0c-8878-a3c5e7df9db7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:55.638210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:55.639791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.640319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.641084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.670851 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 121/243] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:55.672571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f6e76-58c1-475a-9a4a-11c51a7ffaf6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:55.719044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:55.721604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:55.790138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f6e76-58c1-475a-9a4a-11c51a7ffaf6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:55.825233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 123/244] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:55.826007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:55.826615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:55.827724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:55.828594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:55.829071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:55.841445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:55.852370 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:55.853311 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:29:55.854107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:55.861418 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 122/245] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:55.861418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:55.963775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611306a-6199-4b94-bc0a-ee926d86c86e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:55.968957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d17734-a4d2-489a-88da-d6cc702ae93c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:56.003556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.004555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.004828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.005103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.006397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:56.006886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.007938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:56.008147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.008613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.009081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.009944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 123/246] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:55 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:56.010954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.011328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:56.012982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:56.020624 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 124/247] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:56.021476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.124542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ee705-7ce5-48ab-91fd-f150edd7bab6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:56.134528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20490cd-a3be-484d-82a6-7d905d5f74ae None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:56.162444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.163478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.164042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.164516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.165503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:56.166123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:56.167882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:56.169268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.169924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.170203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.170480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.171355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=a9f03d3a45a34282ad5fe4ee556269b7) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:56.172267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:56.175349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:56.183394 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 125/249] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:56 2022] GET /identity/v3/role_assignments?user.id=a9f03d3a45a34282ad5fe4ee556269b7&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:56.183394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.183609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 124/249] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:56.185274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.360591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4feed70-7a7e-4bdf-bb30-a2d2f8d67f0d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:56.403619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0b53a-4f63-4faf-9464-957b1ee9b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.408339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b53a-4f63-4faf-9464-957b1ee9b8f9 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.408884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b53a-4f63-4faf-9464-957b1ee9b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.409312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b53a-4f63-4faf-9464-957b1ee9b8f9 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.410267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0b53a-4f63-4faf-9464-957b1ee9b8f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:56.412039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0b53a-4f63-4faf-9464-957b1ee9b8f9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:56.429315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8289e9-8517-4a94-8de1-7c75fc80fd34 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:56.442689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 126/250] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:29:56 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:56.471270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.472419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.472905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.473326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] PATH_INFO: `/v3/users/766e22f528c94f61af933cf07d5792f0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.481083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739183-9d31-40c7-a39b-c086f880896a None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.481377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739183-9d31-40c7-a39b-c086f880896a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.481663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739183-9d31-40c7-a39b-c086f880896a None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.483604 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 127/251] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:56.490362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da9244-b278-47e8-b692-ca3afc032d0d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.490662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da9244-b278-47e8-b692-ca3afc032d0d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.490986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da9244-b278-47e8-b692-ca3afc032d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.491881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] RBAC: Authorizing `identity:get_user(user_id=766e22f528c94f61af933cf07d5792f0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:56.493882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:56.496341 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 125/252] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:56 2022] GET /identity/v3/users/766e22f528c94f61af933cf07d5792f0 => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:56.502500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.514977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a6da9244-b278-47e8-b692-ca3afc032d0d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:56.516624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a6da9244-b278-47e8-b692-ca3afc032d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:56.608712 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 128/253] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:56.611268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ecb0-c1cf-44eb-89f8-42cd9ea9b2ed None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.612061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ecb0-c1cf-44eb-89f8-42cd9ea9b2ed None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.612809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510ecb0-c1cf-44eb-89f8-42cd9ea9b2ed None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.614893 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 129/254] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:56.620747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9bb2-3b3d-4e60-b3b4-a0d95a73134d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.621242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9bb2-3b3d-4e60-b3b4-a0d95a73134d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.621357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df570f-2c39-4666-9926-6dd665404b11 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:56.621791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d9bb2-3b3d-4e60-b3b4-a0d95a73134d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.644587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bf2d9bb2-3b3d-4e60-b3b4-a0d95a73134d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:56.646077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bf2d9bb2-3b3d-4e60-b3b4-a0d95a73134d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:56.661808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.662905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.663481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.663716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.720030 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 130/255] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:56.721492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d9bb2-3b3d-4e60-b3b4-a0d95a73134d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.740723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:56.742208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:56.849246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d9bb2-3b3d-4e60-b3b4-a0d95a73134d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:56.849665 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 126/256] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:29:56.850521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.892872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:56.894344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:56.894868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:56.895361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:56.906199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:56.914361 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:56.915318 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:56.916442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:56.924185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 131/257] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:56.925280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:56.970921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a37566-703b-458e-a3b3-605b8f07abb5 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.018962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.019782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.020067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.020345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.032504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782cac-7d9a-40fa-aafb-66facd4e9a88 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.033666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:57.044022 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:57.044962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:29:57.045780 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 127/258] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:29:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:57.046443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.071051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.072277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.072805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.073282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.074703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.076435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.078382 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 132/259] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:56 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:57.079393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.152932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262edb1-abe5-4a8a-90e0-4fcdb116eec1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.182623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65497d-38ee-47a7-b7b3-a3032a1403cc None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.188840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.189774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.190701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.191215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.192531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:57.193066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.196968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.214288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 128/260] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:57.214288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.228504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.229184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.229469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.229744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.230557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:57.230902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.232377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.240654 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 133/261] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:57.241340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.339002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe2963-f046-4c9e-ba8f-843ab082524f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.351634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43574-d41b-4795-8cb4-614f98a8ea88 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.371656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.372308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.372586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.372858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.373681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] RBAC: Adding query filter params (role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=766e22f528c94f61af933cf07d5792f0) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:57.373981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.376018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.385955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.386887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.387173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.387280 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 129/262] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/role_assignments?user.id=766e22f528c94f61af933cf07d5792f0&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:57.387439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] PATH_INFO: `/v3/users/b57aa6d610204b18a722b89e4fc148e0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.388205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.388810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] RBAC: Authorizing `identity:get_user(user_id=b57aa6d610204b18a722b89e4fc148e0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.390324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.392960 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 134/263] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/users/b57aa6d610204b18a722b89e4fc148e0 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:57.398335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.506674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863316e-c36b-4f5e-bf03-e9d2a52f745d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.541942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.542950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.543239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.543519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.544794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.546398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.548292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629f71b-1d15-4bcb-9705-ad0fc18e9c4b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.548727 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 135/264] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:57.554477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.582785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.583686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.583965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.584238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] PATH_INFO: `/v3/users/a9f03d3a45a34282ad5fe4ee556269b7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.585499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] RBAC: Authorizing `identity:get_user(user_id=a9f03d3a45a34282ad5fe4ee556269b7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.587006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.588932 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 130/265] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/users/a9f03d3a45a34282ad5fe4ee556269b7 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:57.595174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:57.661728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820a5b4-9b9d-4907-a57d-6628197b45f0 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.694506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898658d-2814-4b04-9e44-67fed3831f3e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:57.696317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.697446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.697913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.698352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/b57aa6d610204b18a722b89e4fc148e0/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.700842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1199484c3cc43c0ae54f73bf271c77d, user_id=b57aa6d610204b18a722b89e4fc148e0, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.702535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.721118 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 136/266] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:29:57 2022] PUT /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/b57aa6d610204b18a722b89e4fc148e0/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:29:57.730891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:57.731561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:57.731842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:57.732113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:57.843905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:57.845317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:57.957530 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 131/267] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:29:57.963648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:58.097368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7db301-2d8a-4e36-888f-f931905cae21 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:58.135700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da061d-360c-4818-92da-b930bea60795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:58.136617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da061d-360c-4818-92da-b930bea60795 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:58.136908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da061d-360c-4818-92da-b930bea60795 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:58.137189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da061d-360c-4818-92da-b930bea60795 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:58.139767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da061d-360c-4818-92da-b930bea60795 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:58.142491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da061d-360c-4818-92da-b930bea60795 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:58.144013 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 137/268] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:29:57 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:58.151542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:58.310291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844253e-8e6e-4c1f-a35f-f8b5b4f9da3e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:58.356414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d12bf-b808-4b2d-8cba-15fa0e0cf900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:58.357002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d12bf-b808-4b2d-8cba-15fa0e0cf900 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:58.357279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d12bf-b808-4b2d-8cba-15fa0e0cf900 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:58.357548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d12bf-b808-4b2d-8cba-15fa0e0cf900 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:58.358366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d12bf-b808-4b2d-8cba-15fa0e0cf900 None admin] RBAC: Adding query filter params (role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=a9f03d3a45a34282ad5fe4ee556269b7) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:58.358668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d12bf-b808-4b2d-8cba-15fa0e0cf900 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:58.360714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d12bf-b808-4b2d-8cba-15fa0e0cf900 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:58.371443 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 132/269] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:29:58 2022] GET /identity/v3/role_assignments?user.id=a9f03d3a45a34282ad5fe4ee556269b7&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:59.124628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd882a5-1b72-404f-8808-5fe5c233ecba None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.125739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd882a5-1b72-404f-8808-5fe5c233ecba None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.125739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd882a5-1b72-404f-8808-5fe5c233ecba None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.127283 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 138/270] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:29:59.133213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47d2d-175a-4321-a1d7-ce017e76ee40 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.133728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47d2d-175a-4321-a1d7-ce017e76ee40 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.133805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47d2d-175a-4321-a1d7-ce017e76ee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.154491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-87d47d2d-175a-4321-a1d7-ce017e76ee40 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:59.156137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-87d47d2d-175a-4321-a1d7-ce017e76ee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:59.228604 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 133/271] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:29:59.253269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd882a5-1b72-404f-8808-5fe5c233ecba None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:59.310294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6a6c-f758-4e58-91aa-b72e8f0df88e None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.310602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6a6c-f758-4e58-91aa-b72e8f0df88e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.310879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b6a6c-f758-4e58-91aa-b72e8f0df88e None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.313167 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 134/272] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:29:59.318704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16a5c-8f48-48de-b925-cb2e8932b9b5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.319333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16a5c-8f48-48de-b925-cb2e8932b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.319814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16a5c-8f48-48de-b925-cb2e8932b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.336725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-68b16a5c-8f48-48de-b925-cb2e8932b9b5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:29:59.338477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68b16a5c-8f48-48de-b925-cb2e8932b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:29:59.363045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd882a5-1b72-404f-8808-5fe5c233ecba None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:59.396770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:59.397485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.397769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.398041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.414959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:29:59.415236 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 135/273] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:29:59.416809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:29:59.417692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:29:59.418505 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 139/274] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:29:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:29:59.425232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b16a5c-8f48-48de-b925-cb2e8932b9b5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:59.441554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:59.530348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b16a5c-8f48-48de-b925-cb2e8932b9b5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:59.565664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:59.566747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.566747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.566747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.567484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:59.567789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:59.569186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:59.570674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a26eb-2936-4363-b6b7-4e79279672ad None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:59.582833 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 136/275] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:59.583778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:59.612091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:59.613431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.614027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.614813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.619560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:59.621036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:59.622693 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 140/276] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:29:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:29:59.633442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:59.713739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ff1f-cbd9-4911-a26d-eb1b93674167 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:59.732114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb7cc5-4a01-4f66-8827-50d250b3a079 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:59.763389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:59.764753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.765376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.766661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] PATH_INFO: `/v3/users/9bf75e473ff7447b9d575defecc4d2b0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.771916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051c16f-e103-4cad-b4d9-063379092753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:59.772713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c16f-e103-4cad-b4d9-063379092753 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.773094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c16f-e103-4cad-b4d9-063379092753 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.773489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c16f-e103-4cad-b4d9-063379092753 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.774316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051c16f-e103-4cad-b4d9-063379092753 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:59.775906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051c16f-e103-4cad-b4d9-063379092753 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:59.783017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf75e473ff7447b9d575defecc4d2b0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:59.785739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:59.788180 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 137/277] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:29:59 2022] GET /identity/v3/users/9bf75e473ff7447b9d575defecc4d2b0 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:29:59.794025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:29:59.806139 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 141/278] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:29:59 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:29:59.907326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db8e03-f185-4ced-b248-e4ea0a9ed727 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:29:59.950101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ade59-9f4a-40cf-8ac3-0a14d420a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:29:59.950931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ade59-9f4a-40cf-8ac3-0a14d420a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:29:59.951217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ade59-9f4a-40cf-8ac3-0a14d420a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:29:59.951491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ade59-9f4a-40cf-8ac3-0a14d420a7e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:29:59.952327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ade59-9f4a-40cf-8ac3-0a14d420a7e5 None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, user.id=9bf75e473ff7447b9d575defecc4d2b0, scope.system=all) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:29:59.952637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ade59-9f4a-40cf-8ac3-0a14d420a7e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:29:59.954281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ade59-9f4a-40cf-8ac3-0a14d420a7e5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:29:59.960613 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 138/279] 10.222.0.32 () {56 vars in 1308 bytes} [Sat May 7 21:29:59 2022] GET /identity/v3/role_assignments?user.id=9bf75e473ff7447b9d575defecc4d2b0&scope.system=all&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:00.294002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752cec6-bdfb-4932-80a2-51a957a68c4e None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:00.294504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752cec6-bdfb-4932-80a2-51a957a68c4e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:00.294582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752cec6-bdfb-4932-80a2-51a957a68c4e None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:00.296160 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 142/280] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:00.301694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be1ed-2d8a-42d9-998d-823587dd9631 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:00.302117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be1ed-2d8a-42d9-998d-823587dd9631 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:00.302304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be1ed-2d8a-42d9-998d-823587dd9631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:00.320149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-861be1ed-2d8a-42d9-998d-823587dd9631 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:00.321315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-861be1ed-2d8a-42d9-998d-823587dd9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:00.361317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677a82-fd52-4d02-bf32-8175105b3a37 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:00.361642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677a82-fd52-4d02-bf32-8175105b3a37 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:00.361879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677a82-fd52-4d02-bf32-8175105b3a37 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:00.363563 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 143/281] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:00.368839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e0bb-f70f-4760-bd1d-17eef7c22e04 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:00.369131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e0bb-f70f-4760-bd1d-17eef7c22e04 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:00.369468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e0bb-f70f-4760-bd1d-17eef7c22e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:00.397662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b398e0bb-f70f-4760-bd1d-17eef7c22e04 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:00.398881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b398e0bb-f70f-4760-bd1d-17eef7c22e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:00.435847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 139/282] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:00.473836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be1ed-2d8a-42d9-998d-823587dd9631 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:00.522284 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 144/283] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:00.566302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e0bb-f70f-4760-bd1d-17eef7c22e04 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:00.602352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be1ed-2d8a-42d9-998d-823587dd9631 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:00.664547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:00.665337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:00.665613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:00.665884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:00.684637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:00.695338 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:00.696290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:00.697128 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:00.697738 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 140/284] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:00.703486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:00.740095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e0bb-f70f-4760-bd1d-17eef7c22e04 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:00.805511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:00.806619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:00.807119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:00.807571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:00.829596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:00.838314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:00.839248 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:00.840060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:00.842430 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 145/285] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:00.849560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:00.877102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b6fd4-898d-43b3-8dd3-f563a1119dc1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:00.944870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:00.945922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:00.946407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:00.946918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:00.947872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:00.950004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:00.951640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:00.973282 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 141/286] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:00.978623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:01.004628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeff186-a239-4a12-a1dc-5a29eb01f576 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:01.074460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:01.075160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:01.076562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:01.076850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:01.077610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:01.077962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:01.079390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:01.102233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 146/287] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:01.107528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:01.134663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed61b-968e-4281-b015-715fe60098e3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:01.171263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:01.172700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:01.172981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:01.173253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] PATH_INFO: `/v3/users/766e22f528c94f61af933cf07d5792f0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:01.174508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] RBAC: Authorizing `identity:get_user(user_id=766e22f528c94f61af933cf07d5792f0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:01.176709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:01.178356 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 142/288] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:00 2022] GET /identity/v3/users/766e22f528c94f61af933cf07d5792f0 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:01.183692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:01.296004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96030e9-4f8a-4d9f-a64f-6698cc08040d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:01.337318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:01.342790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:01.342790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:01.342790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:01.342790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:01.342790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:01.345410 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 143/289] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:01 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:01.350893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:01.353344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0392d-0109-4662-9db5-f0e92f9257f1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:01.408073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:01.408966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:01.409251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:01.409533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] PATH_INFO: `/v3/users/b57aa6d610204b18a722b89e4fc148e0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:01.410755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] RBAC: Authorizing `identity:get_user(user_id=b57aa6d610204b18a722b89e4fc148e0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:01.412245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:01.414211 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 147/290] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:01 2022] GET /identity/v3/users/b57aa6d610204b18a722b89e4fc148e0 => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:01.419201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:01.457648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959f5d6-4123-45cf-aaba-1d315301f4d6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:01.491919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:01.492824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:01.493109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:01.493387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/766e22f528c94f61af933cf07d5792f0/roles/92f5ed5a59a04cc28b8a5f2fa6a9b44a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:01.498802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1199484c3cc43c0ae54f73bf271c77d, user_id=766e22f528c94f61af933cf07d5792f0, role_id=92f5ed5a59a04cc28b8a5f2fa6a9b44a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:01.498802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:01.521546 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 144/291] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:30:01 2022] PUT /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/users/766e22f528c94f61af933cf07d5792f0/roles/92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:30:01.573079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d56d71-18af-4832-9db2-5c802adfea1c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:01.614349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:01.615393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:01.615875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:01.616389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:01.705715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:01.707581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:01.819112 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 148/292] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:30:01.828705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:01.939109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550fad9-e8de-44af-b242-670bd94189a7 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:01.978821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340ac8c-d46b-405c-a2bc-47aad914bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:01.979744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ac8c-d46b-405c-a2bc-47aad914bd26 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:01.980028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ac8c-d46b-405c-a2bc-47aad914bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:01.980480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ac8c-d46b-405c-a2bc-47aad914bd26 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:01.987568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340ac8c-d46b-405c-a2bc-47aad914bd26 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:01.989036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340ac8c-d46b-405c-a2bc-47aad914bd26 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:01.991260 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 145/293] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:01 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:01.999909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:02.120830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86089-a7b4-4e64-869a-f2111b4b8c58 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:02.173138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c5979-9dbc-4d65-bfcd-bbaf1c6fbb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:02.174160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c5979-9dbc-4d65-bfcd-bbaf1c6fbb0b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:02.174664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c5979-9dbc-4d65-bfcd-bbaf1c6fbb0b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:02.175166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c5979-9dbc-4d65-bfcd-bbaf1c6fbb0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:02.176312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c5979-9dbc-4d65-bfcd-bbaf1c6fbb0b None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=b57aa6d610204b18a722b89e4fc148e0) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:02.176838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c5979-9dbc-4d65-bfcd-bbaf1c6fbb0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:02.178487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c5979-9dbc-4d65-bfcd-bbaf1c6fbb0b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:02.186347 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 149/294] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:01 2022] GET /identity/v3/role_assignments?user.id=b57aa6d610204b18a722b89e4fc148e0&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:02.661339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2753f-705b-4cb0-b2d7-abb21dc4b60f None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:02.661875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2753f-705b-4cb0-b2d7-abb21dc4b60f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:02.661875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2753f-705b-4cb0-b2d7-abb21dc4b60f None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:02.663545 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 146/295] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:02.668792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b555cc-ed7d-4820-b459-6a0bbdff9d7c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:02.669225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b555cc-ed7d-4820-b459-6a0bbdff9d7c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:02.669324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b555cc-ed7d-4820-b459-6a0bbdff9d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:02.686690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-59b555cc-ed7d-4820-b459-6a0bbdff9d7c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:02.688452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-59b555cc-ed7d-4820-b459-6a0bbdff9d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:02.732396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082ad78-2be3-4ae6-98c9-7489718523fc None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:02.733038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082ad78-2be3-4ae6-98c9-7489718523fc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:02.733555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082ad78-2be3-4ae6-98c9-7489718523fc None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:02.735917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 147/296] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:02.741495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b30da-96cb-4744-8a38-b286e0c173ee None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:02.742098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b30da-96cb-4744-8a38-b286e0c173ee None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:02.742585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b30da-96cb-4744-8a38-b286e0c173ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:02.764214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1a0b30da-96cb-4744-8a38-b286e0c173ee None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:02.765958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1a0b30da-96cb-4744-8a38-b286e0c173ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:02.791917 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 150/297] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:02.820713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b555cc-ed7d-4820-b459-6a0bbdff9d7c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:02.880547 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 148/298] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:02.906665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b30da-96cb-4744-8a38-b286e0c173ee None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:02.948370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b555cc-ed7d-4820-b459-6a0bbdff9d7c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:02.982144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379b8c0-caea-4c3d-bd8b-1f19dbd5aa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:02.983129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b8c0-caea-4c3d-bd8b-1f19dbd5aa63 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:02.983416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b8c0-caea-4c3d-bd8b-1f19dbd5aa63 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:02.983691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379b8c0-caea-4c3d-bd8b-1f19dbd5aa63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:02.993465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379b8c0-caea-4c3d-bd8b-1f19dbd5aa63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-5379b8c0-caea-4c3d-bd8b-1f19dbd5aa63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:03.002371 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:03.003715 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:03.004680 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:03.007913 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 151/299] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:03.009723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3b72-2389-48ae-83d9-a59252503eff None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.010014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3b72-2389-48ae-83d9-a59252503eff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.010291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f3b72-2389-48ae-83d9-a59252503eff None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.011633 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 152/300] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:03.014976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3b72-2389-48ae-83d9-a59252503eff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.023844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b30da-96cb-4744-8a38-b286e0c173ee None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.058394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7702-2626-4f35-a983-2cd075805b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.059242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7702-2626-4f35-a983-2cd075805b02 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.059527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7702-2626-4f35-a983-2cd075805b02 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.059801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7702-2626-4f35-a983-2cd075805b02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.061053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7702-2626-4f35-a983-2cd075805b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.063201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7702-2626-4f35-a983-2cd075805b02 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.064870 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 149/301] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:03.066129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e6f6-2ea9-4511-9a76-75a7b588291c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.066415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e6f6-2ea9-4511-9a76-75a7b588291c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.066690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4e6f6-2ea9-4511-9a76-75a7b588291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.082754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-64d4e6f6-2ea9-4511-9a76-75a7b588291c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:03.084137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-64d4e6f6-2ea9-4511-9a76-75a7b588291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:03.121284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f3b72-2389-48ae-83d9-a59252503eff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.148283 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 150/302] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:03.149387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e6f6-2ea9-4511-9a76-75a7b588291c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.164980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.165898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.166327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.166747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.167776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:03.168299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.169913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.180299 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 153/303] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:03.181430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.272913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4e6f6-2ea9-4511-9a76-75a7b588291c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.293363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e543c6d-b3e9-46ef-ae41-a9957952bbd3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.305545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.306209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.306490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.306764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.307467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.308926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.322796 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 151/304] 10.222.0.32 () {60 vars in 1134 bytes} [Sat May 7 21:30:03 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:03.326676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.327837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.328318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.328785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.332572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.348215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:03.357176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:03.358181 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:03.359631 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:03.362329 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 154/305] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:03.368519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.449501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d626057-7e2a-46bc-ae18-869b53af593c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.478329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47330841-11bc-4015-821a-a1a2a51850af None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.486800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.487648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.487928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.488200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] PATH_INFO: `/v3/users/8632c724ab9e47da9fd42651f29ac0bd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.503904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] RBAC: Authorizing `identity:get_user(user_id=8632c724ab9e47da9fd42651f29ac0bd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.505411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.507366 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 152/306] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:03 2022] GET /identity/v3/users/8632c724ab9e47da9fd42651f29ac0bd => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:03.513697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.523764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.524704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.525135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.525583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.526348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:03.526656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.528147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.538159 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 155/307] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:03.544604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.645023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44509a-8260-4cb3-bff7-81a2747e31d4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.651964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391397ea-6b20-4f03-85b6-9aa3d380f11f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.683666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb617fee-b5e0-4f56-a1fd-ec8cb016f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.684326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617fee-b5e0-4f56-a1fd-ec8cb016f0ce None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.684600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617fee-b5e0-4f56-a1fd-ec8cb016f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.684873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb617fee-b5e0-4f56-a1fd-ec8cb016f0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.685153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.685699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617fee-b5e0-4f56-a1fd-ec8cb016f0ce None admin] RBAC: Adding query filter params (role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a, user.id=8632c724ab9e47da9fd42651f29ac0bd, scope.system=all) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:03.686010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617fee-b5e0-4f56-a1fd-ec8cb016f0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.686111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.687184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.687184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] PATH_INFO: `/v3/users/9bf75e473ff7447b9d575defecc4d2b0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.687575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb617fee-b5e0-4f56-a1fd-ec8cb016f0ce None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.687825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf75e473ff7447b9d575defecc4d2b0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.689256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.691226 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 156/308] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:03 2022] GET /identity/v3/users/9bf75e473ff7447b9d575defecc4d2b0 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:03.692865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 153/309] 10.222.0.32 () {56 vars in 1308 bytes} [Sat May 7 21:30:03 2022] GET /identity/v3/role_assignments?user.id=8632c724ab9e47da9fd42651f29ac0bd&scope.system=all&role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:03.700107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:03.811634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30e906-198c-42f3-8522-5bedacc72095 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:03.849218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64f7e3-8f67-48bd-b15b-a341d608bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:03.850089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64f7e3-8f67-48bd-b15b-a341d608bb2b None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:03.850367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64f7e3-8f67-48bd-b15b-a341d608bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:03.850637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64f7e3-8f67-48bd-b15b-a341d608bb2b None admin] PATH_INFO: `/v3/system/users/9bf75e473ff7447b9d575defecc4d2b0/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:03.852235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64f7e3-8f67-48bd-b15b-a341d608bb2b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9bf75e473ff7447b9d575defecc4d2b0, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:03.853640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64f7e3-8f67-48bd-b15b-a341d608bb2b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:03.864742 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 157/310] 10.222.0.32 () {58 vars in 1334 bytes} [Sat May 7 21:30:03 2022] PUT /identity/v3/system/users/9bf75e473ff7447b9d575defecc4d2b0/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:04.267810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93831f-8fd2-4708-8398-4c28fa7ae30f None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:04.268134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93831f-8fd2-4708-8398-4c28fa7ae30f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:04.268415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93831f-8fd2-4708-8398-4c28fa7ae30f None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:04.269789 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 154/311] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:04.275377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff2eab-4304-49be-ba4a-d45982d3b32c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:04.275681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff2eab-4304-49be-ba4a-d45982d3b32c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:04.275966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff2eab-4304-49be-ba4a-d45982d3b32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:04.292739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cdff2eab-4304-49be-ba4a-d45982d3b32c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:04.293941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cdff2eab-4304-49be-ba4a-d45982d3b32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:04.359764 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 158/312] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:04.384123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93831f-8fd2-4708-8398-4c28fa7ae30f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:04.497704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93831f-8fd2-4708-8398-4c28fa7ae30f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:04.551201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:04.552370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:04.552851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:04.553318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:04.575417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:04.585330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:04.586293 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:04.587398 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:04.595449 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 155/313] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:04.599419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff2eab-4304-49be-ba4a-d45982d3b32c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:04.731441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff2eab-4304-49be-ba4a-d45982d3b32c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:04.784269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:04.784864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:04.785192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:04.786802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:04.786802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:04.786802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:04.787956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:04.797841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 159/314] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:04.808682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:04.924220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9cdaf-aa81-47ce-b57a-1907acd9c595 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:04.957559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:04.958759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:04.959299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:04.959778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] PATH_INFO: `/v3/users/766e22f528c94f61af933cf07d5792f0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:04.961187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=766e22f528c94f61af933cf07d5792f0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:04.963190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:04.965317 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 156/315] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:04 2022] GET /identity/v3/users/766e22f528c94f61af933cf07d5792f0 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:04.971494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:05.076426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee406f3d-d20c-4d29-ae41-9c9d57637ed8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:05.115264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:05.116289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:05.116800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:05.117553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:05.187648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:05.189457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:05.292270 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 160/316] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:05.298365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:05.399271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686f46-548b-496b-9e19-dcedc420a7d7 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:05.441354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7b04-b37c-46dd-82e7-68d1e4678f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:05.442227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7b04-b37c-46dd-82e7-68d1e4678f00 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:05.442511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7b04-b37c-46dd-82e7-68d1e4678f00 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:05.442799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7b04-b37c-46dd-82e7-68d1e4678f00 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:05.444015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd7b04-b37c-46dd-82e7-68d1e4678f00 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:05.445645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd7b04-b37c-46dd-82e7-68d1e4678f00 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:05.447430 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 157/317] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:05 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:05.457065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:05.569992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6b9af-b014-4851-8c12-3f68fc9d34eb None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:05.613391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3cc7b-e805-4436-89ef-33801b9e54f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:05.614065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3cc7b-e805-4436-89ef-33801b9e54f0 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:05.614345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3cc7b-e805-4436-89ef-33801b9e54f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:05.614615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3cc7b-e805-4436-89ef-33801b9e54f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:05.615487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3cc7b-e805-4436-89ef-33801b9e54f0 None admin] RBAC: Adding query filter params (role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d, user.id=766e22f528c94f61af933cf07d5792f0) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:05.615797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3cc7b-e805-4436-89ef-33801b9e54f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:05.617258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3cc7b-e805-4436-89ef-33801b9e54f0 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:05.625200 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 161/318] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:05 2022] GET /identity/v3/role_assignments?user.id=766e22f528c94f61af933cf07d5792f0&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:05.920453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf047-5853-4f00-816a-253e77f1ac12 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:05.920962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf047-5853-4f00-816a-253e77f1ac12 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:05.921051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abf047-5853-4f00-816a-253e77f1ac12 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:05.922404 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 158/319] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:05.927845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbb059-52e9-4285-84e3-15ea5b7e9453 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:05.928276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbb059-52e9-4285-84e3-15ea5b7e9453 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:05.928380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbb059-52e9-4285-84e3-15ea5b7e9453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:05.944527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a9bbb059-52e9-4285-84e3-15ea5b7e9453 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:05.945703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9bbb059-52e9-4285-84e3-15ea5b7e9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:06.009347 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 162/320] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:06.033621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf047-5853-4f00-816a-253e77f1ac12 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.141068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abf047-5853-4f00-816a-253e77f1ac12 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:06.180166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991e995-e997-4b7a-8625-6529c176e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:06.180876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e995-e997-4b7a-8625-6529c176e890 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.181156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e995-e997-4b7a-8625-6529c176e890 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.181429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e995-e997-4b7a-8625-6529c176e890 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.182630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e995-e997-4b7a-8625-6529c176e890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:06.184306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e995-e997-4b7a-8625-6529c176e890 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:06.186147 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 159/321] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:06.192272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbb059-52e9-4285-84e3-15ea5b7e9453 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.249482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bd488-8bb6-4ef7-8d4b-caaf8fb61c45 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.250350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bd488-8bb6-4ef7-8d4b-caaf8fb61c45 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.250551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bd488-8bb6-4ef7-8d4b-caaf8fb61c45 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.252082 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 160/322] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:06.256830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2058-cc40-47c0-9faa-ac2211ef902f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.257122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2058-cc40-47c0-9faa-ac2211ef902f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.257402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2058-cc40-47c0-9faa-ac2211ef902f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.274072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9b6f2058-cc40-47c0-9faa-ac2211ef902f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:06.275302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b6f2058-cc40-47c0-9faa-ac2211ef902f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:06.298458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbb059-52e9-4285-84e3-15ea5b7e9453 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:06.336338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58ac2c-2378-42e7-9f8b-4d562e2474f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:06.337273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ac2c-2378-42e7-9f8b-4d562e2474f2 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.337556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ac2c-2378-42e7-9f8b-4d562e2474f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.337825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ac2c-2378-42e7-9f8b-4d562e2474f2 None admin] PATH_INFO: `/v3/groups` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.338513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58ac2c-2378-42e7-9f8b-4d562e2474f2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:06.340001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58ac2c-2378-42e7-9f8b-4d562e2474f2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:06.356233 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 161/323] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:06.356825 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 163/324] 10.222.0.32 () {60 vars in 1134 bytes} [Sat May 7 21:30:06 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:06.360128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7873-fe13-4feb-bc91-94cbe5a785f0 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.360423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7873-fe13-4feb-bc91-94cbe5a785f0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.360701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e7873-fe13-4feb-bc91-94cbe5a785f0 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.362306 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 162/325] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:06.368129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84072-d330-4061-9cf6-a078116d0f46 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.368465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84072-d330-4061-9cf6-a078116d0f46 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.368754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a84072-d330-4061-9cf6-a078116d0f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.381221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7873-fe13-4feb-bc91-94cbe5a785f0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.387540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b2a84072-d330-4061-9cf6-a078116d0f46 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:06.388788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b2a84072-d330-4061-9cf6-a078116d0f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:06.461473 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 164/326] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:06.485799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84072-d330-4061-9cf6-a078116d0f46 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.489291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e7873-fe13-4feb-bc91-94cbe5a785f0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:06.525489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:06.526297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.526583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.526894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.537894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:06.545665 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:06.546611 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:06.552613 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 163/327] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:06.554831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.590408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a84072-d330-4061-9cf6-a078116d0f46 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:06.633174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:06.633968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.634247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.634523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.649303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:06.657139 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:06.658043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:06.658916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 165/328] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:06.665251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.666034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd593-1f73-44d0-bdcf-13a8609aaf0e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:06.710095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:06.710919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.711276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.711681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.712715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:06.713089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:06.714583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:06.725672 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 164/329] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:06.731810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.816328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1c2f3-677b-4881-b32b-bd72c692e292 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:06.850485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4603b-70e9-4eda-8174-951384a4fc9e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:06.854333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:06.855180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.855469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.855752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.856506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:06.856818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:06.858231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:06.867734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 166/330] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:06.874310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.888238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:06.889111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:06.889396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:06.889673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] PATH_INFO: `/v3/users/8632c724ab9e47da9fd42651f29ac0bd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:06.891476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] RBAC: Authorizing `identity:get_user(user_id=8632c724ab9e47da9fd42651f29ac0bd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:06.892943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:06.894790 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 165/331] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:06 2022] GET /identity/v3/users/8632c724ab9e47da9fd42651f29ac0bd => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:06.901572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:06.984657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a04f9-355f-48ac-9a11-5fd4f5721702 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:07.007896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f163d3-5307-4fcd-8737-fe2f33fe3c51 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:07.019410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:07.020289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:07.020571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:07.020912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] PATH_INFO: `/v3/users/9bf75e473ff7447b9d575defecc4d2b0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:07.022221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf75e473ff7447b9d575defecc4d2b0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:07.023792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:07.025741 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 167/332] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:06 2022] GET /identity/v3/users/9bf75e473ff7447b9d575defecc4d2b0 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:07.040115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:07.047076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291788c0-1aae-439a-b280-bd27a098ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:07.047998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291788c0-1aae-439a-b280-bd27a098ba38 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:07.048251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291788c0-1aae-439a-b280-bd27a098ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:07.048584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291788c0-1aae-439a-b280-bd27a098ba38 None admin] PATH_INFO: `/v3/system/users/8632c724ab9e47da9fd42651f29ac0bd/roles/92f5ed5a59a04cc28b8a5f2fa6a9b44a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:07.050233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291788c0-1aae-439a-b280-bd27a098ba38 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8632c724ab9e47da9fd42651f29ac0bd, role_id=92f5ed5a59a04cc28b8a5f2fa6a9b44a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:07.051836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291788c0-1aae-439a-b280-bd27a098ba38 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:07.064298 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 166/333] 10.222.0.32 () {58 vars in 1334 bytes} [Sat May 7 21:30:06 2022] PUT /identity/v3/system/users/8632c724ab9e47da9fd42651f29ac0bd/roles/92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:07.158471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874ce91-403e-4584-9e55-d2b8818cd586 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:07.201913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fecbca-05bf-45d4-844a-4ab0fe428c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:07.202654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fecbca-05bf-45d4-844a-4ab0fe428c22 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:07.203027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fecbca-05bf-45d4-844a-4ab0fe428c22 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:07.203254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fecbca-05bf-45d4-844a-4ab0fe428c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:07.206805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fecbca-05bf-45d4-844a-4ab0fe428c22 None admin] RBAC: Adding query filter params (role.id=5f40f2a9333d485c8324a5707fc69ad2, user.id=9bf75e473ff7447b9d575defecc4d2b0, scope.system=all) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:07.206805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fecbca-05bf-45d4-844a-4ab0fe428c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:07.206805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fecbca-05bf-45d4-844a-4ab0fe428c22 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:07.227091 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 168/334] 10.222.0.32 () {56 vars in 1308 bytes} [Sat May 7 21:30:07 2022] GET /identity/v3/role_assignments?user.id=9bf75e473ff7447b9d575defecc4d2b0&scope.system=all&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:09.232747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656149-3a03-4a45-8ab3-43ab6c7e368d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:09.234262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656149-3a03-4a45-8ab3-43ab6c7e368d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:09.234761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656149-3a03-4a45-8ab3-43ab6c7e368d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:09.236653 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 167/335] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:09.242655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ae99-1392-4bdc-b9c0-a152474e1be2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:09.243549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ae99-1392-4bdc-b9c0-a152474e1be2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:09.244044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ae99-1392-4bdc-b9c0-a152474e1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:09.264035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e2d1ae99-1392-4bdc-b9c0-a152474e1be2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:09.265608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e2d1ae99-1392-4bdc-b9c0-a152474e1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:09.336001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 169/336] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:09.367507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9656149-3a03-4a45-8ab3-43ab6c7e368d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:09.473932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9656149-3a03-4a45-8ab3-43ab6c7e368d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:09.509796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:09.511015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:09.511502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:09.513063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:09.524584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:09.532662 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:09.533601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:09.534436 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:09.537159 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 168/337] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:09.543101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1ae99-1392-4bdc-b9c0-a152474e1be2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:09.648430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1ae99-1392-4bdc-b9c0-a152474e1be2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:09.683837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827803e6-0e35-4548-bd56-10734b6f03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:09.684894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827803e6-0e35-4548-bd56-10734b6f03b5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:09.685393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827803e6-0e35-4548-bd56-10734b6f03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:09.685876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827803e6-0e35-4548-bd56-10734b6f03b5 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:09.686910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827803e6-0e35-4548-bd56-10734b6f03b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:09.687961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827803e6-0e35-4548-bd56-10734b6f03b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:09.689557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827803e6-0e35-4548-bd56-10734b6f03b5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:09.698665 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 170/338] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:09.704588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:09.813193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a1d65-10aa-4a94-85aa-9d83ea55ecab None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:09.851321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:09.852363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:09.852861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:09.853349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:09.868259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42558-9055-4456-902c-07cdb510beab None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:09.869604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42558-9055-4456-902c-07cdb510beab None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:09.869604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf42558-9055-4456-902c-07cdb510beab None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:09.870458 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 171/339] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:30:09.876717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5c26-3c0f-4801-ae51-3ab1dcf72e3e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:09.877807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5c26-3c0f-4801-ae51-3ab1dcf72e3e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:09.878309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d5c26-3c0f-4801-ae51-3ab1dcf72e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:09.901183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5f1d5c26-3c0f-4801-ae51-3ab1dcf72e3e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:09.902913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5f1d5c26-3c0f-4801-ae51-3ab1dcf72e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:09.943434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:09.944924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:09.991603 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 172/340] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:10.039060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5c26-3c0f-4801-ae51-3ab1dcf72e3e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:10.063306 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 169/341] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:10.068857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:10.186992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d5c26-3c0f-4801-ae51-3ab1dcf72e3e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:10.227377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:10.228182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.228462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.228834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.242706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:10.250877 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:10.251769 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:10.252579 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 173/342] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:30:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:10.264268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:10.312746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e22bd-eaef-4699-9949-9c55981ff22f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:10.378353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f1ab-8dd3-417d-8442-2cca2230ca9a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:10.408671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab14cd-b4a7-4385-92d7-805d5d450747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:10.411372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab14cd-b4a7-4385-92d7-805d5d450747 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.411372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab14cd-b4a7-4385-92d7-805d5d450747 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.411372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab14cd-b4a7-4385-92d7-805d5d450747 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.411745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab14cd-b4a7-4385-92d7-805d5d450747 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:10.413000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab14cd-b4a7-4385-92d7-805d5d450747 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:10.420276 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 170/343] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:10 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:10.422637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710db8-e0c0-42ec-a791-7b25bb849248 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.423136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710db8-e0c0-42ec-a791-7b25bb849248 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.423565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26710db8-e0c0-42ec-a791-7b25bb849248 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.423681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:10.424274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.424733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.425174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.425282 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 171/344] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:10.426195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:10.426796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:10.428411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:10.432867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3b8d-8d93-458f-90a0-cc52fa710361 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.433149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3b8d-8d93-458f-90a0-cc52fa710361 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.433595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3b8d-8d93-458f-90a0-cc52fa710361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.439305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 174/345] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:10.440532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:10.460732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-96cf3b8d-8d93-458f-90a0-cc52fa710361 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:10.462187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-96cf3b8d-8d93-458f-90a0-cc52fa710361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:10.555023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826cab2-19e2-42aa-9ca9-37c458ca9394 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:10.593096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:10.594718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.595309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.595760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.602898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:10.604622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:10.606807 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 175/346] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:10 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:10.608183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:10.633451 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 172/347] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:10.634512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3b8d-8d93-458f-90a0-cc52fa710361 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:10.720238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925c692-404a-469b-a080-954ac58a3ae9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:10.759932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95762d-abbc-414f-b1c0-35dfdb1c3a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:10.760937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95762d-abbc-414f-b1c0-35dfdb1c3a0a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.761413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95762d-abbc-414f-b1c0-35dfdb1c3a0a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.761880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95762d-abbc-414f-b1c0-35dfdb1c3a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.829752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3b8d-8d93-458f-90a0-cc52fa710361 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:10.852403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95762d-abbc-414f-b1c0-35dfdb1c3a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:10.854296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95762d-abbc-414f-b1c0-35dfdb1c3a0a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:10.916015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:10.916933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:10.917330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:10.917810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:10.919545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=23cdd5d7d6f642f499d34b657383781d) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:10.920105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:10.922914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:10.948364 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 173/348] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:10 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:10.949069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:10.998259 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 176/349] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:11.004756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa602-2a79-41f0-a3c3-4280baebfe35 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.005140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa602-2a79-41f0-a3c3-4280baebfe35 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.005421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa602-2a79-41f0-a3c3-4280baebfe35 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.007072 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 177/350] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:11.007717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fa602-2a79-41f0-a3c3-4280baebfe35 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:11.141215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fa602-2a79-41f0-a3c3-4280baebfe35 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:11.145587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ae7e9-9252-41e4-88a3-8d830c29461f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:11.193435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:11.196234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.196433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.196693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.199764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c92185-1d86-4ef8-b26c-2237a2779c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:11.200642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c92185-1d86-4ef8-b26c-2237a2779c19 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.200920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c92185-1d86-4ef8-b26c-2237a2779c19 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.201190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c92185-1d86-4ef8-b26c-2237a2779c19 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.204357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c92185-1d86-4ef8-b26c-2237a2779c19 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:11.205830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c92185-1d86-4ef8-b26c-2237a2779c19 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:11.207658 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 178/351] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:11 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:11.208876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083490c-a006-4d8b-af10-942eac6b9a46 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.209136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083490c-a006-4d8b-af10-942eac6b9a46 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.211196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083490c-a006-4d8b-af10-942eac6b9a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.226978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:11.235896 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:11.238302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:11.240559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:11.247817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 174/352] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:11.247817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:11.272703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8083490c-a006-4d8b-af10-942eac6b9a46 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:11.273203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8083490c-a006-4d8b-af10-942eac6b9a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:11.389155 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 179/353] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:11.390082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083490c-a006-4d8b-af10-942eac6b9a46 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:11.533050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14f3f-f033-4016-b33b-f9c28c64ef2d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:11.544827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083490c-a006-4d8b-af10-942eac6b9a46 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:11.571949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:11.573186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.573688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.574170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.576426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:11.578912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:11.581174 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 175/354] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:11 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:11.582484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:11.586793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7f22c-0141-4938-a022-64a97b728f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:11.586793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f22c-0141-4938-a022-64a97b728f2c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.586793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f22c-0141-4938-a022-64a97b728f2c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.586793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7f22c-0141-4938-a022-64a97b728f2c None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.587400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f22c-0141-4938-a022-64a97b728f2c None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:11.587400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f22c-0141-4938-a022-64a97b728f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:11.587702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7f22c-0141-4938-a022-64a97b728f2c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:11.599837 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 180/355] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:11.601195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a227-b77d-4243-9e2b-02833cbed770 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.607187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a227-b77d-4243-9e2b-02833cbed770 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.607393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a227-b77d-4243-9e2b-02833cbed770 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.614355 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 181/356] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:11 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:11.615317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a227-b77d-4243-9e2b-02833cbed770 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:11.754749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0c55a-9b1d-4dad-9e00-86be3fd3c84c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:11.767154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a227-b77d-4243-9e2b-02833cbed770 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:11.801940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6aecbd-11a1-4242-ae39-a7783b2245ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:11.803374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aecbd-11a1-4242-ae39-a7783b2245ae None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.803874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aecbd-11a1-4242-ae39-a7783b2245ae None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.804345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6aecbd-11a1-4242-ae39-a7783b2245ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.810627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:11.813142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.813418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.813690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.814817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=23cdd5d7d6f642f499d34b657383781d) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:11.816110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:11.817865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:11.818352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6aecbd-11a1-4242-ae39-a7783b2245ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:11.823747 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 182/357] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:11 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:11.824756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-dd6aecbd-11a1-4242-ae39-a7783b2245ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:11.829604 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:11.830588 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 07 21:30:11.831495 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:11.834169 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 176/358] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:11.835907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6d3e1-1291-4dfc-879c-62b8844ed8f8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:11.836482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6d3e1-1291-4dfc-879c-62b8844ed8f8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:11.837253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6d3e1-1291-4dfc-879c-62b8844ed8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:11.867538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ebb6d3e1-1291-4dfc-879c-62b8844ed8f8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:11.875989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ebb6d3e1-1291-4dfc-879c-62b8844ed8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:11.955017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15887b-f815-4228-b51c-5f8ea905c17e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.029033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.029033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.029333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.029417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.055959 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 177/359] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:12.058792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6d3e1-1291-4dfc-879c-62b8844ed8f8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.152829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:12.154669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:12.206596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6d3e1-1291-4dfc-879c-62b8844ed8f8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.243304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d454-d053-4d3d-9395-ed75cb6b8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.243976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d454-d053-4d3d-9395-ed75cb6b8de0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.244246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d454-d053-4d3d-9395-ed75cb6b8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.244594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d454-d053-4d3d-9395-ed75cb6b8de0 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.246457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d454-d053-4d3d-9395-ed75cb6b8de0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:12.246781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d454-d053-4d3d-9395-ed75cb6b8de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:12.248474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d454-d053-4d3d-9395-ed75cb6b8de0 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:12.258673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 178/360] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:12.262081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b0461-df5d-4ca8-b1f9-d9dbe5603272 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.262366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b0461-df5d-4ca8-b1f9-d9dbe5603272 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.262639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b0461-df5d-4ca8-b1f9-d9dbe5603272 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.264412 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 179/361] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:12.265487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b0461-df5d-4ca8-b1f9-d9dbe5603272 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.278262 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 183/362] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:12.284967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.405175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3189ec6-3fbe-45cf-b351-b2930e558429 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.413361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b0461-df5d-4ca8-b1f9-d9dbe5603272 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.444266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e96e6-c697-4b13-b4fe-8bc52273d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.445211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e96e6-c697-4b13-b4fe-8bc52273d03f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.445576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e96e6-c697-4b13-b4fe-8bc52273d03f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.445761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e96e6-c697-4b13-b4fe-8bc52273d03f None admin] PATH_INFO: `/v3/users/8632c724ab9e47da9fd42651f29ac0bd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.446967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e96e6-c697-4b13-b4fe-8bc52273d03f None admin] RBAC: Authorizing `identity:get_user(user_id=8632c724ab9e47da9fd42651f29ac0bd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:12.448428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e96e6-c697-4b13-b4fe-8bc52273d03f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:12.450299 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 184/363] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/users/8632c724ab9e47da9fd42651f29ac0bd => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:12.451174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bd27-9329-4f5d-a79b-e156572b675f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.451455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bd27-9329-4f5d-a79b-e156572b675f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.451790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bd27-9329-4f5d-a79b-e156572b675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.456920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.458204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.459595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.460091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.470442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a537bd27-9329-4f5d-a79b-e156572b675f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:12.471786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a537bd27-9329-4f5d-a79b-e156572b675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:12.472597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:12.483080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:12.484066 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:12.484877 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:12.488317 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 180/364] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:12.490060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.562382 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 185/365] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:12.563240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537bd27-9329-4f5d-a79b-e156572b675f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.609540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142588-8623-479c-a37f-30b8f30da6a8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.649393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.650624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.651133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.651620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.653005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:12.654677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:12.656855 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 181/366] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:12.657961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.685496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537bd27-9329-4f5d-a79b-e156572b675f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.725119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.725773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.726054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.726321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.727190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] RBAC: Adding query filter params (role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a, user.id=8632c724ab9e47da9fd42651f29ac0bd, scope.system=all) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:12.727495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:12.728955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:12.742161 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 186/367] 10.222.0.32 () {56 vars in 1308 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/role_assignments?user.id=8632c724ab9e47da9fd42651f29ac0bd&scope.system=all&role.id=92f5ed5a59a04cc28b8a5f2fa6a9b44a => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:12.743090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.773172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889d69-ca19-4e55-b7e9-2d3a3b326240 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.809513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.810610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.811148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.811644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.813341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:12.813864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:12.815544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:12.824665 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 182/368] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:12.825893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.851865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ce72e-bd15-4620-a01b-ed88ff25bfbb None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.893040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.893847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.894127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.894403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.909384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:12.920977 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:12.922020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:12.922882 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 187/369] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:12.924295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:12.947002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83063147-8ec6-4d5a-a5cb-81e6e7a1f92e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:12.988970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:12.990255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:12.990852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:12.991326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:12.992711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:12.994381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:12.996810 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 183/370] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:12.997819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.030177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6d56c-5f14-4faf-9454-ebe2561e9c34 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.065197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:13.065840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:13.066126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:13.066394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:13.106533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266947e-88f9-437a-9991-3827722f2dcf None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.141850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:13.143353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:13.145174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:13.146128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:13.146633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:13.147157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:13.148096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:13.148621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:13.150185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:13.161078 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 184/371] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:13.162196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.248643 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 188/372] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:13.249791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.272854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888402a2-f4a3-40c0-a350-4a97d88e3130 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.310345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:13.311427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:13.311974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:13.312460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:13.313484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:13.314002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:13.315682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:13.325642 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 185/373] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:13 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:13.326983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.355939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f392c88-326b-431a-940c-ebf066249523 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.399868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:13.400519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:13.400804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:13.401078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:13.515688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:13.516877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:13.519373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca150e-d3a0-4378-8b35-7405850f2f7c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.583520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:13.584774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:13.585257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:13.585729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:13.587469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:13.589316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:13.599191 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 186/374] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:13 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:13.604436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.625632 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 189/375] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:13.630700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.747738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ff613-8a3d-4739-8447-f8ecdd5e264f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.770296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d44a5-7b92-46e5-b138-62c7967e203f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.830895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:13.831994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:13.832435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:13.832837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] PATH_INFO: `/v3/projects/e2f828af0706465883131e16cb564d05` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:13.834266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] RBAC: Authorizing `identity:get_project(project_id=e2f828af0706465883131e16cb564d05)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:13.835892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:13.838538 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 190/376] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:13 2022] GET /identity/v3/projects/e2f828af0706465883131e16cb564d05 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:13.841980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:13.843185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.846675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:13.848734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:13.853641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:13.855168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:13.856760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:13.861194 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 187/377] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:13 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:13.866030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:13.970199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6a1e0-e914-4fe8-b14a-6d85d5e4fb6d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:13.991917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7ce9f1-046e-43a7-9460-3e6a58c34575 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:14.012907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:14.014103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.014583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.016603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] PATH_INFO: `/v3/groups/27907da530d94c249626bba84153bac0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.022357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] RBAC: Authorizing `identity:get_group(group_id=27907da530d94c249626bba84153bac0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:14.025706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:14.028020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 191/378] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:13 2022] GET /identity/v3/groups/27907da530d94c249626bba84153bac0 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:14.039703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:14.054300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05445b-18f5-40f4-80af-0ded607ee2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:14.054988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05445b-18f5-40f4-80af-0ded607ee2d4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.055262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05445b-18f5-40f4-80af-0ded607ee2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.055554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05445b-18f5-40f4-80af-0ded607ee2d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.056354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05445b-18f5-40f4-80af-0ded607ee2d4 None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:14.056659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05445b-18f5-40f4-80af-0ded607ee2d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:14.058100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05445b-18f5-40f4-80af-0ded607ee2d4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:14.065561 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 188/379] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:13 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:14.067048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aa2f8-f29a-49c6-86bc-df4d5daa69f6 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.067334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aa2f8-f29a-49c6-86bc-df4d5daa69f6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.067604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aa2f8-f29a-49c6-86bc-df4d5daa69f6 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.069179 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 189/380] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:14.074876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192541-1232-4e93-a3c5-6782ad2ca630 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.075187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192541-1232-4e93-a3c5-6782ad2ca630 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.075425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab192541-1232-4e93-a3c5-6782ad2ca630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.094910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ab192541-1232-4e93-a3c5-6782ad2ca630 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:14.096178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab192541-1232-4e93-a3c5-6782ad2ca630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:14.181911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6916e4-c263-4ea6-b105-679afb9bf16e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:14.205010 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 190/381] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:14.242382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:14.243141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.243422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.243692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.245251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] RBAC: Adding query filter params (group.id=27907da530d94c249626bba84153bac0, role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=e2f828af0706465883131e16cb564d05) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:14.245566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:14.247186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:14.262830 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 192/382] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:14 2022] GET /identity/v3/role_assignments?group.id=27907da530d94c249626bba84153bac0&scope.project.id=e2f828af0706465883131e16cb564d05&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:14.268285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192541-1232-4e93-a3c5-6782ad2ca630 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:14.403454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab192541-1232-4e93-a3c5-6782ad2ca630 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:14.444044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:14.445254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.445734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.446223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.458668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:14.467285 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:14.468823 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:14.469649 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:14.472468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 191/383] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:14.478410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:14.632141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031e1c3-67d6-461d-aca8-601e000750c7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:14.675416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a58f3-8e53-4ce1-96ea-beaa6369e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:14.676455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a58f3-8e53-4ce1-96ea-beaa6369e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.677185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a58f3-8e53-4ce1-96ea-beaa6369e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.677746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a58f3-8e53-4ce1-96ea-beaa6369e1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.678827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a58f3-8e53-4ce1-96ea-beaa6369e1d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:14.679356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a58f3-8e53-4ce1-96ea-beaa6369e1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:14.680958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a58f3-8e53-4ce1-96ea-beaa6369e1d5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:14.695300 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 193/384] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:14.700733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:14.822859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba9569-2542-4e3b-a8b6-c729da876ba6 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.823503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba9569-2542-4e3b-a8b6-c729da876ba6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.824012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba9569-2542-4e3b-a8b6-c729da876ba6 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.828774 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 194/385] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:30:14.834710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80de0d-7713-492c-9e6e-ee32885f8c35 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.835288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80de0d-7713-492c-9e6e-ee32885f8c35 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.835762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80de0d-7713-492c-9e6e-ee32885f8c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.867008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2d80de0d-7713-492c-9e6e-ee32885f8c35 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:14.868225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2d80de0d-7713-492c-9e6e-ee32885f8c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:14.871458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0174f09-c524-47a6-b242-f5b9a10f3561 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:14.940573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:14.941382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:14.942811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:14.943106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:14.950799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:14.950799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:14.955933 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 192/386] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:14 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:14.965146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:15.013242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 195/387] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:15.057064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80de0d-7713-492c-9e6e-ee32885f8c35 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:15.095581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44256f5d-942e-4bee-a67b-eaf8fe2c768a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:15.134464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:15.135468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:15.135685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:15.136008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:15.137283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:15.138733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:15.141318 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 193/388] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:14 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:15.147641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:15.193428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80de0d-7713-492c-9e6e-ee32885f8c35 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:15.245425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:15.246606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:15.248115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:15.248403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:15.257254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb10b9d-f0b7-4e6c-940f-35e7acc7d9f1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:15.261185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:15.272965 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:15.273923 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:15.274952 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 196/389] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:30:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:15.283729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:15.329067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:15.329963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:15.330245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:15.330515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:15.332845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=23cdd5d7d6f642f499d34b657383781d, group_id=783a1ecfaa3d4cba891dbac54ebd1d46, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:15.334515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:15.351917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 194/390] 10.222.0.32 () {58 vars in 1442 bytes} [Sat May 7 21:30:15 2022] PUT /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:15.477332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959445a-77ef-45f6-8803-eaf5742d8da4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:15.534823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:15.534823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:15.534823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:15.534823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:15.535643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:15.535643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:15.536948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:15.561297 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 197/391] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:15.566749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:15.718149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e058f2-77c6-4947-9221-250254ef9bc2 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:15.782082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:15.782082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:15.782082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:15.782082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:15.782488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:15.786797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:15.786797 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 195/392] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:15 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:15.792524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:15.968466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee96ba-f098-4447-bf04-e2a9a4d20f2a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:16.012203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b41c81-841d-4bbe-86b8-7e55e6fe11b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:16.013134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41c81-841d-4bbe-86b8-7e55e6fe11b8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:16.013383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41c81-841d-4bbe-86b8-7e55e6fe11b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:16.013660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b41c81-841d-4bbe-86b8-7e55e6fe11b8 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:16.018646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41c81-841d-4bbe-86b8-7e55e6fe11b8 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:16.018646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b41c81-841d-4bbe-86b8-7e55e6fe11b8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:16.018646 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 198/393] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:15 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:16.024733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:16.400819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790eddd-e783-4aa6-9756-7397f475c2f9 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:16.536405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:16.538005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:16.538005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:16.538005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:16.550796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] RBAC: Authorizing `identity:create_grant(project_id=23cdd5d7d6f642f499d34b657383781d, group_id=783a1ecfaa3d4cba891dbac54ebd1d46, role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:16.554792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:16.594843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee0d3-748d-47d0-b998-296cc11efd71 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:16.594843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee0d3-748d-47d0-b998-296cc11efd71 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:16.594843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ee0d3-748d-47d0-b998-296cc11efd71 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:16.597423 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 199/394] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:16.604667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf948-984d-43a7-a583-c11762693747 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:16.605223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf948-984d-43a7-a583-c11762693747 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:16.605749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbf948-984d-43a7-a583-c11762693747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:16.634807 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 196/395] 10.222.0.32 () {58 vars in 1442 bytes} [Sat May 7 21:30:16 2022] PUT /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/0306acbe82504665a6348fd3f25cee0b => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:16.638107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-18dbf948-984d-43a7-a583-c11762693747 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:16.640274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-18dbf948-984d-43a7-a583-c11762693747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:16.785772 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 200/396] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:16.817953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:17.158672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8ecbb-5d6f-4d14-90c3-89f283b66de4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:17.270854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:17.272090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:17.272605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:17.273098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:17.288907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:17.303161 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:17.304156 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:17.304960 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:17.313745 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 197/397] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:17.324134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf948-984d-43a7-a583-c11762693747 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:17.489054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbf948-984d-43a7-a583-c11762693747 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:17.538441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54654293-6695-4073-a12c-3e447643eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:17.539566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654293-6695-4073-a12c-3e447643eeba None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:17.540080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654293-6695-4073-a12c-3e447643eeba None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:17.540556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654293-6695-4073-a12c-3e447643eeba None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:17.546796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654293-6695-4073-a12c-3e447643eeba None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:17.547397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654293-6695-4073-a12c-3e447643eeba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:17.549133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654293-6695-4073-a12c-3e447643eeba None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:17.577161 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 201/398] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:17.587653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:17.660626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8f095-fd3b-4f01-9a24-37a7eca19bfe None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:17.661137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8f095-fd3b-4f01-9a24-37a7eca19bfe None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:17.661137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8f095-fd3b-4f01-9a24-37a7eca19bfe None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:17.662352 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 202/399] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:17.667453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ac5bc-55d5-4790-9748-40489d55782d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:17.667741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ac5bc-55d5-4790-9748-40489d55782d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:17.668023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ac5bc-55d5-4790-9748-40489d55782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:17.715890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-737ac5bc-55d5-4790-9748-40489d55782d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:17.717091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-737ac5bc-55d5-4790-9748-40489d55782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:17.736589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9475ba5-78d5-450c-ae44-132f26221e33 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:17.776243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:17.777568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:17.778065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:17.778546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:17.780164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:17.782382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:17.787527 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 198/400] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:17 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:17.791029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:17.841711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 203/401] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:17.876060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ac5bc-55d5-4790-9748-40489d55782d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:17.901003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed4efa-e496-43b5-b1f1-0306a65e96fa None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:17.939491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:17.940599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:17.941038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:17.941478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:17.942867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:17.944453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:17.950869 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 199/402] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:17 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:17.952395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.006678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ac5bc-55d5-4790-9748-40489d55782d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.047788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.047788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.048062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.048415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.059476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:18.064453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a50c0-aae0-4ed7-b872-9aaf11d898c8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:18.068429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:18.069389 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:18.070453 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 204/403] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:30:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:18.080806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.120251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de4f2-f6f9-4c20-a8c0-0d3479b349fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.122352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de4f2-f6f9-4c20-a8c0-0d3479b349fb None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.122878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de4f2-f6f9-4c20-a8c0-0d3479b349fb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.123356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de4f2-f6f9-4c20-a8c0-0d3479b349fb None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.126364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de4f2-f6f9-4c20-a8c0-0d3479b349fb None admin] RBAC: Authorizing `identity:create_grant(project_id=d1199484c3cc43c0ae54f73bf271c77d, group_id=783a1ecfaa3d4cba891dbac54ebd1d46, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:18.131215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de4f2-f6f9-4c20-a8c0-0d3479b349fb None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:18.159742 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 200/404] 10.222.0.32 () {58 vars in 1442 bytes} [Sat May 7 21:30:17 2022] PUT /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:30:18.161807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060505-749e-459b-ae1b-607347f47110 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.162258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060505-749e-459b-ae1b-607347f47110 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.162672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7060505-749e-459b-ae1b-607347f47110 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.164212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 201/405] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:18.170031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d515-e0da-47a5-a836-de24bec72c30 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.170548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d515-e0da-47a5-a836-de24bec72c30 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.171081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d515-e0da-47a5-a836-de24bec72c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.193184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1ba2d515-e0da-47a5-a836-de24bec72c30 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:18.198270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1ba2d515-e0da-47a5-a836-de24bec72c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:18.295422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526a5f1-63a2-4e38-84c0-38c4a21c3e74 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.340147 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 202/406] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:18.365472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.366166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.366502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.366802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.367569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:18.367873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:18.369381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:18.383674 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 205/407] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:18.389330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2d515-e0da-47a5-a836-de24bec72c30 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.412738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.497770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2d515-e0da-47a5-a836-de24bec72c30 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.523737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f3964-0777-47e8-8ee9-e34409cc210a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.537663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.539015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.539434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.539837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.541200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:18.542813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:18.544878 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 203/408] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:18 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:18.555743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.561211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.562272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.562744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.563186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.573678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:18.581726 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:18.582930 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:18.583797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:18.585982 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 206/409] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:18.592642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.708094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f6083-208f-41b2-96a6-c280ce009c34 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.751153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9b4b6-aeb6-4ebb-be4a-5aaf2783e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.752090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9b4b6-aeb6-4ebb-be4a-5aaf2783e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.752499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9b4b6-aeb6-4ebb-be4a-5aaf2783e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.752902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9b4b6-aeb6-4ebb-be4a-5aaf2783e4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.753833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9b4b6-aeb6-4ebb-be4a-5aaf2783e4e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:18.754282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9b4b6-aeb6-4ebb-be4a-5aaf2783e4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:18.757359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9b4b6-aeb6-4ebb-be4a-5aaf2783e4e9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:18.762890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00712ee5-39bc-4967-8406-9fdee422e609 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.772187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 207/410] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:18.773766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae82f-95b7-4acb-8028-b5d9d4417a25 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.774194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae82f-95b7-4acb-8028-b5d9d4417a25 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.774636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae82f-95b7-4acb-8028-b5d9d4417a25 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.776834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 208/411] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:18.778575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae82f-95b7-4acb-8028-b5d9d4417a25 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.807325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2b5d-d536-495a-ad9c-4ff0d8e1fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.808182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2b5d-d536-495a-ad9c-4ff0d8e1fd7a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.808465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2b5d-d536-495a-ad9c-4ff0d8e1fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.808740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2b5d-d536-495a-ad9c-4ff0d8e1fd7a None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.810856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2b5d-d536-495a-ad9c-4ff0d8e1fd7a None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:18.812940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2b5d-d536-495a-ad9c-4ff0d8e1fd7a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:18.814956 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 204/412] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:18 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:18.816207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214317-de2e-4321-9d48-5aea2cb25b3d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.816490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214317-de2e-4321-9d48-5aea2cb25b3d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.816767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214317-de2e-4321-9d48-5aea2cb25b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.833836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-73214317-de2e-4321-9d48-5aea2cb25b3d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:18.835045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-73214317-de2e-4321-9d48-5aea2cb25b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:18.906414 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 205/413] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:18.906860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae82f-95b7-4acb-8028-b5d9d4417a25 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:18.907330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73214317-de2e-4321-9d48-5aea2cb25b3d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:18.951133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:18.952564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:18.953068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:18.953787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] PATH_INFO: `/v3/groups/27907da530d94c249626bba84153bac0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:18.955928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] RBAC: Authorizing `identity:get_group(group_id=27907da530d94c249626bba84153bac0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:18.957396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:18.959382 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 209/414] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:18 2022] GET /identity/v3/groups/27907da530d94c249626bba84153bac0 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:18.960337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:19.036792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73214317-de2e-4321-9d48-5aea2cb25b3d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:19.079500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:19.080507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e14e0-157f-4839-af41-39ff302ce476 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:19.080991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.081464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.082099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.085347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] RBAC: Authorizing `identity:create_grant(project_id=d1199484c3cc43c0ae54f73bf271c77d, group_id=783a1ecfaa3d4cba891dbac54ebd1d46, role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:19.087336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:19.108572 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 206/415] 10.222.0.32 () {58 vars in 1442 bytes} [Sat May 7 21:30:18 2022] PUT /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d/groups/783a1ecfaa3d4cba891dbac54ebd1d46/roles/0306acbe82504665a6348fd3f25cee0b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:19.110153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:19.122759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:19.123585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.123879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.125195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.136060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:19.144772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:19.145826 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:19.146672 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 210/416] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:19.151944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:19.325674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1bd2-05b9-43bf-83e4-378e15d1ceff None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:19.350798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8ac4c-a374-458e-8794-afd186d08bd4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:19.369446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:19.370325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.370611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.370916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] PATH_INFO: `/v3/projects/e2f828af0706465883131e16cb564d05` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.372571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] RBAC: Authorizing `identity:get_project(project_id=e2f828af0706465883131e16cb564d05)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:19.375201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:19.378316 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 207/417] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:19 2022] GET /identity/v3/projects/e2f828af0706465883131e16cb564d05 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:19.383744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:19.395997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:19.396957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.397413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.397882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.398830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:19.399311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:19.400883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:19.410693 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 211/418] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:19.416742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:19.487968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107dcfc-fb2e-46b8-9e3b-60a68936e1af None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:19.522736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:19.523645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.523927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.524204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] PATH_INFO: `/v3/projects/e2f828af0706465883131e16cb564d05/groups/27907da530d94c249626bba84153bac0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.526467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2f828af0706465883131e16cb564d05, group_id=27907da530d94c249626bba84153bac0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:19.528005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:19.546804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 208/419] 10.222.0.32 () {58 vars in 1442 bytes} [Sat May 7 21:30:19 2022] PUT /identity/v3/projects/e2f828af0706465883131e16cb564d05/groups/27907da530d94c249626bba84153bac0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:19.647921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996a44d-b6c3-40e1-b84f-6017a28198f5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:19.724271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84db5fa-9a23-4bf1-9aa9-4b2b637ea64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:19.725095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84db5fa-9a23-4bf1-9aa9-4b2b637ea64a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.725364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84db5fa-9a23-4bf1-9aa9-4b2b637ea64a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.725697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84db5fa-9a23-4bf1-9aa9-4b2b637ea64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.809392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84db5fa-9a23-4bf1-9aa9-4b2b637ea64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:19.810805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84db5fa-9a23-4bf1-9aa9-4b2b637ea64a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:19.914169 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 212/420] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:19.919501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:19.934849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f70b9-bace-4062-83c6-aef5d140b529 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.935270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f70b9-bace-4062-83c6-aef5d140b529 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.935556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f70b9-bace-4062-83c6-aef5d140b529 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.937644 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 213/421] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:19.943392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b093-d65b-4911-b4bf-e99fab4a5e6a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:19.943683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b093-d65b-4911-b4bf-e99fab4a5e6a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:19.943960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0b093-d65b-4911-b4bf-e99fab4a5e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:19.978280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c9d0b093-d65b-4911-b4bf-e99fab4a5e6a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:19.980957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9d0b093-d65b-4911-b4bf-e99fab4a5e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:20.087479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7b06c-9e9a-4bc7-9570-28724e444fd1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:20.107312 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 214/422] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:20.152066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:20.152952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:20.153236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:20.153573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:20.154792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:20.156267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:20.158262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 209/423] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:19 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:20.162668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b093-d65b-4911-b4bf-e99fab4a5e6a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:20.166348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:20.354558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0b093-d65b-4911-b4bf-e99fab4a5e6a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:20.374249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e1ed-c3be-49b2-b8d9-089b992fed3f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:20.420412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:20.421781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:20.422057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:20.422327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:20.439978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:20.440861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:20.441208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:20.441486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:20.444108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:20.446917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:20.453063 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 210/424] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:20 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:20.459266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:20.459413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:20.467615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:20.468850 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:20.469865 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:20.472035 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 215/425] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:30:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:20.477768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:20.585201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b056a-f95c-4b32-9b01-b96904014601 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:20.619511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:20.620135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:20.620418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:20.620694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:20.621444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:20.621774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:20.623300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:20.632528 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 216/426] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:20.637842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:20.744857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530595ce-a515-42e3-91d6-8dc4c691b43a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:20.779616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:20.781783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:20.783547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:20.786790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:20.812736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8b779-f663-4cb2-96c6-616beecac026 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:20.855945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:20.857564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:20.955571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c27c25-26af-4968-ae08-771683d45f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:20.956167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27c25-26af-4968-ae08-771683d45f4a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:20.956452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27c25-26af-4968-ae08-771683d45f4a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:20.956730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c27c25-26af-4968-ae08-771683d45f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:20.957564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c27c25-26af-4968-ae08-771683d45f4a None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=23cdd5d7d6f642f499d34b657383781d) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:20.957878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c27c25-26af-4968-ae08-771683d45f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:20.959380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c27c25-26af-4968-ae08-771683d45f4a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:20.963906 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 217/427] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:30:20.969302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:20.973051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 211/428] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:20 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 611 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:21.079042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b92512-51c7-4860-9adb-1a1e716b8c44 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:21.104975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba158fb-109d-4af2-884a-f869550d940d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.105291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba158fb-109d-4af2-884a-f869550d940d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.105530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba158fb-109d-4af2-884a-f869550d940d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.107333 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 212/429] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:21.113021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133bff-ca64-457a-b6a4-09ed274f7381 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.113313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133bff-ca64-457a-b6a4-09ed274f7381 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.113703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133bff-ca64-457a-b6a4-09ed274f7381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.116616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:21.117678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.118032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.118527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] PATH_INFO: `/v3/projects/23cdd5d7d6f642f499d34b657383781d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.120087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=23cdd5d7d6f642f499d34b657383781d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:21.121631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:21.125221 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 218/430] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:20 2022] GET /identity/v3/projects/23cdd5d7d6f642f499d34b657383781d => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:21.129933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:21.134803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-62133bff-ca64-457a-b6a4-09ed274f7381 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:21.138807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-62133bff-ca64-457a-b6a4-09ed274f7381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:21.214888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 213/431] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:21.249118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133bff-ca64-457a-b6a4-09ed274f7381 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:21.262795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493b8e1-473f-4ff4-8d87-1164a53a0bf8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:21.298664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:21.302800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.302800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.302800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.302800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:21.302800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:21.309601 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 219/432] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:21 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:21.310533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:21.420113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133bff-ca64-457a-b6a4-09ed274f7381 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:21.434702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e46d1d-0e4b-464c-abce-20732bae8cc2 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:21.456358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:21.457151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.457430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.457701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.477013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:21.479262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:21.479923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.480206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.480478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.481312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=23cdd5d7d6f642f499d34b657383781d) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:21.481623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:21.483116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:21.485541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:21.486443 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:21.487294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 214/433] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:21.490799 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 220/434] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:21 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=23cdd5d7d6f642f499d34b657383781d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:21.492783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:21.618124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b2088-fe94-4cbe-95ce-3b0945a9e2c0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:21.656917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc3a7d-f80b-4638-998a-0476574f11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:21.657600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3a7d-f80b-4638-998a-0476574f11d2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.662073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3a7d-f80b-4638-998a-0476574f11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.662466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc3a7d-f80b-4638-998a-0476574f11d2 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.663329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3a7d-f80b-4638-998a-0476574f11d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:21.663647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3a7d-f80b-4638-998a-0476574f11d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:21.665107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc3a7d-f80b-4638-998a-0476574f11d2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:21.675890 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 215/435] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:30:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:21.682075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:21.843264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035aa359-62d4-4e41-983a-57d43b2fb57d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:21.882714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:21.883486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.884965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.884965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.964951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8e4ad-b842-4b46-aab6-8db75380f2ea None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.964951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8e4ad-b842-4b46-aab6-8db75380f2ea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.965346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8e4ad-b842-4b46-aab6-8db75380f2ea None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.967115 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 216/436] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:30:21.972874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97642cd-8b78-4064-8c66-506df6306905 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:21.973240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97642cd-8b78-4064-8c66-506df6306905 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:21.973605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97642cd-8b78-4064-8c66-506df6306905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:21.974967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:21.976482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:22.000018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b97642cd-8b78-4064-8c66-506df6306905 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:22.001220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b97642cd-8b78-4064-8c66-506df6306905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:22.106207 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 217/437] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:22.120891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 221/438] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:22.126535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97642cd-8b78-4064-8c66-506df6306905 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.131069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.269825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97642cd-8b78-4064-8c66-506df6306905 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.274493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbe081-d2a7-4e04-a95a-100ded97e6b6 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.307146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.308024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.308309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.308584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.309848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:22.311928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:22.313729 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 218/439] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:22.315432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.316457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.316879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.317288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.319393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.332086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:22.340968 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:22.342113 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:22.343179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:22.345606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 222/440] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:22.351090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.424634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153b03-5804-4df2-8552-044f10f7c98f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.456238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd101c-5d0a-483e-be9d-67061d6f0c82 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.458485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.459375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.459656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.459931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.461095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:22.462839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:22.470752 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 219/441] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:22.471964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.493795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.494462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.494743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.495050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.495791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:22.496093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:22.497471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:22.506056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 223/442] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:22.511348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.570267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e5069-c280-4696-adc4-a33410512133 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.604338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239d02f-97d5-49e5-9db0-851f1ff1d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.604991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239d02f-97d5-49e5-9db0-851f1ff1d269 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.605281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239d02f-97d5-49e5-9db0-851f1ff1d269 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.605554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239d02f-97d5-49e5-9db0-851f1ff1d269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.606366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239d02f-97d5-49e5-9db0-851f1ff1d269 None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=5f40f2a9333d485c8324a5707fc69ad2, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:22.606677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239d02f-97d5-49e5-9db0-851f1ff1d269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:22.606992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba77ab-6c59-4d68-8abe-6bde958aa96e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.608159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239d02f-97d5-49e5-9db0-851f1ff1d269 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:22.617099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 220/443] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=5f40f2a9333d485c8324a5707fc69ad2 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:22.617099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fca9-e55d-4722-9c97-cbce2be43c7a None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.617099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fca9-e55d-4722-9c97-cbce2be43c7a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.617099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fca9-e55d-4722-9c97-cbce2be43c7a None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.617099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 221/444] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:22.630821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcd353-1164-41d7-b743-495f3f3f58ff None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.630821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcd353-1164-41d7-b743-495f3f3f58ff None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.630821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcd353-1164-41d7-b743-495f3f3f58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.641110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bdfcd353-1164-41d7-b743-495f3f3f58ff None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:22.641398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.642069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.642320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bdfcd353-1164-41d7-b743-495f3f3f58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:22.642467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.642615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.715191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:22.715774 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 222/445] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:22.720322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:22.740786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcd353-1164-41d7-b743-495f3f3f58ff None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.832964 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 224/446] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:30:22.839027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.856627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcd353-1164-41d7-b743-495f3f3f58ff None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.896241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.898889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.898889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.898889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.909753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:22.918239 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:22.919235 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:22.920050 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 223/447] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:22.925928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:22.948515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98ec2d-776d-4560-9d19-aac35a7f2e5f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:22.988215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:22.989061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:22.989339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:22.989607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] PATH_INFO: `/v3/projects/d1199484c3cc43c0ae54f73bf271c77d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:22.990803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] RBAC: Authorizing `identity:get_project(project_id=d1199484c3cc43c0ae54f73bf271c77d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:22.992310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:22.994077 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 225/448] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/projects/d1199484c3cc43c0ae54f73bf271c77d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:22.999415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:23.036164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df234088-a4ae-49ed-b2dd-787f494d577f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:23.068030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:23.068691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:23.068974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:23.069251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:23.069982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:23.070285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:23.071700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:23.079313 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 224/449] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:23.084838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:23.096258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f8aae-04fc-43d6-85b9-8c4001a17b22 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:23.128638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:23.129488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:23.129771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:23.130046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] PATH_INFO: `/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:23.131263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] RBAC: Authorizing `identity:get_group(group_id=783a1ecfaa3d4cba891dbac54ebd1d46)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:23.132710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:23.134316 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 226/450] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:22 2022] GET /identity/v3/groups/783a1ecfaa3d4cba891dbac54ebd1d46 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:23.141987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:23.178916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ec70d-86a1-41e7-ad6b-45cafcbe4d1f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:23.213365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:23.214104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:23.214392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:23.214668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:23.236968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d336d48-6744-4a28-b30e-65fee686aef8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:23.268799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:23.269378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:23.269653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:23.269922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:23.270734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] RBAC: Adding query filter params (group.id=783a1ecfaa3d4cba891dbac54ebd1d46, role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=d1199484c3cc43c0ae54f73bf271c77d) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:23.271077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:23.272509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:23.278028 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 227/451] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:23 2022] GET /identity/v3/role_assignments?group.id=783a1ecfaa3d4cba891dbac54ebd1d46&scope.project.id=d1199484c3cc43c0ae54f73bf271c77d&role.id=0306acbe82504665a6348fd3f25cee0b => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:23.278214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:23.279769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:23.381473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 225/452] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:30:23.387378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:23.488019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dd933-f5e3-4484-b6b9-2751e1c4ec57 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:23.519948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:23.520729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:23.521006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:23.521278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] PATH_INFO: `/v3/projects/e2f828af0706465883131e16cb564d05` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:23.522464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] RBAC: Authorizing `identity:get_project(project_id=e2f828af0706465883131e16cb564d05)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:23.523964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:23.525803 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 228/453] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:30:23 2022] GET /identity/v3/projects/e2f828af0706465883131e16cb564d05 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:23.532467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:23.630260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb07aa5-84db-4583-a4af-c855425b28d5 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:23.664172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd93ca6-3faa-470e-a34b-cc9daa23aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:23.665021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd93ca6-3faa-470e-a34b-cc9daa23aeea None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:23.665301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd93ca6-3faa-470e-a34b-cc9daa23aeea None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:23.665574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd93ca6-3faa-470e-a34b-cc9daa23aeea None admin] PATH_INFO: `/v3/groups/27907da530d94c249626bba84153bac0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:23.666719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd93ca6-3faa-470e-a34b-cc9daa23aeea None admin] RBAC: Authorizing `identity:get_group(group_id=27907da530d94c249626bba84153bac0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:23.668177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd93ca6-3faa-470e-a34b-cc9daa23aeea None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:23.669773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 226/454] 10.222.0.32 () {56 vars in 1180 bytes} [Sat May 7 21:30:23 2022] GET /identity/v3/groups/27907da530d94c249626bba84153bac0 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:23.676125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:23.770111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc52440-3b90-401d-83a8-df2f0cd728ae None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:23.802885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea6fb1-39e5-4f45-9f6b-d2b5ec0823ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:23.803527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea6fb1-39e5-4f45-9f6b-d2b5ec0823ce None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:23.803813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea6fb1-39e5-4f45-9f6b-d2b5ec0823ce None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:23.804089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea6fb1-39e5-4f45-9f6b-d2b5ec0823ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:23.804911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea6fb1-39e5-4f45-9f6b-d2b5ec0823ce None admin] RBAC: Adding query filter params (group.id=27907da530d94c249626bba84153bac0, role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=e2f828af0706465883131e16cb564d05) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:23.805220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea6fb1-39e5-4f45-9f6b-d2b5ec0823ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:23.806665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea6fb1-39e5-4f45-9f6b-d2b5ec0823ce None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:23.812416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 229/455] 10.222.0.32 () {56 vars in 1376 bytes} [Sat May 7 21:30:23 2022] GET /identity/v3/role_assignments?group.id=27907da530d94c249626bba84153bac0&scope.project.id=e2f828af0706465883131e16cb564d05&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:26.794889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712bf24-e54d-4e9f-ae45-4d9103759567 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:26.796667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712bf24-e54d-4e9f-ae45-4d9103759567 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:26.797383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712bf24-e54d-4e9f-ae45-4d9103759567 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:26.799354 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 227/456] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:26.805043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209263-3297-42e3-b195-7fac09542139 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:26.805735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209263-3297-42e3-b195-7fac09542139 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:26.805735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba209263-3297-42e3-b195-7fac09542139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:26.841696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ba209263-3297-42e3-b195-7fac09542139 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:26.843400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba209263-3297-42e3-b195-7fac09542139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:26.983703 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 230/457] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:27.027261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712bf24-e54d-4e9f-ae45-4d9103759567 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.062325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556418da-82f7-4f8f-a19b-e5df15172a72 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.062609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556418da-82f7-4f8f-a19b-e5df15172a72 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.062813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556418da-82f7-4f8f-a19b-e5df15172a72 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.064429 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 231/458] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:27.069540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8193e0-087a-4ec1-b616-0e3e58cbcd41 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.069830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8193e0-087a-4ec1-b616-0e3e58cbcd41 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.070107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8193e0-087a-4ec1-b616-0e3e58cbcd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.088509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2f8193e0-087a-4ec1-b616-0e3e58cbcd41 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:27.090075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f8193e0-087a-4ec1-b616-0e3e58cbcd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:27.162403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 232/459] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:27.163902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85259ab1-0b11-4b1c-9328-188ff96ad82f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.164209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85259ab1-0b11-4b1c-9328-188ff96ad82f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.164471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85259ab1-0b11-4b1c-9328-188ff96ad82f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.165753 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 233/460] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:27.174795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072e69-dd00-41d8-bc32-659dabadfa12 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.174795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072e69-dd00-41d8-bc32-659dabadfa12 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.174795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072e69-dd00-41d8-bc32-659dabadfa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.175521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712bf24-e54d-4e9f-ae45-4d9103759567 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:27.202799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-73072e69-dd00-41d8-bc32-659dabadfa12 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:27.210365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73072e69-dd00-41d8-bc32-659dabadfa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:27.242748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:27.243843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.244132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.244409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.258837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:27.260301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:27.284633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:27.285537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:27.286377 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:27.286377 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:27.286377 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:27.286377 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:27.286377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 228/461] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:27.290985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.298046 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 234/462] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:27.299232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73072e69-dd00-41d8-bc32-659dabadfa12 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.420193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede3f7-734c-4be5-aa30-622bd9ea1d64 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:27.426581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73072e69-dd00-41d8-bc32-659dabadfa12 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:27.457893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dc8f2-970c-4150-a167-6b7cc188ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:27.458684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dc8f2-970c-4150-a167-6b7cc188ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.458998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dc8f2-970c-4150-a167-6b7cc188ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.459267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dc8f2-970c-4150-a167-6b7cc188ddb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.468280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:27.469499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.469684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dc8f2-970c-4150-a167-6b7cc188ddb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:27.470161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.470662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.471145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dc8f2-970c-4150-a167-6b7cc188ddb1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:27.472027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:27.472553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:27.474626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:27.492323 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 235/463] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:27.492323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-522dc8f2-970c-4150-a167-6b7cc188ddb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:27.492693 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:27.493953 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 229/464] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263495-5bbf-46b4-8e15-f1a0d06a3521 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263495-5bbf-46b4-8e15-f1a0d06a3521 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.495608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263495-5bbf-46b4-8e15-f1a0d06a3521 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.496391 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 230/465] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:27.500097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263495-5bbf-46b4-8e15-f1a0d06a3521 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.608661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263495-5bbf-46b4-8e15-f1a0d06a3521 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:27.609379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7867e5-2486-49a1-af1d-6896a5138ad1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:27.642694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:27.643383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.643665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.643934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.644624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:27.644787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c61e-bea3-4fec-b05c-60db3784507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:27.645564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c61e-bea3-4fec-b05c-60db3784507a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.645851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c61e-bea3-4fec-b05c-60db3784507a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.646064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:27.646217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c61e-bea3-4fec-b05c-60db3784507a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.660715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439c61e-bea3-4fec-b05c-60db3784507a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:27.662228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439c61e-bea3-4fec-b05c-60db3784507a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:27.668373 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 231/466] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:30:27 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:30:27.675996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-c439c61e-bea3-4fec-b05c-60db3784507a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:27.681408 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:27.682419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:27.683333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:27.683333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:27.683333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:27.683333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:27.687300 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 236/467] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:27.688785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30bec-455e-4ccb-8873-d572959ab498 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.689081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30bec-455e-4ccb-8873-d572959ab498 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.689362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd30bec-455e-4ccb-8873-d572959ab498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.711122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3fd30bec-455e-4ccb-8873-d572959ab498 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:27.712666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3fd30bec-455e-4ccb-8873-d572959ab498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:27.797188 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 237/468] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:27.797928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd30bec-455e-4ccb-8873-d572959ab498 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.816925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c961a4-14f1-40dd-8955-f0c452e8a9fc None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:27.854369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:27.855498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.855987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.856528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.857494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:27.858027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:27.859720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:27.873751 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 232/469] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:27.879483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.920600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd30bec-455e-4ccb-8873-d572959ab498 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:27.962230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:27.962925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:27.963207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:27.963479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:27.964223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:27.964524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:27.965957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:27.981326 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 238/470] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:27.982724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:27.996135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377d84f-c0f2-49c1-8dea-f9d60606537f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:28.032649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:28.033829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.034314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.034816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.045221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:28.047045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:28.065267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:28.066147 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:28.067050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:28.067050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:28.067050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:28.067050 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:28.068937 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 233/471] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:28.069910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:28.098150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c10379-6d0b-4bf8-8256-e8e9b57a3592 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:28.132426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:28.133047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.133335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.133622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.134330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:28.135808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:28.165002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 239/472] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:30:27 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:28.165002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:28.206151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189508fa-d9b7-48d6-a8a5-946a5a5d3291 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:28.241851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0be4a9-7d0c-4ecf-8dd1-6576f2cb0afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:28.242713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0be4a9-7d0c-4ecf-8dd1-6576f2cb0afb None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.243122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0be4a9-7d0c-4ecf-8dd1-6576f2cb0afb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.243468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0be4a9-7d0c-4ecf-8dd1-6576f2cb0afb None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.244256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0be4a9-7d0c-4ecf-8dd1-6576f2cb0afb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:28.245885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0be4a9-7d0c-4ecf-8dd1-6576f2cb0afb None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:28.269629 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 234/473] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:30:28 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:28.275621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950deddc-d282-47f0-90d7-6bdace666823 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.275975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950deddc-d282-47f0-90d7-6bdace666823 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.276330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950deddc-d282-47f0-90d7-6bdace666823 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.278231 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 235/474] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:28.284709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49234cb0-1ac8-48e7-8e86-98a8d916d8c5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.285072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49234cb0-1ac8-48e7-8e86-98a8d916d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.285483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49234cb0-1ac8-48e7-8e86-98a8d916d8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.286546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fca29-7e2b-4233-bddb-c2fc48706980 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:28.323090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-49234cb0-1ac8-48e7-8e86-98a8d916d8c5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:28.325029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-49234cb0-1ac8-48e7-8e86-98a8d916d8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:28.326469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:28.327818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.328198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.328476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.329208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:28.329511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:28.334824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:28.345992 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 240/475] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:28.351376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:28.456251 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 236/476] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:28.482039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49234cb0-1ac8-48e7-8e86-98a8d916d8c5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:28.496754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d391-df29-4911-bc57-8394f7b6c3de None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:28.541441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:28.542005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.545138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.545138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.545138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:28.545138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:28.583450 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 241/477] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:30:28 2022] POST /identity/v3/users => generated 249 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:28.625771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49234cb0-1ac8-48e7-8e86-98a8d916d8c5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:28.678637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:28.679457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.679744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.680021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.680890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:28.682325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:28.695354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.sql.core [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 07 21:30:28.695354 ncdv-master-1 devstack@keystone.service[91075]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 07 21:30:28.695354 ncdv-master-1 devstack@keystone.service[91075]: [parameters: {'id': 'c4cfee8d0f194ab1b3d2d6ac96db2c9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 07 21:30:28.695354 ncdv-master-1 devstack@keystone.service[91075]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91075) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result = self._query(query) May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application conn.query(q) May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result.read() May 07 21:30:28.714116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return ref.to_dict() May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:30:28.715159 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application next(self.gen) May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application yield resource May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application next(self.gen) May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.session.rollback() May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.force_reraise() May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise self.value May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application session.commit() May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 07 21:30:28.716123 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._prepare_impl() May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.session.flush() May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._flush(objects) May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application compat.raise_( May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application flush_context.execute() May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rec.execute(self) May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 07 21:30:28.717001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application _emit_insert_statements( May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application c = connection._execute_20( May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ret = self._execute_context( May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 21:30:28.718478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result = self._query(query) May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application conn.query(q) May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result.read() May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 21:30:28.720878 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [parameters: {'id': 'c4cfee8d0f194ab1b3d2d6ac96db2c9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:28.722943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 07 21:30:28.724899 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:28.731658 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 237/478] 10.222.0.32 () {60 vars in 1131 bytes} [Sat May 7 21:30:28 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:28.731813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:28.896953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2d82d-b35a-454d-97d3-7f300f8731f4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:28.933713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1c2ee-88e5-418a-9d7e-4491d679fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:28.934871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c2ee-88e5-418a-9d7e-4491d679fcba None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:28.935157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c2ee-88e5-418a-9d7e-4491d679fcba None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:28.935432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c2ee-88e5-418a-9d7e-4491d679fcba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:28.946464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c2ee-88e5-418a-9d7e-4491d679fcba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-07f1c2ee-88e5-418a-9d7e-4491d679fcba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:28.955218 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:28.956132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 07 21:30:28.956947 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:28.958054 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 242/479] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:30:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:28.963250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:29.084441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053bef-ea6f-4ebf-a325-874afe6665f8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:29.121586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef223-64ae-4f5d-b996-198edfddec3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:29.122645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef223-64ae-4f5d-b996-198edfddec3a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:29.123177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef223-64ae-4f5d-b996-198edfddec3a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:29.123693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef223-64ae-4f5d-b996-198edfddec3a None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:29.124639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cef223-64ae-4f5d-b996-198edfddec3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:29.125146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cef223-64ae-4f5d-b996-198edfddec3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:29.126731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cef223-64ae-4f5d-b996-198edfddec3a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:29.135667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 238/480] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:30.344229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f53b3-0fc0-4873-afbc-ba252267fcfd None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:30.344760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f53b3-0fc0-4873-afbc-ba252267fcfd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:30.344760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f53b3-0fc0-4873-afbc-ba252267fcfd None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:30.346389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 243/481] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:30.352792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97cd4f-3d4a-45f4-8064-dbdf204b868f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:30.353206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97cd4f-3d4a-45f4-8064-dbdf204b868f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:30.353382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97cd4f-3d4a-45f4-8064-dbdf204b868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:30.370680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8f97cd4f-3d4a-45f4-8064-dbdf204b868f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:30.371888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8f97cd4f-3d4a-45f4-8064-dbdf204b868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:30.442880 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 239/482] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:30.462103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f53b3-0fc0-4873-afbc-ba252267fcfd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:30.564417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f53b3-0fc0-4873-afbc-ba252267fcfd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:30.598796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:30.598999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:30.602796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:30.602796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:30.610370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:30.618184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:30.619158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:30.620060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:30.624177 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 244/483] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:30.626158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97cd4f-3d4a-45f4-8064-dbdf204b868f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:30.725173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97cd4f-3d4a-45f4-8064-dbdf204b868f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:30.759704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:30.760379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:30.760663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:30.760934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:30.761675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:30.761977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:30.763377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:30.776092 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 240/484] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:30.777467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:30.878520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7005d-3f20-46e6-ac4f-4798684f143d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:30.917077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:30.917077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:30.917077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:30.917077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:30.926928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:30.928406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:30.945377 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:30.946314 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:30.947242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:30.947242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:30.947242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:30.947242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:30.950972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 245/485] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:30.956042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:31.089402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e7d33-38a4-4070-94ee-40891b4de000 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:31.124232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:31.124901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.125237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.125517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.126231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:31.126534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:31.127928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:31.143804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 241/486] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:31.146517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:31.254843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab871f93-c704-4701-b4eb-2c998167524a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:31.288803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aaf4b-01b7-4473-aeaf-92bbed31ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:31.289589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aaf4b-01b7-4473-aeaf-92bbed31ac14 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.289870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aaf4b-01b7-4473-aeaf-92bbed31ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.290147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aaf4b-01b7-4473-aeaf-92bbed31ac14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.298553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aaf4b-01b7-4473-aeaf-92bbed31ac14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:31.300121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aaf4b-01b7-4473-aeaf-92bbed31ac14 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-003aaf4b-01b7-4473-aeaf-92bbed31ac14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:31.315325 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:31.316240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:31.317187 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:31.318871 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 246/487] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:30:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:31.322462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:31.407997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f797-4ee8-4946-847c-4988c96c03da None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.408530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f797-4ee8-4946-847c-4988c96c03da None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.408530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f797-4ee8-4946-847c-4988c96c03da None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.413662 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 247/488] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:30:31.415326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6906a-f8ae-4778-9971-2fb32e3b24ef None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.415616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6906a-f8ae-4778-9971-2fb32e3b24ef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.415894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6906a-f8ae-4778-9971-2fb32e3b24ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.431317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80036e3e-70fc-4209-9356-920aba2b40ba None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:31.455919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-64f6906a-f8ae-4778-9971-2fb32e3b24ef None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:31.457205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-64f6906a-f8ae-4778-9971-2fb32e3b24ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:31.474355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da31b68-a394-4a50-8f95-f55242e28216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:31.475433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31b68-a394-4a50-8f95-f55242e28216 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.475872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31b68-a394-4a50-8f95-f55242e28216 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.476317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da31b68-a394-4a50-8f95-f55242e28216 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.477857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31b68-a394-4a50-8f95-f55242e28216 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:31.478326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31b68-a394-4a50-8f95-f55242e28216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:31.480512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da31b68-a394-4a50-8f95-f55242e28216 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:31.529148 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 242/489] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:30:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:31.530717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e287c32-0fa0-40a1-8e2e-e24f4f3a45cd None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.531133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e287c32-0fa0-40a1-8e2e-e24f4f3a45cd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.531512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e287c32-0fa0-40a1-8e2e-e24f4f3a45cd None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.537121 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 243/490] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:31.538011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e287c32-0fa0-40a1-8e2e-e24f4f3a45cd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:31.540052 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 248/491] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:31.541553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7521-8e3f-4020-8bc1-aef13e2a7cab None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.541975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7521-8e3f-4020-8bc1-aef13e2a7cab None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.542385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb7521-8e3f-4020-8bc1-aef13e2a7cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.565690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-40cb7521-8e3f-4020-8bc1-aef13e2a7cab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:31.566918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-40cb7521-8e3f-4020-8bc1-aef13e2a7cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:31.646801 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 249/492] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:31.646801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7521-8e3f-4020-8bc1-aef13e2a7cab None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:31.669005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e287c32-0fa0-40a1-8e2e-e24f4f3a45cd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:31.708120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:31.708771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.709056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.709332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.756842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb7521-8e3f-4020-8bc1-aef13e2a7cab None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:31.776178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:31.777653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:31.791018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08407aa-98b5-4ddc-b8df-7029949f4b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:31.791806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08407aa-98b5-4ddc-b8df-7029949f4b98 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.792087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08407aa-98b5-4ddc-b8df-7029949f4b98 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.792360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08407aa-98b5-4ddc-b8df-7029949f4b98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.802704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08407aa-98b5-4ddc-b8df-7029949f4b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f08407aa-98b5-4ddc-b8df-7029949f4b98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:31.812244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:31.813225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:31.814041 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 250/493] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:31.815339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806677-3289-4829-b86e-ebbc42ed2056 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.815339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806677-3289-4829-b86e-ebbc42ed2056 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.815497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806677-3289-4829-b86e-ebbc42ed2056 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.820679 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 251/494] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:31.820679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806677-3289-4829-b86e-ebbc42ed2056 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:31.888787 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 244/495] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:31.890422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:31.917457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806677-3289-4829-b86e-ebbc42ed2056 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:31.950283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48042fab-10a9-43da-b93e-d5e8f291df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:31.951019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48042fab-10a9-43da-b93e-d5e8f291df94 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.951308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48042fab-10a9-43da-b93e-d5e8f291df94 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.951604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48042fab-10a9-43da-b93e-d5e8f291df94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.962055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48042fab-10a9-43da-b93e-d5e8f291df94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-48042fab-10a9-43da-b93e-d5e8f291df94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:31.969799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:31.970732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:31.971599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:31.975579 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 252/496] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:31.975579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0255a91-58da-4182-8809-f5a40ae2cddf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:31.975579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0255a91-58da-4182-8809-f5a40ae2cddf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:31.975579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0255a91-58da-4182-8809-f5a40ae2cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:31.991891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a0255a91-58da-4182-8809-f5a40ae2cddf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:31.993068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a0255a91-58da-4182-8809-f5a40ae2cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:32.000167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d7416-96d5-4cf0-aac4-4564ce32332f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.040351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.041187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.041844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.042122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.043066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:32.043350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.044736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.057604 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 245/497] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:32.057604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.074053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 253/498] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:32.074053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0255a91-58da-4182-8809-f5a40ae2cddf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.182056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ce38-a79c-442c-90d6-890de7d89771 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.192788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0255a91-58da-4182-8809-f5a40ae2cddf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.223977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.224777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.225062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.225339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.238137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.239739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.240401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.240526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.240823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.241081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.241834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:32.242493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.244611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.261018 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 254/499] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:32.265664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:32.272118 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:32.273037 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:32.273909 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:32.273909 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:32.273909 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:32.273909 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:32.276003 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 246/500] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:32.282255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.397700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8264e-2db0-452d-ae12-a1d9e016342f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.401434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63b183-be08-4354-a2bc-59c2b3b10bc6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.432109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.432893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.433179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.433500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.438102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.439475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.439960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.440430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.445902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.447612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.451838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:32.459901 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:32.460808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:32.461925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:32.464749 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 247/501] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:32.465877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:32.469832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:32.471012 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:32.472048 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:32.472048 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:32.472048 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:32.472048 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:32.473377 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 255/502] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:32.474044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.571724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75cfb1-9568-43ba-9472-f14734b13c60 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.583299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbf15c-2c38-45e1-b46e-af3ecabec236 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.608948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeaf5f-caa8-4292-b02e-f1c970db6a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.609739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeaf5f-caa8-4292-b02e-f1c970db6a68 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.610023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeaf5f-caa8-4292-b02e-f1c970db6a68 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.610304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeaf5f-caa8-4292-b02e-f1c970db6a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.619008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.619671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.619946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.620229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.620944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:32.621203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeaf5f-caa8-4292-b02e-f1c970db6a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.621297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.622627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.622739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeaf5f-caa8-4292-b02e-f1c970db6a68 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.635594 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 256/503] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:32.636688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-8eeeaf5f-caa8-4292-b02e-f1c970db6a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:32.640889 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:32.641927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:32.642993 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:32.642993 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:32.642993 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:32.642993 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:32.642993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 248/504] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:32.644265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4132e43-a031-42a0-8aee-01a522800328 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.645653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4132e43-a031-42a0-8aee-01a522800328 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.645653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4132e43-a031-42a0-8aee-01a522800328 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.650365 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 249/505] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:32.650365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4132e43-a031-42a0-8aee-01a522800328 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.746054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bd10c-22d0-44f2-89c1-e429ebea2a86 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.754144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4132e43-a031-42a0-8aee-01a522800328 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.786138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.786974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.787412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.787702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.788445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:32.788752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.790129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.792101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.792101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.792101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.792371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.793596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:32.797830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.799115 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 257/506] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:32.799397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.799939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.814981 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 250/507] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:32.816498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.906257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768da4f-10bf-4763-ac53-58c926942510 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.924673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fe2e-7da6-4092-b0af-649f2cb443a4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:32.940632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b4307-d358-4d42-a4c6-68afa565f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.941423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b4307-d358-4d42-a4c6-68afa565f665 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.941711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b4307-d358-4d42-a4c6-68afa565f665 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.941987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b4307-d358-4d42-a4c6-68afa565f665 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.948576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b4307-d358-4d42-a4c6-68afa565f665 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.950150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b4307-d358-4d42-a4c6-68afa565f665 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.962545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:32.963328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.963679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.964025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.964836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:32.965209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d92b4307-d358-4d42-a4c6-68afa565f665 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:32.965303 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:32.966073 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:32.967008 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 258/508] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:32.967541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:32.968052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e6039-550e-48da-bc28-9757e3432418 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:32.968362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e6039-550e-48da-bc28-9757e3432418 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:32.968524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e6039-550e-48da-bc28-9757e3432418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:32.979363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 251/509] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:32.980186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:32.986548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1a8e6039-550e-48da-bc28-9757e3432418 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:32.988017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1a8e6039-550e-48da-bc28-9757e3432418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:33.056031 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 259/510] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:33.056818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e6039-550e-48da-bc28-9757e3432418 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.096994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a3061-8bcd-4014-ad5d-c1de32e2146d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.133645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.134431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.134711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.135023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.145823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.147349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.166267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e6039-550e-48da-bc28-9757e3432418 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:33.168401 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:33.169374 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:33.170428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:33.170428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:33.170428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:33.170428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:33.170428 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 252/511] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:33.170750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.206635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.207540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.207888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.208226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.216058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.218137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:33.233955 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:33.234944 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:33.236038 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 260/512] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:33.236801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.284400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478199-5142-4a83-84a9-e56b0f1f7c61 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.319904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.320509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.320791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.321063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.321850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:33.322157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.323658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.340102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afa28a-0482-488c-a6a8-025c061e71c5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.343768 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 253/513] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:33.344711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.379331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.380125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.380410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.380696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] PATH_INFO: `/v3/users/glance` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.388475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.389987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:33.405429 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:33.406396 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:33.407997 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 261/514] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:33.408579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.450381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2eb95-077c-4ee8-a254-cfd370f29a9a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.487624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.488417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.488814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.488970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.499473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.500962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.511072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e11e7-3d7d-4498-9aa8-346d41ab846b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:33.518831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:33.519840 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:33.520700 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:33.520700 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:33.520700 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:33.520700 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:33.520700 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 254/515] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:33.520974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.551506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.552621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.552621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.553130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.553854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:33.554223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.555648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.572136 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 262/516] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:33.573067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.623974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd2d6c-2af3-44df-a553-fada79e861e3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.659422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.660218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.660560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.660899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.661803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:33.662172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.663720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.676943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ffdc0-197b-4835-8746-96f7e2d1af25 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.688193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 255/517] 10.222.0.32 () {56 vars in 1137 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:33.688940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.714395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.715173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.715519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.715858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.716743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=8643bb571c514f1fa358526b00ce47ee) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:33.717228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.719400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.725144 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 263/518] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/role_assignments?user.id=8643bb571c514f1fa358526b00ce47ee&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:33.726653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.817507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d3cf-13db-413b-a960-e8ecbcb7d4dd None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.866882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafed91-1beb-4051-9757-8a8deea28a54 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:33.869207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.869974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.870327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.870675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.871849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:33.872270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.875101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.896792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 256/519] 10.222.0.32 () {56 vars in 1137 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:33.898044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:33.912873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:33.913788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:33.914223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:33.914644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:33.915735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:33.916042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:33.917475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:33.933318 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 264/520] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:33.934170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:34.023721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3437f5-5fbb-4bc2-88da-e838cd7a9442 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:34.044772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e976-5b2d-4531-8825-b765f2355897 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:34.069423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:34.070232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:34.070835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:34.071125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:34.083672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:34.085117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:34.094105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:34.095060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:34.095332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:34.095606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:34.105174 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:34.106310 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 07 21:30:34.107455 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:34.108897 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 257/521] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:34.109783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:34.189730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:34.191435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:34.258856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f4283-656d-45bc-90eb-afea6f7e292d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:34.307440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:34.308497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:34.308980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:34.309434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:34.320762 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 265/522] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:34.322334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:34.407139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:34.409079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:34.429894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a95e7-4207-4b21-9166-e5c1747b5be7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:34.470436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:34.471185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:34.471531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:34.471892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:34.472663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:34.474183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:34.502612 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 266/523] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:30:34 2022] POST /identity/v3/users => generated 247 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:34.503477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:34.554636 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 258/524] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:34.555455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:34.640927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d3aa8-f966-4232-bd33-492570cb5d1b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:34.690213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31522b9b-1d86-49ec-bb9c-200764283c29 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:34.695603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:34.696289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:34.696563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:34.696843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:34.697692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:34.697995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:34.699508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:34.758593 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 267/525] 10.222.0.32 () {56 vars in 1139 bytes} [Sat May 7 21:30:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:34.760180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:34.762741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:34.763607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:34.763885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:34.764688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:34.778211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:34.779715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:34.801253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:34.802206 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:34.803143 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:34.803143 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:34.803143 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:34.803143 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:34.808035 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 259/526] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:34.808838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:34.942801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9804bb-2817-4f89-b61c-936696941a31 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:34.968815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87277dfc-7fe3-4382-80a4-2d8c007e8968 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:35.002205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.003409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.005774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.006273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.011208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.011796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.012470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.012663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.028057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.030197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:35.064170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:35.065111 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:35.065967 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:35.065967 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:35.065967 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:35.065967 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:35.073461 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 268/527] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:35.074550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:35.154195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.156511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:35.277903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0dc2-b4f3-457b-a238-050b3c8fb41e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:35.352894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.353917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.354402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 260/528] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:35.355878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:35.356369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.356841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.357842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:35.360817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.362541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:35.390013 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 269/529] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:35.391244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:35.534883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d702a-b53c-4379-86de-e9d98b0a9e61 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:35.536241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede342-8371-4625-a283-cfa146a2d67c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:35.573726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.574926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.575432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.576133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.584103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.584779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.585066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.585339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.586061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:35.586639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.588032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:35.595449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.597186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:35.610373 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 261/530] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:35.611122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:35.617585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:35.618453 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:35.619356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:35.619356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:35.619356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:35.619356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:35.621605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 270/531] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:35.622663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:35.748985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ba10f-c360-4c37-bf3f-e56093b9d2d5 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:35.750240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca0033-baae-4b41-a319-727ca0a52a1f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:35.787007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.788430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.789028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.789605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.791417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.792577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.792691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.792958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.799737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.801541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:35.808282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.809763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:35.818309 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:35.819220 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:35.820096 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:35.822611 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 271/532] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:35.823669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:35.829462 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:35.830407 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:35.831290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 262/533] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:35.831755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:35.950807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af31c5-fd79-4399-bda0-4cb8d9e77c68 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:35.990591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:35.991633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:35.992115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:35.992617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:35.993535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:35.994117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:35.995778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:36.010691 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 272/534] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:36.012271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:36.016870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57271ad-cf40-49e5-bd9d-ac5cf3c08f0c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:36.070601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:36.071281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.071565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.071840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.072622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:36.072933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:36.074382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:36.097511 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 263/535] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:36.099120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:36.152576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f93fb-18a6-4ee5-9586-252fbc4f0ffc None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:36.202761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:36.203674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.203929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.204325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.205204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:36.205584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:36.207135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:36.236290 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 273/536] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:36.237455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:36.243797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5bb3a-7bb0-4059-91e2-02e02efef56f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:36.294215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb3383-6e07-4a13-ba68-c4f3aa216121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:36.296002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3383-6e07-4a13-ba68-c4f3aa216121 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.296002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3383-6e07-4a13-ba68-c4f3aa216121 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.296002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3383-6e07-4a13-ba68-c4f3aa216121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.307033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb3383-6e07-4a13-ba68-c4f3aa216121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:36.308786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb3383-6e07-4a13-ba68-c4f3aa216121 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c5bb3383-6e07-4a13-ba68-c4f3aa216121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:36.328001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:36.329102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:36.330187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:36.336195 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 264/537] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:36.337889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae4dc2-b177-49c1-880d-48b184eb2f02 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.338260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae4dc2-b177-49c1-880d-48b184eb2f02 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.339711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae4dc2-b177-49c1-880d-48b184eb2f02 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.344168 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 265/538] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:36.344168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae4dc2-b177-49c1-880d-48b184eb2f02 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:36.368256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935338c-b920-4468-8ee9-775ae0ceab04 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:36.408709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:36.409369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.409665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.409921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.410742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=0275c43e4d7744b4a556c30662b7e84f) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:36.411089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:36.412594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:36.427386 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 274/539] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:36 2022] GET /identity/v3/role_assignments?user.id=0275c43e4d7744b4a556c30662b7e84f&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:36.428211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:36.468301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae4dc2-b177-49c1-880d-48b184eb2f02 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:36.510067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40e4c9-3b77-40fc-887a-d1fa98a53ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:36.515378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e4c9-3b77-40fc-887a-d1fa98a53ee2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.516675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e4c9-3b77-40fc-887a-d1fa98a53ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.517165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40e4c9-3b77-40fc-887a-d1fa98a53ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.518289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40e4c9-3b77-40fc-887a-d1fa98a53ee2 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=cf4eae7f407e44ecbe525049b262e3a5) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:36.519029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40e4c9-3b77-40fc-887a-d1fa98a53ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:36.520734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40e4c9-3b77-40fc-887a-d1fa98a53ee2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:36.530389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 266/540] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:36 2022] GET /identity/v3/role_assignments?user.id=cf4eae7f407e44ecbe525049b262e3a5&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:36.532339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b74d7-fa6b-4498-b9c6-92ba8cc77f82 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.532885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b74d7-fa6b-4498-b9c6-92ba8cc77f82 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.533369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b74d7-fa6b-4498-b9c6-92ba8cc77f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.569977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5b2b74d7-fa6b-4498-b9c6-92ba8cc77f82 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:36.573717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b2b74d7-fa6b-4498-b9c6-92ba8cc77f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:36.633472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1728bf-3f2f-4d1b-9e8e-41bc669a9769 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:36.713798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:36.714947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:36.717921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:36.718465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:36.720716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:36.721321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:36.724067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:36.753012 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 275/541] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:36.759994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:36.789182 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 267/542] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:36.828102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b74d7-fa6b-4498-b9c6-92ba8cc77f82 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:36.957447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a959a2e-4c57-4f7f-840d-4a4fb9629a7e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:37.008458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b74d7-fa6b-4498-b9c6-92ba8cc77f82 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:37.062795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79aee-82ce-4278-b12c-eb6c724f0bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:37.062795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79aee-82ce-4278-b12c-eb6c724f0bc1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.062795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79aee-82ce-4278-b12c-eb6c724f0bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.062795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79aee-82ce-4278-b12c-eb6c724f0bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.063209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79aee-82ce-4278-b12c-eb6c724f0bc1 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=a71ab917f46d4b419179eccc29a98e38) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:37.063209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79aee-82ce-4278-b12c-eb6c724f0bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:37.065229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79aee-82ce-4278-b12c-eb6c724f0bc1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:37.070793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:37.070793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.070793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.070793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.074798 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 276/543] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:36 2022] GET /identity/v3/role_assignments?user.id=a71ab917f46d4b419179eccc29a98e38&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:37.078797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c154ab-d4e6-4dab-a4c7-146e17018700 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.078797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c154ab-d4e6-4dab-a4c7-146e17018700 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.078797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c154ab-d4e6-4dab-a4c7-146e17018700 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.082815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 277/544] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:37.091347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:37.095582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71838286-d7d1-493f-beca-cf4dc472da39 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.095702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71838286-d7d1-493f-beca-cf4dc472da39 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.098833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71838286-d7d1-493f-beca-cf4dc472da39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:37.102799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:37.104007 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:37.105102 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 268/545] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:37.117941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:37.144035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-71838286-d7d1-493f-beca-cf4dc472da39 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:37.150805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-71838286-d7d1-493f-beca-cf4dc472da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:37.319130 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 278/546] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 07 21:30:37.322798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04694a-9319-4420-8ea1-bd8ad5b4365c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:37.350286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71838286-d7d1-493f-beca-cf4dc472da39 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:37.377436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:37.377973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.378258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.378529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.380049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:37.380049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:37.381787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:37.405118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 269/547] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:37.415825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:37.468072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71838286-d7d1-493f-beca-cf4dc472da39 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:37.511382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:37.513052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.513550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.514623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.526642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:37.537872 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:37.538849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:37.539732 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:37.542450 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 279/548] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:37.549333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:37.685395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e51313-cb05-4da5-8923-d88fd9ef5638 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:37.708715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e89f5-4d87-434e-8731-c808db6fd1dd None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:37.750199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:37.752209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.754683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.756246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.757314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:37.757871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:37.759520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:37.774039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:37.775373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:37.776282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:37.777449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:37.783736 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 280/549] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:37.792466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:37.815820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:37.817306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:37.875740 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:37.876869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:37.878080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:37.878080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:37.878080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:37.878080 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:37.878080 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 270/550] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:37.887802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:37.939356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c034-0b7e-4597-be9f-92e4930874f7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.005300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e2f93-9040-4671-94a4-b8016dd2fefe None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.020979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.022134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.022629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.023160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.043331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.045122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:38.064043 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:38.064974 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:38.065816 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:38.065816 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:38.065816 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:38.065816 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:38.068187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 281/551] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:38.073667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.074419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.074715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.075040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.075777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:38.076084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.077211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:38.078048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.119288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 271/552] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:38.128812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:38.187725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5335-7439-4586-9dd9-a76ec09e37e5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.222961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.223840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.224215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.224636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.225503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:38.225907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.227545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.240479 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 282/553] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:38.245788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:38.411293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359bbd-3e10-4557-aee7-9bfe7d3d0050 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.421875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14c3d-8b2a-4f7c-9ae8-4e351458a3ff None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.481023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.483701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.485389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.486191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.488590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.489372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.489651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.489920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.506795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.506795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.510798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.510798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:38.526288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:38.527307 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:38.528221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:38.529233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 283/554] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:38.534735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:38.541884 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:38.542883 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:38.543817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:38.548624 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 272/555] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:30:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:38.555758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:38.648383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a7b9f-8ee7-4fb5-a5c3-a2599fab0b91 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.683685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.684378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.684652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.687498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.687498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:38.687498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.687803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.710816 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 284/556] 10.222.0.32 () {56 vars in 1135 bytes} [Sat May 7 21:30:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:38.715270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:38.786473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241070b-ebad-4444-af8c-1ba31c6bb5d8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.821050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4fe0b-0d84-4738-b140-2b72deea2240 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:38.870807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.870807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.870807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.870807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.903326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:38.906792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:38.906792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:38.906792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:38.906792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:38.906792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.907279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.957546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:38.959544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:38.962590 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 273/557] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:30:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:38.975834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.070983 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 285/558] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:39.077270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.185587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998db68b-85bc-4187-9270-7627baaa870f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:39.226894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:39.226894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.226894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.226894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.235492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:39.236983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:39.254501 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:39.255448 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:39.256324 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:39.256324 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:39.256324 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:39.256324 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:39.256324 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 286/559] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:39.261362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.369905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c3c3a-b84e-4cc3-8c35-b0a7d10cb9f4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:39.407785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0664dc9-9eaf-4515-83c7-148a5b9227bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:39.408247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0664dc9-9eaf-4515-83c7-148a5b9227bb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.408582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0664dc9-9eaf-4515-83c7-148a5b9227bb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.408763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0664dc9-9eaf-4515-83c7-148a5b9227bb None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.412439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0664dc9-9eaf-4515-83c7-148a5b9227bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:39.412439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0664dc9-9eaf-4515-83c7-148a5b9227bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:39.412655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c164e-eea1-434d-bdb3-82f6ca001784 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:39.412742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0664dc9-9eaf-4515-83c7-148a5b9227bb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:39.428136 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 287/560] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:39.429607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6db6-0a46-49e6-8d39-84a05519292b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.429607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6db6-0a46-49e6-8d39-84a05519292b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.429901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6db6-0a46-49e6-8d39-84a05519292b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.436967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 288/561] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:39.436967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6db6-0a46-49e6-8d39-84a05519292b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.457736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a5e39-793c-49c5-bfb6-c32a609f5280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:39.458967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a5e39-793c-49c5-bfb6-c32a609f5280 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.459486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a5e39-793c-49c5-bfb6-c32a609f5280 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.459966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a5e39-793c-49c5-bfb6-c32a609f5280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.475599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a5e39-793c-49c5-bfb6-c32a609f5280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:39.477355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a5e39-793c-49c5-bfb6-c32a609f5280 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-ff8a5e39-793c-49c5-bfb6-c32a609f5280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:39.501582 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:39.503044 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:39.504082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:39.504082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:39.504082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:39.504082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:39.506387 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 274/562] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 531 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:39.508015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb2046-f2d1-4ee1-b7f6-8c180fa71964 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.508684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb2046-f2d1-4ee1-b7f6-8c180fa71964 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.509163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb2046-f2d1-4ee1-b7f6-8c180fa71964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.527578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c4bb2046-f2d1-4ee1-b7f6-8c180fa71964 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:39.529212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c4bb2046-f2d1-4ee1-b7f6-8c180fa71964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:39.553593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6db6-0a46-49e6-8d39-84a05519292b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:39.603735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03eb13-2a16-48bd-a7a8-e8e4db31d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:39.604531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03eb13-2a16-48bd-a7a8-e8e4db31d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.605091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03eb13-2a16-48bd-a7a8-e8e4db31d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.605091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03eb13-2a16-48bd-a7a8-e8e4db31d1b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.615233 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 275/563] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:39.615233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb2046-f2d1-4ee1-b7f6-8c180fa71964 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.615494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03eb13-2a16-48bd-a7a8-e8e4db31d1b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:39.615494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03eb13-2a16-48bd-a7a8-e8e4db31d1b7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3b03eb13-2a16-48bd-a7a8-e8e4db31d1b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:39.630288 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:39.631244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 289/564] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c05e-f70f-4ea7-89b1-ebfd45cdeb81 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.632204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c05e-f70f-4ea7-89b1-ebfd45cdeb81 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.632907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c05e-f70f-4ea7-89b1-ebfd45cdeb81 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.638127 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 290/565] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:39.639605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2c05e-f70f-4ea7-89b1-ebfd45cdeb81 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.737250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb2046-f2d1-4ee1-b7f6-8c180fa71964 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:39.770298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2c05e-f70f-4ea7-89b1-ebfd45cdeb81 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:39.777414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165a1c6-0c33-4364-82d2-5b78214f8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:39.778087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165a1c6-0c33-4364-82d2-5b78214f8380 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.778639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165a1c6-0c33-4364-82d2-5b78214f8380 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.778966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165a1c6-0c33-4364-82d2-5b78214f8380 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.780314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165a1c6-0c33-4364-82d2-5b78214f8380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:39.780620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165a1c6-0c33-4364-82d2-5b78214f8380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:39.782461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0165a1c6-0c33-4364-82d2-5b78214f8380 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:39.802802 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 276/566] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:39.804284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debff39a-ab5e-46fb-9c57-f439521a06a2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.804603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debff39a-ab5e-46fb-9c57-f439521a06a2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.804894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debff39a-ab5e-46fb-9c57-f439521a06a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.818226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:39.819256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:39.819256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:39.819558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:39.820331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:39.820643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:39.822137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:39.824739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-debff39a-ab5e-46fb-9c57-f439521a06a2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:39.825958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-debff39a-ab5e-46fb-9c57-f439521a06a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:39.842720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 291/567] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:39.842720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.924265 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 277/568] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:39.925056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debff39a-ab5e-46fb-9c57-f439521a06a2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:39.963210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe41a19-52a4-406c-b6a2-05f15f0c728a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.008225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.009021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.009307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.009581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.022436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:40.030799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:40.031789 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:40.032640 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 292/569] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:40.033362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.044845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debff39a-ab5e-46fb-9c57-f439521a06a2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.082345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.083455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.083795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.084078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.091081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:40.092591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:40.106260 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:40.107308 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:40.108178 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 278/570] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:40.109081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.141784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002692-a30c-47df-8fa1-e6592319de8d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.182759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d848d-098a-44e3-ae0c-5208b93f7ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.183390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d848d-098a-44e3-ae0c-5208b93f7ce7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.183712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d848d-098a-44e3-ae0c-5208b93f7ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.183998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d848d-098a-44e3-ae0c-5208b93f7ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.184788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d848d-098a-44e3-ae0c-5208b93f7ce7 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=ddea6c1eb8764f1a9f0a310a78128460) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:40.185095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d848d-098a-44e3-ae0c-5208b93f7ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:40.187097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d848d-098a-44e3-ae0c-5208b93f7ce7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:40.192985 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 293/571] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/role_assignments?user.id=ddea6c1eb8764f1a9f0a310a78128460&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:40.194367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f16a-a7fb-4249-a816-a93fd933ec2d None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.194663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f16a-a7fb-4249-a816-a93fd933ec2d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.194974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1f16a-a7fb-4249-a816-a93fd933ec2d None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.196450 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 294/572] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:40.197084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1f16a-a7fb-4249-a816-a93fd933ec2d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.246863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484c9b2-5ba3-4dc9-8769-d3aad7f6e51e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.287385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.288322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.288670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.289039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.304418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:40.313152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:40.314162 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:40.315117 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:40.319824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 279/573] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:40.320809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.345007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1f16a-a7fb-4249-a816-a93fd933ec2d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.393969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8728c-0604-451f-9572-ecd68681e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.394694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8728c-0604-451f-9572-ecd68681e988 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.395197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8728c-0604-451f-9572-ecd68681e988 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.395483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8728c-0604-451f-9572-ecd68681e988 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.396418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8728c-0604-451f-9572-ecd68681e988 None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:40.396956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8728c-0604-451f-9572-ecd68681e988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:40.399258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8728c-0604-451f-9572-ecd68681e988 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:40.409489 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 295/574] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:40.411943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623135c-ba81-43e8-a7c4-fbfd42338568 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.412400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623135c-ba81-43e8-a7c4-fbfd42338568 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.412825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623135c-ba81-43e8-a7c4-fbfd42338568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.433240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2623135c-ba81-43e8-a7c4-fbfd42338568 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:40.434373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2623135c-ba81-43e8-a7c4-fbfd42338568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:40.445269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b11adf-08be-468b-8273-44bb6cb30215 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.480762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.481428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.482068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.482346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.483825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:40.484130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:40.485586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:40.500000 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 280/575] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:40.501003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.522793 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 296/576] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:40.522793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623135c-ba81-43e8-a7c4-fbfd42338568 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.615865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c3e70-2bf7-42f9-ba55-00617ced3c3d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.637429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623135c-ba81-43e8-a7c4-fbfd42338568 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.652167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.653173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.653663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.654175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.655711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:40.656254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:40.657846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:40.671568 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 281/577] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:40.672448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.676237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.677032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.677375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.677655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.689707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:40.691145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:40.712404 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:40.713376 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:40.714299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:40.714299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:40.714299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:40.714299 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:40.714299 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 297/578] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:40.714584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.792791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09fe16-b2e7-4e60-bfe3-9fc4546594f8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.836104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.836743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9556c38-ef8c-40e6-b06e-12bb8962da72 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:40.838307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.838836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.840087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/8643bb571c514f1fa358526b00ce47ee/roles/77f0d0906e434f6dbaccba585bd68b27` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.856942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=8643bb571c514f1fa358526b00ce47ee, role_id=77f0d0906e434f6dbaccba585bd68b27)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:40.858749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:40.875263 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 282/579] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:30:40 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/8643bb571c514f1fa358526b00ce47ee/roles/77f0d0906e434f6dbaccba585bd68b27 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:40.876472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:40.882294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:40.882294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:40.882294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:40.882294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:40.897603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:40.907783 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:40.908828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:40.909664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:40.912803 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 298/580] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:40.914021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.005527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070284b-2d0f-4d26-8d49-fb6fddd4f0de None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.038868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89f1b9-29cf-4850-95fd-3afb12cd0cc3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.048644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.049461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.052246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.052699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.069565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.071134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.081891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.082984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.085290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.085848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.087238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:41.087766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.089394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.104121 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 299/581] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:41.105296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:41.113931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:41.114929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:41.115820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:41.115820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:41.115820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:41.115820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:41.122414 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 283/582] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:41.123162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.261320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789374c5-327a-4872-a7dc-4e6b025ef75f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.273089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cecb1-54d2-4b29-b400-fb3b27144bdf None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.336576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.337061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.337347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.337625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.338376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:41.338683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.340121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.343716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.347215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.347831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.348330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.361205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.363137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.363972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 300/583] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:41.364902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:41.381736 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:41.382722 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 07 21:30:41.383983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:41.387231 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 284/584] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:41.388230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.526138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b3d05-9a32-464e-ac6c-86f4c8384cfa None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.558364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c368e-3601-452e-8f21-df3df538dc08 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.567017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.568015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.568513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.568998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.570294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:41.570921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.572515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.590016 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 301/585] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:41.591216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.610808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.613301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.613586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.613856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.633707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.638317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:41.662150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:41.663153 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:41.664061 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:41.664061 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:41.664061 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:41.664061 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:41.664686 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 285/586] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:41.667699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.714113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2469de-1c4e-49d1-9a20-af71821fd011 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.753443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.754618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.755189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.755660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.756881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:41.757393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.759069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.780467 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 302/587] 10.222.0.32 () {56 vars in 1137 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:41.781622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.810361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc907d-001e-4952-b5dc-c04ee4173029 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.865107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.865919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.866200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.866473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.877402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.878984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.899854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2690fd-613b-4aa2-bb96-4669bb969b50 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:41.907445 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:41.908399 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:30:41.909340 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:41.913294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 286/588] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:41.914163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:41.956586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:41.957634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:41.958118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:41.958589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:41.959522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:41.960042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:41.961890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:41.976533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 303/589] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:41.977690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.053986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c14ec-1e1c-4de9-bdde-f542ff565ec5 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.094523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed3328-d307-4cec-ae10-c4e30e45069b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.099409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.100653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.101055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.101464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.114274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.116911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.133922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.134962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.135443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.135909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.136948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:42.137480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.139746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.162981 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 304/590] 10.222.0.32 () {56 vars in 1137 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:42.164209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:42.165283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:42.166144 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:42.167082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:42.167082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:42.167082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:42.167082 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:42.175347 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 287/591] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:42.176422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.315831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede9f06-8096-4b51-89bd-ef08b7675c31 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.367430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970262f6-01a6-4eab-b648-a416667e512b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.369551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.370415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.370697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.371077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.392971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.397146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:42.434054 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:42.435323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:42.436783 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:42.436783 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:42.436783 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:42.436783 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:42.436783 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 288/592] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:42.436783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.446277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.447214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.447499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.447774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.465362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.466920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:42.489016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:42.490089 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 07 21:30:42.491127 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:42.493965 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 305/593] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:42.498884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.618868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b919b-fb7e-485d-a1fd-ef7c85bb9e40 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.666796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.666796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.666796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.666796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.667186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:42.667186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.667345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.679565 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 289/594] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:42.680475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.686659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50527c3d-bfec-4459-a2ce-e3e8ba067cb5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.726710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4829a2-b57c-48a6-81df-bebf6fd67425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.727825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4829a2-b57c-48a6-81df-bebf6fd67425 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.728140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4829a2-b57c-48a6-81df-bebf6fd67425 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.728403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4829a2-b57c-48a6-81df-bebf6fd67425 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.729126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4829a2-b57c-48a6-81df-bebf6fd67425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:42.729785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4829a2-b57c-48a6-81df-bebf6fd67425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.731527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4829a2-b57c-48a6-81df-bebf6fd67425 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.749696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 306/595] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:42.751425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5e5b-a7b1-4e78-aa83-37d931d40450 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.751708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5e5b-a7b1-4e78-aa83-37d931d40450 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.751981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de5e5b-a7b1-4e78-aa83-37d931d40450 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.757589 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 307/596] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:42.759692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de5e5b-a7b1-4e78-aa83-37d931d40450 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.800925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de92c0-3517-4ffe-bdb0-3ab569ce1ec4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.844040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.844839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.845191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.845538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.846447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:42.846875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.848687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.867371 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 290/597] 10.222.0.32 () {56 vars in 1139 bytes} [Sat May 7 21:30:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:42.868468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:42.887551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de5e5b-a7b1-4e78-aa83-37d931d40450 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:42.939812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d0114-8770-4a54-9e0a-55416a95b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:42.941163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0114-8770-4a54-9e0a-55416a95b245 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.941538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0114-8770-4a54-9e0a-55416a95b245 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.941842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0114-8770-4a54-9e0a-55416a95b245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:42.952394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d0114-8770-4a54-9e0a-55416a95b245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:42.953955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d0114-8770-4a54-9e0a-55416a95b245 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e16d0114-8770-4a54-9e0a-55416a95b245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:42.971263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:42.972199 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:42.973084 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 308/598] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:42.974736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687aa4-48b5-408e-a541-4916180c8da6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:42.975131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687aa4-48b5-408e-a541-4916180c8da6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:42.975473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687aa4-48b5-408e-a541-4916180c8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.003867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-00687aa4-48b5-408e-a541-4916180c8da6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:43.005138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00687aa4-48b5-408e-a541-4916180c8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:43.013844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dd9b1-3243-444c-9223-704882b49197 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.062924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.064503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.066260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.067689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.081196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.082720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.098988 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 309/599] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:43.098988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687aa4-48b5-408e-a541-4916180c8da6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:43.110745 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:43.111873 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:43.113046 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:43.116693 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 291/600] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:43.119879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.257459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76929901-278b-4e6d-979a-b1eb7d377714 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.265299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687aa4-48b5-408e-a541-4916180c8da6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.308461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.309438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.309779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.310177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.311414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.312072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.312478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.312657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.313403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:43.313724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.315153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.323489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.325307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.327230 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 292/601] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:43.328176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:43.349177 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:43.350141 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:43.351094 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:43.351094 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:43.351094 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:43.351094 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:43.351094 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 310/602] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:43.351373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.457818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e1875-71dd-4485-b93d-1951a615ebb8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.465315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e3879-9369-46e0-a103-79dde98edac2 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.492973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.493764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.494048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.494324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.500876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.501683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.502225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.502503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.503316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:43.503613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.504607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:43.505339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:43.512257 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:43.513210 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:43.514618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 293/603] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:43.516356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.522604 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 311/604] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:43.522604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.620006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023e73-6d1a-47ff-914e-ee20befcbe7a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.628387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beb380-59b7-4465-b9d3-680177396af4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.656388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.657274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.657557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.657827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/0275c43e4d7744b4a556c30662b7e84f/roles/77f0d0906e434f6dbaccba585bd68b27` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.661958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb5e3b-03dd-442b-9228-412945d99400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.662613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5e3b-03dd-442b-9228-412945d99400 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.662932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5e3b-03dd-442b-9228-412945d99400 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.663209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5e3b-03dd-442b-9228-412945d99400 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.663920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb5e3b-03dd-442b-9228-412945d99400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:43.664227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb5e3b-03dd-442b-9228-412945d99400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.665597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb5e3b-03dd-442b-9228-412945d99400 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.671987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=0275c43e4d7744b4a556c30662b7e84f, role_id=77f0d0906e434f6dbaccba585bd68b27)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.673418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.682222 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 312/605] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:43.682222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c6d18-001f-4f79-b32d-3b4a266de691 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.682222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c6d18-001f-4f79-b32d-3b4a266de691 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.682222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c6d18-001f-4f79-b32d-3b4a266de691 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.682222 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 313/606] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:43.682222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c6d18-001f-4f79-b32d-3b4a266de691 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.700937 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 294/607] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:30:43 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/0275c43e4d7744b4a556c30662b7e84f/roles/77f0d0906e434f6dbaccba585bd68b27 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:43.700937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.840447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c6d18-001f-4f79-b32d-3b4a266de691 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.860211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78e794-a515-4e95-9493-77a89c200201 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:43.897309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.897993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.898413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.898545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.899707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:43.899707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.901000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.909894 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 314/608] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:43.910519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28319d3-11bc-4bcb-a8e9-c2ac2b57e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:43.910830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:43.911969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28319d3-11bc-4bcb-a8e9-c2ac2b57e333 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.913160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28319d3-11bc-4bcb-a8e9-c2ac2b57e333 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.913793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28319d3-11bc-4bcb-a8e9-c2ac2b57e333 None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/cf4eae7f407e44ecbe525049b262e3a5/roles/77f0d0906e434f6dbaccba585bd68b27` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.940820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28319d3-11bc-4bcb-a8e9-c2ac2b57e333 None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=cf4eae7f407e44ecbe525049b262e3a5, role_id=77f0d0906e434f6dbaccba585bd68b27)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:43.942289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28319d3-11bc-4bcb-a8e9-c2ac2b57e333 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:43.970799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 295/609] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:30:43 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/cf4eae7f407e44ecbe525049b262e3a5/roles/77f0d0906e434f6dbaccba585bd68b27 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:43.970799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d7ae-b909-4db2-8434-93827d3d34fd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:43.970799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d7ae-b909-4db2-8434-93827d3d34fd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:43.970799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8d7ae-b909-4db2-8434-93827d3d34fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:43.987844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c8e8d7ae-b909-4db2-8434-93827d3d34fd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:43.989693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c8e8d7ae-b909-4db2-8434-93827d3d34fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:44.070025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f22a3-94c6-4d72-8aad-450b5f723b3a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:44.077142 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 296/610] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:44.082124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d7ae-b909-4db2-8434-93827d3d34fd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:44.153932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:44.155920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:44.155920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:44.155920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:44.176585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:44.178158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:44.207040 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:44.207989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:44.208891 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:44.215492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 315/611] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:44.216596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:44.242685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8d7ae-b909-4db2-8434-93827d3d34fd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:44.283672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:44.284823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:44.285116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:44.285396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:44.296575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:44.298887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:44.319125 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:44.320058 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:44.320984 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:44.320984 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:44.320984 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:44.320984 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:44.320984 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 297/612] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:44.321422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:44.448994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630bd9b-eb3c-438d-a669-90edced24809 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:44.488359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:44.489032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:44.489359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:44.489641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:44.491095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:44.491442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:44.492918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:44.506799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 298/613] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:44.507798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:44.520720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a98e9-e6d5-47a5-beaf-141e2c4a1c94 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:44.603419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:44.605577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:44.607184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:44.607754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:44.645026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:44.672542 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:44.673588 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:44.674425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:44.680667 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 316/614] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 464 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:44.683438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:44.744901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd5b89-1bf0-4f8b-8c55-bf88b91c5675 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:44.845093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:44.846394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:44.846949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:44.847405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:44.849317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:44.849954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:44.853480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:44.894069 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 299/615] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:44.896100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:44.964386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a382d-7da1-43fa-b3fa-b99420f61ea4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:45.077842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:45.078655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:45.078988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:45.079268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/a71ab917f46d4b419179eccc29a98e38/roles/77f0d0906e434f6dbaccba585bd68b27` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:45.094328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=a71ab917f46d4b419179eccc29a98e38, role_id=77f0d0906e434f6dbaccba585bd68b27)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:45.096200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:45.108759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59814a73-513b-4686-9ddf-e55a8fda94e6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:45.113201 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 317/616] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:30:44 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/a71ab917f46d4b419179eccc29a98e38/roles/77f0d0906e434f6dbaccba585bd68b27 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:45.114087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:45.175743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:45.177628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:45.179049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:45.179597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:45.180796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:45.182841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:45.187168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:45.215206 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 300/617] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:45.221014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:45.339579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf6eba-7dd5-44a0-90c5-722e16d0dec6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:45.365801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cee8df-b6a4-4dec-a4c2-81d9dded1872 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:45.376069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:45.377161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:45.377663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:45.378137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:45.389666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:45.391508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:45.403166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:45.403967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:45.404279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:45.404558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:45.410916 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:45.411829 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:45.412720 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:45.412720 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:45.412720 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:45.412720 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:45.412942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:45.413433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:45.415428 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 301/618] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:45.420636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:45.428207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:45.429144 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:45.430088 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 318/619] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:45.434876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:45.538063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ae1e9-9c0f-4cdb-9095-5f0efc63a75e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:45.574653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:45.575442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:45.575732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:45.575998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:45.580920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:45.581230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:45.583630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:45.604334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed7f7-b3c4-4457-8cc1-cd1c61885de3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:45.605155 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 319/620] 10.222.0.32 () {56 vars in 1135 bytes} [Sat May 7 21:30:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:45.614108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:45.678729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:45.679750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:45.680236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:45.680706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:45.681646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:45.682193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:45.692047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:45.725126 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 302/621] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:45.735777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:45.786580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3d83d-4093-448a-9c6f-4fc009660a4a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:45.833392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:45.834208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:45.835429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:45.835429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:45.846511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:45.848161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:45.870331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:45.871296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:45.872231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:45.872231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:45.872231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:45.872231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:45.872231 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 320/622] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:45.878005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:45.989024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9295b8-1a46-41b9-b4a9-ddf945b7f1cb None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.008848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857c7a-9bad-4cf0-aed6-41b859d73e51 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.028557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.029887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.030180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.030449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.038041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:46.039580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:46.054831 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:46.055854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:46.056799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 303/623] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:30:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:46.062693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:46.091473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.092692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.092981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.093263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.098792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:46.098792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:46.098792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:46.120540 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 321/624] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:46.130804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:46.270818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430ce1f-b848-4bb9-9ee2-6010172ce119 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.308449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10e548-038a-4363-a5a3-3db41a09fabe None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.314356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647a199-2ab5-41e8-a1a8-72a5fb754975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.315128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647a199-2ab5-41e8-a1a8-72a5fb754975 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.315413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647a199-2ab5-41e8-a1a8-72a5fb754975 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.315693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647a199-2ab5-41e8-a1a8-72a5fb754975 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.316594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647a199-2ab5-41e8-a1a8-72a5fb754975 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:46.322803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647a199-2ab5-41e8-a1a8-72a5fb754975 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:46.322803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647a199-2ab5-41e8-a1a8-72a5fb754975 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:46.338415 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 304/625] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:30:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:46.340583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e41d-2118-4b79-9975-2b44dcf1a9d0 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.340875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e41d-2118-4b79-9975-2b44dcf1a9d0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.341154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e41d-2118-4b79-9975-2b44dcf1a9d0 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.342819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 305/626] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:46.348164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6e41d-2118-4b79-9975-2b44dcf1a9d0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:46.358989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751cd65-82de-4ec8-b715-3c115737058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.359791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751cd65-82de-4ec8-b715-3c115737058a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.360076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751cd65-82de-4ec8-b715-3c115737058a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.360586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751cd65-82de-4ec8-b715-3c115737058a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.369418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751cd65-82de-4ec8-b715-3c115737058a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:46.370956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751cd65-82de-4ec8-b715-3c115737058a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b751cd65-82de-4ec8-b715-3c115737058a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:46.401775 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:46.402757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:46.403997 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:46.411879 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 322/627] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:46.413432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b50a-fc27-4d60-a1f5-384ffad633ac None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.415112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b50a-fc27-4d60-a1f5-384ffad633ac None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.416023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b50a-fc27-4d60-a1f5-384ffad633ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.446301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e28b50a-fc27-4d60-a1f5-384ffad633ac None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:46.448412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e28b50a-fc27-4d60-a1f5-384ffad633ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:46.531316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6e41d-2118-4b79-9975-2b44dcf1a9d0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.578806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 323/628] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:46.578806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b50a-fc27-4d60-a1f5-384ffad633ac None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:46.584468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78e511-b980-45f1-b07b-3ac10f0564a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.588407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78e511-b980-45f1-b07b-3ac10f0564a8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.588769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78e511-b980-45f1-b07b-3ac10f0564a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.589118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78e511-b980-45f1-b07b-3ac10f0564a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.663292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78e511-b980-45f1-b07b-3ac10f0564a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:46.665047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78e511-b980-45f1-b07b-3ac10f0564a8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:46.692878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b50a-fc27-4d60-a1f5-384ffad633ac None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.727341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.727999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.728277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.728554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.729328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:46.729628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:46.731116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:46.742100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 324/629] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:46.742922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:46.773543 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 306/630] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:30:46.774933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05154-e6fb-44d9-83c7-ca7557757c17 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.775213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05154-e6fb-44d9-83c7-ca7557757c17 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.775501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05154-e6fb-44d9-83c7-ca7557757c17 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.781498 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 307/631] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:46.782254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05154-e6fb-44d9-83c7-ca7557757c17 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:46.847621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b75af-b409-4ec1-8cca-55af06d6e0e8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.879991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.880771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.881050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.881318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.883939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05154-e6fb-44d9-83c7-ca7557757c17 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:46.891543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:46.899400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:46.900717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:46.901828 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:46.905205 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 325/632] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:46.906009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:46.923366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cef864-f3c0-4f56-b795-8044daedc620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:46.924168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cef864-f3c0-4f56-b795-8044daedc620 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.924444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cef864-f3c0-4f56-b795-8044daedc620 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.924929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cef864-f3c0-4f56-b795-8044daedc620 None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/ddea6c1eb8764f1a9f0a310a78128460/roles/77f0d0906e434f6dbaccba585bd68b27` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.939234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cef864-f3c0-4f56-b795-8044daedc620 None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=ddea6c1eb8764f1a9f0a310a78128460, role_id=77f0d0906e434f6dbaccba585bd68b27)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:46.940687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cef864-f3c0-4f56-b795-8044daedc620 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:46.953454 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 308/633] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:30:46 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/ddea6c1eb8764f1a9f0a310a78128460/roles/77f0d0906e434f6dbaccba585bd68b27 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:30:46.954671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8880b-3c93-430c-98b2-01fa53ad0c6c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:46.954976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8880b-3c93-430c-98b2-01fa53ad0c6c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:46.955248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8880b-3c93-430c-98b2-01fa53ad0c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:46.973498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b7d8880b-3c93-430c-98b2-01fa53ad0c6c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:46.976946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b7d8880b-3c93-430c-98b2-01fa53ad0c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:47.036885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187e4e0-d2b3-4c22-9f74-91adfe9bd47f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.066847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 309/634] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:47.066847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8880b-3c93-430c-98b2-01fa53ad0c6c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.100973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.102384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.102837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.103355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.119589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.121428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:47.140804 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:47.141774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:47.142870 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:47.142870 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:47.142870 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:47.142870 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:47.149079 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 326/635] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:47.150260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.174969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8880b-3c93-430c-98b2-01fa53ad0c6c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.217559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.218147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.218429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.218704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.219480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:47.219789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.221205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.238865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 310/636] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:47.240214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.261119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca955986-e48f-4f0d-ab0a-2c85839aafa4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.299992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.300814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.301095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.301369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.313749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:47.321560 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:47.322519 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 327/637] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:47.324010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.372504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf59fd0-db3e-478b-961a-bda635a38c93 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.417985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.419104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.419609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.420622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.421546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:47.422480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.424466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.440942 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 311/638] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:47.442210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.450929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237045a3-0dac-4e69-ab79-458e14fc3398 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.485689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.486879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.487368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.487869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.499155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.500914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:47.518927 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:47.519887 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:47.520772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:47.520772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:47.520772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:47.520772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:47.523027 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 328/639] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:47.524062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.554663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59112d8-1bf7-49d2-b9f1-8960cc1aa3ee None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.594674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.595773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.596369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.596846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.597796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:47.598304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.599917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.608888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 312/640] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:47.610046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.648506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7154-501e-4f51-9aa0-60191781dfb2 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.680958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.681743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.682101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.682279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.689510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.691303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:47.705698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:47.706707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:47.707759 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:47.711783 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 329/641] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:47.712645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.719176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d7d29-de1e-42a7-8495-ca9541bdae09 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.753591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.754801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.755309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.755781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.756756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:47.757262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.758934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.771798 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 313/642] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:47.772489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.817412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c9244-f74d-445a-91c7-3b02a92480c4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.855451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05187f0-85a9-428e-9158-e9883a430654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.856239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05187f0-85a9-428e-9158-e9883a430654 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.856524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05187f0-85a9-428e-9158-e9883a430654 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.856798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05187f0-85a9-428e-9158-e9883a430654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.867957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05187f0-85a9-428e-9158-e9883a430654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.869413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05187f0-85a9-428e-9158-e9883a430654 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.872060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed5d29-29b4-44e5-8e77-5ed5b0866b76 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b05187f0-85a9-428e-9158-e9883a430654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:47.887065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:47.888024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:47.889632 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:47.889632 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:47.889632 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:47.889632 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:47.889632 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 330/643] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:47.890500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e56a3b-76d0-4156-b224-8d60f3fa63ca None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.890500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e56a3b-76d0-4156-b224-8d60f3fa63ca None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.890500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e56a3b-76d0-4156-b224-8d60f3fa63ca None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.894812 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 331/644] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:47.894812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e56a3b-76d0-4156-b224-8d60f3fa63ca None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.916225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:47.916975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:47.917266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:47.917605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:47.918390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:47.918699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:47.920215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:47.931653 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 314/645] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:47.932964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:47.995866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e56a3b-76d0-4156-b224-8d60f3fa63ca None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.030151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762aab9-6a84-4890-9857-a986c828223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.030436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a762d35-bc0c-4e47-b0d9-cd9e6eb621c3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.030974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762aab9-6a84-4890-9857-a986c828223a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.031258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762aab9-6a84-4890-9857-a986c828223a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.031532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762aab9-6a84-4890-9857-a986c828223a None admin] PATH_INFO: `/v3/users/glance` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.038272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762aab9-6a84-4890-9857-a986c828223a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.039844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762aab9-6a84-4890-9857-a986c828223a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d762aab9-6a84-4890-9857-a986c828223a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:48.054119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:48.055132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:48.056112 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 332/646] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:48.056736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063c685-71c6-4bf5-b796-2f7d1fe0654a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.057312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063c685-71c6-4bf5-b796-2f7d1fe0654a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.057312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063c685-71c6-4bf5-b796-2f7d1fe0654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.068270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.069042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.069391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.069737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.070525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:48.070944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.072411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.073768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e063c685-71c6-4bf5-b796-2f7d1fe0654a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:48.074972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e063c685-71c6-4bf5-b796-2f7d1fe0654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:48.086445 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 315/647] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:48.087372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.142161 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 333/648] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:48.143625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063c685-71c6-4bf5-b796-2f7d1fe0654a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.192368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb2561-e3c1-473f-8997-cda2abe4c30a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.227327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.227981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.228266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.228540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.229365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=8643bb571c514f1fa358526b00ce47ee) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:48.229672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.231121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.238127 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 316/649] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/role_assignments?user.id=8643bb571c514f1fa358526b00ce47ee&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:48.238840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.268784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063c685-71c6-4bf5-b796-2f7d1fe0654a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.320653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.321347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.321637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.322555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.323474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:48.323785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.325725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.348583 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 334/650] 10.222.0.32 () {56 vars in 1137 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:48.349625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.357005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7718ed-481b-4b38-818d-ecbbdfea16be None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.404335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.405667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.406015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.406579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.417378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.419634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:48.442295 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:48.443363 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:48.444449 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 317/651] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:48.446886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.454381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d14cd-738c-441c-888b-0000e7d340dc None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.489718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.490510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.492142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.492142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.504454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:48.512535 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:48.513540 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:48.514959 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 335/652] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:48.515687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.551690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e474f-6da5-4a2c-a62a-3c2c2d210b14 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.587727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.588376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.588679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.588956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.623339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f70c45-7641-4f9c-bafc-9e9c8cf4932d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.649774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.650443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.650728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.651034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.651863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:48.652171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.653624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.660020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.661467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.671548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 336/653] 10.222.0.32 () {56 vars in 1137 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:48.672385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.762353 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 318/654] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:48.763246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.776885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c0212-1141-4c3c-9f92-4fb2325a2248 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.811359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.811951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.812234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.812508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.813259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:48.813565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.814968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.823574 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 337/655] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:48.824462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:48.866385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f3e9-b41d-4235-a7aa-a5e3062840d6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.903063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.903720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.904004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.904893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.930335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a1894-f58c-480c-aae3-aecafd4219da None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:48.964391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:48.964914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:48.965188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:48.965455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:48.978763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.979849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:48.980450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:48.981249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:49.004263 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:49.006065 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:49.007907 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:49.007907 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:49.007907 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:49.007907 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:49.010234 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 338/656] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:49.011129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.103257 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 319/657] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:49.104608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.120333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf456017-a9c5-4b94-a72e-c9d5f7a7c436 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.153626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.155066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.155350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.158806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.166219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.167755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:49.185351 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:49.187410 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:49.189472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:49.189472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:49.189472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:49.189472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:49.189472 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 339/658] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:49.189472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.214855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029ac88-0ba4-496b-a7a0-ecdee133a2aa None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.253417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.254245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.254531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.255155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.256165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:49.256473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.258059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.272300 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 320/659] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:49.273512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.305316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a10fe2-65cd-4aaf-8910-6d03ad76997a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.349329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.350122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.350404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.350678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.365640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.367589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.376488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a670ba-16bc-479e-a2aa-3bcaef282f10 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:49.389906 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:49.391227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:49.392197 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:49.392197 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:49.392197 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:49.392197 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:49.392197 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 340/660] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:49.398793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.414682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.415510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.415797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.416148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.416779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:49.417085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.418451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.430789 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 321/661] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:49.431613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.505282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20725-6b53-475f-8288-cbcde5e13015 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.528547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed8c11-fa4e-4da2-ad2c-38776313aed7 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.536765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136f182-dd46-45b0-856d-50c812316ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.537556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136f182-dd46-45b0-856d-50c812316ec2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.537839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136f182-dd46-45b0-856d-50c812316ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.538111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136f182-dd46-45b0-856d-50c812316ec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.545336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136f182-dd46-45b0-856d-50c812316ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.546879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136f182-dd46-45b0-856d-50c812316ec2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-2136f182-dd46-45b0-856d-50c812316ec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:49.561281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:49.562193 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:49.563742 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:49.564169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.564169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.564350 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 341/662] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:49.564421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.564490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494954d-cd93-4845-9fc2-f5417569a8f4 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.564490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494954d-cd93-4845-9fc2-f5417569a8f4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.564490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494954d-cd93-4845-9fc2-f5417569a8f4 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.569756 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 342/663] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:49.569756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494954d-cd93-4845-9fc2-f5417569a8f4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.572402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.572402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:49.572402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.572402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.588896 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 322/664] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:49.588896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.671003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494954d-cd93-4845-9fc2-f5417569a8f4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.688376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2426-e41d-47be-8781-0ab73f8acb3d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.704051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64446c-944c-43b6-9bfd-e529b51d3865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.704855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64446c-944c-43b6-9bfd-e529b51d3865 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.705141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64446c-944c-43b6-9bfd-e529b51d3865 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.705419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64446c-944c-43b6-9bfd-e529b51d3865 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.712904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64446c-944c-43b6-9bfd-e529b51d3865 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.714396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64446c-944c-43b6-9bfd-e529b51d3865 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.722253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.722942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.723225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.723496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.724254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:49.724558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.726126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-4c64446c-944c-43b6-9bfd-e529b51d3865 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:49.729463 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:49.730416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:49.731423 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 343/665] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:49.733086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c4d82-77f8-4987-a780-d30b7c02d45c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.733086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c4d82-77f8-4987-a780-d30b7c02d45c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.733269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c4d82-77f8-4987-a780-d30b7c02d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.744201 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 323/666] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:49.744201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.749587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-da7c4d82-77f8-4987-a780-d30b7c02d45c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:49.750751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-da7c4d82-77f8-4987-a780-d30b7c02d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:49.830797 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 344/667] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:49.830797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c4d82-77f8-4987-a780-d30b7c02d45c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.854949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e782-9419-4278-913e-5721ad5e3c9a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.887219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.887950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.888255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.889067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.899081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.900537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:49.914065 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:49.915019 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 324/668] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:49.916039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:49.927305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c4d82-77f8-4987-a780-d30b7c02d45c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:49.966043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:49.967579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:49.968040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:49.968484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:49.969495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:49.969801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:49.971275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:49.988373 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 345/669] 10.222.0.32 () {56 vars in 1139 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:49.989176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.023724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc975c-6ffc-4178-b42a-d8c610a8ce5c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.056561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.057213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.057495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.057829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.058610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=0275c43e4d7744b4a556c30662b7e84f) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:50.058955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.060426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.075065 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 325/670] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/role_assignments?user.id=0275c43e4d7744b4a556c30662b7e84f&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:50.075065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.110053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec394-c89d-4abe-9e0b-194c2efb75df None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.156557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.157621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.158000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.158373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.169947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:50.178526 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:50.179587 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:50.180449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 346/671] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:50.181292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.190238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b8009-ae07-4123-b4c2-48691267c557 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.232805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.233618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.233947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.234224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.235223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:50.235537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.238156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.257280 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 326/672] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:50.258639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.316148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797de2d-7351-44fc-95be-68c488e3da8e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.358208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.359216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.359661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.359941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.388853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db89bf-d967-4f96-894a-c54f614bad91 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.428309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.429347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.429877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.430162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.431002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:50.431304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.432848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.436015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.437538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.443830 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 327/673] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:50.444740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.543665 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 347/674] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:50.549231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.557994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a935646-334b-492c-a12c-d14a5f7310e9 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.592418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.593174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.593511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.593804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.594696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=cf4eae7f407e44ecbe525049b262e3a5) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:50.595042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.596568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.611086 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 328/675] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/role_assignments?user.id=cf4eae7f407e44ecbe525049b262e3a5&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:50.612125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.655878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c251f0-0622-4022-bd63-096d8d9d310e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.691511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.692226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.692509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.692783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.704313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.705794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:50.724050 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:50.725011 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:50.725916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:50.725916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:50.725916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:50.725916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:50.725916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 348/676] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:50.731294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.792918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07ba3f-ceda-4f43-a7a3-af70808692a2 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.843833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b009-9204-46ab-bf5a-4937e869ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.844644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b009-9204-46ab-bf5a-4937e869ad38 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.844931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b009-9204-46ab-bf5a-4937e869ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.845209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b009-9204-46ab-bf5a-4937e869ad38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.856719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b009-9204-46ab-bf5a-4937e869ad38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.858801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b009-9204-46ab-bf5a-4937e869ad38 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.869279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a120eb4-a0a6-4662-848a-65c70307dcba None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-0266b009-9204-46ab-bf5a-4937e869ad38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:50.876854 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:50.877826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:50.878721 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:50.878721 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:50.878721 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:50.878721 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:50.878721 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 329/677] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:50.882805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14034f-69a2-41ad-921f-b132372ed8ea None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.882805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14034f-69a2-41ad-921f-b132372ed8ea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.882805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14034f-69a2-41ad-921f-b132372ed8ea None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.885756 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 330/678] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:50.886564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14034f-69a2-41ad-921f-b132372ed8ea None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:50.924157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12998311-88fb-42dd-91eb-d2dc61ed1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:50.924822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998311-88fb-42dd-91eb-d2dc61ed1d69 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.925106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998311-88fb-42dd-91eb-d2dc61ed1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.925443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12998311-88fb-42dd-91eb-d2dc61ed1d69 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.926192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12998311-88fb-42dd-91eb-d2dc61ed1d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:50.926498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12998311-88fb-42dd-91eb-d2dc61ed1d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:50.927915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12998311-88fb-42dd-91eb-d2dc61ed1d69 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:50.941782 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 349/679] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:50.943697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4112-bdd4-4138-bd98-77cc0f5d1598 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:50.944263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4112-bdd4-4138-bd98-77cc0f5d1598 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:50.944549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e4112-bdd4-4138-bd98-77cc0f5d1598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:50.964262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-377e4112-bdd4-4138-bd98-77cc0f5d1598 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:50.965472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-377e4112-bdd4-4138-bd98-77cc0f5d1598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:51.008596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14034f-69a2-41ad-921f-b132372ed8ea None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.049163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.050324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.050933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.051411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.052305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 350/680] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:51.052486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:51.052968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.054617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.059141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4112-bdd4-4138-bd98-77cc0f5d1598 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.079052 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 331/681] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:51.083110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.188909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e4112-bdd4-4138-bd98-77cc0f5d1598 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.189805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad41a2-1545-4805-be26-5988b4e71940 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.226814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.228171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.228787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.229333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.229661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.230453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.230730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.231080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.238451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.240211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.243175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:51.254497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:51.255615 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:51.256492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:51.257158 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:51.258014 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:51.259002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:51.262004 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 332/683] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:51.263038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.263520 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 351/683] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:51.264989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.365314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229125e-e69b-47c6-b2a7-745b1aef5bbb None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.370112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3467-fceb-44f8-81dc-15f79504d7ed None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.400072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.401286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.401896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.402510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.405781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.406439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.406721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.407050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.407945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:51.408254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.409713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.412883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.414561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.428419 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 352/684] 10.222.0.32 () {56 vars in 1135 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:51.429348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:51.431090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:51.432328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:51.433225 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:51.436202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 333/685] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:51.437267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.534367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868c224-53be-4981-8731-68350b1ed3f7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.538567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a6642-b570-44c9-b7de-5cc9ed2fe8d1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.568610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.569300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.569774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.569896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.570560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:51.570921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.572280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.575456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.576928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.577420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.577912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.581333 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 353/686] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:51.582490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.652482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.654323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.683248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2527af-37e7-467b-b2f8-81b4b2601398 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.716716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.717383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.717772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.718052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.718885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:51.719234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.720688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.739729 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 354/687] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:51.740658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.757160 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 334/688] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 21:30:51.758239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.842613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc310a-db88-44c7-a510-4dc320f496fc None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.858077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c94f3e-c120-4c45-95b1-423fbba6542a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:51.881719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.882515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.882814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.883105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.893709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.894877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:51.895310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.896266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:51.896767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:51.897244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:51.898430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=a71ab917f46d4b419179eccc29a98e38) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:51.899002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:51.900692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:51.907840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 335/689] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/role_assignments?user.id=a71ab917f46d4b419179eccc29a98e38&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:51.908928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:51.925343 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:51.926334 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:51.927338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:51.927338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:51.927338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:51.927338 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:51.934259 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 355/690] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:51.935358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.024169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b15e-bcf7-4abb-8353-bae043c75cf9 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.060792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.061985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.062492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.063008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.073658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34f758-aac4-4694-aec6-b4966115dfdb None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.075103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.077550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:52.097497 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:52.098504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:52.099842 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:52.099842 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:52.099842 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:52.099842 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:52.102072 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 336/691] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:52.109683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.136542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.137311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.137514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.137774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.138550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:52.138896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.140333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.158029 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 356/692] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:52.159096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.230820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c4297-aab0-4514-bde7-4f00a58d49d4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.266181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.267394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.267909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.268413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.269345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:52.269872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82950-6c71-47a3-a98b-8307aae92534 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.270308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.271950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.285442 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 337/693] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:52.290500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.305445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.307246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.307246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.307246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] PATH_INFO: `/v3/users/nova` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.317617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.319677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:52.334995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:52.336420 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:52.337397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:52.342034 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 357/694] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:52.343650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.400211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ab46-0efe-4bde-bc66-eee70c06a57b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.435012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.437180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.437668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.438148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.445091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.445850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021a1e7-e5e0-4f93-b1fa-1b4f9af1253d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.447027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:52.461350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:52.462320 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:52.463259 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:52.465750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 338/695] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:52.471039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.480708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.482640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.483208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.483694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.485074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:52.485864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.487871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.513636 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 358/696] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:52.523977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.585726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688bea-c4ea-4b30-88b1-0d7e458b97bc None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.620301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.621265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.621785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.622268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.623839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:52.624357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.625620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4452-77fe-469e-bad8-6dfd58533e52 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.626521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.639402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 339/697] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:52.644725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.661181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cb885-5598-48cb-96b2-a7afac6fd4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.661758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb885-5598-48cb-96b2-a7afac6fd4dd None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.662042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb885-5598-48cb-96b2-a7afac6fd4dd None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.662358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb885-5598-48cb-96b2-a7afac6fd4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.732866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cb885-5598-48cb-96b2-a7afac6fd4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.734349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cb885-5598-48cb-96b2-a7afac6fd4dd None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.772513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714165d5-1aa7-4126-82e5-a062b329cb7f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:52.817797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:52.819168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.819679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.820161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.821654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=ddea6c1eb8764f1a9f0a310a78128460) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:52.822181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:52.824305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:52.833711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 340/698] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/role_assignments?user.id=ddea6c1eb8764f1a9f0a310a78128460&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:52.841331 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 359/699] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:30:52.841593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:52.869261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e968b-b312-4562-9a0e-d3b656722f73 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.869605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e968b-b312-4562-9a0e-d3b656722f73 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.869835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e968b-b312-4562-9a0e-d3b656722f73 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.874916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 360/700] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:30:52.878136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559805-f0b1-4016-aef5-da92b59620cf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:52.878335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559805-f0b1-4016-aef5-da92b59620cf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:52.878665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559805-f0b1-4016-aef5-da92b59620cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:52.897270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b6559805-f0b1-4016-aef5-da92b59620cf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:52.898503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b6559805-f0b1-4016-aef5-da92b59620cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:52.970673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56208c7d-82cd-45b2-a873-e97f3d877836 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.006925 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 361/701] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:53.024868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.025680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.026027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.026307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.041256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.042755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:53.063737 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:53.064728 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:53.065628 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:53.065628 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:53.065628 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:53.065628 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:53.069705 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 341/702] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:53.071210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6559805-f0b1-4016-aef5-da92b59620cf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.097053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.202169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6559805-f0b1-4016-aef5-da92b59620cf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.241789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fa7a-f61c-40ca-8b2d-ba2e797458f2 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.260535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.261547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.262044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.262549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.265067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:53.265625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.267363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.277746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.277746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.277746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.278107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.290392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.290728 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 362/703] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:53.291656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.292673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:53.311830 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:53.312821 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:53.313732 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:53.313732 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:53.313732 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:53.313732 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:53.315175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 342/704] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:53.319725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.413321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03742e34-c52d-4f89-bbd1-d17c36d98052 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.442813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbc07f-3ea3-44d2-8744-ed306f6b89a4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.450282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6686a-302d-49b5-9a0a-ae0c21a1bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.451232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6686a-302d-49b5-9a0a-ae0c21a1bc56 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.451583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6686a-302d-49b5-9a0a-ae0c21a1bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.451927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6686a-302d-49b5-9a0a-ae0c21a1bc56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.458799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6686a-302d-49b5-9a0a-ae0c21a1bc56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.460399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6686a-302d-49b5-9a0a-ae0c21a1bc56 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-bcc6686a-302d-49b5-9a0a-ae0c21a1bc56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:53.475469 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:53.476400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:53.477319 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:53.481716 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 363/705] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:53.483944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96f44b-486d-4d94-bfa6-1a0d801930a2 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.484234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96f44b-486d-4d94-bfa6-1a0d801930a2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.484510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96f44b-486d-4d94-bfa6-1a0d801930a2 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.484831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f406-3db7-4dd3-9e85-bbda9e7bb607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.485735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f406-3db7-4dd3-9e85-bbda9e7bb607 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.486228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f406-3db7-4dd3-9e85-bbda9e7bb607 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.486703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f406-3db7-4dd3-9e85-bbda9e7bb607 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.487644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f406-3db7-4dd3-9e85-bbda9e7bb607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:53.488151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f406-3db7-4dd3-9e85-bbda9e7bb607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.489734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f406-3db7-4dd3-9e85-bbda9e7bb607 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.489845 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 364/706] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:53.490535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96f44b-486d-4d94-bfa6-1a0d801930a2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.503877 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 343/707] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:53.505415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391dc82-b933-4f0f-87c3-41222d84c1d2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.505930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391dc82-b933-4f0f-87c3-41222d84c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.506428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391dc82-b933-4f0f-87c3-41222d84c1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.526355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7391dc82-b933-4f0f-87c3-41222d84c1d2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:53.527880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7391dc82-b933-4f0f-87c3-41222d84c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:53.603711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 344/708] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:53.603711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391dc82-b933-4f0f-87c3-41222d84c1d2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.640479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96f44b-486d-4d94-bfa6-1a0d801930a2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.677967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.679048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.679560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.680057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.681095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:53.681606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.684692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.702260 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 365/709] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:53.703651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.712155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391dc82-b933-4f0f-87c3-41222d84c1d2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.747121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.747642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.747930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.748205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.748910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.750354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.779524 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 345/710] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:30:53 2022] POST /identity/v3/users => generated 254 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:53.782486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:53.843721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c01cf-678d-4f50-a049-81ad96755bc1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:53.916758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:53.918029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:53.918569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:53.919075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:53.920514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:53.923780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:53.949764 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:53.951852 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:30:53.952721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:53.958803 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 366/711] 10.222.0.32 () {56 vars in 1129 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:53.965151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:54.007579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0b5f9-6c3e-4b7f-962c-360f9512ac4d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:54.062233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:54.063332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:54.063870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:54.064369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:54.065458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=758d4dea899344b883971712aebe042f, user.id=8643bb571c514f1fa358526b00ce47ee) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:54.066057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:54.067866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:54.076748 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 346/712] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/role_assignments?user.id=8643bb571c514f1fa358526b00ce47ee&scope.project.id=758d4dea899344b883971712aebe042f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:54.090344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279b867-fb91-43aa-90bf-40c4c65dd367 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:54.127497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cbf08-3909-4b7d-b737-dd3ef920da41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:54.128175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cbf08-3909-4b7d-b737-dd3ef920da41 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:54.128462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cbf08-3909-4b7d-b737-dd3ef920da41 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:54.128737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cbf08-3909-4b7d-b737-dd3ef920da41 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:54.129447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cbf08-3909-4b7d-b737-dd3ef920da41 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:54.129757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cbf08-3909-4b7d-b737-dd3ef920da41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:54.131446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cbf08-3909-4b7d-b737-dd3ef920da41 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:54.136819 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 367/713] 10.222.0.32 () {56 vars in 1124 bytes} [Sat May 7 21:30:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:30:54.142636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:54.271131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758384d-751d-4f83-bbb5-ea77d8391962 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:54.305977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e2304-d7ac-44a4-ae3c-20c40e16ed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:54.306588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e2304-d7ac-44a4-ae3c-20c40e16ed7d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:54.306894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e2304-d7ac-44a4-ae3c-20c40e16ed7d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:54.307171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e2304-d7ac-44a4-ae3c-20c40e16ed7d None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:54.307878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e2304-d7ac-44a4-ae3c-20c40e16ed7d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:54.308177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e2304-d7ac-44a4-ae3c-20c40e16ed7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:54.309546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e2304-d7ac-44a4-ae3c-20c40e16ed7d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:54.316476 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 347/714] 10.222.0.32 () {56 vars in 1124 bytes} [Sat May 7 21:30:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:54.886735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893ee1-1ddf-4496-8609-7bc728c47999 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:54.887785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893ee1-1ddf-4496-8609-7bc728c47999 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:54.888817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893ee1-1ddf-4496-8609-7bc728c47999 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:54.890674 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 368/715] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:54.896242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7565-2f5f-4448-910b-6876e57021fa None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:54.898856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7565-2f5f-4448-910b-6876e57021fa None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:54.898856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7565-2f5f-4448-910b-6876e57021fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:54.923780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f19c7565-2f5f-4448-910b-6876e57021fa None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:54.925001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f19c7565-2f5f-4448-910b-6876e57021fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:55.007377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 348/716] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:55.047640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86893ee1-1ddf-4496-8609-7bc728c47999 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:55.168895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86893ee1-1ddf-4496-8609-7bc728c47999 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:55.207272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:55.208175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:55.208459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:55.208641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:55.212783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:55.212783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:55.226394 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:55.227510 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:30:55.228388 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:55.233075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 369/717] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:55 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:55.234673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c7565-2f5f-4448-910b-6876e57021fa None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:55.361438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c7565-2f5f-4448-910b-6876e57021fa None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:55.412798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d327e16-2f04-4d9d-b257-f6b3db55fc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:55.413465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327e16-2f04-4d9d-b257-f6b3db55fc21 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:55.413745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327e16-2f04-4d9d-b257-f6b3db55fc21 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:55.414014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327e16-2f04-4d9d-b257-f6b3db55fc21 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:55.414708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d327e16-2f04-4d9d-b257-f6b3db55fc21 None admin] RBAC: Adding query filter params (name=network) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:55.415036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d327e16-2f04-4d9d-b257-f6b3db55fc21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:55.416397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d327e16-2f04-4d9d-b257-f6b3db55fc21 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:55.426757 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 349/718] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:30:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:55.432007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:55.595068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5d00-2266-4134-8498-8c4e8e1706f7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:55.644393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185a378-3b19-48e1-a695-50d079fcd00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:55.645066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a378-3b19-48e1-a695-50d079fcd00d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:55.645350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a378-3b19-48e1-a695-50d079fcd00d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:55.645629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185a378-3b19-48e1-a695-50d079fcd00d None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:55.646340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185a378-3b19-48e1-a695-50d079fcd00d None admin] RBAC: Adding query filter params (type=network) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:55.646648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185a378-3b19-48e1-a695-50d079fcd00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:55.648126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185a378-3b19-48e1-a695-50d079fcd00d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:55.659745 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 370/719] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:30:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:55.763061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a2e8-7055-4493-9492-1e8ef9c8d3c3 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:55.763959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a2e8-7055-4493-9492-1e8ef9c8d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:55.764156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a2e8-7055-4493-9492-1e8ef9c8d3c3 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:55.765773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 350/720] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:55.771003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05fe4-26f2-4427-ae93-defa6819f567 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:55.771298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05fe4-26f2-4427-ae93-defa6819f567 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:55.771567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d05fe4-26f2-4427-ae93-defa6819f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:55.799971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-61d05fe4-26f2-4427-ae93-defa6819f567 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:55.801223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-61d05fe4-26f2-4427-ae93-defa6819f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:55.896628 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 371/721] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:55.919822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a2e8-7055-4493-9492-1e8ef9c8d3c3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:56.071312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a2e8-7055-4493-9492-1e8ef9c8d3c3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:56.116382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:56.117169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:56.117449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:56.117719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:56.135627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:56.143918 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:56.144948 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:56.145817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 351/722] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:56.150676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d05fe4-26f2-4427-ae93-defa6819f567 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:56.296439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d05fe4-26f2-4427-ae93-defa6819f567 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:56.347172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:56.347776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:56.348059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:56.348338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:56.349083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:56.349390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:56.350797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:56.360433 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 372/723] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:56.368463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:56.491961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec5f4-b902-4356-9f2f-0259d9e464be None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:56.539391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:56.540186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:56.540468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:56.540740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:56.557453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:56.558945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:56.580332 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:56.581291 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:56.582227 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:56.582227 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:56.582227 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:56.582227 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:56.582227 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 352/724] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:56.588842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:56.691413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dcbb7-d1d5-4036-aa73-ed34c7042c14 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:56.726354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:56.727055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:56.727341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:56.727621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:56.728343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:56.728653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:56.730041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:56.742314 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 373/725] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:56.747260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:56.986414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67102758-b7e7-4e05-9f6d-297189e23a1e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.022527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db7bf2-512d-406b-834b-161b39e88c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.023378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7bf2-512d-406b-834b-161b39e88c8e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.023660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7bf2-512d-406b-834b-161b39e88c8e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.023934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db7bf2-512d-406b-834b-161b39e88c8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.031977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7bf2-512d-406b-834b-161b39e88c8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:57.033465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db7bf2-512d-406b-834b-161b39e88c8e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-43db7bf2-512d-406b-834b-161b39e88c8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:57.049920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:57.051116 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:57.052090 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 353/726] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:57.061349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.176082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179ad5d-bf9c-42f6-9d54-bf55a357741e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.223588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.224284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.224567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.224842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.225692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:57.226004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:57.227484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:57.243013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4787c-ada5-4a01-886c-98191cc24f78 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.243288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4787c-ada5-4a01-886c-98191cc24f78 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.243484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4787c-ada5-4a01-886c-98191cc24f78 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.244978 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 354/727] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:57.249729 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 374/728] 10.222.0.32 () {56 vars in 1135 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:57.249998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5297e-2edc-4737-8376-02b0b96e8062 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.250286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5297e-2edc-4737-8376-02b0b96e8062 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.250555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5297e-2edc-4737-8376-02b0b96e8062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.258862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.273544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-77a5297e-2edc-4737-8376-02b0b96e8062 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:57.274894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-77a5297e-2edc-4737-8376-02b0b96e8062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:57.360437 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 355/729] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:57.361786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d940-8fe8-408a-a005-2242fce2ba31 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.362074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d940-8fe8-408a-a005-2242fce2ba31 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.362352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d940-8fe8-408a-a005-2242fce2ba31 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.364720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba59be3-69a6-4999-b5f6-942a27cf0937 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.371824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 356/730] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:57.377978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7a0a-2d2b-434a-9076-011bd7e5755a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.378267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7a0a-2d2b-434a-9076-011bd7e5755a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.378544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad7a0a-2d2b-434a-9076-011bd7e5755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.399607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3396f0a-bc13-4fd5-97cc-6f0e4f1d791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.400255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396f0a-bc13-4fd5-97cc-6f0e4f1d791e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.400538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396f0a-bc13-4fd5-97cc-6f0e4f1d791e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.400816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3396f0a-bc13-4fd5-97cc-6f0e4f1d791e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.402836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a0ad7a0a-2d2b-434a-9076-011bd7e5755a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:57.404557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a0ad7a0a-2d2b-434a-9076-011bd7e5755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:57.467173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3396f0a-bc13-4fd5-97cc-6f0e4f1d791e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:57.475005 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 357/731] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 21:30:57.475161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3396f0a-bc13-4fd5-97cc-6f0e4f1d791e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:57.475258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad7a0a-2d2b-434a-9076-011bd7e5755a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.566848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad7a0a-2d2b-434a-9076-011bd7e5755a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.575499 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 375/732] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 21:30:57.581428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c1f4-8e83-40a6-bc27-7f4d147786fb None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.581723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c1f4-8e83-40a6-bc27-7f4d147786fb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.581998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c1f4-8e83-40a6-bc27-7f4d147786fb None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.583311 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 376/733] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:57.584008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c1f4-8e83-40a6-bc27-7f4d147786fb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.602506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.603334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.603619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.603889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.614467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:57.622268 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:57.623281 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 358/734] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:57.624241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.694180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c1f4-8e83-40a6-bc27-7f4d147786fb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.732984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfeec-2679-4af9-87a9-0436f27cf5ab None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.734661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650822c-b9a4-4c9e-8f06-4dd385dc78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.736315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650822c-b9a4-4c9e-8f06-4dd385dc78e9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.736606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650822c-b9a4-4c9e-8f06-4dd385dc78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.736883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650822c-b9a4-4c9e-8f06-4dd385dc78e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.755271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650822c-b9a4-4c9e-8f06-4dd385dc78e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f650822c-b9a4-4c9e-8f06-4dd385dc78e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:30:57.765345 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:57.766296 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:57.767656 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 377/735] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:57.768353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b57dcd-0fe9-4d4d-8ccf-897fe1858ed4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.768353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b57dcd-0fe9-4d4d-8ccf-897fe1858ed4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.768353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b57dcd-0fe9-4d4d-8ccf-897fe1858ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.772302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.773160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.773517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.773818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.785643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:57.787121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:57.787828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-10b57dcd-0fe9-4d4d-8ccf-897fe1858ed4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:57.789020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-10b57dcd-0fe9-4d4d-8ccf-897fe1858ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:57.806482 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:57.807614 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:57.808521 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:57.808521 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:57.808521 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:57.808521 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:57.808521 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 359/736] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:57.808521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.860109 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 378/737] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:57.860949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b57dcd-0fe9-4d4d-8ccf-897fe1858ed4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.923513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b33d8a-ed4e-461b-b4df-a91018703f80 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.956741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.956943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b57dcd-0fe9-4d4d-8ccf-897fe1858ed4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:57.957413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.957695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.958123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.958901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:57.959206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:57.960572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:57.969153 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 360/738] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:57.969949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:57.995225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:57.995886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:57.996164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:57.996449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:57.997167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:57.997488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:57.998914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.011457 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 379/739] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:58.011457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.080669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0607-cea5-496d-8bfc-fbc7478fde6a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.112467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.113442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.113728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.114005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.114718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:58.114962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217ed7-4765-47ef-a006-1cfcb46f2ead None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.115392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.116514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.128638 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 361/740] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:58.129681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.149362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.150052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.150339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.150618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.151404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.152846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.177545 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 380/741] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:30:58 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:58.177545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.237479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e59df-87a9-4d0d-8146-0dbc3611de89 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.287369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.288007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392e95-55c5-4ccb-b9ec-1f761fe40a1c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.288188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.288438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.288710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.300838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.302328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:58.320335 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:58.321345 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:58.322287 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:58.322287 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:58.322287 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:58.322287 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:58.322287 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 362/742] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:58.322593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.329802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.330632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.330972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.331257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.344189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.345690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:58.368553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:58.369522 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:58.371439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:58.371439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:58.371439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:58.371439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:58.371439 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 381/743] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:58.371439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.446049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ecff3-ca1b-4dc7-8642-a80f7bfa94e9 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.477574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6fdcc3-eccf-4829-96ec-a3e853f835f4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.479878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003d726-a7bd-4cda-be3a-e249ff7eaa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.480668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003d726-a7bd-4cda-be3a-e249ff7eaa18 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.480947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003d726-a7bd-4cda-be3a-e249ff7eaa18 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.481220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003d726-a7bd-4cda-be3a-e249ff7eaa18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.488321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003d726-a7bd-4cda-be3a-e249ff7eaa18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.489761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003d726-a7bd-4cda-be3a-e249ff7eaa18 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c003d726-a7bd-4cda-be3a-e249ff7eaa18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:58.503601 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:58.504551 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:58.505520 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 363/744] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:58.506544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc4b6-8bcd-48d2-af0e-2287bf2a5ce8 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.506544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc4b6-8bcd-48d2-af0e-2287bf2a5ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.506544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc4b6-8bcd-48d2-af0e-2287bf2a5ce8 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.510899 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 364/745] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:30:58.510899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc4b6-8bcd-48d2-af0e-2287bf2a5ce8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.518512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.519211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.519495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.519770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.520499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:58.520807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.522197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.538864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 382/746] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:58.538864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.615927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc4b6-8bcd-48d2-af0e-2287bf2a5ce8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.635898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a8498-a060-40ea-bec6-6fd540099050 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.648776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878cb16-63a9-4511-92fe-acd6f60c6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.649440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878cb16-63a9-4511-92fe-acd6f60c6bef None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.649719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878cb16-63a9-4511-92fe-acd6f60c6bef None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.649990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878cb16-63a9-4511-92fe-acd6f60c6bef None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.650733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878cb16-63a9-4511-92fe-acd6f60c6bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:58.651071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878cb16-63a9-4511-92fe-acd6f60c6bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.652445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878cb16-63a9-4511-92fe-acd6f60c6bef None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.663439 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 365/747] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:58.664432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392f27e-5852-4658-a516-d7a23448a4f4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.664719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392f27e-5852-4658-a516-d7a23448a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.664997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392f27e-5852-4658-a516-d7a23448a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.675789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.677181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.677925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.678375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.679395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:58.679898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.681645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.682062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0392f27e-5852-4658-a516-d7a23448a4f4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:30:58.684096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0392f27e-5852-4658-a516-d7a23448a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:30:58.697389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 383/748] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:58.698807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.763055 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 366/749] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:30:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 21:30:58.765676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392f27e-5852-4658-a516-d7a23448a4f4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.816277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfee39-2466-4f8a-b932-ece4b4812013 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.849863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.850673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.850975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.851247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.859153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.860600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.863476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392f27e-5852-4658-a516-d7a23448a4f4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:58.874669 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:58.875799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 384/750] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:58.876729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.901035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:58.902278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:58.902859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:58.903149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:58.913106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:58.914558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:30:58.929900 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:58.930955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 367/751] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:58.931906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:58.975735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae4efe-ca8c-497b-b8f0-652c45c2ef9d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.012226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.012884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.013778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.014054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.015021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=758d4dea899344b883971712aebe042f, user.id=ddea6c1eb8764f1a9f0a310a78128460) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:59.015328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.016912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.031096 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 385/752] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:30:58 2022] GET /identity/v3/role_assignments?user.id=ddea6c1eb8764f1a9f0a310a78128460&scope.project.id=758d4dea899344b883971712aebe042f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:59.031096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.035714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b88d1e-8cef-4c8b-afff-865cc4aa3f12 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.071991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.072679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.072961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.073237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.073965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.075432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.092584 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 368/753] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:30:58 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:30:59.093527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.140477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485e47-c15b-4087-ba09-05d3fd50915a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.183052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.183645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.183926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.184220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.185685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:59.185988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.187623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.207533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 386/754] 10.222.0.32 () {56 vars in 1149 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:59.207912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e9cc9-14e8-484f-9216-3e50c454a790 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.220082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.249297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.249987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.250266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.250543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.251449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:59.252016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.258805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.273141 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 369/755] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:59.279337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.349380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12da3d0-033b-4e4e-9ad6-fe3a16dbd59a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.383034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dc928-b47d-494d-b277-ca757507a1a7 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.383228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.383863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.384151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.384427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.418468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.419491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.419876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.420152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.432057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.433633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:59.452726 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:59.453663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:59.454552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:59.454552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:59.454552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:59.454552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:59.454552 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 370/756] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:30:59.454861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.456179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.460177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.600991 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 387/757] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:30:59.607712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.624418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0f109-9cdf-4a87-912c-f2c24dc8529a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.672035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.672861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.673149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.673422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.674137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:30:59.674438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.675838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.689431 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 371/758] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:30:59.694877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.803530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7947cc-d172-4843-8336-4fdd8126f57d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.808404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b8ffd-26f8-435b-9284-71281c319137 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:30:59.844849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.845636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.845918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.846192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.853201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.855337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:30:59.871098 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:59.872053 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:30:59.873515 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 372/759] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:59.878807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.887224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:30:59.888941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:30:59.889421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:30:59.889889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:30:59.907558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:30:59.909372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:30:59.934743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:30:59.936329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:30:59.937221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:30:59.937221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:30:59.937221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:30:59.937221 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:30:59.944342 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 388/760] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:30:59.949798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:30:59.985283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d120f2-054f-491a-b44b-a6ef9efb8d3b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:00.021070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:00.021735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:00.022017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:00.022290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:00.023112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:00.023412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:00.025351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:00.041730 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 373/761] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:00.047954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:00.146956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17a661-905c-45f1-bd07-533c88a82f3d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:00.170672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02195ff6-ee58-47d9-8282-bc20fbbb46e0 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:00.180345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:00.181225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:00.181506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:00.181778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/8643bb571c514f1fa358526b00ce47ee/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:00.183795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=8643bb571c514f1fa358526b00ce47ee, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:00.185277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:00.209389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 374/762] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:31:00 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/8643bb571c514f1fa358526b00ce47ee/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:31:00.236179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:00.236858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:00.237141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:00.237417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:00.238151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:00.238456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:00.240062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:00.257690 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 389/763] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:00.263653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:00.381872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4acbf-eba6-431e-9af7-68df90e5db20 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:00.418645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:00.419551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:00.419832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:00.420105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:00.427282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:00.428770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:00.444328 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:00.445323 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:00.446240 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 375/764] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:00.452211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:00.564441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f27d68-435c-4204-92b2-75bd5ffae6fc None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:00.599050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14933aaa-5e0b-4005-8974-2524d64c28ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:00.599722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14933aaa-5e0b-4005-8974-2524d64c28ff None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:00.600002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14933aaa-5e0b-4005-8974-2524d64c28ff None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:00.600280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14933aaa-5e0b-4005-8974-2524d64c28ff None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:00.601062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14933aaa-5e0b-4005-8974-2524d64c28ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:00.601370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14933aaa-5e0b-4005-8974-2524d64c28ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:00.602844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14933aaa-5e0b-4005-8974-2524d64c28ff None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:00.615981 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 390/765] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:00.628019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:00.775237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3657b-78cc-416e-b048-6b315f5cd3f4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:00.823249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4be3f-97a5-4d1e-9a77-81516d296511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:00.823911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4be3f-97a5-4d1e-9a77-81516d296511 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:00.824192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4be3f-97a5-4d1e-9a77-81516d296511 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:00.824463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4be3f-97a5-4d1e-9a77-81516d296511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:00.825291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4be3f-97a5-4d1e-9a77-81516d296511 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=d5e959f3745040feb800a00c9c5e4e2b) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:00.825642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4be3f-97a5-4d1e-9a77-81516d296511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:00.827108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4be3f-97a5-4d1e-9a77-81516d296511 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:00.839960 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 376/766] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:00 2022] GET /identity/v3/role_assignments?user.id=d5e959f3745040feb800a00c9c5e4e2b&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:01.179505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263327-2798-4807-864d-207dc826ae6b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:01.180177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263327-2798-4807-864d-207dc826ae6b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:01.180177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b263327-2798-4807-864d-207dc826ae6b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:01.181596 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 391/767] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:01.187794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d840e-2ff4-4ede-bde9-467d3f6286ad None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:01.188233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d840e-2ff4-4ede-bde9-467d3f6286ad None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:01.188457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d840e-2ff4-4ede-bde9-467d3f6286ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:01.208389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0b5d840e-2ff4-4ede-bde9-467d3f6286ad None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:01.214965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b5d840e-2ff4-4ede-bde9-467d3f6286ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:01.297030 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 377/768] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:01.333094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b263327-2798-4807-864d-207dc826ae6b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:01.459700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b263327-2798-4807-864d-207dc826ae6b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:01.505153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bcc59-1fbc-4ab6-81b2-4e24eb9bf089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:01.506416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bcc59-1fbc-4ab6-81b2-4e24eb9bf089 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:01.507050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bcc59-1fbc-4ab6-81b2-4e24eb9bf089 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:01.507543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bcc59-1fbc-4ab6-81b2-4e24eb9bf089 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:01.508400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bcc59-1fbc-4ab6-81b2-4e24eb9bf089 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:01.510021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bcc59-1fbc-4ab6-81b2-4e24eb9bf089 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3e8bcc59-1fbc-4ab6-81b2-4e24eb9bf089 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:01.523798 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:01.524788 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:31:01.525661 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:01.528673 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 392/769] 10.222.0.32 () {56 vars in 1129 bytes} [Sat May 7 21:31:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:01.534905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d840e-2ff4-4ede-bde9-467d3f6286ad None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:01.669218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d840e-2ff4-4ede-bde9-467d3f6286ad None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:01.698033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f63ced-b6af-48f9-8661-031fccf066d3 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:01.698361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f63ced-b6af-48f9-8661-031fccf066d3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:01.698594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f63ced-b6af-48f9-8661-031fccf066d3 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:01.701941 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 393/770] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:01.706950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756e25-7d17-4a1d-8787-296dea04637e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:01.707247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756e25-7d17-4a1d-8787-296dea04637e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:01.707531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc756e25-7d17-4a1d-8787-296dea04637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:01.734638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fc756e25-7d17-4a1d-8787-296dea04637e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:01.735848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fc756e25-7d17-4a1d-8787-296dea04637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:01.738354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:01.739124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:01.739400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:01.739667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:01.740371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:01.740669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:01.742025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:01.753035 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 378/771] 10.222.0.32 () {56 vars in 1124 bytes} [Sat May 7 21:31:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:01.753887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:01.877093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e661490-ac62-4273-a2cb-dafc67d7b365 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:01.905100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 394/772] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:01.915183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:01.915848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:01.916132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:01.916402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:01.917439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:01.917748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:01.919143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:01.930429 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 379/773] 10.222.0.32 () {56 vars in 1124 bytes} [Sat May 7 21:31:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:01.932784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756e25-7d17-4a1d-8787-296dea04637e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:01.935567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.042986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06dea-85cc-4242-8ac1-10393e0eb7e2 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.077383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868926-099b-401d-b0e0-68cd494f4954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.078182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868926-099b-401d-b0e0-68cd494f4954 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.078491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868926-099b-401d-b0e0-68cd494f4954 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.078809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868926-099b-401d-b0e0-68cd494f4954 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.079900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868926-099b-401d-b0e0-68cd494f4954 None admin] RBAC: Adding query filter params (interface=public, service_id=44b62541d866462a93554202c237bd8d, region_id=RegionOne) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:02.080219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868926-099b-401d-b0e0-68cd494f4954 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.081868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868926-099b-401d-b0e0-68cd494f4954 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.083063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc756e25-7d17-4a1d-8787-296dea04637e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.095301 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 380/774] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:31:01 2022] GET /identity/v3/endpoints?service_id=44b62541d866462a93554202c237bd8d&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:02.095301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742dfdb-1931-4c27-a850-e4c0490bc637 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.095301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742dfdb-1931-4c27-a850-e4c0490bc637 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.095301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742dfdb-1931-4c27-a850-e4c0490bc637 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.095301 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 381/775] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:02.099870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742dfdb-1931-4c27-a850-e4c0490bc637 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.124620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c28367-cf4d-40bf-a2ca-d4ad7e2082ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.125717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c28367-cf4d-40bf-a2ca-d4ad7e2082ac None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.126249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c28367-cf4d-40bf-a2ca-d4ad7e2082ac None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.126727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c28367-cf4d-40bf-a2ca-d4ad7e2082ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.137066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c28367-cf4d-40bf-a2ca-d4ad7e2082ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-62c28367-cf4d-40bf-a2ca-d4ad7e2082ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:02.145442 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:02.146397 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:02.147282 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:02.154873 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 395/776] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:02.156429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc45f9-5337-477b-bbc1-39e23bb0fc2c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.156929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc45f9-5337-477b-bbc1-39e23bb0fc2c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.157415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc45f9-5337-477b-bbc1-39e23bb0fc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.174095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-adbc45f9-5337-477b-bbc1-39e23bb0fc2c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:02.175567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-adbc45f9-5337-477b-bbc1-39e23bb0fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:02.202826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742dfdb-1931-4c27-a850-e4c0490bc637 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.237360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.238021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.238293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.238588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.239293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.240753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.245956 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 396/777] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:02.247474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc45f9-5337-477b-bbc1-39e23bb0fc2c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.251657 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 382/778] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:02.306615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.352674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc45f9-5337-477b-bbc1-39e23bb0fc2c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.391199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.392263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.392783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.393277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.394260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:02.394815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.396503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.411761 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 397/779] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:02.413370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.498139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5028ef-27ef-401d-b13c-2c0db45446ea None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.518870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d94ba6-cd51-4a0f-8996-2b9f731a88bf None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.552321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.553136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.553423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.553698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] PATH_INFO: `/v3/services/network` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.554361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.555566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.555790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.556845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.557349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.557832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.569910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:02.570466 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:02.571475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:02.572751 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 383/780] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/services/network => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:02.576060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.578886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:02.595656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:02.596641 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:02.597538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:02.597538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:02.597538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:02.597538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:02.604248 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 398/781] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:02.605849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.682022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd187f-8862-4e0f-8b45-72e4702e2444 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.716522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e5836-8655-4499-8108-5fcf02f6adae None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.718580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.719284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.719569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.719846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.720836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] RBAC: Adding query filter params (name=network) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:02.720836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.722211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.727111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 384/782] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:02.732581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.753628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.754623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.755163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.755645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.756567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:02.757094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.758687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.774876 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 399/783] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:02.777459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.837762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451603f-075c-4ca0-bb20-bcac16c03d81 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.871594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.872825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.873206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.873479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.874189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] RBAC: Adding query filter params (type=network) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:02.874491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.875969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.881289 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 385/784] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:02.882001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d2fa2-c9b6-4087-9a48-39e7dfaf9f4e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:02.886853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.921378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:02.922544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:02.923104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:02.923601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:02.931573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:02.933461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:02.953293 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:02.954331 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 07 21:31:02.955329 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:02.962523 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 400/785] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:02.963995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:02.990469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6a4ca-2a77-46c6-a9b2-660f164cc364 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.025378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.026106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.026392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.027008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.027516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] RBAC: Adding query filter params (interface=public, service_id=08db651e8b8244dbb92deb0838a533e1, region_id=RegionOne) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:03.027829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:03.029290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:03.035591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 386/786] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/endpoints?service_id=08db651e8b8244dbb92deb0838a533e1&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:03.041057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.075998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521d31a-5024-4e1c-9ccd-a5638428ebc7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.111269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.112310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.112806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.113306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.114361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:03.114939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:03.116596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:03.150982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc6504-70e7-4394-a2ee-f80b67e1632c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.151635 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 401/787] 10.222.0.32 () {56 vars in 1135 bytes} [Sat May 7 21:31:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:03.157311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.179125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca7d22-34bc-4aaa-975d-ec31fe7b00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.187579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca7d22-34bc-4aaa-975d-ec31fe7b00ff None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.187858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca7d22-34bc-4aaa-975d-ec31fe7b00ff None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.188135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca7d22-34bc-4aaa-975d-ec31fe7b00ff None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.188825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca7d22-34bc-4aaa-975d-ec31fe7b00ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:03.190198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca7d22-34bc-4aaa-975d-ec31fe7b00ff None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:03.214225 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 387/788] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:03.253992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2edb4-3183-4af9-bdd3-af837ce46317 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.254273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2edb4-3183-4af9-bdd3-af837ce46317 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.254551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2edb4-3183-4af9-bdd3-af837ce46317 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.256208 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 388/789] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:03.262093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197ae40-992a-44ab-aaa7-1908022ee2ca None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.262714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197ae40-992a-44ab-aaa7-1908022ee2ca None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.263775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197ae40-992a-44ab-aaa7-1908022ee2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.276255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6193e5-e4f7-42d0-bdfb-4acded5f11a4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.299903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8197ae40-992a-44ab-aaa7-1908022ee2ca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:03.301516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8197ae40-992a-44ab-aaa7-1908022ee2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:03.314819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.314819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.314819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.314819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.329445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:03.331847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:03.367538 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:03.368494 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:03.369401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:03.369401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:03.369401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:03.369401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:03.375856 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 402/790] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:03.377214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.444759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 389/791] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:03.498895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197ae40-992a-44ab-aaa7-1908022ee2ca None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.538025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0373-ed57-495f-bc8d-64180dc62f99 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.585611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.586545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.586854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.587134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.588388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:03.588699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:03.592234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:03.605564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 403/792] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:03.611739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.655114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197ae40-992a-44ab-aaa7-1908022ee2ca None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.713250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ae0b-7192-4dd3-8ec2-1477a68c1143 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.722366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.723398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.723842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.724259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.743699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:03.751536 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:03.752494 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:03.753355 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 390/793] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:03.760045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.760351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.761155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.761442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.761716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.773536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:03.775048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:03.805354 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:03.807563 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:03.809701 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 404/794] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:03.815962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.861940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd28297-9b50-45a7-af4d-bad83934532b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.905092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84695f-761e-4c7a-8fc1-7a767ace2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.905822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84695f-761e-4c7a-8fc1-7a767ace2dab None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.906047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84695f-761e-4c7a-8fc1-7a767ace2dab None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.906388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84695f-761e-4c7a-8fc1-7a767ace2dab None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.907156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84695f-761e-4c7a-8fc1-7a767ace2dab None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:03.907466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84695f-761e-4c7a-8fc1-7a767ace2dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:03.908891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84695f-761e-4c7a-8fc1-7a767ace2dab None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:03.918165 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 391/795] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:03.923050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f8ee-cf9a-4755-8365-37d9c60ba414 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.923050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f8ee-cf9a-4755-8365-37d9c60ba414 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.923050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0f8ee-cf9a-4755-8365-37d9c60ba414 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.923050 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 392/796] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:03.926840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0f8ee-cf9a-4755-8365-37d9c60ba414 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:03.952450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6f5fc-c473-458a-83ca-059e6e0cfacf None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:03.993528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd64282-51f5-48c8-8154-d90dbc071936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:03.995039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64282-51f5-48c8-8154-d90dbc071936 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:03.995652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64282-51f5-48c8-8154-d90dbc071936 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:03.996127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd64282-51f5-48c8-8154-d90dbc071936 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:03.998074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd64282-51f5-48c8-8154-d90dbc071936 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:03.998896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd64282-51f5-48c8-8154-d90dbc071936 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.000558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd64282-51f5-48c8-8154-d90dbc071936 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.016060 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 405/797] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:04.017754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c7ef-2d9c-416a-9964-4b5742f40b99 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.018240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c7ef-2d9c-416a-9964-4b5742f40b99 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.018736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c7ef-2d9c-416a-9964-4b5742f40b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.048036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6b41c7ef-2d9c-416a-9964-4b5742f40b99 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:04.049247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b41c7ef-2d9c-416a-9964-4b5742f40b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:04.055914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0f8ee-cf9a-4755-8365-37d9c60ba414 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.101071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.101918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.102197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.102518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.116252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.117827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.118933 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 406/798] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:04.120010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41c7ef-2d9c-416a-9964-4b5742f40b99 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:04.151668 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:04.152658 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:04.154101 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:04.154101 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:04.154101 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:04.154101 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:04.156392 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 393/799] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:04.157389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.249193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41c7ef-2d9c-416a-9964-4b5742f40b99 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.278096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcc412-8244-4dad-af1f-0e2860539147 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.315653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.316493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.316774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.317045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.329353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:04.337511 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:04.338523 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:31:04.339750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:04.343700 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 394/800] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:04.344630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.416865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.418583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.419625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.420106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/ddea6c1eb8764f1a9f0a310a78128460/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.422312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=ddea6c1eb8764f1a9f0a310a78128460, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.424000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.440264 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 407/801] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:31:04 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/ddea6c1eb8764f1a9f0a310a78128460/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:31:04.441474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.472598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061202-5bf7-4778-893b-98de447af33c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.534735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.535457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.535742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.536015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.536867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:04.537182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.538554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.553709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93e7a9-0541-4ccc-8d7f-5c83a84e6e96 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.561102 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 395/802] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:04.566046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.590603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.592523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.593035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.593528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.594557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:04.595132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.596839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.607610 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 408/803] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:04.622470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.688781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5aad5-20a9-4e6f-b815-351cdfbe182a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.726408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.727250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.727529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.727814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.736244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.737711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:04.755051 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:04.756267 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:04.757463 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 396/804] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:04.760037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.814830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a3a13-f7d8-4176-aa86-af695bad000f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.861458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e67090-7ef8-4808-a793-b38912154d4c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:04.878695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.879990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.880479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.880958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.891840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.893807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.897233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:04.897794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:04.898073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:04.898378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:04.899307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:04.899616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:04.901265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:04.915287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:04.916251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:04.917190 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:04.917190 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:04.917190 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:04.917190 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:04.920137 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 409/805] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:04.923897 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 397/806] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:04.926722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:04.927518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.028985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d05a3-2e08-424d-84a9-9ee268137c07 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.031217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499d958-0076-4fe3-993c-7b3f67d77c04 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.067321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d6141-31a9-480f-b12f-ccc9dbba988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.067979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6141-31a9-480f-b12f-ccc9dbba988e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.068266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6141-31a9-480f-b12f-ccc9dbba988e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.068530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6141-31a9-480f-b12f-ccc9dbba988e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.070732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.071571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.071850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.072126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.072845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:05.073149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.074531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.115189 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 410/807] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:05.117466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.191275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d6141-31a9-480f-b12f-ccc9dbba988e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.192742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d6141-31a9-480f-b12f-ccc9dbba988e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.280933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee2188-0e7e-4a61-a5e4-182dd3128a5f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.320765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f860c7-b0e1-486c-a5bf-4c3a6e939ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.321672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f860c7-b0e1-486c-a5bf-4c3a6e939ab2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.321964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f860c7-b0e1-486c-a5bf-4c3a6e939ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.322237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f860c7-b0e1-486c-a5bf-4c3a6e939ab2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.332067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f860c7-b0e1-486c-a5bf-4c3a6e939ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.333872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f860c7-b0e1-486c-a5bf-4c3a6e939ab2 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.349184 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 398/808] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 07 21:31:05.351167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f1d6-6132-4751-9b3f-004335dbb78b None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.351668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f1d6-6132-4751-9b3f-004335dbb78b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.352171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f1d6-6132-4751-9b3f-004335dbb78b None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.353908 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 399/809] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f2f860c7-b0e1-486c-a5bf-4c3a6e939ab2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:05.357684 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:05.358643 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:05.359645 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:05.361468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4f1d6-6132-4751-9b3f-004335dbb78b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.363450 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 411/810] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:05.364745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83262b-4b3c-4f88-a41b-6c8ce45ecdd6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.365034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83262b-4b3c-4f88-a41b-6c8ce45ecdd6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.365310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83262b-4b3c-4f88-a41b-6c8ce45ecdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.383281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9f83262b-4b3c-4f88-a41b-6c8ce45ecdd6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:05.384471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9f83262b-4b3c-4f88-a41b-6c8ce45ecdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:05.458823 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 412/811] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:05.458823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83262b-4b3c-4f88-a41b-6c8ce45ecdd6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.500430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4f1d6-6132-4751-9b3f-004335dbb78b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.543771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.544711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.545084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.545454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.555636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.557290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.559589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83262b-4b3c-4f88-a41b-6c8ce45ecdd6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:05.576814 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:05.577760 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:05.578675 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:05.578675 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:05.578675 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:05.578675 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:05.582969 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 400/812] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:05.583822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.595401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.596073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.596355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.596627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.597465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:05.597772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.599241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.616666 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 413/813] 10.222.0.32 () {56 vars in 1149 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:05.617500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.688422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07b9ed-df3d-4287-a2fd-5e89aa6d387a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.721303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11173d6-47ff-4dc1-8c22-5c3e59f2ed52 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.733003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.733806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.734083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.734354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.735027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.736388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:05.748594 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:05.750872 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:05.753006 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 401/814] 10.222.0.32 () {56 vars in 1129 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:05.762885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.763070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.763070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.763070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.763070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.763414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:05.763414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.763414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.774803 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 414/815] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:05.775790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.861423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255429e-5002-48b2-8890-0214f733d778 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.875602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636182f-63d0-475b-978a-a59e0619cd41 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:05.895025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2a3b8-4865-40e6-b2e1-b57794e5570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.895839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a3b8-4865-40e6-b2e1-b57794e5570b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.896115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a3b8-4865-40e6-b2e1-b57794e5570b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.896389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2a3b8-4865-40e6-b2e1-b57794e5570b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.907029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2a3b8-4865-40e6-b2e1-b57794e5570b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.908467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2a3b8-4865-40e6-b2e1-b57794e5570b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.909515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:05.910170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.910453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.910731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.911456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:05.911757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:05.913108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:05.922949 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 415/816] 10.222.0.32 () {56 vars in 1124 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:05.922949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-20b2a3b8-4865-40e6-b2e1-b57794e5570b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:05.925534 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:05.926623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:05.927836 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:05.927836 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:05.927836 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:05.927836 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:05.931140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 402/817] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:05.932389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296227b-d048-454d-a0b0-78c0113a80c5 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:05.932670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296227b-d048-454d-a0b0-78c0113a80c5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:05.932940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296227b-d048-454d-a0b0-78c0113a80c5 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:05.934187 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 403/818] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:05.935531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296227b-d048-454d-a0b0-78c0113a80c5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.026511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbb76-6a1d-4801-ba95-aa35eb64d8f7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.037699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296227b-d048-454d-a0b0-78c0113a80c5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.059239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.060575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.060855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.061125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.068040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.069538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:06.086153 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:06.087308 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:06.088228 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 416/819] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:06.088723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.098432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a985f-2a42-4ee5-8829-40250b13902c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.099288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a985f-2a42-4ee5-8829-40250b13902c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.101540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a985f-2a42-4ee5-8829-40250b13902c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.101831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a985f-2a42-4ee5-8829-40250b13902c None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.102602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a985f-2a42-4ee5-8829-40250b13902c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:06.102944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a985f-2a42-4ee5-8829-40250b13902c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.104330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a985f-2a42-4ee5-8829-40250b13902c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.115049 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 404/820] 10.222.0.32 () {56 vars in 1124 bytes} [Sat May 7 21:31:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:06.116103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3075-a29c-4fac-8228-a0d66e0f2ea9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.116455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3075-a29c-4fac-8228-a0d66e0f2ea9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.116721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3075-a29c-4fac-8228-a0d66e0f2ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.133462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9c9d3075-a29c-4fac-8228-a0d66e0f2ea9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:06.134634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9c9d3075-a29c-4fac-8228-a0d66e0f2ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:06.192440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbb85a-1e55-4578-bdcc-1d3fefd3fec3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.204348 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 405/821] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:06.205488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d3075-a29c-4fac-8228-a0d66e0f2ea9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.230545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.231237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.231588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.231857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.232571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:06.232867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.234258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.245590 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 417/822] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:06.246210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.319858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d3075-a29c-4fac-8228-a0d66e0f2ea9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.340736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7160d-0676-4119-98cd-1cc7932b6421 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.354091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.354749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.355061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.355323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.356096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:06.356423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.357847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.369328 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 406/823] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:06.370041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.379097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.379771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.380054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.380333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.381078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.382447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.410808 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 418/824] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:06.410808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.490429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8c392-0b34-4550-926d-448c1e9ec71f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.535467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3ce13-6fe4-4d16-ad83-08666db3da23 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.539065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.539873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.540149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.540417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] PATH_INFO: `/v3/services/network` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.541068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.542513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:06.557275 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:06.558361 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:06.559249 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 407/825] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:06.560096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.577374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.578183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.578625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.578928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.588562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.590708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:06.610998 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:06.613103 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 419/826] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:06.615223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.682294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b77277-829f-41d7-98aa-1f8b638ca96f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.717384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.718073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.718355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.718630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.719499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=758d4dea899344b883971712aebe042f, user.id=8643bb571c514f1fa358526b00ce47ee) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:06.719807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.721253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.727358 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 408/827] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/role_assignments?user.id=8643bb571c514f1fa358526b00ce47ee&scope.project.id=758d4dea899344b883971712aebe042f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:06.728152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.731082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49146862-58c9-4d81-b6a7-1dc998116293 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.772033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.773387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.773882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.774517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.775483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] RBAC: Adding query filter params (name=network) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:06.776019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.777694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.784945 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 420/828] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:06.791432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:06.911954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a49cd-30e2-4230-8242-ce1733544097 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.950320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:06.951402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:06.951917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:06.952426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:06.953365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] RBAC: Adding query filter params (type=network) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:06.953887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:06.955543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:06.957172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53bea0-af1f-4782-ab52-b6393e6b2c7b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:06.962338 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 421/829] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:06.968812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:07.017326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:07.018084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.018369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.018646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.019519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:07.019830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:07.021277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:07.034653 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 409/830] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:07.040458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:07.082971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf3aaa-ee37-4858-91fb-838ad346f101 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:07.118153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad6b3f-65dc-42a1-930d-436dfcdb40b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:07.119236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6b3f-65dc-42a1-930d-436dfcdb40b3 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.119734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6b3f-65dc-42a1-930d-436dfcdb40b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.120243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad6b3f-65dc-42a1-930d-436dfcdb40b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.121202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad6b3f-65dc-42a1-930d-436dfcdb40b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:07.122907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad6b3f-65dc-42a1-930d-436dfcdb40b3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:07.143759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9e439-a11d-425f-bb0d-cc16dc758000 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:07.147035 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 422/831] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:07.192116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec2946-86be-4b33-9785-13ffe2d3d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:07.193051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2946-86be-4b33-9785-13ffe2d3d110 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.193327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2946-86be-4b33-9785-13ffe2d3d110 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.193599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec2946-86be-4b33-9785-13ffe2d3d110 None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/d5e959f3745040feb800a00c9c5e4e2b/roles/77f0d0906e434f6dbaccba585bd68b27` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.215500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec2946-86be-4b33-9785-13ffe2d3d110 None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=d5e959f3745040feb800a00c9c5e4e2b, role_id=77f0d0906e434f6dbaccba585bd68b27)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:07.217536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec2946-86be-4b33-9785-13ffe2d3d110 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:07.238229 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 410/832] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:31:07 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/d5e959f3745040feb800a00c9c5e4e2b/roles/77f0d0906e434f6dbaccba585bd68b27 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:31:07.369223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385b93f-675c-4125-8c5d-116916ae7047 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.369585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385b93f-675c-4125-8c5d-116916ae7047 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.369785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385b93f-675c-4125-8c5d-116916ae7047 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.371444 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 423/833] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:07.377977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819104-3d31-468e-962a-222300d27e5a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.378484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819104-3d31-468e-962a-222300d27e5a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.378563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819104-3d31-468e-962a-222300d27e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.401738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-31819104-3d31-468e-962a-222300d27e5a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:07.402995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-31819104-3d31-468e-962a-222300d27e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:07.477590 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 411/834] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:07.504743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385b93f-675c-4125-8c5d-116916ae7047 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:07.612020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385b93f-675c-4125-8c5d-116916ae7047 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:07.646092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:07.646903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.647183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.647449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.658617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:07.666231 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:07.667229 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:07.668098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 424/835] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:07.675880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819104-3d31-468e-962a-222300d27e5a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:07.790268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819104-3d31-468e-962a-222300d27e5a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:07.824724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cff30-c404-448d-bb81-be176525f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:07.826064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cff30-c404-448d-bb81-be176525f06d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.826345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cff30-c404-448d-bb81-be176525f06d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.826617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cff30-c404-448d-bb81-be176525f06d None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.827396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cff30-c404-448d-bb81-be176525f06d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:07.827699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cff30-c404-448d-bb81-be176525f06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:07.829056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cff30-c404-448d-bb81-be176525f06d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:07.837902 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 412/836] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:07.843437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:07.946609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa024-ce84-4f07-9e97-865da214a302 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:07.980181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:07.980967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:07.981249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:07.982119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:07.992805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:07.994265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:08.011774 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:08.013995 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:08.016178 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:08.016178 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:08.016178 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:08.016178 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:08.016178 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 425/837] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:08.020008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cff30-c404-448d-bb81-be176525f06d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:08.119021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cff30-c404-448d-bb81-be176525f06d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:08.151889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:08.152547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:08.152827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:08.153098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:08.153864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:08.154165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:08.155555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:08.167689 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 413/838] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:08.175843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:08.279633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c12fe-a162-4c6a-9b25-8876fef44504 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:08.311868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:08.312872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:08.313342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:08.313774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:08.321383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:08.323017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:08.337681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:08.338898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 07 21:31:08.340207 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:08.342930 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 426/839] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:08.348660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:08.457784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9d9fc-63a1-4034-abdf-07e9b918b57c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:08.496512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:08.497629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:08.498148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:08.498599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:08.499630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:08.500105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:08.501715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:08.520791 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 414/840] 10.222.0.32 () {56 vars in 1135 bytes} [Sat May 7 21:31:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:08.526597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:08.627873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209cd19-b2bb-4bf4-819b-f85b136994c9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:08.661446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19334991-4cd4-4568-b2e8-cd8c1a7ece0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:08.662093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334991-4cd4-4568-b2e8-cd8c1a7ece0d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:08.662427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334991-4cd4-4568-b2e8-cd8c1a7ece0d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:08.662763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19334991-4cd4-4568-b2e8-cd8c1a7ece0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:08.739753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19334991-4cd4-4568-b2e8-cd8c1a7ece0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:08.741224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19334991-4cd4-4568-b2e8-cd8c1a7ece0d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:08.839874 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 427/841] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:08.845970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:08.914385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70da221-7fdb-4e6c-a995-024f0caac35b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:08.914603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70da221-7fdb-4e6c-a995-024f0caac35b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:08.914898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70da221-7fdb-4e6c-a995-024f0caac35b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:08.918063 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 428/842] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:08.921471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d772bf-a82a-44b2-b99c-e6c02f82204a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:08.921757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d772bf-a82a-44b2-b99c-e6c02f82204a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:08.922032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d772bf-a82a-44b2-b99c-e6c02f82204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:08.938084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-53d772bf-a82a-44b2-b99c-e6c02f82204a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:08.939298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53d772bf-a82a-44b2-b99c-e6c02f82204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:08.948872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d13bed-56b5-40d4-a7a9-10b541b5b923 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:08.996173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:08.997376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:08.997892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:08.998408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.009127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.010829 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 429/843] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:09.011118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:09.030818 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:09.031851 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:09.032869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:09.032869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:09.032869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:09.032869 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:09.032869 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 415/844] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:09.037117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d772bf-a82a-44b2-b99c-e6c02f82204a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.048319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.146655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d772bf-a82a-44b2-b99c-e6c02f82204a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:09.171999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d648-b4c7-4268-8a85-5f6508e9ba7e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:09.189970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:09.190639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.190973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.191252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.192144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:09.192451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.194715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.212898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 430/845] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:09.214595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:09.215670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.216332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.216967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.217728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.218104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.219958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:09.233428 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:09.234541 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:09.235460 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:09.244205 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 416/846] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:09.245423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.336749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350b242-5228-4b29-8d41-54d336b55f7e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:09.348223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62634bba-34aa-4b73-946b-46f4dc5bb115 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:09.372406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:09.373209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.373501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.373799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.380775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.382226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.384430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:09.385541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.386136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.386709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.387712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:09.388266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.389905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:09.398856 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:09.399807 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:09.400729 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:09.402896 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 431/848] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:09.403036 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 417/848] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:09.404388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.405584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.510760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fa1f1-d6db-438c-ada4-0bcd225dc34a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:09.511450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00afe9-c32a-4efa-b52e-727c34311380 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:09.547757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:09.547971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28b428-c57a-4b2f-8a28-22edda52975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:09.548500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28b428-c57a-4b2f-8a28-22edda52975c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.548789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28b428-c57a-4b2f-8a28-22edda52975c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.549067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28b428-c57a-4b2f-8a28-22edda52975c None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.549690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.549881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28b428-c57a-4b2f-8a28-22edda52975c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:09.550155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28b428-c57a-4b2f-8a28-22edda52975c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.550575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.551170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.551632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28b428-c57a-4b2f-8a28-22edda52975c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.552323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:09.553028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.554590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.567217 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 418/850] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:09.569144 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 432/850] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:09.570407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.681309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe125bf-a5b5-4925-9388-1bc7b2a9c5ab None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:09.687210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4559c9-ae0f-4ec5-8f36-56728c990cc4 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.687751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4559c9-ae0f-4ec5-8f36-56728c990cc4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.687751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4559c9-ae0f-4ec5-8f36-56728c990cc4 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.691617 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 433/851] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:09.695086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8dd99-249a-4581-b9f9-f7abf4abf127 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.695377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8dd99-249a-4581-b9f9-f7abf4abf127 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.695939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8dd99-249a-4581-b9f9-f7abf4abf127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.715363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-84d8dd99-249a-4581-b9f9-f7abf4abf127 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:09.717264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-84d8dd99-249a-4581-b9f9-f7abf4abf127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:09.720970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf80af2-98a1-4867-a872-e952c71a8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:09.721639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf80af2-98a1-4867-a872-e952c71a8012 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.721921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf80af2-98a1-4867-a872-e952c71a8012 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.722192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf80af2-98a1-4867-a872-e952c71a8012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.723058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf80af2-98a1-4867-a872-e952c71a8012 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=758d4dea899344b883971712aebe042f, user.id=ddea6c1eb8764f1a9f0a310a78128460) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:09.723366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf80af2-98a1-4867-a872-e952c71a8012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:09.724816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf80af2-98a1-4867-a872-e952c71a8012 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:09.731322 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 419/852] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/role_assignments?user.id=ddea6c1eb8764f1a9f0a310a78128460&scope.project.id=758d4dea899344b883971712aebe042f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:09.733078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248acdb-d0c0-4555-b034-21428001d11c None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.733382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248acdb-d0c0-4555-b034-21428001d11c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.733663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248acdb-d0c0-4555-b034-21428001d11c None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.734994 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 420/853] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:09.745158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065b646-9b07-4068-85c6-2d6c5ba42aaa None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:09.745477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065b646-9b07-4068-85c6-2d6c5ba42aaa None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:09.745715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065b646-9b07-4068-85c6-2d6c5ba42aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:09.770647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5065b646-9b07-4068-85c6-2d6c5ba42aaa None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:09.771916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5065b646-9b07-4068-85c6-2d6c5ba42aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:09.814229 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 434/854] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:09.837073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8dd99-249a-4581-b9f9-f7abf4abf127 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.862203 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 421/855] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:09.889006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065b646-9b07-4068-85c6-2d6c5ba42aaa None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:09.955935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8dd99-249a-4581-b9f9-f7abf4abf127 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.009015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.009829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.010112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.010389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.011080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.012456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:10.014750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065b646-9b07-4068-85c6-2d6c5ba42aaa None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:10.025412 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:10.026683 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:10.028853 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 435/856] 10.222.0.32 () {56 vars in 1132 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:10.036731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:10.060757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.061560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.061844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.062120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.082007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:10.092759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:10.093809 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:31:10.094678 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:10.101124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 422/857] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:31:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:10.102725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:10.160282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47c1d5-f324-4c57-907f-20b3c761656b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.195451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.196128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.196411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.196684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.197393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:10.197701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.199110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:10.212889 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 436/858] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:10.215592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:10.246058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc62c6-a7e6-44e2-bcc1-4d91ebc330fc None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.285582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.286588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.287105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.287578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.288541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:10.289054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.290649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:10.300222 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 423/859] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:31:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:10.308195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:10.323021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9519f-7391-4f81-b898-b44e393fd201 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.366243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.367690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.368309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.368908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.369966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:10.370495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.372877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:10.381698 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 437/860] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:10.424850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e3bf-c9ba-4f94-aeb2-30184dc0e3fd None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.464050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.465205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.465707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.466238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.479015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.480865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:10.500699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:10.501684 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:10.502586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:10.502586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:10.502586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:10.502586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:10.504980 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 424/861] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:10.512008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:10.615681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ac344-2ccd-4fa8-b0a0-9c26aaa8c0f9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.649216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.649884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.650167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.650446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.651188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:10.651495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.652866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:10.670064 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 438/862] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:10.671495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:10.772857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b15f55-2ace-4afa-846f-25673338d2e1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.806983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.808120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.808585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.809049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.817347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.819025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:10.834394 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:10.835409 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:10.836659 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:10.839084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 425/863] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:31:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:10.846812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:10.945185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d245c-ce6c-4466-8e64-ce218e14c645 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:10.983164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:10.983830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:10.984111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:10.984384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:10.985278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:10.985584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:10.987096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:11.004269 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 439/864] 10.222.0.32 () {56 vars in 1149 bytes} [Sat May 7 21:31:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:11.009958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:11.112449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2f3dc-9ab6-4adb-9348-63b9031460a6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:11.150593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:11.151276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:11.151561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:11.151836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:11.220520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:11.221994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:11.325495 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 426/865] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:11.328325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:11.428537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332deb3d-82d5-426d-af61-e0a73b0586df None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:11.462949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:11.463739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:11.464016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:11.464285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:11.474877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:11.476505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:11.493541 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:11.494464 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:11.495419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:11.495419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:11.495419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:11.495419 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:11.495419 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 440/866] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:11.500493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:11.603677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41e3ff-aff6-4dca-8141-6b5c3d8a3b49 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:11.638797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:11.639465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:11.639750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:11.640026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:11.640745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:11.641049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:11.642421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:11.658438 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 427/867] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:11.659814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:11.760398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59765f-cee5-4497-8a4f-384839a7baf4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:11.794022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:11.795171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:11.795673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:11.796147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:11.802953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:11.804708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:11.818859 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:11.819809 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:11.820712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:11.823253 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 441/868] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:11.834926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:11.936288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde1574-b7f7-4fdb-a371-5fd8ecf60d1c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:11.970913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa3aee-62b7-440c-80ec-e1d6a25ef7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:11.971633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3aee-62b7-440c-80ec-e1d6a25ef7f2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:11.971918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3aee-62b7-440c-80ec-e1d6a25ef7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:11.972198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa3aee-62b7-440c-80ec-e1d6a25ef7f2 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:11.972982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa3aee-62b7-440c-80ec-e1d6a25ef7f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:11.973288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa3aee-62b7-440c-80ec-e1d6a25ef7f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:11.974730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa3aee-62b7-440c-80ec-e1d6a25ef7f2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:11.993803 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 428/869] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:11.995909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:12.049225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25ac12-1854-46fb-903a-ebe761a29b19 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.049415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25ac12-1854-46fb-903a-ebe761a29b19 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.049635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25ac12-1854-46fb-903a-ebe761a29b19 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.051290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 429/870] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:12.056449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebbfe8-912c-4dff-914b-e3e23d673506 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.056745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebbfe8-912c-4dff-914b-e3e23d673506 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.057022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebbfe8-912c-4dff-914b-e3e23d673506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.073515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eeebbfe8-912c-4dff-914b-e3e23d673506 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:12.074718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eeebbfe8-912c-4dff-914b-e3e23d673506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:12.101855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56cca4-4f9d-43fd-b5d7-30f2e566a952 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:12.135651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:12.136961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.137455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.138669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.140333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=d5e959f3745040feb800a00c9c5e4e2b) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:12.140804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:12.143125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:12.150415 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 442/872] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:11 2022] GET /identity/v3/role_assignments?user.id=d5e959f3745040feb800a00c9c5e4e2b&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:12.158912 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 430/872] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:12.176978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:12.192069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e328d-5d54-4e2c-bfbe-a81368ac087e None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.192359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e328d-5d54-4e2c-bfbe-a81368ac087e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.192644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e328d-5d54-4e2c-bfbe-a81368ac087e None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.194745 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 431/873] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:12.200534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de564-5000-4085-82f3-ae3560629869 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.201336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de564-5000-4085-82f3-ae3560629869 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.201336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de564-5000-4085-82f3-ae3560629869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.221033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4d4de564-5000-4085-82f3-ae3560629869 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:12.222250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4d4de564-5000-4085-82f3-ae3560629869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:12.307037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 432/874] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:12.315143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ea781-ef8d-4959-9535-c27237df073c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:12.324534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de564-5000-4085-82f3-ae3560629869 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:12.362700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:12.363857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.364373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.364875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.366145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:12.368084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:12.389236 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 443/875] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:31:12 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:12.445449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de564-5000-4085-82f3-ae3560629869 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:12.500913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:12.500913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.500913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.500913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.501378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:12.502753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:12.519294 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:12.520356 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:12.521200 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:12.525775 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 433/876] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:12.527205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:12.638751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b73ab-8a5c-4e05-9151-e0f874af38cb None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:12.671292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bac55-f39b-4a48-a7fd-a9b7f2245248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:12.671950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bac55-f39b-4a48-a7fd-a9b7f2245248 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.672249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bac55-f39b-4a48-a7fd-a9b7f2245248 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.672489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bac55-f39b-4a48-a7fd-a9b7f2245248 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.673204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bac55-f39b-4a48-a7fd-a9b7f2245248 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:12.673489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bac55-f39b-4a48-a7fd-a9b7f2245248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:12.674885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bac55-f39b-4a48-a7fd-a9b7f2245248 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:12.679841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 444/877] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:12.686141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:12.798875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee448a53-40f9-4e65-971a-76007de41931 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:12.799073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ef97-e279-43e1-859f-e2c985459fc5 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.799073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ef97-e279-43e1-859f-e2c985459fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.799073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957ef97-e279-43e1-859f-e2c985459fc5 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.799073 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 445/878] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:12.803735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135692-99a7-4658-af50-6bb3d8c96df3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.804024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135692-99a7-4658-af50-6bb3d8c96df3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.804308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135692-99a7-4658-af50-6bb3d8c96df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.821325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-03135692-99a7-4658-af50-6bb3d8c96df3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:12.822513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-03135692-99a7-4658-af50-6bb3d8c96df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:12.840261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:12.841797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:12.842085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:12.842364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:12.843270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:12.843886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:12.845274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:12.851262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 434/879] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:12.904056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 446/880] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:12.927598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:13.037254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6e6b6-4527-4b2c-90a5-da1f617da0a5 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:13.072295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d598a-919b-43fa-9298-fbcd8b95647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:13.073335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d598a-919b-43fa-9298-fbcd8b95647a None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:13.073825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d598a-919b-43fa-9298-fbcd8b95647a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:13.074306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d598a-919b-43fa-9298-fbcd8b95647a None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:13.075844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d598a-919b-43fa-9298-fbcd8b95647a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:13.077486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d598a-919b-43fa-9298-fbcd8b95647a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:13.095470 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 435/881] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:31:12 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:14.725694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647295e9-7e48-4e86-872e-cc358b92b610 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:14.726222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647295e9-7e48-4e86-872e-cc358b92b610 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:14.726222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647295e9-7e48-4e86-872e-cc358b92b610 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:14.728001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 447/882] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:14.733467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853b88-5981-40f3-8053-cd5cf6e27278 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:14.733902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853b88-5981-40f3-8053-cd5cf6e27278 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:14.734085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8853b88-5981-40f3-8053-cd5cf6e27278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:14.751326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b8853b88-5981-40f3-8053-cd5cf6e27278 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:14.752505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b8853b88-5981-40f3-8053-cd5cf6e27278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:14.826042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 436/883] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:14.850631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647295e9-7e48-4e86-872e-cc358b92b610 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:14.860475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9828cf-d910-4ef0-b3f5-dd5fdfead1af None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:14.860475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9828cf-d910-4ef0-b3f5-dd5fdfead1af None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:14.860742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9828cf-d910-4ef0-b3f5-dd5fdfead1af None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:14.862275 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 437/884] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:14.867359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594342-bb1d-4e22-915a-15b1d4542e62 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:14.867638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594342-bb1d-4e22-915a-15b1d4542e62 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:14.867915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f594342-bb1d-4e22-915a-15b1d4542e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:14.884614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3f594342-bb1d-4e22-915a-15b1d4542e62 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:14.885779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3f594342-bb1d-4e22-915a-15b1d4542e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:14.958914 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 438/885] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:14.971306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647295e9-7e48-4e86-872e-cc358b92b610 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:14.977542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f594342-bb1d-4e22-915a-15b1d4542e62 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.013733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.014635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.014836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.015161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.031283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:15.041238 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:15.042269 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:15.043192 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:15.044181 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 448/886] 10.222.0.32 () {56 vars in 1120 bytes} [Sat May 7 21:31:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:15.050433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.103759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f594342-bb1d-4e22-915a-15b1d4542e62 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.140709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.141613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.141959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.142300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.143174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.144621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:15.157086 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:15.158365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:15.159352 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:15.160097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd45e6-9c15-49c4-9b96-69b79f43ad65 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.164013 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 439/887] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:15.164958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.192960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.193628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.193909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.194185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.194961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:15.195269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.196656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.205958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 449/888] 10.222.0.32 () {56 vars in 1115 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:15.211529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.279876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2530e-1737-40a7-b68b-49ba9b10cc3a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.311676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36121ec5-49f7-4698-9f05-cdf7787811f0 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.312771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a086f0e-e141-4c62-af39-aad711719b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.313456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086f0e-e141-4c62-af39-aad711719b8f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.313737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086f0e-e141-4c62-af39-aad711719b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.314018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086f0e-e141-4c62-af39-aad711719b8f None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.314737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a086f0e-e141-4c62-af39-aad711719b8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:15.315079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a086f0e-e141-4c62-af39-aad711719b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.316688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a086f0e-e141-4c62-af39-aad711719b8f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.326503 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 440/889] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:15.326503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530b32-881f-4a6f-9f9a-57d4663296c1 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.326503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530b32-881f-4a6f-9f9a-57d4663296c1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.326503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3530b32-881f-4a6f-9f9a-57d4663296c1 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.327268 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 441/890] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:15.329817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3530b32-881f-4a6f-9f9a-57d4663296c1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.354358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005c314-43ba-4eca-ac46-42f30668a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.355182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c314-43ba-4eca-ac46-42f30668a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.355459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c314-43ba-4eca-ac46-42f30668a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.355727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005c314-43ba-4eca-ac46-42f30668a9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.366533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005c314-43ba-4eca-ac46-42f30668a9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.367998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005c314-43ba-4eca-ac46-42f30668a9d6 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-5005c314-43ba-4eca-ac46-42f30668a9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:15.384718 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:15.385686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:15.386622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:15.386622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:15.386622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:15.386622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:15.386622 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 450/891] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:15.387489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4f13-6bb7-4978-99ec-f02e61ba90d5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.387489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4f13-6bb7-4978-99ec-f02e61ba90d5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.387731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4f13-6bb7-4978-99ec-f02e61ba90d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.403813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7d0a4f13-6bb7-4978-99ec-f02e61ba90d5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:15.404989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7d0a4f13-6bb7-4978-99ec-f02e61ba90d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:15.436974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3530b32-881f-4a6f-9f9a-57d4663296c1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.469963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.470624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.470931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.471200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.471887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:15.472183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.473522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.475080 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 451/892] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:15.475790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4f13-6bb7-4978-99ec-f02e61ba90d5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.488134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 442/893] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:15.490207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.578043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4f13-6bb7-4978-99ec-f02e61ba90d5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.595253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf0b33-5d7a-4a0e-95ec-812fad058d74 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.609183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.609835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.610113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.610378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.611112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:15.611409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.612762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.623756 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 452/894] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:15.624507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.632481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcc384-a207-4320-ad73-2bf00daa0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.633135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc384-a207-4320-ad73-2bf00daa0103 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.633414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc384-a207-4320-ad73-2bf00daa0103 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.633684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc384-a207-4320-ad73-2bf00daa0103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.634464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcc384-a207-4320-ad73-2bf00daa0103 None admin] RBAC: Adding query filter params (interface=public, service_id=5859ff9c8f194d18becf89897f9979d1, region_id=RegionOne) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:15.634793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcc384-a207-4320-ad73-2bf00daa0103 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.636171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcc384-a207-4320-ad73-2bf00daa0103 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.641870 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 443/895] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/endpoints?service_id=5859ff9c8f194d18becf89897f9979d1&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:15.642929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597c39-ff5c-4e02-b3d3-f362379e2d98 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.643214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597c39-ff5c-4e02-b3d3-f362379e2d98 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.643489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597c39-ff5c-4e02-b3d3-f362379e2d98 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.644688 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 444/896] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:15.645421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3597c39-ff5c-4e02-b3d3-f362379e2d98 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.720606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1560db-db0f-4543-b456-8808c47ac7f1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.739380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3597c39-ff5c-4e02-b3d3-f362379e2d98 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.752391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.753055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.753333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.753603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.754310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.755709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.767979 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 453/897] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:31:15 2022] POST /identity/v3/services => generated 241 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:15.768759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.777955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766ffbd-f009-44dd-9ba3-4a7410ffb5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.778875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766ffbd-f009-44dd-9ba3-4a7410ffb5b2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.779157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766ffbd-f009-44dd-9ba3-4a7410ffb5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.779424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766ffbd-f009-44dd-9ba3-4a7410ffb5b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.787388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766ffbd-f009-44dd-9ba3-4a7410ffb5b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.788877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766ffbd-f009-44dd-9ba3-4a7410ffb5b2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-2766ffbd-f009-44dd-9ba3-4a7410ffb5b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:15.805365 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:15.806405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:15.807567 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 445/898] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:15.808175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9173a44-7e84-42e1-9b3f-1ef53df4b8bb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.808792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9173a44-7e84-42e1-9b3f-1ef53df4b8bb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.808792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9173a44-7e84-42e1-9b3f-1ef53df4b8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.826080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b9173a44-7e84-42e1-9b3f-1ef53df4b8bb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:15.827349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b9173a44-7e84-42e1-9b3f-1ef53df4b8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:15.882735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b9e44-e771-4aa9-838b-40865b55fd8f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:15.911347 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 446/899] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:15.912168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9173a44-7e84-42e1-9b3f-1ef53df4b8bb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:15.926431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:15.927180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:15.927466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:15.927740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:15.928437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:15.929843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:15.937023 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 454/900] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:31:15.938860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.045123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9173a44-7e84-42e1-9b3f-1ef53df4b8bb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.070669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42212b0e-b254-4149-83dc-b4882db586be None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.083169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.084195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.084677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.085141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.086450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:16.086976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.088669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.109628 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 447/901] 10.222.0.32 () {56 vars in 1149 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:16.116209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.116209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.116209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.117754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.120399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.121137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.123548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:16.136225 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:16.137431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:16.139045 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:16.141337 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 455/902] 10.222.0.32 () {56 vars in 1132 bytes} [Sat May 7 21:31:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:16.147571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.239226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ab413-bad2-4cdf-a737-322bbef5149c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.265743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7040f-7fc5-4455-9990-e894afb51603 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.272975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.273754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.274347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.274467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.301592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.302499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.302972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.303388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.304283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:16.304744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.306271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.316055 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 456/903] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:16.317230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.346682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.348176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.450021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19678a66-ce49-4dc1-bf86-a14b8d65d72e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.469123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 448/904] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:16.470294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.499641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.500672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.501151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.501697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.502659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:16.503180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.504758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.515094 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 457/905] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:16.516252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.590866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bf464-aa66-4406-8a42-848280dcdd9c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.633516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08885e3c-e0b8-48ee-869d-ff82f30d95ec None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.635467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.637199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.637710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.638156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.650991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.652682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.669190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.669949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.670306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.670656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.671578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] RBAC: Adding query filter params (interface=public, service_id=dd9739ed561b4f978e5416ad9d227d87, region_id=RegionOne) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:16.672175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.673687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:16.678706 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:16.679622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:16.680520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:16.680520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:16.680520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:16.680520 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:16.690053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 458/906] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/endpoints?service_id=dd9739ed561b4f978e5416ad9d227d87&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:16.690304 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 449/907] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:16.691156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.698166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.802966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc941c2-6728-4ecb-a820-ec9f770b01fa None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.807593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4e3bc-eefa-4594-9704-117c858e54ac None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:16.841565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.842718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.843232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.843815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.844411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:16.844834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.845270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:16.845652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:16.846030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:16.846894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:16.847051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.847417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:16.848951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:16.862981 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 450/908] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:31:16.867840 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 459/909] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:16.869312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:16.990034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ce82e-e4c1-40e2-9d74-5f45a10648fa None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:17.028838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:17.029683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:17.029964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:17.030234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:17.038631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:17.040224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:17.057334 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:17.058273 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:17.059564 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 451/910] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:17.066295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:17.173526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c02bae-befb-4491-b03f-6c55351c8d1a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:17.208857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4f072-3ff6-451e-8c65-87df0d61c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:17.209607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4f072-3ff6-451e-8c65-87df0d61c06c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:17.209978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4f072-3ff6-451e-8c65-87df0d61c06c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:17.210294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4f072-3ff6-451e-8c65-87df0d61c06c None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:17.211463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4f072-3ff6-451e-8c65-87df0d61c06c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:17.211839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4f072-3ff6-451e-8c65-87df0d61c06c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:17.213382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4f072-3ff6-451e-8c65-87df0d61c06c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:17.226757 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 460/911] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:17.233564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:17.339324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5491e9e-a9b9-42d1-b2ca-820b87dc402c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:17.374549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603bf536-3393-4fc5-8640-ff4d4896f44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:17.375238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf536-3393-4fc5-8640-ff4d4896f44e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:17.375525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf536-3393-4fc5-8640-ff4d4896f44e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:17.375798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603bf536-3393-4fc5-8640-ff4d4896f44e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:17.376622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bf536-3393-4fc5-8640-ff4d4896f44e None admin] RBAC: Adding query filter params (role.id=350456731f2942a1b3ac74f1b51b3c15, scope.project.id=758d4dea899344b883971712aebe042f, user.id=d5e959f3745040feb800a00c9c5e4e2b) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:17.376931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bf536-3393-4fc5-8640-ff4d4896f44e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:17.378362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603bf536-3393-4fc5-8640-ff4d4896f44e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:17.384382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 452/912] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:17 2022] GET /identity/v3/role_assignments?user.id=d5e959f3745040feb800a00c9c5e4e2b&scope.project.id=758d4dea899344b883971712aebe042f&role.id=350456731f2942a1b3ac74f1b51b3c15 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:18.275182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4096-6287-44df-964c-f4c49e1adce0 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.275698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4096-6287-44df-964c-f4c49e1adce0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.275808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4096-6287-44df-964c-f4c49e1adce0 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.277286 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 461/913] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:18.283224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531cc4-f8f2-456c-ac26-d2c3b9e85163 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.283625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531cc4-f8f2-456c-ac26-d2c3b9e85163 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.283797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05531cc4-f8f2-456c-ac26-d2c3b9e85163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.300362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-05531cc4-f8f2-456c-ac26-d2c3b9e85163 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:18.301532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-05531cc4-f8f2-456c-ac26-d2c3b9e85163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:18.358075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723ce8-c8e7-4acb-8531-de3d537fb8b8 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.358693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723ce8-c8e7-4acb-8531-de3d537fb8b8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.359225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92723ce8-c8e7-4acb-8531-de3d537fb8b8 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.362067 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 462/914] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:18.366368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8985ae-fd03-4262-bbe2-b5f1a62794fb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.366958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8985ae-fd03-4262-bbe2-b5f1a62794fb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.367442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8985ae-fd03-4262-bbe2-b5f1a62794fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.367792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 453/915] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:18.385238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ba8985ae-fd03-4262-bbe2-b5f1a62794fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:18.386691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba8985ae-fd03-4262-bbe2-b5f1a62794fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:18.392866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531cc4-f8f2-456c-ac26-d2c3b9e85163 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.462994 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 463/916] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:18.484255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8985ae-fd03-4262-bbe2-b5f1a62794fb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.493342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05531cc4-f8f2-456c-ac26-d2c3b9e85163 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:18.527883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:18.529534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.529948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.530350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.531241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:18.532805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:18.545213 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:18.546229 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:18.547133 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 454/917] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:18.553989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.595256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8985ae-fd03-4262-bbe2-b5f1a62794fb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:18.631086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:18.632250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.632740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.633251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.634107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:18.635733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:18.649095 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:18.650403 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 07 21:31:18.651370 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:18.653567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f64d3-3227-4e17-b178-ea1f43ad1596 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:18.659056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 464/918] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:18.660542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.688317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:18.688975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.689254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.689526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.690222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:18.690530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:18.692010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:18.701647 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 455/919] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:18.702497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.766722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdced58-15e7-4df3-9b9a-12906f37a30d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:18.800832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:18.801356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e00ec8-c1e3-4981-8cb8-799a7ae347c1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:18.801943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.802378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.802827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.803910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:18.804598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:18.807036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:18.817367 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 465/920] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:18.819407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.835909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:18.836569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.836937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.837168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.837913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:18.838217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:18.839606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:18.844731 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 456/921] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:18.850196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.923758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0dc7-737e-4e34-a6a3-9c01c4d819df None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:18.949347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7406a-569b-417e-9a86-2a407ff2a791 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:18.958379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:18.959300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.959750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.960177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.961593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:18.962064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:18.963632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:18.974092 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 466/922] 10.222.0.32 () {56 vars in 1114 bytes} [Sat May 7 21:31:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:18.975739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:18.984111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:18.984795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:18.985049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:18.985522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:18.986188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] RBAC: Adding query filter params (interface=public, service_id=cb5f2f8156954fbdbce4cff2bcbd9184, region_id=RegionOne) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:18.986492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:18.988015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:19.001806 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 457/923] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:31:18 2022] GET /identity/v3/endpoints?service_id=cb5f2f8156954fbdbce4cff2bcbd9184&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:19.003110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:19.086274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5020-0848-431c-8c41-04c28ace604f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:19.103417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d847fb-5722-4628-ace6-6480b0a975b9 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:19.125021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec6445-08ce-4c66-bb07-633d1b33fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:19.126074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6445-08ce-4c66-bb07-633d1b33fa02 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.126588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6445-08ce-4c66-bb07-633d1b33fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.127122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6445-08ce-4c66-bb07-633d1b33fa02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.128200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec6445-08ce-4c66-bb07-633d1b33fa02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:19.129866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec6445-08ce-4c66-bb07-633d1b33fa02 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:19.141870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723eeb7-de4f-4627-a667-a5db47bd92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:19.142533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723eeb7-de4f-4627-a667-a5db47bd92ae None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.142978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723eeb7-de4f-4627-a667-a5db47bd92ae None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.143230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723eeb7-de4f-4627-a667-a5db47bd92ae None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.144090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723eeb7-de4f-4627-a667-a5db47bd92ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:19.145609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723eeb7-de4f-4627-a667-a5db47bd92ae None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:19.159050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 467/925] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:31:19.159430 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 458/925] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:19 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:31:19.321068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d96c4e-cd88-4f1e-bd64-d75232ba2803 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.321702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d96c4e-cd88-4f1e-bd64-d75232ba2803 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.321702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d96c4e-cd88-4f1e-bd64-d75232ba2803 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.323431 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 459/926] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:19.329394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c29e-452c-4803-9704-5529acf191e8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.330348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c29e-452c-4803-9704-5529acf191e8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.330878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602c29e-452c-4803-9704-5529acf191e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.350437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5602c29e-452c-4803-9704-5529acf191e8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:19.352046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5602c29e-452c-4803-9704-5529acf191e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:19.431184 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 468/927] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:19.455901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d96c4e-cd88-4f1e-bd64-d75232ba2803 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:19.563377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d96c4e-cd88-4f1e-bd64-d75232ba2803 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:19.599392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc316-264c-40a0-b41e-74715b71ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:19.600202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc316-264c-40a0-b41e-74715b71ce64 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.600532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc316-264c-40a0-b41e-74715b71ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.600747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc316-264c-40a0-b41e-74715b71ce64 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.601392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc316-264c-40a0-b41e-74715b71ce64 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:19.602754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc316-264c-40a0-b41e-74715b71ce64 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-247bc316-264c-40a0-b41e-74715b71ce64 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:19.615667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:19.616648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:19.617712 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 460/928] 10.222.0.32 () {56 vars in 1132 bytes} [Sat May 7 21:31:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:19.623308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602c29e-452c-4803-9704-5529acf191e8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:19.723747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602c29e-452c-4803-9704-5529acf191e8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:19.743330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20cb9-77e6-4e7d-a3f6-b5b2b93cafeb None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.743632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20cb9-77e6-4e7d-a3f6-b5b2b93cafeb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.743875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e20cb9-77e6-4e7d-a3f6-b5b2b93cafeb None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.745458 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 461/929] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:19.751042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105b602-3301-4f77-a8ba-b2b2a9b43486 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.751329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105b602-3301-4f77-a8ba-b2b2a9b43486 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.751607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105b602-3301-4f77-a8ba-b2b2a9b43486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.759978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:19.760740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.761024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.761298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.762001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:19.762330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:19.764186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:19.768558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f105b602-3301-4f77-a8ba-b2b2a9b43486 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:19.774919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f105b602-3301-4f77-a8ba-b2b2a9b43486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:19.775043 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 469/930] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:19.776454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:19.846926 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 462/931] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:19.866274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105b602-3301-4f77-a8ba-b2b2a9b43486 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:19.881307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b842-b431-43c2-968d-3dd2090adbc4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:19.915354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:19.916403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:19.917059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:19.917731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:19.919272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:19.919812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:19.921391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:19.931371 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 470/932] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:19.932491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:19.966645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105b602-3301-4f77-a8ba-b2b2a9b43486 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:20.001455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:20.002278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:20.002544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:20.002875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:20.014678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:20.023134 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:20.024126 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:20.024990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:20.032998 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 463/933] 10.222.0.32 () {56 vars in 1120 bytes} [Sat May 7 21:31:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:20.034134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:20.039841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb7b2-8b27-445f-81b7-ce00a8d99647 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:20.075380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:20.076972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:20.077656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:20.078387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:20.079471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:20.081690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:20.110910 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 471/934] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:20.140586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ffb7e-f43a-4c6a-9aa0-5b5d3f3ba987 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:20.183592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:20.184838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:20.185168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:20.185445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:20.186189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:20.186492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:20.188087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:20.203658 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 464/935] 10.222.0.32 () {56 vars in 1115 bytes} [Sat May 7 21:31:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:20.210164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:20.320680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899ea5e-27cf-4a8d-be52-e7f45482510d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:20.356642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:20.357462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:20.357745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:20.358017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:20.370346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:20.372538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:20.391712 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:20.392638 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:20.393621 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:20.393621 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:20.393621 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:20.393621 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:20.393621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 472/936] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:20.398871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:20.501704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6dc9b-e18d-4994-a53d-e42142d7e9f6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:20.535605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:20.536267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:20.536548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:20.536820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:20.537528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:20.537827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:20.539351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:20.552267 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 465/937] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:20.560371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:20.658335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1312a4-49e9-4af2-91ac-042433a5dbaa None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:20.692051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:20.692863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:20.693147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:20.693422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:20.700519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:20.702039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:20.717827 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:20.718799 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:20.719753 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:20.722890 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 473/938] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:31:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:20.725195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:20.829660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c355a8d-1afa-4d1e-a4cc-2b6f2f8c62f8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:20.863375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:20.864051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:20.864332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:20.864609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:20.865436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:20.865747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:20.867286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:20.885223 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 466/939] 10.222.0.32 () {56 vars in 1149 bytes} [Sat May 7 21:31:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:20.891175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:20.993062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fbdec-d62c-41aa-bd5b-5922bd528834 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:21.027164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:21.028004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.028289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.028570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.039820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:21.041501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:21.061126 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:21.062271 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:21.063191 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:21.063191 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:21.063191 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:21.063191 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:21.066978 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 474/940] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:21.068522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:21.173581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314739e-1d6d-4502-a629-56e3ddf01e46 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:21.222797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:21.223473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.223758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.224033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.224749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:21.225054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:21.226491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:21.240028 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 467/941] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:21.245489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:21.344264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a7c4-0378-4678-aa29-4c41eeb93a2b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:21.380722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd32e01-3536-4904-b948-d27d4470eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:21.382485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32e01-3536-4904-b948-d27d4470eb58 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.383036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32e01-3536-4904-b948-d27d4470eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.383529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32e01-3536-4904-b948-d27d4470eb58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.394034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd32e01-3536-4904-b948-d27d4470eb58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:21.395972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd32e01-3536-4904-b948-d27d4470eb58 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0bd32e01-3536-4904-b948-d27d4470eb58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:21.410700 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:21.411841 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:21.412740 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:21.415127 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 475/942] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:21.426802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:21.531591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd201-e507-4408-bc7a-2ebebaa192ad None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:21.572312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:21.572985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.573267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.573544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.574326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:21.574634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:21.576206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:21.578536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a856b-86a2-4660-b0dc-4bff582ccceb None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.578858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a856b-86a2-4660-b0dc-4bff582ccceb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.579145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a856b-86a2-4660-b0dc-4bff582ccceb None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.581896 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 476/943] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:21.586236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19fbab-2012-47a4-9ee6-f07b8aaa6691 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.586526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19fbab-2012-47a4-9ee6-f07b8aaa6691 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.586820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19fbab-2012-47a4-9ee6-f07b8aaa6691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.591797 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 468/944] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:21.598298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:21.612906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ab19fbab-2012-47a4-9ee6-f07b8aaa6691 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:21.614939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ab19fbab-2012-47a4-9ee6-f07b8aaa6691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:21.695548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 477/945] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:21.697303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae92c31-7023-4c7d-8a71-0f9dff3f2d81 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.697658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae92c31-7023-4c7d-8a71-0f9dff3f2d81 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.698007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae92c31-7023-4c7d-8a71-0f9dff3f2d81 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.703281 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 478/946] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:21.705031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874225c-1508-47fe-ac37-98071c0001ab None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.705311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874225c-1508-47fe-ac37-98071c0001ab None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.705582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874225c-1508-47fe-ac37-98071c0001ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.708598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ec7ef-affe-49b0-857b-3a80cb4fcc4c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:21.729668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c874225c-1508-47fe-ac37-98071c0001ab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:21.730892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c874225c-1508-47fe-ac37-98071c0001ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:21.742013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:21.742923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.743206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.743480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/d5e959f3745040feb800a00c9c5e4e2b/roles/350456731f2942a1b3ac74f1b51b3c15` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.745685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=d5e959f3745040feb800a00c9c5e4e2b, role_id=350456731f2942a1b3ac74f1b51b3c15)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:21.747182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:21.759319 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 469/947] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:31:21 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/d5e959f3745040feb800a00c9c5e4e2b/roles/350456731f2942a1b3ac74f1b51b3c15 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:31:21.760086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:21.826208 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 479/948] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:21.848646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874225c-1508-47fe-ac37-98071c0001ab None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:21.886500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56fbd9-4f76-4c04-a364-bec449e49bbe None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:21.933751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:21.935764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:21.936156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:21.936492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:21.937561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:21.939478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:21.941550 ncdv-master-1 devstack@keystone.service[91075]: WARNING keystone.server.flask.common [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 07 21:31:21.967780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.sql.core [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 07 21:31:21.967780 ncdv-master-1 devstack@keystone.service[91075]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 07 21:31:21.967780 ncdv-master-1 devstack@keystone.service[91075]: [parameters: {'id': '8b8e186b2cb74df8b6030236447fab29', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 07 21:31:21.967780 ncdv-master-1 devstack@keystone.service[91075]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91075) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 07 21:31:21.974056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874225c-1508-47fe-ac37-98071c0001ab None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b8e186b2cb74df8b6030236447fab29.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b8e186b2cb74df8b6030236447fab29. May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result = self._query(query) May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application conn.query(q) May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 21:31:21.974535 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result.read() May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 07 21:31:21.975350 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return project_ref.to_dict() May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application next(self.gen) May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application yield resource May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application next(self.gen) May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.session.rollback() May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.force_reraise() May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise self.value May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application session.commit() May 07 21:31:21.976318 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._prepare_impl() May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.session.flush() May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._flush(objects) May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application compat.raise_( May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application flush_context.execute() May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 07 21:31:21.977232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rec.execute(self) May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application _emit_insert_statements( May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application c = connection._execute_20( May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ret = self._execute_context( May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 07 21:31:21.978750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result = self._query(query) May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application conn.query(q) May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result.read() May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 21:31:21.979602 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [parameters: {'id': '8b8e186b2cb74df8b6030236447fab29', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:21.982018 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:21.983904 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.Conflict( May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8b8e186b2cb74df8b6030236447fab29. May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 470/949] 10.222.0.32 () {60 vars in 1140 bytes} [Sat May 7 21:31:21 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:21.986081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:22.016447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:22.017320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.017610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.018169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.018898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:22.021035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:22.034693 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:22.035792 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:22.036681 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:22.041138 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 480/950] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:22.042375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:22.149414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf84b4f-4741-4db6-90c3-d92f14d58e1f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:22.173775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81018e9a-7d85-4f76-bbea-6e3ecb13574f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:22.183214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:22.183914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.184736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.185016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.185726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:22.186031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:22.187447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:22.197284 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 481/951] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:22.198669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:22.243871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:22.244754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.245086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.245369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.253870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:22.255703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:22.271085 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:22.272038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:22.272927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:22.273421 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 471/952] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:22.278812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:22.389339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e77984-9ae6-4003-b048-f259dc1ed561 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:22.424445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:22.425442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.425943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.426416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.427357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:22.427883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:22.429442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:22.435108 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 482/953] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:22.442808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db0302-c902-4b9f-a2b5-9509bff07b43 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:22.443836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:22.481784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a50473-6ee1-4b11-aa3f-ae6f4bd97537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:22.482806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50473-6ee1-4b11-aa3f-ae6f4bd97537 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.483247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50473-6ee1-4b11-aa3f-ae6f4bd97537 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.483676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a50473-6ee1-4b11-aa3f-ae6f4bd97537 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.484714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a50473-6ee1-4b11-aa3f-ae6f4bd97537 None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:22.485191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a50473-6ee1-4b11-aa3f-ae6f4bd97537 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:22.487003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a50473-6ee1-4b11-aa3f-ae6f4bd97537 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:22.515169 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 472/954] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:22.565241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1cb17-46e8-470e-9c2b-edfe5a77b450 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:22.605115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4cba8-3b9d-44b7-a62b-f79ad78890b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:22.605784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4cba8-3b9d-44b7-a62b-f79ad78890b4 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.606132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4cba8-3b9d-44b7-a62b-f79ad78890b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.606407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4cba8-3b9d-44b7-a62b-f79ad78890b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.607187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4cba8-3b9d-44b7-a62b-f79ad78890b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:22.608673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4cba8-3b9d-44b7-a62b-f79ad78890b4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:22.630288 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 483/955] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:22.681850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33008b-cbb1-4cfb-8511-0e15f93b68b6 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.682031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33008b-cbb1-4cfb-8511-0e15f93b68b6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.682537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33008b-cbb1-4cfb-8511-0e15f93b68b6 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.684987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 473/956] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:22.690850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc492dc-dcf0-461c-935c-fc1f9690b39e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.691180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc492dc-dcf0-461c-935c-fc1f9690b39e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.691516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc492dc-dcf0-461c-935c-fc1f9690b39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.711242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1cc492dc-dcf0-461c-935c-fc1f9690b39e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:22.712461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1cc492dc-dcf0-461c-935c-fc1f9690b39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:22.800941 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 484/957] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:22.823801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33008b-cbb1-4cfb-8511-0e15f93b68b6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:22.927661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33008b-cbb1-4cfb-8511-0e15f93b68b6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:22.962514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:22.963263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:22.963543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:22.963816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:22.964468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:22.966543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:22.978559 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:22.979635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:22.980936 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 474/958] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:22.986601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc492dc-dcf0-461c-935c-fc1f9690b39e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:23.087276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc492dc-dcf0-461c-935c-fc1f9690b39e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:23.124922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ad6ea-fc09-4f8d-bf6b-b453797b49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:23.125590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad6ea-fc09-4f8d-bf6b-b453797b49d9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:23.125872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad6ea-fc09-4f8d-bf6b-b453797b49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:23.126146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ad6ea-fc09-4f8d-bf6b-b453797b49d9 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:23.130814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad6ea-fc09-4f8d-bf6b-b453797b49d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:23.130814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad6ea-fc09-4f8d-bf6b-b453797b49d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:23.130814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ad6ea-fc09-4f8d-bf6b-b453797b49d9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:23.135210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 485/959] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:23.142872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:23.243289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718698b-c29e-49a5-9f9f-f02d5526dbf0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:23.276571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea147b-b6cc-4bfa-ae7d-c467103f030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:23.277221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea147b-b6cc-4bfa-ae7d-c467103f030f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:23.277498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea147b-b6cc-4bfa-ae7d-c467103f030f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:23.277790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea147b-b6cc-4bfa-ae7d-c467103f030f None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:23.278483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea147b-b6cc-4bfa-ae7d-c467103f030f None admin] RBAC: Adding query filter params (type=compute) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:23.278795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea147b-b6cc-4bfa-ae7d-c467103f030f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:23.280159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea147b-b6cc-4bfa-ae7d-c467103f030f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:23.284916 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 475/960] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:24.299020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306974-e67d-4695-898e-f1cb799cd485 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:24.299995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306974-e67d-4695-898e-f1cb799cd485 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:24.300570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306974-e67d-4695-898e-f1cb799cd485 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:24.302413 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 486/961] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:24.307414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2352-e68d-401c-b1b8-6457d240ce07 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:24.307836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2352-e68d-401c-b1b8-6457d240ce07 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:24.308011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b2352-e68d-401c-b1b8-6457d240ce07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:24.325889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0b4b2352-e68d-401c-b1b8-6457d240ce07 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:24.327422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b4b2352-e68d-401c-b1b8-6457d240ce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:24.393473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 476/962] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:24.417978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09306974-e67d-4695-898e-f1cb799cd485 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:24.527703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09306974-e67d-4695-898e-f1cb799cd485 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:24.564437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:24.565249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:24.565530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:24.565802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:24.576372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:24.584531 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:24.585768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:24.586622 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 487/963] 10.222.0.32 () {56 vars in 1120 bytes} [Sat May 7 21:31:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:24.595306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2352-e68d-401c-b1b8-6457d240ce07 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:24.694728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b2352-e68d-401c-b1b8-6457d240ce07 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:24.729534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:24.730558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:24.731115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:24.731588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:24.732518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:24.733034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:24.734576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:24.743052 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 477/964] 10.222.0.32 () {56 vars in 1115 bytes} [Sat May 7 21:31:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:24.748812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:24.850359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd289c03-2b19-49f8-a594-0d7eba6bb205 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:24.888668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ee34-61ac-462e-927e-57b9793328ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:24.889487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ee34-61ac-462e-927e-57b9793328ad None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:24.889766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ee34-61ac-462e-927e-57b9793328ad None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:24.890038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ee34-61ac-462e-927e-57b9793328ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:24.901845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ee34-61ac-462e-927e-57b9793328ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:24.903429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6ee34-61ac-462e-927e-57b9793328ad None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-11d6ee34-61ac-462e-927e-57b9793328ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:24.921311 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:24.922247 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:24.923185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:24.923185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:24.923185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:24.923185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:24.923185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 488/965] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:24.929473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.010223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdc88-b738-421b-a347-630ec6a2f136 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.010541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdc88-b738-421b-a347-630ec6a2f136 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.010799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdc88-b738-421b-a347-630ec6a2f136 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.012420 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 489/966] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:25.021857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4199-e23e-4e8e-ae74-7b9aa430f9b6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.022440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4199-e23e-4e8e-ae74-7b9aa430f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.022950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4199-e23e-4e8e-ae74-7b9aa430f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.040698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-94dc4199-e23e-4e8e-ae74-7b9aa430f9b6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:25.042203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-94dc4199-e23e-4e8e-ae74-7b9aa430f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:25.042550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a1f9-d451-4e6d-ac71-2c1b65a216b3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.076485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e7b05-b4a2-465e-8030-219e6dd8e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.077151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7b05-b4a2-465e-8030-219e6dd8e56b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.077499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7b05-b4a2-465e-8030-219e6dd8e56b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.077805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7b05-b4a2-465e-8030-219e6dd8e56b None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.078518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7b05-b4a2-465e-8030-219e6dd8e56b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:25.078842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7b05-b4a2-465e-8030-219e6dd8e56b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.080253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7b05-b4a2-465e-8030-219e6dd8e56b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.093200 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 478/967] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:25.094497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be182fc-4296-4dbe-ac5b-23d2b75ad6be None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.094861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be182fc-4296-4dbe-ac5b-23d2b75ad6be None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.100795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be182fc-4296-4dbe-ac5b-23d2b75ad6be None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.100795 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 479/968] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:25.101782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be182fc-4296-4dbe-ac5b-23d2b75ad6be None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.118826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 490/969] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:25.119700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063a49-e957-4faf-94cc-54ba1f28ce2f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.120093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063a49-e957-4faf-94cc-54ba1f28ce2f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.120473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2063a49-e957-4faf-94cc-54ba1f28ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.139709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d2063a49-e957-4faf-94cc-54ba1f28ce2f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:25.143597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d2063a49-e957-4faf-94cc-54ba1f28ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:25.210646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be182fc-4296-4dbe-ac5b-23d2b75ad6be None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.212291 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 491/970] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:25.213350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2063a49-e957-4faf-94cc-54ba1f28ce2f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.254655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.255576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.255856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.256128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.264031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.265481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:25.279925 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:25.280931 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 480/971] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:25.281891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.317414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2063a49-e957-4faf-94cc-54ba1f28ce2f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.350660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.351406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.351633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.351902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.352577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.353999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.355306 ncdv-master-1 devstack@keystone.service[91076]: WARNING keystone.server.flask.common [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 07 21:31:25.368077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.sql.core [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 07 21:31:25.368077 ncdv-master-1 devstack@keystone.service[91076]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 07 21:31:25.368077 ncdv-master-1 devstack@keystone.service[91076]: [parameters: {'user_id': '13cf690a07004634954620048725c168', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 07 21:31:25.368077 ncdv-master-1 devstack@keystone.service[91076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 07 21:31:25.380145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5b75e-0088-40af-a6af-c4a3d3d46f22 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._query(query) May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application conn.query(q) May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result.read() May 07 21:31:25.385149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:31:25.386034 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application next(self.gen) May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application yield resource May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application next(self.gen) May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.session.rollback() May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.force_reraise() May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise self.value May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application session.commit() May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 07 21:31:25.392791 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._prepare_impl() May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.session.flush() May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._flush(objects) May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application compat.raise_( May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application flush_context.execute() May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rec.execute(self) May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 07 21:31:25.393847 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application _emit_insert_statements( May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = connection._execute_20( May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ret = self._execute_context( May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 21:31:25.394823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._query(query) May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application conn.query(q) May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result.read() May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 21:31:25.395705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [parameters: {'user_id': '13cf690a07004634954620048725c168', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:25.398281 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 07 21:31:25.400431 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 492/972] 10.222.0.32 () {60 vars in 1131 bytes} [Sat May 7 21:31:25 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:25.402696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.416334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.417604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.418074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.419119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.419968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.421472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:25.433653 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:25.435360 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:25.436248 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 481/973] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:25.437163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.502638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bf96-3403-4867-aa56-f190535f9811 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.535809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95210d67-9eb2-46c1-9cef-4a3cb9322e06 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.536448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.537145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.537431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.537707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.538545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:25.538883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.540535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.569614 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 493/974] 10.222.0.32 () {56 vars in 1149 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:25.569614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.576449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.577273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.577545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.578001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.586262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.587746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:25.602828 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:25.603968 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 482/975] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:25.604943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.679066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5540f0a-58b4-48d1-9454-280d6cd65c87 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.705752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a140a-ed9d-4708-9af7-ace914d4b8ff None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.712203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.712865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.713149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.713429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.714143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:25.714449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.716485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.721205 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 494/976] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:25.721826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.738997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f235c7-3f31-494d-a179-5308fce75c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.739633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f235c7-3f31-494d-a179-5308fce75c4e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.739911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f235c7-3f31-494d-a179-5308fce75c4e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.740183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f235c7-3f31-494d-a179-5308fce75c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.803125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f235c7-3f31-494d-a179-5308fce75c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.804566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f235c7-3f31-494d-a179-5308fce75c4e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.814190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c523d-15a4-4c9e-a06b-5ec2f831f646 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:25.846298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3325-7b44-479f-86b5-5b230027aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:25.846976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3325-7b44-479f-86b5-5b230027aa11 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.847260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3325-7b44-479f-86b5-5b230027aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.847538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3325-7b44-479f-86b5-5b230027aa11 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.848316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3325-7b44-479f-86b5-5b230027aa11 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:25.848626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3325-7b44-479f-86b5-5b230027aa11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:25.850020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3325-7b44-479f-86b5-5b230027aa11 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:25.883234 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 495/977] 10.222.0.32 () {56 vars in 1101 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:25.884508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb7d8-a8fa-4e83-94a1-6907bf647d0f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.884798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb7d8-a8fa-4e83-94a1-6907bf647d0f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.885077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cb7d8-a8fa-4e83-94a1-6907bf647d0f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.886465 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 496/978] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:25.887289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb7d8-a8fa-4e83-94a1-6907bf647d0f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:25.906349 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 483/979] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:25.908135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab615-5d57-47dc-8c80-4a954959c7fb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:25.908509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab615-5d57-47dc-8c80-4a954959c7fb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:25.908862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ab615-5d57-47dc-8c80-4a954959c7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:25.932765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-910ab615-5d57-47dc-8c80-4a954959c7fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:25.934114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-910ab615-5d57-47dc-8c80-4a954959c7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:26.014810 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 484/980] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:26.014810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab615-5d57-47dc-8c80-4a954959c7fb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.035068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cb7d8-a8fa-4e83-94a1-6907bf647d0f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.075656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.076435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.076792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.077079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.077800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:26.078087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.079492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.084893 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 497/981] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:26.085935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.126535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ab615-5d57-47dc-8c80-4a954959c7fb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.163559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.164601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.164890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.165166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.175708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.177091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:26.194561 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:26.195699 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:26.196927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:26.196927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:26.196927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:26.196927 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:26.196927 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 485/982] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:26.196927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.199369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407bb7-0e23-4ae5-950e-bcb56a28a40d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.232958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.233612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.233895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.234168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.234909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.236289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.250748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 498/983] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:31:26 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:26.251556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.299069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946a332-5f79-4eb4-ba7c-2a1a39cfe19b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.343729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.344399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.344688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.344966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.345774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] RBAC: Adding query filter params (interface=admin, service_id=cb5f2f8156954fbdbce4cff2bcbd9184, region_id=RegionOne) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:26.346089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.347518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.358374 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 486/984] 10.222.0.32 () {56 vars in 1249 bytes} [Sat May 7 21:31:26 2022] GET /identity/v3/endpoints?service_id=cb5f2f8156954fbdbce4cff2bcbd9184&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:26.358584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6be585-dfda-4085-b4f5-e256016c3ae3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.359610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.393559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.394238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.394524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.394817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.395563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:26.395869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.397269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.410671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 499/985] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:26.417206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.470734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c0cf3-6a00-4480-9a8e-c8be081d4081 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.506736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.507435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.507716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.507988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.508657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.510010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.516175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 487/986] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:26 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:31:26.520246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0cedb-e795-4ca7-8d4c-51ec48a26260 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.557380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.558218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.558502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.558795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.566269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.567769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:26.582569 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:26.583768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:26.584832 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 500/987] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:26.590011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.693653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492f22d-193b-428d-a05a-68968e312b1f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.730107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8e740-ad44-4c8a-979e-d9332a1807e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.731624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8e740-ad44-4c8a-979e-d9332a1807e0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.731908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8e740-ad44-4c8a-979e-d9332a1807e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.732184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8e740-ad44-4c8a-979e-d9332a1807e0 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.732965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8e740-ad44-4c8a-979e-d9332a1807e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:26.733272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8e740-ad44-4c8a-979e-d9332a1807e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.734698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8e740-ad44-4c8a-979e-d9332a1807e0 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.746944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 488/988] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:26.752898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:26.848924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e61ff1-ff6b-4efe-a890-2d46e3dd575e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:26.881146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79bb8-6fdd-4ebf-8ade-b07231ad7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:26.881945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79bb8-6fdd-4ebf-8ade-b07231ad7295 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:26.882330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79bb8-6fdd-4ebf-8ade-b07231ad7295 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:26.882705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79bb8-6fdd-4ebf-8ade-b07231ad7295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:26.883659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79bb8-6fdd-4ebf-8ade-b07231ad7295 None admin] RBAC: Adding query filter params (role.id=350456731f2942a1b3ac74f1b51b3c15, scope.project.id=758d4dea899344b883971712aebe042f, user.id=d5e959f3745040feb800a00c9c5e4e2b) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:26.884072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79bb8-6fdd-4ebf-8ade-b07231ad7295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:26.885618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79bb8-6fdd-4ebf-8ade-b07231ad7295 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:26.892383 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 501/989] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:26 2022] GET /identity/v3/role_assignments?user.id=d5e959f3745040feb800a00c9c5e4e2b&scope.project.id=758d4dea899344b883971712aebe042f&role.id=350456731f2942a1b3ac74f1b51b3c15 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:28.588283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce2cc-438c-4483-92d3-98531128e1db None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:28.588806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce2cc-438c-4483-92d3-98531128e1db None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:28.588888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce2cc-438c-4483-92d3-98531128e1db None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:28.590804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 489/990] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:28.596058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6f14-8f38-44a7-bf93-635abf761dd0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:28.596446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6f14-8f38-44a7-bf93-635abf761dd0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:28.596631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6f14-8f38-44a7-bf93-635abf761dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:28.615664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-595f6f14-8f38-44a7-bf93-635abf761dd0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:28.617199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-595f6f14-8f38-44a7-bf93-635abf761dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:28.693080 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 502/991] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:28.717825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ce2cc-438c-4483-92d3-98531128e1db None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:28.816661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ce2cc-438c-4483-92d3-98531128e1db None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:28.849377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:28.850088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:28.850371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:28.850645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] PATH_INFO: `/v3/services/compute` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:28.851330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:28.852700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:28.864107 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:28.865136 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:28.865998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:28.869464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 490/992] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:28.871812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecc109-a3f0-483c-90c2-019ba3e4519e None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:28.872056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:28.872161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecc109-a3f0-483c-90c2-019ba3e4519e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:28.872483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecc109-a3f0-483c-90c2-019ba3e4519e None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:28.873865 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 503/993] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:28.878933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117f15-bacc-44dd-85b9-d03fac678889 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:28.879222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117f15-bacc-44dd-85b9-d03fac678889 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:28.879497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a117f15-bacc-44dd-85b9-d03fac678889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:28.895981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1a117f15-bacc-44dd-85b9-d03fac678889 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:28.897174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1a117f15-bacc-44dd-85b9-d03fac678889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:28.967836 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 504/994] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:28.992459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a117f15-bacc-44dd-85b9-d03fac678889 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:28.997255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c9f07-3000-44d2-b1d9-82393ae7bdfa None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.032023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.032679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.032958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.033224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.033910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] RBAC: Adding query filter params (name=compute) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:29.034206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.035588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.040346 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 491/995] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:29.046188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.105502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a117f15-bacc-44dd-85b9-d03fac678889 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.140182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.140992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.141278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.141562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.142208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.143632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.146806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c33e4-86ff-48d0-9155-885b34f3f31a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:29.155517 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:29.156557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:29.157595 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 505/996] 10.222.0.32 () {56 vars in 1126 bytes} [Sat May 7 21:31:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:29.162599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.185728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.186633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.187101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.187518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.188400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] RBAC: Adding query filter params (type=compute) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:29.188845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.190362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.195659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 492/997] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:29.200988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.267725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9968a9c-33f9-4103-a3b3-7bee92938fde None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.298903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dbc58-2985-4e32-b4a7-b1d6d121514a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.301956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69d754-a325-4b04-8537-c6b1e5557a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.302575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69d754-a325-4b04-8537-c6b1e5557a10 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.302898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69d754-a325-4b04-8537-c6b1e5557a10 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.303180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69d754-a325-4b04-8537-c6b1e5557a10 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.303889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69d754-a325-4b04-8537-c6b1e5557a10 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:29.304197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69d754-a325-4b04-8537-c6b1e5557a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.305584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69d754-a325-4b04-8537-c6b1e5557a10 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.310960 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 506/998] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:29.312318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175acfb-b475-4997-9a32-c5bc62455781 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.312613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175acfb-b475-4997-9a32-c5bc62455781 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.312891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175acfb-b475-4997-9a32-c5bc62455781 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.314867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 507/999] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:29.316485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175acfb-b475-4997-9a32-c5bc62455781 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.342747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c38a-9c1d-475d-a050-31c92250c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.343415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c38a-9c1d-475d-a050-31c92250c13f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.343698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c38a-9c1d-475d-a050-31c92250c13f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.343966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c38a-9c1d-475d-a050-31c92250c13f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.344732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c38a-9c1d-475d-a050-31c92250c13f None admin] RBAC: Adding query filter params (interface=public, service_id=5a6307f2cc2646738359570051da050c, region_id=RegionOne) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:29.345037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c38a-9c1d-475d-a050-31c92250c13f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.346384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c38a-9c1d-475d-a050-31c92250c13f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.351228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 493/1000] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/endpoints?service_id=5a6307f2cc2646738359570051da050c&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:29.355059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf282-71b2-476a-b72f-fe1ab8b0ebe6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.355349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf282-71b2-476a-b72f-fe1ab8b0ebe6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.356492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf282-71b2-476a-b72f-fe1ab8b0ebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.372268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f36cf282-71b2-476a-b72f-fe1ab8b0ebe6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:29.373436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f36cf282-71b2-476a-b72f-fe1ab8b0ebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:29.416230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175acfb-b475-4997-9a32-c5bc62455781 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.434517 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 494/1001] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:29.435354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf282-71b2-476a-b72f-fe1ab8b0ebe6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.456845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.457792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.458072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.458347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.459084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:29.459386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.461014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.466826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 508/1002] 10.222.0.32 () {56 vars in 1122 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:29.467175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.533385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf282-71b2-476a-b72f-fe1ab8b0ebe6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.558732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f905a0-fcff-4418-9d3b-e0f43601a491 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.565471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.566127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.566408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.566681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.567383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.568740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.575268 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 495/1003] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:31:29.576019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.597304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.598106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.598386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.598657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] PATH_INFO: `/v3/services/image` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.599349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.600851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:29.613426 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:29.614495 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:29.622179 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 509/1004] 10.222.0.32 () {56 vars in 1105 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:29.623377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.695619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a05d1-cd0f-484c-95f5-003922d71362 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.733112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.733684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ddc80-a6e3-43ff-8e16-ca334799d0d0 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.733830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.734115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.734396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.735200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.736619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.763037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 496/1005] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:29.778217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44f0df-d331-4201-8baa-f88ccb627b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.779601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f0df-d331-4201-8baa-f88ccb627b6a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.779601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f0df-d331-4201-8baa-f88ccb627b6a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.779798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44f0df-d331-4201-8baa-f88ccb627b6a None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.780542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f0df-d331-4201-8baa-f88ccb627b6a None admin] RBAC: Adding query filter params (name=image) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:29.780852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f0df-d331-4201-8baa-f88ccb627b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.782291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44f0df-d331-4201-8baa-f88ccb627b6a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.788700 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 510/1006] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:29.794557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:29.899979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd03f8-67ab-466a-8f64-1b0be73f6162 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:29.934428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90c645-985c-469c-8fe3-2bd020c6edc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:29.935125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c645-985c-469c-8fe3-2bd020c6edc8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:29.935405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c645-985c-469c-8fe3-2bd020c6edc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:29.935674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c645-985c-469c-8fe3-2bd020c6edc8 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:29.936381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90c645-985c-469c-8fe3-2bd020c6edc8 None admin] RBAC: Adding query filter params (type=image) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:29.936681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90c645-985c-469c-8fe3-2bd020c6edc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:29.938072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90c645-985c-469c-8fe3-2bd020c6edc8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:29.942938 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 497/1007] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:31.923528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dd59d-29d0-4292-b99e-bbd96af6270e None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:31.924080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dd59d-29d0-4292-b99e-bbd96af6270e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:31.924080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dd59d-29d0-4292-b99e-bbd96af6270e None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:31.925516 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 511/1008] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:31.931581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079542-c3b0-4802-8f49-6863a734bd1f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:31.932146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079542-c3b0-4802-8f49-6863a734bd1f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:31.932146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac079542-c3b0-4802-8f49-6863a734bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:31.951720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ac079542-c3b0-4802-8f49-6863a734bd1f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:31.953469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ac079542-c3b0-4802-8f49-6863a734bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:32.016982 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 498/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:32.040879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dd59d-29d0-4292-b99e-bbd96af6270e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:32.116446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8b53-fff1-49ee-9b11-fb49a1056fc8 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.116765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8b53-fff1-49ee-9b11-fb49a1056fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.117009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca8b53-fff1-49ee-9b11-fb49a1056fc8 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.118393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 499/1010] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:32.123279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65136990-fa06-4f45-99a8-6ec6b4098709 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.123563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65136990-fa06-4f45-99a8-6ec6b4098709 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.123840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65136990-fa06-4f45-99a8-6ec6b4098709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.141045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-65136990-fa06-4f45-99a8-6ec6b4098709 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:32.142198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65136990-fa06-4f45-99a8-6ec6b4098709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:32.146361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dd59d-29d0-4292-b99e-bbd96af6270e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:32.179316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:32.180023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.180308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.180582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.181228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:32.182611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:32.197433 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:32.198695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:32.200321 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 512/1011] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:32.202310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:32.220792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 500/1012] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:32.244766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65136990-fa06-4f45-99a8-6ec6b4098709 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:32.300864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037473d0-8778-418f-83ef-24d7c7f892bc None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:32.332517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827d4ab-7ffc-4382-9763-eff685403ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:32.333166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d4ab-7ffc-4382-9763-eff685403ecd None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.333447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d4ab-7ffc-4382-9763-eff685403ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.333718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827d4ab-7ffc-4382-9763-eff685403ecd None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.334410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827d4ab-7ffc-4382-9763-eff685403ecd None admin] RBAC: Adding query filter params (name=compute) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:32.334713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827d4ab-7ffc-4382-9763-eff685403ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:32.336361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827d4ab-7ffc-4382-9763-eff685403ecd None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:32.340981 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 513/1013] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:32.342154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385740f2-6f61-429a-95df-0c206c8f475a None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.342350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65136990-fa06-4f45-99a8-6ec6b4098709 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:32.342456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385740f2-6f61-429a-95df-0c206c8f475a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.342697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385740f2-6f61-429a-95df-0c206c8f475a None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.343944 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 514/1014] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:32.346343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385740f2-6f61-429a-95df-0c206c8f475a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:32.377498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47865ab-8f32-4f5d-a6fb-7d5227b9203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:32.378278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47865ab-8f32-4f5d-a6fb-7d5227b9203e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.378558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47865ab-8f32-4f5d-a6fb-7d5227b9203e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.378860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47865ab-8f32-4f5d-a6fb-7d5227b9203e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.380025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47865ab-8f32-4f5d-a6fb-7d5227b9203e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:32.381448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47865ab-8f32-4f5d-a6fb-7d5227b9203e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:32.383091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 501/1015] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:32.384208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c47a4-220f-417a-a9df-b722a6b0ba57 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.384494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c47a4-220f-417a-a9df-b722a6b0ba57 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.384766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c47a4-220f-417a-a9df-b722a6b0ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.399939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-241c47a4-220f-417a-a9df-b722a6b0ba57 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:32.401097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-241c47a4-220f-417a-a9df-b722a6b0ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:32.444410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385740f2-6f61-429a-95df-0c206c8f475a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:32.463501 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 502/1016] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:32.464292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c47a4-220f-417a-a9df-b722a6b0ba57 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:32.478215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:32.478897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.479180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.479457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.480158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] RBAC: Adding query filter params (type=compute) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:32.480463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:32.482432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:32.487266 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 515/1017] 10.222.0.32 () {56 vars in 1112 bytes} [Sat May 7 21:31:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:32.491261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:32.563342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c47a4-220f-417a-a9df-b722a6b0ba57 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:32.584449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7ccb-9995-4191-81e7-1cf0656dac2e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:32.595005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:32.595652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.595929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.596198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.596885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:32.598295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:32.616184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d727a7f-7054-4a87-a04d-a23c543233d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:32.616852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727a7f-7054-4a87-a04d-a23c543233d3 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.617176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727a7f-7054-4a87-a04d-a23c543233d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.617396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727a7f-7054-4a87-a04d-a23c543233d3 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.618097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d727a7f-7054-4a87-a04d-a23c543233d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:32.619478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d727a7f-7054-4a87-a04d-a23c543233d3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:32.623299 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 503/1018] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:31:32 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:32.624410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:32.643227 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 516/1019] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:31:32 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:31:32.740565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad640-0fe5-4dc9-b378-faadba854937 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:32.785613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7233dfc-96c1-467c-a9f5-39aa7015d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:32.786301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7233dfc-96c1-467c-a9f5-39aa7015d49b None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:32.786584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7233dfc-96c1-467c-a9f5-39aa7015d49b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:32.786896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7233dfc-96c1-467c-a9f5-39aa7015d49b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:32.787659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7233dfc-96c1-467c-a9f5-39aa7015d49b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:32.789100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7233dfc-96c1-467c-a9f5-39aa7015d49b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:32.811467 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 504/1020] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:34.975968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96cb12-a9ef-48a0-ae43-d27550c6cdc1 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:34.976499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96cb12-a9ef-48a0-ae43-d27550c6cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:34.976499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96cb12-a9ef-48a0-ae43-d27550c6cdc1 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:34.977857 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 517/1021] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:34.984015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae120-9735-4138-befe-b85552fabb8c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:34.984485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae120-9735-4138-befe-b85552fabb8c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:34.984564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae120-9735-4138-befe-b85552fabb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.003610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-681ae120-9735-4138-befe-b85552fabb8c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:35.004841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-681ae120-9735-4138-befe-b85552fabb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:35.029647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79edf-03ff-4bdf-82e2-3569db4e55e1 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.029951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79edf-03ff-4bdf-82e2-3569db4e55e1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.030210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79edf-03ff-4bdf-82e2-3569db4e55e1 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.031774 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 518/1022] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:35.036944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7688-d87b-42a9-8472-f22a329c19ef None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.037235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7688-d87b-42a9-8472-f22a329c19ef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.037516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a7688-d87b-42a9-8472-f22a329c19ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.054180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1a2a7688-d87b-42a9-8472-f22a329c19ef None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:35.055386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1a2a7688-d87b-42a9-8472-f22a329c19ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:35.081809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 505/1023] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:35.106284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae120-9735-4138-befe-b85552fabb8c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.119891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 519/1024] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:35.145582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7688-d87b-42a9-8472-f22a329c19ef None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.200754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae120-9735-4138-befe-b85552fabb8c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.233815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e7eda-2fb6-42bd-bb1b-c206cce873fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.234603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e7eda-2fb6-42bd-bb1b-c206cce873fc None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.234920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e7eda-2fb6-42bd-bb1b-c206cce873fc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.235199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e7eda-2fb6-42bd-bb1b-c206cce873fc None admin] PATH_INFO: `/v3/services/image` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.235845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e7eda-2fb6-42bd-bb1b-c206cce873fc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.237210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e7eda-2fb6-42bd-bb1b-c206cce873fc None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.240430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a7688-d87b-42a9-8472-f22a329c19ef None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-445e7eda-2fb6-42bd-bb1b-c206cce873fc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:35.248654 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:35.249660 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:35.250533 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 506/1025] 10.222.0.32 () {56 vars in 1105 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:35.252394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6690-3786-45cd-a17e-848600a499ed None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.252394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6690-3786-45cd-a17e-848600a499ed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.252394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6690-3786-45cd-a17e-848600a499ed None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.253597 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 507/1026] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:35.255786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6690-3786-45cd-a17e-848600a499ed None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.273764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4d97a-e025-4a70-8472-50baacbcd2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.274546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4d97a-e025-4a70-8472-50baacbcd2cf None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.274860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4d97a-e025-4a70-8472-50baacbcd2cf None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.275135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4d97a-e025-4a70-8472-50baacbcd2cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.276299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4d97a-e025-4a70-8472-50baacbcd2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.278305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4d97a-e025-4a70-8472-50baacbcd2cf None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.280073 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 520/1027] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:35.281070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661ebf-61fc-4099-9e59-0ba3dc16e6d5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.281358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661ebf-61fc-4099-9e59-0ba3dc16e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.281710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661ebf-61fc-4099-9e59-0ba3dc16e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.298295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-23661ebf-61fc-4099-9e59-0ba3dc16e6d5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:35.299503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-23661ebf-61fc-4099-9e59-0ba3dc16e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:35.353336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6690-3786-45cd-a17e-848600a499ed None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.362727 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 521/1028] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:35.363536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661ebf-61fc-4099-9e59-0ba3dc16e6d5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.386819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.387482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.387761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.388031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.388726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] RBAC: Adding query filter params (name=image) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:35.389028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.390382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.395111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 508/1029] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:35.395884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.455176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661ebf-61fc-4099-9e59-0ba3dc16e6d5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.486607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.487227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.487512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.487786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.488476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.489093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23048-f723-403a-95bb-30059eda194e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.489912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.509725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 522/1030] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:31:35 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:35.510527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.524369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.525518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.525805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.526094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.538234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:35.547546 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:35.548762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:35.549801 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:35.552127 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 509/1031] 10.222.0.32 () {56 vars in 1120 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:35.558257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.618228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c198703-1872-49b1-8997-9d76623388e1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.653388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.654070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.654368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.654628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.655378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] RBAC: Adding query filter params (type=image) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:35.655689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.657103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.663393 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 523/1032] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:35.664414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9970a-d771-425b-88d6-8c03ee4a16f0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.669959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.700602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.701374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.701579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.701814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.703310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:35.703310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.704968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.716916 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 510/1033] 10.222.0.32 () {56 vars in 1115 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:35.718729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.774583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce0791-b157-4927-abcb-590fa5a61f38 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.810512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.811287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.811570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.811912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.812702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] RBAC: Adding query filter params (interface=public, service_id=96c1744176df4d978831b43f805a2745, region_id=RegionOne) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:35.813012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.814380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.816832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e34e2-6d08-44eb-8aad-f1c0e7cfb852 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.819633 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 524/1034] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/endpoints?service_id=96c1744176df4d978831b43f805a2745&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:35.825375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.850635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.851534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.851818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.852095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.862277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.863766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:35.880964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:35.882093 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:35.883251 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:35.883251 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:35.883251 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:35.883251 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:35.886694 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 511/1035] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:35.888452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:35.927875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f70a9-f3e6-4046-bde1-a7ce8a924e17 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:35.961018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:35.961684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:35.961971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:35.962249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:35.962958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:35.964336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:35.978800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 525/1036] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:31:35.998505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247aa6d-2bf0-4818-8c21-2ebf036187b1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:36.034408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:36.035041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:36.035322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:36.035595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:36.036327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:36.036631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:36.038041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:36.051143 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 512/1037] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:36.057179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:36.160643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7bbdd-6305-4d7f-9b89-c168553e4052 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:36.193697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:36.195281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:36.195281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:36.195281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:36.204131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:36.205583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:36.220165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:36.221176 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:36.222155 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 526/1038] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:31:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:36.227395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:36.322518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fbde1-a6b0-4b5f-a78f-07acb7182dbd None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:36.361116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:36.361791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:36.362072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:36.362344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:36.363201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:36.363512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:36.364939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:36.387961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 513/1039] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:31:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:36.389237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:36.484325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3d796-1971-4cea-bc1c-4e9d4c144729 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:36.519448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:36.520096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:36.520380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:36.520655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:36.583989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:36.585630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:36.685702 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 527/1040] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:36.687414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:36.784658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb8181-eaa2-4e0e-9433-a49b83b49075 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:36.818059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:36.818890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:36.819173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:36.819447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:36.829251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:36.830700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:36.847895 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:36.848820 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:36.854572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:36.854572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:36.854572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:36.854572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:36.854572 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 514/1041] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:36.856916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:36.950535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e582e-1152-4b3a-8c38-467387647fcb None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:36.983408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:36.984162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:36.984357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:36.985188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:36.985367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:36.985714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:36.987333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:37.009482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 528/1042] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:37.010422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:37.106481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9b65e-5ea4-4fe0-8267-84cec55d0596 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:37.140742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:37.141537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:37.141820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:37.142097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:37.148688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:37.150132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:37.163368 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:37.164280 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:37.165278 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:37.166553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 515/1043] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:37.170386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:37.268436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e599e-6609-4eef-a188-16c9117a914f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:37.301534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce584-3408-426e-8397-eb56a8ef1780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:37.302227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce584-3408-426e-8397-eb56a8ef1780 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:37.302509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce584-3408-426e-8397-eb56a8ef1780 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:37.302804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce584-3408-426e-8397-eb56a8ef1780 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:37.303592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce584-3408-426e-8397-eb56a8ef1780 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:37.303900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce584-3408-426e-8397-eb56a8ef1780 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:37.305336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ce584-3408-426e-8397-eb56a8ef1780 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:37.322474 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 529/1044] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:37.323774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:37.421866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b3cf-41db-4230-8bec-914d13cebff6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:37.453581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471b9ae-7b9c-490d-9f74-817c80330c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:37.454238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b9ae-7b9c-490d-9f74-817c80330c1f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:37.454522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b9ae-7b9c-490d-9f74-817c80330c1f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:37.454943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471b9ae-7b9c-490d-9f74-817c80330c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:37.455643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471b9ae-7b9c-490d-9f74-817c80330c1f None admin] RBAC: Adding query filter params (role.id=350456731f2942a1b3ac74f1b51b3c15, scope.project.id=758d4dea899344b883971712aebe042f, user.id=8643bb571c514f1fa358526b00ce47ee) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:37.455953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471b9ae-7b9c-490d-9f74-817c80330c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:37.457381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471b9ae-7b9c-490d-9f74-817c80330c1f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:37.467144 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 516/1045] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:37 2022] GET /identity/v3/role_assignments?user.id=8643bb571c514f1fa358526b00ce47ee&scope.project.id=758d4dea899344b883971712aebe042f&role.id=350456731f2942a1b3ac74f1b51b3c15 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:37.894683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca18957-026d-481e-bb00-0189de5a1d97 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:37.895117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca18957-026d-481e-bb00-0189de5a1d97 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:37.895299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca18957-026d-481e-bb00-0189de5a1d97 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:37.896787 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 530/1046] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:37.901949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595f10-6bf2-4924-9291-278c94742f8c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:37.902276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595f10-6bf2-4924-9291-278c94742f8c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:37.902559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595f10-6bf2-4924-9291-278c94742f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:37.918842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e3595f10-6bf2-4924-9291-278c94742f8c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:37.920031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e3595f10-6bf2-4924-9291-278c94742f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:37.984644 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 517/1047] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:38.012545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca18957-026d-481e-bb00-0189de5a1d97 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.113959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca18957-026d-481e-bb00-0189de5a1d97 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.149245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b9a11-51f1-46a6-b7e3-3cf730454df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.149941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b9a11-51f1-46a6-b7e3-3cf730454df3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.150221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b9a11-51f1-46a6-b7e3-3cf730454df3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.150493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b9a11-51f1-46a6-b7e3-3cf730454df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.160934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b9a11-51f1-46a6-b7e3-3cf730454df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-c72b9a11-51f1-46a6-b7e3-3cf730454df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:38.168512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:38.169476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:38.175241 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 531/1048] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:38.175956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595f10-6bf2-4924-9291-278c94742f8c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.278060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595f10-6bf2-4924-9291-278c94742f8c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.291965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb267a-edb1-40d5-8187-0088df6e6683 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.292435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb267a-edb1-40d5-8187-0088df6e6683 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.292562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb267a-edb1-40d5-8187-0088df6e6683 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.294068 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 532/1049] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:31:38.298732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e6c70-befe-405e-b329-137c247c1c2d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.299049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e6c70-befe-405e-b329-137c247c1c2d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.299321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e6c70-befe-405e-b329-137c247c1c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.311526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.312394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.312881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.313303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.314210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:38.314665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.315350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-648e6c70-befe-405e-b329-137c247c1c2d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:38.316377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:38.316498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-648e6c70-befe-405e-b329-137c247c1c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:38.330082 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 518/1050] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:38.331471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.381670 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 533/1051] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:38.405547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e6c70-befe-405e-b329-137c247c1c2d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.442191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b7cb5-b0cb-4408-95ca-c5e9c5ae81ca None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.479289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.480150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.480963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.481236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] PATH_INFO: `/v3/users/4f12c5bff33b4700bda21681b18b7b5b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.494448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] RBAC: Authorizing `identity:get_user(user_id=4f12c5bff33b4700bda21681b18b7b5b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.495917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:38.503796 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 519/1052] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/users/4f12c5bff33b4700bda21681b18b7b5b => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:38.503961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e6c70-befe-405e-b329-137c247c1c2d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.505628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.537596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.538496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.538887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.539236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.539896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.541271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:38.553485 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:38.554512 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:38.555534 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 534/1053] 10.222.0.32 () {56 vars in 1105 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:38.561061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.603927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10227f-5649-4530-b0b5-ee418cb4a6ce None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.637416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.638108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.638386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.638737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.662135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b62af-d44f-4174-addf-36f2dbc5a3d9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.694539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.695232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.695517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.695800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.696499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] RBAC: Adding query filter params (name=image) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:38.696807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.698208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:38.702900 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 535/1054] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:38.704875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.706584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:38.708580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.803627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44cf0b-8be6-4fa1-bfda-60178a3c13ef None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.804426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 520/1055] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 07 21:31:38.810551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.836541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.837196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.837478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.837753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.838466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] RBAC: Adding query filter params (type=image) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:38.838750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.840239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:38.845050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 536/1056] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:38.850900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.908100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4259f-3961-4767-b3e8-4f0b8e75deaa None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.940716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.941755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.942182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.942618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.943950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] RBAC: Authorizing `identity:get_project(project_id=5af07f0ef7934900866f638c8fcc252f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.945524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:38.946220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766a8eb-73d7-4569-b45e-dc2465c72599 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:38.947850 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 521/1057] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:38.953459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:38.983607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fee0b-7a38-484d-8ce0-e412cda16001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:38.984260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fee0b-7a38-484d-8ce0-e412cda16001 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:38.984546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fee0b-7a38-484d-8ce0-e412cda16001 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:38.984820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fee0b-7a38-484d-8ce0-e412cda16001 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:38.985547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fee0b-7a38-484d-8ce0-e412cda16001 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:38.986944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fee0b-7a38-484d-8ce0-e412cda16001 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:39.007453 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 537/1058] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:31:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:31:39.057532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c0c85-e8ae-4d5f-9abb-41ad2ad4572c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:39.103142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176492c-54b6-4f47-a74c-e727224d65ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:39.104187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176492c-54b6-4f47-a74c-e727224d65ef None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:39.104738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176492c-54b6-4f47-a74c-e727224d65ef None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:39.105216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176492c-54b6-4f47-a74c-e727224d65ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:39.106289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176492c-54b6-4f47-a74c-e727224d65ef None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=5af07f0ef7934900866f638c8fcc252f, user.id=4f12c5bff33b4700bda21681b18b7b5b) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:39.106883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176492c-54b6-4f47-a74c-e727224d65ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:39.108582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176492c-54b6-4f47-a74c-e727224d65ef None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:39.122840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 522/1059] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:38 2022] GET /identity/v3/role_assignments?user.id=4f12c5bff33b4700bda21681b18b7b5b&scope.project.id=5af07f0ef7934900866f638c8fcc252f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:39.790943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f87308-4349-4ec3-9456-76f055f2cc4e None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:39.791573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f87308-4349-4ec3-9456-76f055f2cc4e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:39.791573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f87308-4349-4ec3-9456-76f055f2cc4e None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:39.793458 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 538/1060] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:39.798792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381411d4-f70e-4203-b294-9546cc7d9a2e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:39.799227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381411d4-f70e-4203-b294-9546cc7d9a2e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:39.799406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381411d4-f70e-4203-b294-9546cc7d9a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:39.816302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-381411d4-f70e-4203-b294-9546cc7d9a2e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:39.817483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-381411d4-f70e-4203-b294-9546cc7d9a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:39.882400 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 523/1061] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:39.907191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f87308-4349-4ec3-9456-76f055f2cc4e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:40.009394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f87308-4349-4ec3-9456-76f055f2cc4e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:40.046987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:40.047706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:40.047988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:40.048259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:40.058940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:40.066933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:40.067986 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:40.068936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:40.070274 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 539/1062] 10.222.0.32 () {56 vars in 1120 bytes} [Sat May 7 21:31:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:40.074999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381411d4-f70e-4203-b294-9546cc7d9a2e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:40.168086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381411d4-f70e-4203-b294-9546cc7d9a2e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:40.204862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:40.205779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:40.206260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:40.206731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:40.207780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:40.208297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:40.209857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:40.221828 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 524/1063] 10.222.0.32 () {56 vars in 1115 bytes} [Sat May 7 21:31:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:40.227950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:40.328229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b767bbd-f22f-4433-a4ee-50e1487f4b8f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:40.361672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:40.362470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:40.362753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:40.363063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:40.377604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:40.379460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:40.397615 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:40.398581 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:40.399551 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:40.399551 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:40.399551 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:40.399551 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:40.399551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 540/1064] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:40.404640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:40.503632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf78483-fd7e-480c-8efa-ec60ef254233 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:40.534782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:40.535464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:40.535748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:40.536025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:40.536729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:40.537034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:40.538399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:40.554694 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 525/1065] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:40.556427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:40.650887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9617fb-73a0-4862-b622-c116e4350781 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:40.682446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:40.683264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:40.684104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:40.684382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:40.691701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:40.693139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:40.706688 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:40.707900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:40.708898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:40.711089 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 541/1066] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:31:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:40.713986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:40.809453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5cbc2-593b-43e6-9ede-0165d4d6c89a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:40.842544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:40.843240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:40.843523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:40.843797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:40.844616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:40.844922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:40.846343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:40.868367 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 526/1067] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:31:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:40.869912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:40.967738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2161c-6e02-4312-8f6f-162e125c48d8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.000255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.001050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.001334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.001606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.012543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.014063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:41.031973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:41.032949 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:41.033869 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:41.033869 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:41.033869 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:41.033869 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:41.038819 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 542/1068] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:41.039018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.133665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7d1e5-b8bb-4e64-96b7-7c4e28578692 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.168859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816efab-f9ec-40b8-ad16-ae4430f4006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.169556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816efab-f9ec-40b8-ad16-ae4430f4006f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.169844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816efab-f9ec-40b8-ad16-ae4430f4006f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.170121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816efab-f9ec-40b8-ad16-ae4430f4006f None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.170891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816efab-f9ec-40b8-ad16-ae4430f4006f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:41.171204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816efab-f9ec-40b8-ad16-ae4430f4006f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.172622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816efab-f9ec-40b8-ad16-ae4430f4006f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:41.185785 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 527/1069] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:41.191382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.299604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c63b1-7ad0-4732-b794-f1619120e9c5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.331764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.332549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.332830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.333105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.340339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.341752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:41.355666 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:41.356622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:41.357530 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:41.359203 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 543/1070] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:41.360723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb61bd-df28-48f0-9b92-4acd7e866bff None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.361012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb61bd-df28-48f0-9b92-4acd7e866bff None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.361289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb61bd-df28-48f0-9b92-4acd7e866bff None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.362556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.362674 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 528/1071] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:41.367673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471783-e0d2-4292-9d98-9d6e3de36cf9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.367963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471783-e0d2-4292-9d98-9d6e3de36cf9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.368242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471783-e0d2-4292-9d98-9d6e3de36cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.384288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c4471783-e0d2-4292-9d98-9d6e3de36cf9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:41.385468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c4471783-e0d2-4292-9d98-9d6e3de36cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:41.452146 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 529/1072] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:41.453717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd022ea-b4a7-41e6-ac3e-c056cbb25e11 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.454002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd022ea-b4a7-41e6-ac3e-c056cbb25e11 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.454273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd022ea-b4a7-41e6-ac3e-c056cbb25e11 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.458944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 530/1073] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:41.461444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0fb9a-37ea-430b-9dfa-16280edc3686 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.461732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0fb9a-37ea-430b-9dfa-16280edc3686 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.462014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0fb9a-37ea-430b-9dfa-16280edc3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.468642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97c0b2-73ed-438f-96e8-28c247c45ab1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.478674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5ea0fb9a-37ea-430b-9dfa-16280edc3686 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:41.479889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ea0fb9a-37ea-430b-9dfa-16280edc3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:41.501491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.502139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.502417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.502688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.503506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:41.503807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.505237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:41.516094 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 544/1074] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:41.516094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.544099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 531/1075] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:41.544894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0fb9a-37ea-430b-9dfa-16280edc3686 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.611566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90772f-bc40-468d-8e4f-5c4b6607b05d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.636628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0fb9a-37ea-430b-9dfa-16280edc3686 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.642340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.643009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.643294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.643568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.668796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.669659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.669931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.670199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/8643bb571c514f1fa358526b00ce47ee/roles/350456731f2942a1b3ac74f1b51b3c15` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.672388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=8643bb571c514f1fa358526b00ce47ee, role_id=350456731f2942a1b3ac74f1b51b3c15)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.673812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:41.687024 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 532/1076] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:31:41 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/8643bb571c514f1fa358526b00ce47ee/roles/350456731f2942a1b3ac74f1b51b3c15 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:31:41.687797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.711748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.713261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:41.790582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269336a1-3d14-43c2-89a3-67929770a02e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.818506 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 545/1077] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:41.824851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.825955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.826787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.827093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.827371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.838444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:41.846283 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:41.847330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:41.848194 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 533/1078] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:41.854111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.924521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea69109-c87b-4a32-80e4-451fbd8646db None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.957187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0c68-72df-4cc6-a579-32ac42ac2ba9 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:41.960215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.961007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.961285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.961551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.971512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.972961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:41.990341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:41.991379 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:41.992356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:41.992356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:41.992356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:41.992356 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:41.992356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 546/1079] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:41.993786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:41.994440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:41.994718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:41.995018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:41.995753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:41.996727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:41.997802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:41.998040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:42.006406 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 534/1080] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:42.013202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:42.097743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849d197-8221-4754-829f-8778cad776a4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:42.111077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb5943-8b5b-4523-b860-73fb39e548eb None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:42.132261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:42.132926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:42.133206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:42.133484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:42.134195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:42.134500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:42.135939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:42.144735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:42.145601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:42.145882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:42.146156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] PATH_INFO: `/v3/users/4f12c5bff33b4700bda21681b18b7b5b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:42.147580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] RBAC: Authorizing `identity:get_user(user_id=4f12c5bff33b4700bda21681b18b7b5b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:42.147703 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 547/1081] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:42.148808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:42.155966 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 535/1082] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:42 2022] GET /identity/v3/users/4f12c5bff33b4700bda21681b18b7b5b => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:42.157002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:42.264495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ead469-5eec-4159-8fab-3e290f622f60 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:42.298793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13187e2c-0de7-4f5f-aacf-8526703ff1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:42.299688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187e2c-0de7-4f5f-aacf-8526703ff1d3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:42.299965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187e2c-0de7-4f5f-aacf-8526703ff1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:42.300237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13187e2c-0de7-4f5f-aacf-8526703ff1d3 None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:42.301482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13187e2c-0de7-4f5f-aacf-8526703ff1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=5af07f0ef7934900866f638c8fcc252f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:42.302961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13187e2c-0de7-4f5f-aacf-8526703ff1d3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:42.310172 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 548/1083] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:31:42 2022] GET /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:42.311285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:42.409834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c4c8b-28c8-4dec-b6be-0844b494c876 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:42.444226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a9808-8849-41f9-99db-805c43c4ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:42.445125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a9808-8849-41f9-99db-805c43c4ac3c None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:42.445429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a9808-8849-41f9-99db-805c43c4ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:42.445733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a9808-8849-41f9-99db-805c43c4ac3c None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f/users/4f12c5bff33b4700bda21681b18b7b5b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:42.447777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a9808-8849-41f9-99db-805c43c4ac3c None admin] RBAC: Authorizing `identity:create_grant(project_id=5af07f0ef7934900866f638c8fcc252f, user_id=4f12c5bff33b4700bda21681b18b7b5b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:42.449827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a9808-8849-41f9-99db-805c43c4ac3c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:42.466922 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 536/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:31:42 2022] PUT /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f/users/4f12c5bff33b4700bda21681b18b7b5b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:31:44.012342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d0a3-51ba-414b-9be0-ab3ccc8bdd8a None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.012873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d0a3-51ba-414b-9be0-ab3ccc8bdd8a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.012873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d0a3-51ba-414b-9be0-ab3ccc8bdd8a None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.014217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 549/1085] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:44.019468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcec16-47f5-4778-ad44-a93de43acb03 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.019857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcec16-47f5-4778-ad44-a93de43acb03 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.020150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcec16-47f5-4778-ad44-a93de43acb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.036349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d7bcec16-47f5-4778-ad44-a93de43acb03 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:44.037521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d7bcec16-47f5-4778-ad44-a93de43acb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:44.125437 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 537/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:44.150033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d0a3-51ba-414b-9be0-ab3ccc8bdd8a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:44.248381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d0a3-51ba-414b-9be0-ab3ccc8bdd8a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:44.281099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:44.281819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.282103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.282377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.292495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:44.301060 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:44.302185 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:44.303375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 550/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Sat May 7 21:31:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:44.308235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcec16-47f5-4778-ad44-a93de43acb03 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:44.412696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcec16-47f5-4778-ad44-a93de43acb03 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:44.457750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:44.458410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.458686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.458985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.459713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:44.460265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:44.461617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:44.469930 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 538/1088] 10.222.0.32 () {56 vars in 1115 bytes} [Sat May 7 21:31:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:44.475568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:44.572379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c9f5-4d88-4488-b2de-3a40634e7bf9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:44.607929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5bb02-d4f3-40a5-a966-f176042f5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:44.608714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bb02-d4f3-40a5-a966-f176042f5d7e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.608998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bb02-d4f3-40a5-a966-f176042f5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.609276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5bb02-d4f3-40a5-a966-f176042f5d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.619030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5bb02-d4f3-40a5-a966-f176042f5d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:44.620481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5bb02-d4f3-40a5-a966-f176042f5d7e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-06a5bb02-d4f3-40a5-a966-f176042f5d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:44.638203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:44.639165 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:44.640240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:44.640240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:44.640240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:44.640240 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:44.640240 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 551/1089] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:31:44.645106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:44.744544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251be911-f6ca-4c12-a06b-8c26d9662b23 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:44.774972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9fee-5168-4a80-b116-d7e177816ae8 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.775363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9fee-5168-4a80-b116-d7e177816ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.775642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9fee-5168-4a80-b116-d7e177816ae8 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.776826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:44.777735 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 552/1090] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:44.778020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.778300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.778604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.779315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:44.779619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:44.780983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:44.782461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c775-149d-41c9-a35c-960c49f897ef None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.782738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c775-149d-41c9-a35c-960c49f897ef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.783038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c775-149d-41c9-a35c-960c49f897ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.793372 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 539/1091] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:44.798653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:44.799968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0c36c775-149d-41c9-a35c-960c49f897ef None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:44.801135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0c36c775-149d-41c9-a35c-960c49f897ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:44.863758 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 553/1092] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:31:44.889268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c775-149d-41c9-a35c-960c49f897ef None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:44.891516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba288bb-5137-493d-9dcb-a413e3f5339a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:44.926544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:44.927345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:44.927622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:44.927889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] PATH_INFO: `/v3/users/nova` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:44.936023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:44.937519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:31:44.951716 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:44.952786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:44.953759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 540/1093] 10.222.0.32 () {56 vars in 1093 bytes} [Sat May 7 21:31:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:44.958700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:44.986937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c775-149d-41c9-a35c-960c49f897ef None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.018555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.019355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.019632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.019901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.029387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:31:45.036840 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:45.038006 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:31:45.038920 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 554/1094] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:31:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:45.044527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.052111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5bbb2-ef41-4e78-bb99-5b33636f0def None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.091924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.092591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.092875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.093153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.093980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:45.094288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.095779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.112883 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 541/1095] 10.222.0.32 () {56 vars in 1133 bytes} [Sat May 7 21:31:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:45.118597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.154536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c9dc8-48c4-43aa-9b6b-513a3f4aea23 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.186252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.186959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.187245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.187523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.188259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:45.188567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.189942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.197866 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 555/1096] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:45.204011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.211215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2ace2-f5c1-4c91-a291-7509d2c6485d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.243864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.244500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.244781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.245051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.296416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39af28-0af7-4318-a399-d38c0b037a0f None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.306874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.308841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.328469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.329323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.329603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.329876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] PATH_INFO: `/v3/users/4f12c5bff33b4700bda21681b18b7b5b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.331097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] RBAC: Authorizing `identity:get_user(user_id=4f12c5bff33b4700bda21681b18b7b5b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.332561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.334182 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 556/1097] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/users/4f12c5bff33b4700bda21681b18b7b5b => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:45.340324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.402700 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 542/1098] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 07 21:31:45.408159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.434989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdf73-7cd9-42d9-8b8f-c956635f6f69 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.466387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.467051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.467329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.467598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.499933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ac411-46d6-48ca-bbce-6e4a7db26ced None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.529872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.531345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.531663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.532441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.532725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.533002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.542610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.544100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:31:45.561151 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:45.562075 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:45.563182 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:31:45.563182 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:31:45.563182 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:31:45.563182 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:45.563182 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 543/1099] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:45.567834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.624641 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 557/1100] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:45.630325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.661203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be7656-1dea-42c6-834c-754c188c37de None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.693115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.693758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.694033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.694301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.695031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:45.695333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.696694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.707578 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 544/1101] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:45.713152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.724227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff165c3-1652-475a-8cb0-8b1eacd45c87 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.757475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.758317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.758592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.758902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.760123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] RBAC: Authorizing `identity:get_project(project_id=5af07f0ef7934900866f638c8fcc252f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.761652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.763383 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 558/1102] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:45.769226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.807247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6ef6-52d0-4538-9501-11c46ec6f507 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.839134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.839955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.840234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.840508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.846891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.848330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.861089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7cf6-dae0-4c1c-8118-9ecba254a6ef None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:31:45.862674 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:31:45.863590 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:31:45.864508 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 545/1103] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:31:45.869425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:45.893209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:45.893859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:45.894141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:45.894413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:45.895267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=5af07f0ef7934900866f638c8fcc252f, user.id=4f12c5bff33b4700bda21681b18b7b5b) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:45.895581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:45.897027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:45.902728 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 559/1104] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/role_assignments?user.id=4f12c5bff33b4700bda21681b18b7b5b&scope.project.id=5af07f0ef7934900866f638c8fcc252f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:45.966545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ec46d-4421-46d9-a88f-7f25a2a6c833 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:46.002070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04651fa-3eec-4b7e-a7bc-75b54d86b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:46.002745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04651fa-3eec-4b7e-a7bc-75b54d86b93a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:46.003058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04651fa-3eec-4b7e-a7bc-75b54d86b93a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:46.003335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04651fa-3eec-4b7e-a7bc-75b54d86b93a None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:46.004124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04651fa-3eec-4b7e-a7bc-75b54d86b93a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:46.004431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04651fa-3eec-4b7e-a7bc-75b54d86b93a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:46.005867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04651fa-3eec-4b7e-a7bc-75b54d86b93a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:46.018050 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 546/1105] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:46.024186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:46.124044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce6a7b-73f3-48ea-b828-f1055b6e0a12 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:46.156475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a11c4-18bd-4f1f-aac7-d859e1105a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:46.157123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a11c4-18bd-4f1f-aac7-d859e1105a12 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:46.157403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a11c4-18bd-4f1f-aac7-d859e1105a12 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:46.157675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a11c4-18bd-4f1f-aac7-d859e1105a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:46.158493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a11c4-18bd-4f1f-aac7-d859e1105a12 None admin] RBAC: Adding query filter params (role.id=350456731f2942a1b3ac74f1b51b3c15, scope.project.id=758d4dea899344b883971712aebe042f, user.id=8643bb571c514f1fa358526b00ce47ee) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:46.158826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a11c4-18bd-4f1f-aac7-d859e1105a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:46.160265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a11c4-18bd-4f1f-aac7-d859e1105a12 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:46.165841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 560/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:46 2022] GET /identity/v3/role_assignments?user.id=8643bb571c514f1fa358526b00ce47ee&scope.project.id=758d4dea899344b883971712aebe042f&role.id=350456731f2942a1b3ac74f1b51b3c15 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:48.239883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548e48-e14b-4a05-9faa-aefb2f6156ac None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:48.240373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548e48-e14b-4a05-9faa-aefb2f6156ac None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:48.240470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548e48-e14b-4a05-9faa-aefb2f6156ac None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:48.241790 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 547/1107] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:48.247047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b8f4-51b8-4507-884e-820f4fa19fd8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:48.247453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b8f4-51b8-4507-884e-820f4fa19fd8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:48.247596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7b8f4-51b8-4507-884e-820f4fa19fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:48.263959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b4a7b8f4-51b8-4507-884e-820f4fa19fd8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:48.265113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4a7b8f4-51b8-4507-884e-820f4fa19fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:48.328178 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 561/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:48.353946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e548e48-e14b-4a05-9faa-aefb2f6156ac None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:48.447939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e548e48-e14b-4a05-9faa-aefb2f6156ac None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:48.479511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a237b6f-a29c-4ee6-bc4d-11df91a8c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:48.480304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a237b6f-a29c-4ee6-bc4d-11df91a8c785 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:48.480585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a237b6f-a29c-4ee6-bc4d-11df91a8c785 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:48.480860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a237b6f-a29c-4ee6-bc4d-11df91a8c785 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:48.482005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a237b6f-a29c-4ee6-bc4d-11df91a8c785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:48.483454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a237b6f-a29c-4ee6-bc4d-11df91a8c785 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:48.485068 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 548/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:31:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:48.490558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b8f4-51b8-4507-884e-820f4fa19fd8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:48.585981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7b8f4-51b8-4507-884e-820f4fa19fd8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:48.617695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692501e1-4080-4225-9abb-9c4948c120a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:48.618342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692501e1-4080-4225-9abb-9c4948c120a1 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:48.618620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692501e1-4080-4225-9abb-9c4948c120a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:48.618925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692501e1-4080-4225-9abb-9c4948c120a1 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:48.619618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692501e1-4080-4225-9abb-9c4948c120a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:48.621082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692501e1-4080-4225-9abb-9c4948c120a1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:48.639806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 562/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:31:48 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:31:50.960303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570f2c-1e30-4daa-9ab6-a20c3c19d2e4 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:50.960883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570f2c-1e30-4daa-9ab6-a20c3c19d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:50.960883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570f2c-1e30-4daa-9ab6-a20c3c19d2e4 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:50.962204 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 549/1111] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:50.968003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ead2-d956-476a-81e9-2ef001122ad6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:50.968385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ead2-d956-476a-81e9-2ef001122ad6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:50.968554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ead2-d956-476a-81e9-2ef001122ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:50.985053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-80d2ead2-d956-476a-81e9-2ef001122ad6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:50.986225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-80d2ead2-d956-476a-81e9-2ef001122ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:51.048225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 563/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:51.072637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570f2c-1e30-4daa-9ab6-a20c3c19d2e4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:51.168313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570f2c-1e30-4daa-9ab6-a20c3c19d2e4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:51.199407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:51.200132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:51.200408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:51.200677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] PATH_INFO: `/v3/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:51.202120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] RBAC: Authorizing `identity:get_role(role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:51.203497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:51.204833 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 550/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:51 2022] GET /identity/v3/roles/0306acbe82504665a6348fd3f25cee0b => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:51.210886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2ead2-d956-476a-81e9-2ef001122ad6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:51.302141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2ead2-d956-476a-81e9-2ef001122ad6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:51.333400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:51.334241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:51.334524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:51.335080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] PATH_INFO: `/v3/users/8cde76005bc64d828d9aaa947a662f71` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:51.347717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] RBAC: Authorizing `identity:get_user(user_id=8cde76005bc64d828d9aaa947a662f71)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:51.349168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:51.350791 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 564/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:51 2022] GET /identity/v3/users/8cde76005bc64d828d9aaa947a662f71 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:51.356939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:51.447969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124ad5-861c-4445-b37d-0f65a4443161 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:51.479303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:51.480489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:51.480768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:51.481035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:51.542192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:51.544225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:51.633075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 551/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:51.639436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:51.731919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb9f0-bb04-423c-9e48-f1ffcd5704a8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:51.763158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f1b47-f155-4a1c-abd2-24cd9ded2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:51.763997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1b47-f155-4a1c-abd2-24cd9ded2556 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:51.764285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1b47-f155-4a1c-abd2-24cd9ded2556 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:51.764561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f1b47-f155-4a1c-abd2-24cd9ded2556 None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:51.765718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f1b47-f155-4a1c-abd2-24cd9ded2556 None admin] RBAC: Authorizing `identity:get_project(project_id=5af07f0ef7934900866f638c8fcc252f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:51.767207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f1b47-f155-4a1c-abd2-24cd9ded2556 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:51.768872 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 565/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:31:51 2022] GET /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:31:51.775132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:51.872109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff23b3-24a5-4a60-94c0-65083003103c None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:51.903924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ffae1-9368-4d40-9d73-d85801ce67a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:51.904564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ffae1-9368-4d40-9d73-d85801ce67a5 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:51.904844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ffae1-9368-4d40-9d73-d85801ce67a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:51.905116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ffae1-9368-4d40-9d73-d85801ce67a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:51.905925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ffae1-9368-4d40-9d73-d85801ce67a5 None admin] RBAC: Adding query filter params (role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=5af07f0ef7934900866f638c8fcc252f, user.id=8cde76005bc64d828d9aaa947a662f71) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:51.906235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ffae1-9368-4d40-9d73-d85801ce67a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:51.907690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ffae1-9368-4d40-9d73-d85801ce67a5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:51.912858 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 552/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:51 2022] GET /identity/v3/role_assignments?user.id=8cde76005bc64d828d9aaa947a662f71&scope.project.id=5af07f0ef7934900866f638c8fcc252f&role.id=0306acbe82504665a6348fd3f25cee0b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:54.186356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a443-2534-4beb-946c-3d93f3fa942d None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:54.186908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a443-2534-4beb-946c-3d93f3fa942d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:54.187001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6a443-2534-4beb-946c-3d93f3fa942d None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:54.188307 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 566/1118] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:54.193381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582713c-290f-49da-9220-aa3e407b5ac6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:54.193781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582713c-290f-49da-9220-aa3e407b5ac6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:54.193946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582713c-290f-49da-9220-aa3e407b5ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:54.210378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5582713c-290f-49da-9220-aa3e407b5ac6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:54.211589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5582713c-290f-49da-9220-aa3e407b5ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:54.273835 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 553/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:54.297833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6a443-2534-4beb-946c-3d93f3fa942d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:54.393298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6a443-2534-4beb-946c-3d93f3fa942d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:54.425486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:54.426317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:54.426601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:54.426909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] PATH_INFO: `/v3/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:54.428369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] RBAC: Authorizing `identity:get_role(role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:54.429743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:54.431111 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 567/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:54 2022] GET /identity/v3/roles/0306acbe82504665a6348fd3f25cee0b => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:54.436827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582713c-290f-49da-9220-aa3e407b5ac6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:54.529073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582713c-290f-49da-9220-aa3e407b5ac6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:54.561834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:54.562686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:54.563001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:54.563320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] PATH_INFO: `/v3/users/8cde76005bc64d828d9aaa947a662f71` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:54.564844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=8cde76005bc64d828d9aaa947a662f71)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:54.566286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:54.567948 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 554/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:54 2022] GET /identity/v3/users/8cde76005bc64d828d9aaa947a662f71 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:54.573613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:54.664683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa426e-6879-441a-90fd-2a68f87a2114 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:54.696232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded886ad-31cb-414f-bfc4-5d6bc6a4acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:54.697006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded886ad-31cb-414f-bfc4-5d6bc6a4acee None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:54.697286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded886ad-31cb-414f-bfc4-5d6bc6a4acee None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:54.697557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded886ad-31cb-414f-bfc4-5d6bc6a4acee None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:54.698730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded886ad-31cb-414f-bfc4-5d6bc6a4acee None admin] RBAC: Authorizing `identity:get_project(project_id=5af07f0ef7934900866f638c8fcc252f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:54.700169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded886ad-31cb-414f-bfc4-5d6bc6a4acee None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:54.701804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 568/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:31:54 2022] GET /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:54.707530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:54.801266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c54d5-b529-4760-a3f5-19403c7b5bb6 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:54.833311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67dfa1-5c70-4701-bf12-c5b82ca2e864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:54.834181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67dfa1-5c70-4701-bf12-c5b82ca2e864 None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:54.834462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67dfa1-5c70-4701-bf12-c5b82ca2e864 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:54.835021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67dfa1-5c70-4701-bf12-c5b82ca2e864 None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f/users/8cde76005bc64d828d9aaa947a662f71/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:54.837190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67dfa1-5c70-4701-bf12-c5b82ca2e864 None admin] RBAC: Authorizing `identity:create_grant(project_id=5af07f0ef7934900866f638c8fcc252f, user_id=8cde76005bc64d828d9aaa947a662f71, role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:54.838621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67dfa1-5c70-4701-bf12-c5b82ca2e864 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:54.850858 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 555/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:31:54 2022] PUT /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f/users/8cde76005bc64d828d9aaa947a662f71/roles/0306acbe82504665a6348fd3f25cee0b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:31:57.121523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c42b-f176-48ed-b51f-6059d0eaf316 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:57.122070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c42b-f176-48ed-b51f-6059d0eaf316 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:57.122070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2c42b-f176-48ed-b51f-6059d0eaf316 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:57.123543 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 569/1124] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:31:57.129178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d084-957e-4b21-abbc-6b4ff4e49899 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:57.129582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d084-957e-4b21-abbc-6b4ff4e49899 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:57.129724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d084-957e-4b21-abbc-6b4ff4e49899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:57.146226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2d43d084-957e-4b21-abbc-6b4ff4e49899 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:31:57.147423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2d43d084-957e-4b21-abbc-6b4ff4e49899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:31:57.210528 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 556/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:31:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:31:57.235356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2c42b-f176-48ed-b51f-6059d0eaf316 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:57.330426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2c42b-f176-48ed-b51f-6059d0eaf316 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:57.361594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:57.362425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:57.362705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:57.363008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] PATH_INFO: `/v3/roles/0306acbe82504665a6348fd3f25cee0b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:57.364473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] RBAC: Authorizing `identity:get_role(role_id=0306acbe82504665a6348fd3f25cee0b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:57.365840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:57.367214 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 570/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:57 2022] GET /identity/v3/roles/0306acbe82504665a6348fd3f25cee0b => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:57.373390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43d084-957e-4b21-abbc-6b4ff4e49899 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:57.465593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43d084-957e-4b21-abbc-6b4ff4e49899 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:57.497144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:57.497994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:57.498276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:57.498552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] PATH_INFO: `/v3/users/8cde76005bc64d828d9aaa947a662f71` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:57.499744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] RBAC: Authorizing `identity:get_user(user_id=8cde76005bc64d828d9aaa947a662f71)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:57.501211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:57.502826 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 557/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:31:57 2022] GET /identity/v3/users/8cde76005bc64d828d9aaa947a662f71 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:57.508280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:57.601274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211f665-8dcc-4a7d-89af-b5223ec9c7ec None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:57.633105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:57.633667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:57.633946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:57.634213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:57.696286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:57.697728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:57.787594 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 571/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:31:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:31:57.793910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:57.889489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cc2ad-b5fc-430a-a014-1531c216d040 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:57.921161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b0c85-2fd2-4ab7-8537-d79da9d1f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:57.922011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0c85-2fd2-4ab7-8537-d79da9d1f640 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:57.922291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0c85-2fd2-4ab7-8537-d79da9d1f640 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:57.922563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0c85-2fd2-4ab7-8537-d79da9d1f640 None admin] PATH_INFO: `/v3/projects/5af07f0ef7934900866f638c8fcc252f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:57.923764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0c85-2fd2-4ab7-8537-d79da9d1f640 None admin] RBAC: Authorizing `identity:get_project(project_id=5af07f0ef7934900866f638c8fcc252f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:57.925215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b0c85-2fd2-4ab7-8537-d79da9d1f640 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:57.926972 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 558/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:31:57 2022] GET /identity/v3/projects/5af07f0ef7934900866f638c8fcc252f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:31:57.933936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:31:58.029321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc939e-107b-4482-b15e-9bd558fbfa4c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:31:58.061180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6e88c-4db3-484b-977a-4d7a85257f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:31:58.061825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6e88c-4db3-484b-977a-4d7a85257f2f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:31:58.062105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6e88c-4db3-484b-977a-4d7a85257f2f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:31:58.062468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6e88c-4db3-484b-977a-4d7a85257f2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:31:58.063223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6e88c-4db3-484b-977a-4d7a85257f2f None admin] RBAC: Adding query filter params (role.id=0306acbe82504665a6348fd3f25cee0b, scope.project.id=5af07f0ef7934900866f638c8fcc252f, user.id=8cde76005bc64d828d9aaa947a662f71) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:31:58.063534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6e88c-4db3-484b-977a-4d7a85257f2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:31:58.064967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6e88c-4db3-484b-977a-4d7a85257f2f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:31:58.070472 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 572/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:31:57 2022] GET /identity/v3/role_assignments?user.id=8cde76005bc64d828d9aaa947a662f71&scope.project.id=5af07f0ef7934900866f638c8fcc252f&role.id=0306acbe82504665a6348fd3f25cee0b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:00.442921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1478e-cb92-4092-9c2e-7e717e96d6cf None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:00.443443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1478e-cb92-4092-9c2e-7e717e96d6cf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:00.443536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1478e-cb92-4092-9c2e-7e717e96d6cf None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:00.444823 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 559/1131] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:00.450610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e1d5-4c63-47b6-9b07-c8cb7bb7503e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:00.451080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e1d5-4c63-47b6-9b07-c8cb7bb7503e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:00.451180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8e1d5-4c63-47b6-9b07-c8cb7bb7503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:00.467598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-68e8e1d5-4c63-47b6-9b07-c8cb7bb7503e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:00.468779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-68e8e1d5-4c63-47b6-9b07-c8cb7bb7503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:00.530540 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 573/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:32:00.553847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1478e-cb92-4092-9c2e-7e717e96d6cf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:00.651757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1478e-cb92-4092-9c2e-7e717e96d6cf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:00.683352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381eaf-856b-4208-90d3-149efb94ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:00.684124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381eaf-856b-4208-90d3-149efb94ed1c None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:00.684399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381eaf-856b-4208-90d3-149efb94ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:00.684665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381eaf-856b-4208-90d3-149efb94ed1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:00.685806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381eaf-856b-4208-90d3-149efb94ed1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:00.687254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381eaf-856b-4208-90d3-149efb94ed1c None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:00.688830 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 560/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:32:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:00.694583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8e1d5-4c63-47b6-9b07-c8cb7bb7503e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:00.794953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8e1d5-4c63-47b6-9b07-c8cb7bb7503e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:00.826452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380190-bcab-4498-8888-33928b18e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:00.827131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380190-bcab-4498-8888-33928b18e3db None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:00.827417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380190-bcab-4498-8888-33928b18e3db None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:00.827693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380190-bcab-4498-8888-33928b18e3db None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:00.828386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380190-bcab-4498-8888-33928b18e3db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:00.829854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380190-bcab-4498-8888-33928b18e3db None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:00.853337 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 574/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:32:00 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:32:03.144406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f9eb-918f-4435-af2e-245460cf5973 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:03.144962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f9eb-918f-4435-af2e-245460cf5973 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:03.144962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710f9eb-918f-4435-af2e-245460cf5973 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:03.146295 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 561/1135] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:03.151467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c8d41-360c-4241-ab32-5b4c4e15f154 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:03.151848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c8d41-360c-4241-ab32-5b4c4e15f154 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:03.152023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c8d41-360c-4241-ab32-5b4c4e15f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:03.168606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-179c8d41-360c-4241-ab32-5b4c4e15f154 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:03.169758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-179c8d41-360c-4241-ab32-5b4c4e15f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:03.233341 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 575/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 21:32:03.259041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710f9eb-918f-4435-af2e-245460cf5973 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:03.352239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710f9eb-918f-4435-af2e-245460cf5973 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:03.383820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ba06b-d045-4c1b-84d4-8a320535512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:03.384581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba06b-d045-4c1b-84d4-8a320535512d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:03.384854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba06b-d045-4c1b-84d4-8a320535512d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:03.385117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ba06b-d045-4c1b-84d4-8a320535512d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:03.386309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ba06b-d045-4c1b-84d4-8a320535512d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:03.388262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ba06b-d045-4c1b-84d4-8a320535512d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:03.389823 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 562/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:32:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:03.396141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c8d41-360c-4241-ab32-5b4c4e15f154 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:03.486377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c8d41-360c-4241-ab32-5b4c4e15f154 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:03.518580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9f97f-2c37-42c8-a467-8ed4fe651b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:03.519257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f97f-2c37-42c8-a467-8ed4fe651b07 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:03.519537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f97f-2c37-42c8-a467-8ed4fe651b07 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:03.519811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9f97f-2c37-42c8-a467-8ed4fe651b07 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:03.520491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9f97f-2c37-42c8-a467-8ed4fe651b07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:03.521913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9f97f-2c37-42c8-a467-8ed4fe651b07 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:03.540073 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 576/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:32:03 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:32:05.853282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e22f-c6d4-4749-aeb2-63a57ad6ecbd None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:05.853813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e22f-c6d4-4749-aeb2-63a57ad6ecbd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:05.853813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e22f-c6d4-4749-aeb2-63a57ad6ecbd None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:05.855242 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 563/1139] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:05.860488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbfc0e-b0ba-48b8-9cc9-27ea6f7d55ca None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:05.860912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbfc0e-b0ba-48b8-9cc9-27ea6f7d55ca None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:05.861050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbfc0e-b0ba-48b8-9cc9-27ea6f7d55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:05.877704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9dfbfc0e-b0ba-48b8-9cc9-27ea6f7d55ca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:05.878902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9dfbfc0e-b0ba-48b8-9cc9-27ea6f7d55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:05.943240 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 577/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:05.967559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49e22f-c6d4-4749-aeb2-63a57ad6ecbd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:06.062401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49e22f-c6d4-4749-aeb2-63a57ad6ecbd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:06.093731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:06.094501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:06.094801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:06.095075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:06.105143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:32:06.112544 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:32:06.113647 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:32:06.114687 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 564/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:32:06.119535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbfc0e-b0ba-48b8-9cc9-27ea6f7d55ca None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:06.211622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbfc0e-b0ba-48b8-9cc9-27ea6f7d55ca None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:06.243337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:06.243988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:06.244268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:06.244542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:06.245883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:06.246185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:06.247572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:06.255098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 578/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:32:06.260992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:06.354294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d100bfb-37d3-4924-9a92-eef1141e014b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:06.386791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:06.387602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:06.387880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:06.388148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] PATH_INFO: `/v3/users/f44d88df2d1d403b8e850068f49cd403` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:06.400181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=f44d88df2d1d403b8e850068f49cd403)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:06.401679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:06.403332 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 565/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:32:06 2022] GET /identity/v3/users/f44d88df2d1d403b8e850068f49cd403 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:06.408930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:06.502608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716a5d2-dd37-4cd2-bb3a-e4743ce5dd59 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:06.534818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:06.535454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:06.535738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:06.536011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:06.598519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:06.600026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:06.698404 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 579/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:32:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:32:06.704254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:06.796973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f02382-40d4-41dd-87b4-8a9cd04c3eb0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:06.828357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a1cf9-6918-4328-9ad4-c41ca4d1ed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:06.829190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1cf9-6918-4328-9ad4-c41ca4d1ed5a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:06.829469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1cf9-6918-4328-9ad4-c41ca4d1ed5a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:06.829741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a1cf9-6918-4328-9ad4-c41ca4d1ed5a None admin] PATH_INFO: `/v3/projects/abb76e4fe7ec4f87a96fef888643a07c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:06.830925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a1cf9-6918-4328-9ad4-c41ca4d1ed5a None admin] RBAC: Authorizing `identity:get_project(project_id=abb76e4fe7ec4f87a96fef888643a07c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:06.832348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a1cf9-6918-4328-9ad4-c41ca4d1ed5a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:06.834026 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 566/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:32:06 2022] GET /identity/v3/projects/abb76e4fe7ec4f87a96fef888643a07c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:06.840212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:06.931128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fccbb-5f35-4283-b0ed-e5d79d14f482 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:06.963132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35bc21-b592-4e63-9a02-272d8c2814a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:06.963742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35bc21-b592-4e63-9a02-272d8c2814a5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:06.964025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35bc21-b592-4e63-9a02-272d8c2814a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:06.964300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35bc21-b592-4e63-9a02-272d8c2814a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:06.965115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35bc21-b592-4e63-9a02-272d8c2814a5 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=abb76e4fe7ec4f87a96fef888643a07c, user.id=f44d88df2d1d403b8e850068f49cd403) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:06.965423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35bc21-b592-4e63-9a02-272d8c2814a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:06.966863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35bc21-b592-4e63-9a02-272d8c2814a5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:06.972129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 580/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:32:06 2022] GET /identity/v3/role_assignments?user.id=f44d88df2d1d403b8e850068f49cd403&scope.project.id=abb76e4fe7ec4f87a96fef888643a07c&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:09.244049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145aab-7135-41cb-b168-73abc97373d4 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:09.244507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145aab-7135-41cb-b168-73abc97373d4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:09.244604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a145aab-7135-41cb-b168-73abc97373d4 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:09.246662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 567/1147] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:09.251968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53e7c-0140-41b4-b813-1dfe2410315a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:09.252410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53e7c-0140-41b4-b813-1dfe2410315a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:09.252531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e53e7c-0140-41b4-b813-1dfe2410315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:09.269333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b3e53e7c-0140-41b4-b813-1dfe2410315a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:09.270507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3e53e7c-0140-41b4-b813-1dfe2410315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:09.332948 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 581/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:09.357415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a145aab-7135-41cb-b168-73abc97373d4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:09.451107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a145aab-7135-41cb-b168-73abc97373d4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:09.483236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:09.484007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:09.484291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:09.484565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:09.493974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:32:09.501545 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:32:09.502648 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:32:09.503750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 568/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:32:09.508507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e53e7c-0140-41b4-b813-1dfe2410315a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:09.599663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e53e7c-0140-41b4-b813-1dfe2410315a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:09.640223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:09.640871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:09.641151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:09.641422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:09.642155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:09.642459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:09.643857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:09.651944 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 582/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:32:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:09.658102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:09.749866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf42e8-67b5-44d8-8e5d-84221f02947b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:09.781330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:09.782173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:09.782454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:09.782725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] PATH_INFO: `/v3/users/f44d88df2d1d403b8e850068f49cd403` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:09.783911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] RBAC: Authorizing `identity:get_user(user_id=f44d88df2d1d403b8e850068f49cd403)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:09.785324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:09.786929 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 569/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:32:09 2022] GET /identity/v3/users/f44d88df2d1d403b8e850068f49cd403 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:09.792368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:09.884314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbb92a-95c0-46a5-9567-61e7da98dd09 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:09.915842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b96de1-3c87-4fd8-82b1-e05f7a558821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:09.916719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96de1-3c87-4fd8-82b1-e05f7a558821 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:09.917194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96de1-3c87-4fd8-82b1-e05f7a558821 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:09.917503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96de1-3c87-4fd8-82b1-e05f7a558821 None admin] PATH_INFO: `/v3/projects/abb76e4fe7ec4f87a96fef888643a07c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:09.918679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96de1-3c87-4fd8-82b1-e05f7a558821 None admin] RBAC: Authorizing `identity:get_project(project_id=abb76e4fe7ec4f87a96fef888643a07c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:09.920171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96de1-3c87-4fd8-82b1-e05f7a558821 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:09.921841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 583/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:32:09 2022] GET /identity/v3/projects/abb76e4fe7ec4f87a96fef888643a07c => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:09.928982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:10.022292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7cfb-a75f-44d6-91e7-950a8f7e47a3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:10.054105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9ccd7-9cd3-417f-83a3-148996ab242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:10.055002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ccd7-9cd3-417f-83a3-148996ab242e None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:10.055283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ccd7-9cd3-417f-83a3-148996ab242e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:10.055553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ccd7-9cd3-417f-83a3-148996ab242e None admin] PATH_INFO: `/v3/projects/abb76e4fe7ec4f87a96fef888643a07c/users/f44d88df2d1d403b8e850068f49cd403/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:10.058005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9ccd7-9cd3-417f-83a3-148996ab242e None admin] RBAC: Authorizing `identity:create_grant(project_id=abb76e4fe7ec4f87a96fef888643a07c, user_id=f44d88df2d1d403b8e850068f49cd403, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:10.059467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9ccd7-9cd3-417f-83a3-148996ab242e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:10.071234 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 570/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:32:09 2022] PUT /identity/v3/projects/abb76e4fe7ec4f87a96fef888643a07c/users/f44d88df2d1d403b8e850068f49cd403/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:32:12.355608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374f68-11c9-4b00-80b8-50d19b98b2f5 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:12.356167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374f68-11c9-4b00-80b8-50d19b98b2f5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:12.356167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374f68-11c9-4b00-80b8-50d19b98b2f5 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:12.357518 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 584/1154] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:12.362903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e1ce-b787-4ab7-ad65-34d517effe7a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:12.363348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e1ce-b787-4ab7-ad65-34d517effe7a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:12.363452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e1ce-b787-4ab7-ad65-34d517effe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:12.379494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d123e1ce-b787-4ab7-ad65-34d517effe7a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:12.380669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d123e1ce-b787-4ab7-ad65-34d517effe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:12.443246 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 571/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:12.467669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374f68-11c9-4b00-80b8-50d19b98b2f5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:12.563304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374f68-11c9-4b00-80b8-50d19b98b2f5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:12.595220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:12.595990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:12.596274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:12.596552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:12.607178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:32:12.614656 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:32:12.615897 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:32:12.617025 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 585/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:32:12.623894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123e1ce-b787-4ab7-ad65-34d517effe7a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:12.716507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123e1ce-b787-4ab7-ad65-34d517effe7a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:12.747511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:12.748234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:12.748510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:12.748775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:12.749496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:12.749790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:12.751155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:12.758729 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 572/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:32:12.764953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:12.857212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51b48-5dc6-42ad-af3b-d2406c715f5b None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:12.888375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:12.889209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:12.889491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:12.889763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] PATH_INFO: `/v3/users/f44d88df2d1d403b8e850068f49cd403` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:12.890948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] RBAC: Authorizing `identity:get_user(user_id=f44d88df2d1d403b8e850068f49cd403)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:12.892375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:12.893952 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 586/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:32:12 2022] GET /identity/v3/users/f44d88df2d1d403b8e850068f49cd403 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:12.899923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:12.993258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d2c98-c3fb-4034-b934-61433d69f147 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:13.024191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:13.024764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:13.025044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:13.025314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:13.088996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:13.090443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:13.180682 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 573/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:32:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:32:13.187217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:13.280575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71a30b-0fb1-4368-9e67-bab79c57a620 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:13.312781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e710144-3386-4c4d-beb9-7d4b8edc0418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:13.313610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e710144-3386-4c4d-beb9-7d4b8edc0418 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:13.313893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e710144-3386-4c4d-beb9-7d4b8edc0418 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:13.314165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e710144-3386-4c4d-beb9-7d4b8edc0418 None admin] PATH_INFO: `/v3/projects/abb76e4fe7ec4f87a96fef888643a07c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:13.315338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e710144-3386-4c4d-beb9-7d4b8edc0418 None admin] RBAC: Authorizing `identity:get_project(project_id=abb76e4fe7ec4f87a96fef888643a07c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:13.316776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e710144-3386-4c4d-beb9-7d4b8edc0418 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:13.318433 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 587/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:32:13 2022] GET /identity/v3/projects/abb76e4fe7ec4f87a96fef888643a07c => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:13.325223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:13.417810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b9c5b-08c7-498d-9a89-f7ca75ef93d9 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:13.449971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6867fc3-2254-4a09-b2ab-ced9a2be2796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:13.450614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867fc3-2254-4a09-b2ab-ced9a2be2796 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:13.450935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867fc3-2254-4a09-b2ab-ced9a2be2796 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:13.451214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6867fc3-2254-4a09-b2ab-ced9a2be2796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:13.452027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6867fc3-2254-4a09-b2ab-ced9a2be2796 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=abb76e4fe7ec4f87a96fef888643a07c, user.id=f44d88df2d1d403b8e850068f49cd403) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:13.452337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6867fc3-2254-4a09-b2ab-ced9a2be2796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:13.453769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6867fc3-2254-4a09-b2ab-ced9a2be2796 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:13.459636 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 574/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:32:13 2022] GET /identity/v3/role_assignments?user.id=f44d88df2d1d403b8e850068f49cd403&scope.project.id=abb76e4fe7ec4f87a96fef888643a07c&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:15.758365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9505-6e1b-4642-8a48-741fb625f165 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:15.758918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9505-6e1b-4642-8a48-741fb625f165 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:15.759036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec9505-6e1b-4642-8a48-741fb625f165 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:15.760325 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 588/1162] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:15.765832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7848df-391d-4d7e-838e-85d48ef081fe None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:15.766241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7848df-391d-4d7e-838e-85d48ef081fe None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:15.766395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7848df-391d-4d7e-838e-85d48ef081fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:15.782481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-aa7848df-391d-4d7e-838e-85d48ef081fe None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:15.783728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aa7848df-391d-4d7e-838e-85d48ef081fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:15.853698 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 575/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:15.877931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9505-6e1b-4642-8a48-741fb625f165 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:15.972824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec9505-6e1b-4642-8a48-741fb625f165 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:16.004246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:16.004870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:16.005149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:16.005421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:16.067072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:16.068443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:16.163338 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 589/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:32:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:32:16.169977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7848df-391d-4d7e-838e-85d48ef081fe None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:16.262675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7848df-391d-4d7e-838e-85d48ef081fe None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:16.294754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa3897-f42e-4fb3-ade0-79fdab4e9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:16.295562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3897-f42e-4fb3-ade0-79fdab4e9e9e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:16.295844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3897-f42e-4fb3-ade0-79fdab4e9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:16.296118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa3897-f42e-4fb3-ade0-79fdab4e9e9e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:16.302420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3897-f42e-4fb3-ade0-79fdab4e9e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:16.303898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa3897-f42e-4fb3-ade0-79fdab4e9e9e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-6caa3897-f42e-4fb3-ade0-79fdab4e9e9e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:32:16.317504 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:32:16.322957 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:32:16.324074 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 576/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:32:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:32:16.325203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:16.419568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cfa5-17a6-435d-9e65-7233f84a162e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:16.454813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bd789-f93d-44d6-9342-e085c2486a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:16.455470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd789-f93d-44d6-9342-e085c2486a77 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:16.455749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd789-f93d-44d6-9342-e085c2486a77 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:16.456021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bd789-f93d-44d6-9342-e085c2486a77 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:16.456731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bd789-f93d-44d6-9342-e085c2486a77 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:16.457033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bd789-f93d-44d6-9342-e085c2486a77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:16.458402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bd789-f93d-44d6-9342-e085c2486a77 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:16.466206 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 590/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Sat May 7 21:32:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:18.807183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312363d-5816-4f7f-bc0e-7cb15f9c644f None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:18.810814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312363d-5816-4f7f-bc0e-7cb15f9c644f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:18.810814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312363d-5816-4f7f-bc0e-7cb15f9c644f None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:18.810814 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 577/1167] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:18.814716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495bcc1-e165-42c6-a2db-b127a2acae79 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:18.815145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495bcc1-e165-42c6-a2db-b127a2acae79 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:18.815310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495bcc1-e165-42c6-a2db-b127a2acae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:18.832000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e495bcc1-e165-42c6-a2db-b127a2acae79 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:18.833175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e495bcc1-e165-42c6-a2db-b127a2acae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:18.896324 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 591/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:18.920255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312363d-5816-4f7f-bc0e-7cb15f9c644f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:19.015534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312363d-5816-4f7f-bc0e-7cb15f9c644f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:19.047739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b056b-c179-493f-a9c0-ac9d6a3fdb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:19.048409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b056b-c179-493f-a9c0-ac9d6a3fdb09 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:19.048688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b056b-c179-493f-a9c0-ac9d6a3fdb09 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:19.049070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b056b-c179-493f-a9c0-ac9d6a3fdb09 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:19.049688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b056b-c179-493f-a9c0-ac9d6a3fdb09 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:19.051105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b056b-c179-493f-a9c0-ac9d6a3fdb09 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:19.065649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 578/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Sat May 7 21:32:18 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:32:21.337931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03627e2-7454-48b1-a743-526cdda4bcc9 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:21.338511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03627e2-7454-48b1-a743-526cdda4bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:21.338511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03627e2-7454-48b1-a743-526cdda4bcc9 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:21.339929 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 592/1170] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:21.345117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6449-43bf-4130-bb44-6f412490c0cb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:21.345490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6449-43bf-4130-bb44-6f412490c0cb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:21.345668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da6449-43bf-4130-bb44-6f412490c0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:21.361554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f1da6449-43bf-4130-bb44-6f412490c0cb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:21.362717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1da6449-43bf-4130-bb44-6f412490c0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:21.423841 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 579/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:21.448171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03627e2-7454-48b1-a743-526cdda4bcc9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:21.542555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03627e2-7454-48b1-a743-526cdda4bcc9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:21.574515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df81b7-17e2-487c-a704-43082057ba0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:21.575379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df81b7-17e2-487c-a704-43082057ba0e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:21.575655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df81b7-17e2-487c-a704-43082057ba0e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:21.575919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df81b7-17e2-487c-a704-43082057ba0e None admin] PATH_INFO: `/v3/domains/fdad9f6ef29a4edbaf69d43f9c11e773` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:21.585820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df81b7-17e2-487c-a704-43082057ba0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=fdad9f6ef29a4edbaf69d43f9c11e773)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:21.587297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df81b7-17e2-487c-a704-43082057ba0e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:21.589200 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 593/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Sat May 7 21:32:21 2022] GET /identity/v3/domains/fdad9f6ef29a4edbaf69d43f9c11e773 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:21.595026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6449-43bf-4130-bb44-6f412490c0cb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:21.687452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da6449-43bf-4130-bb44-6f412490c0cb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:21.718694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b4727-5799-46bc-8a2d-66134099a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:21.719375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4727-5799-46bc-8a2d-66134099a9a8 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:21.719659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4727-5799-46bc-8a2d-66134099a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:21.719939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b4727-5799-46bc-8a2d-66134099a9a8 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:21.720634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4727-5799-46bc-8a2d-66134099a9a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:21.722063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b4727-5799-46bc-8a2d-66134099a9a8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:21.746202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 580/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:32:21 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:32:24.063338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55fd8-51bb-48a9-a8ec-5212670bdd14 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:24.063893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55fd8-51bb-48a9-a8ec-5212670bdd14 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:24.063893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da55fd8-51bb-48a9-a8ec-5212670bdd14 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:24.065256 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 594/1174] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:24.070408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76436410-4eb6-4796-8318-911fd7052904 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:24.070931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76436410-4eb6-4796-8318-911fd7052904 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:24.071038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76436410-4eb6-4796-8318-911fd7052904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:24.087300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-76436410-4eb6-4796-8318-911fd7052904 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:24.088574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-76436410-4eb6-4796-8318-911fd7052904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:24.150075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 581/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:24.176010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da55fd8-51bb-48a9-a8ec-5212670bdd14 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:24.271317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da55fd8-51bb-48a9-a8ec-5212670bdd14 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:24.304490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24136c75-d602-46d7-b139-afcdd368d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:24.305325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136c75-d602-46d7-b139-afcdd368d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:24.305600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136c75-d602-46d7-b139-afcdd368d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:24.305866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24136c75-d602-46d7-b139-afcdd368d2a6 None admin] PATH_INFO: `/v3/domains/fdad9f6ef29a4edbaf69d43f9c11e773` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:24.307067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24136c75-d602-46d7-b139-afcdd368d2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fdad9f6ef29a4edbaf69d43f9c11e773)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:24.308501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24136c75-d602-46d7-b139-afcdd368d2a6 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:24.310100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 595/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Sat May 7 21:32:24 2022] GET /identity/v3/domains/fdad9f6ef29a4edbaf69d43f9c11e773 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:24.315890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76436410-4eb6-4796-8318-911fd7052904 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:24.407717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76436410-4eb6-4796-8318-911fd7052904 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:24.439933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203b159-d5cb-4767-96b9-37d4f5bfacb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:24.440587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b159-d5cb-4767-96b9-37d4f5bfacb5 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:24.440868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b159-d5cb-4767-96b9-37d4f5bfacb5 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:24.441141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b159-d5cb-4767-96b9-37d4f5bfacb5 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:24.441827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203b159-d5cb-4767-96b9-37d4f5bfacb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:24.443316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203b159-d5cb-4767-96b9-37d4f5bfacb5 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:24.462602 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 582/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:32:24 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:32:26.768090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf3f4-69ea-41ac-b1e1-9dd8123ddddd None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:26.768645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf3f4-69ea-41ac-b1e1-9dd8123ddddd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:26.768645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bf3f4-69ea-41ac-b1e1-9dd8123ddddd None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:26.769995 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 596/1178] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:26.775307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb51c8-a091-4394-8e1b-e0abeffe3795 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:26.776258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb51c8-a091-4394-8e1b-e0abeffe3795 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:26.776355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb51c8-a091-4394-8e1b-e0abeffe3795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:26.793255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-73bb51c8-a091-4394-8e1b-e0abeffe3795 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:26.794422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-73bb51c8-a091-4394-8e1b-e0abeffe3795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:26.866862 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 583/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:26.891574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf3f4-69ea-41ac-b1e1-9dd8123ddddd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:26.987808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bf3f4-69ea-41ac-b1e1-9dd8123ddddd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:27.019979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:27.020702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:27.020988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:27.021270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:27.031956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:32:27.039483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:32:27.040691 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:32:27.041909 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 597/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:32:27.046690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb51c8-a091-4394-8e1b-e0abeffe3795 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:27.139091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb51c8-a091-4394-8e1b-e0abeffe3795 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:27.170887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:27.171550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:27.171831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:27.172103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:27.172841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:27.173143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:27.174520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:27.182662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 584/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:27.188679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:27.282902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1211a95-b4b4-4dd7-b500-63dbf84561ae None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:27.313988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:27.314861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:27.315145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:27.315417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] PATH_INFO: `/v3/users/6808f01ad6a347a39f2b2ecb2072dd54` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:27.328071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] RBAC: Authorizing `identity:get_user(user_id=6808f01ad6a347a39f2b2ecb2072dd54)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:27.329511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:27.331177 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 598/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:32:27 2022] GET /identity/v3/users/6808f01ad6a347a39f2b2ecb2072dd54 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:32:27.337333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:27.430189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022eacb-b58a-463e-8d2d-53a8c05637f3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:27.461921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:27.462553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:27.462874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:27.463156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:27.524696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:27.526148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:27.617219 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 585/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:32:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:32:27.623729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:27.717436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2487bb0-0e59-4846-9aaf-060d6dc62226 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:27.748502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6fee-344c-4e30-88c2-1ab90bdb206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:27.749339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6fee-344c-4e30-88c2-1ab90bdb206a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:27.749623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6fee-344c-4e30-88c2-1ab90bdb206a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:27.749900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6fee-344c-4e30-88c2-1ab90bdb206a None admin] PATH_INFO: `/v3/projects/65c03a8f528a4514b9f1a6302a264c86` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:27.751092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6fee-344c-4e30-88c2-1ab90bdb206a None admin] RBAC: Authorizing `identity:get_project(project_id=65c03a8f528a4514b9f1a6302a264c86)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:27.752531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6fee-344c-4e30-88c2-1ab90bdb206a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:27.754185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 599/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:32:27 2022] GET /identity/v3/projects/65c03a8f528a4514b9f1a6302a264c86 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:27.760605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:27.852206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5e086-8e86-459b-a008-e279c3d83c4b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:27.882912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fd909-5c60-4e47-a801-af6a5121d3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:27.883490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd909-5c60-4e47-a801-af6a5121d3aa None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:27.883771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd909-5c60-4e47-a801-af6a5121d3aa None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:27.884041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fd909-5c60-4e47-a801-af6a5121d3aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:27.885337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd909-5c60-4e47-a801-af6a5121d3aa None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=65c03a8f528a4514b9f1a6302a264c86, user.id=6808f01ad6a347a39f2b2ecb2072dd54) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:27.885642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd909-5c60-4e47-a801-af6a5121d3aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:27.887097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fd909-5c60-4e47-a801-af6a5121d3aa None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:27.892249 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 586/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:32:27 2022] GET /identity/v3/role_assignments?user.id=6808f01ad6a347a39f2b2ecb2072dd54&scope.project.id=65c03a8f528a4514b9f1a6302a264c86&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:30.149173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9540-5680-46bb-880b-fdae3ae31936 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:30.149733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9540-5680-46bb-880b-fdae3ae31936 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:30.149733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc9540-5680-46bb-880b-fdae3ae31936 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:30.151663 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 600/1186] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:30.156764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac5012-ef0f-4aae-8b53-41efee5e5c5d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:30.157190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac5012-ef0f-4aae-8b53-41efee5e5c5d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:30.157318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac5012-ef0f-4aae-8b53-41efee5e5c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:30.174654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b9ac5012-ef0f-4aae-8b53-41efee5e5c5d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:30.175852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b9ac5012-ef0f-4aae-8b53-41efee5e5c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:30.240402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 587/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:30.266642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9540-5680-46bb-880b-fdae3ae31936 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:30.361877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc9540-5680-46bb-880b-fdae3ae31936 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:30.392873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:30.393639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:30.393925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:30.394201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:30.404546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:32:30.412244 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:32:30.413164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:32:30.414080 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 601/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:32:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:32:30.419940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac5012-ef0f-4aae-8b53-41efee5e5c5d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:30.514904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac5012-ef0f-4aae-8b53-41efee5e5c5d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:30.549132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:30.549796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:30.550078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:30.550355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:30.551123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:30.551433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:30.553079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:30.560780 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 588/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:32:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:30.566673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:30.661454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7221-0c63-457d-956e-4a05a99245b3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:30.696129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:30.696971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:30.697838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:30.698116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] PATH_INFO: `/v3/users/6808f01ad6a347a39f2b2ecb2072dd54` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:30.699310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=6808f01ad6a347a39f2b2ecb2072dd54)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:30.700733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:30.702336 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 602/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:32:30 2022] GET /identity/v3/users/6808f01ad6a347a39f2b2ecb2072dd54 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:30.708078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:30.800686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb5e19-e42f-4b60-bf66-b4c69329369a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:30.831430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff7420-cd0e-4e0d-a48e-4286a69f07e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:30.832269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7420-cd0e-4e0d-a48e-4286a69f07e2 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:30.832547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7420-cd0e-4e0d-a48e-4286a69f07e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:30.832821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7420-cd0e-4e0d-a48e-4286a69f07e2 None admin] PATH_INFO: `/v3/projects/65c03a8f528a4514b9f1a6302a264c86` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:30.834223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff7420-cd0e-4e0d-a48e-4286a69f07e2 None admin] RBAC: Authorizing `identity:get_project(project_id=65c03a8f528a4514b9f1a6302a264c86)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:30.835668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff7420-cd0e-4e0d-a48e-4286a69f07e2 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:30.837316 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 589/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:32:30 2022] GET /identity/v3/projects/65c03a8f528a4514b9f1a6302a264c86 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:30.843554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:30.944104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1286a-3150-47a7-94f9-231d46f87fe4 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:30.975714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acac1a-0165-4c70-b56c-bdfe738e8d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:30.976585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acac1a-0165-4c70-b56c-bdfe738e8d81 None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:30.976867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acac1a-0165-4c70-b56c-bdfe738e8d81 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:30.977141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acac1a-0165-4c70-b56c-bdfe738e8d81 None admin] PATH_INFO: `/v3/projects/65c03a8f528a4514b9f1a6302a264c86/users/6808f01ad6a347a39f2b2ecb2072dd54/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:30.979525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acac1a-0165-4c70-b56c-bdfe738e8d81 None admin] RBAC: Authorizing `identity:create_grant(project_id=65c03a8f528a4514b9f1a6302a264c86, user_id=6808f01ad6a347a39f2b2ecb2072dd54, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:30.981066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acac1a-0165-4c70-b56c-bdfe738e8d81 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:30.992878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 603/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:32:30 2022] PUT /identity/v3/projects/65c03a8f528a4514b9f1a6302a264c86/users/6808f01ad6a347a39f2b2ecb2072dd54/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:32:33.248640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763e734-9371-4157-b593-469cec1c581d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:33.249136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763e734-9371-4157-b593-469cec1c581d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:33.249238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763e734-9371-4157-b593-469cec1c581d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:33.250576 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 590/1193] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:32:33.255788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bc0db-b29b-4d62-9ee5-ba2f12f1ba0c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:33.256173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bc0db-b29b-4d62-9ee5-ba2f12f1ba0c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:33.256331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bc0db-b29b-4d62-9ee5-ba2f12f1ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:33.272349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f70bc0db-b29b-4d62-9ee5-ba2f12f1ba0c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:32:33.273508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f70bc0db-b29b-4d62-9ee5-ba2f12f1ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:32:33.334890 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 604/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:32:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:32:33.359478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763e734-9371-4157-b593-469cec1c581d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:33.453942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763e734-9371-4157-b593-469cec1c581d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:33.485914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:33.486673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:33.486978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:33.487250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:33.496566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:32:33.503929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:32:33.505020 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:32:33.505938 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 591/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:32:33.510981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bc0db-b29b-4d62-9ee5-ba2f12f1ba0c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:33.601409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bc0db-b29b-4d62-9ee5-ba2f12f1ba0c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:33.632598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:33.633252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:33.633528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:33.633795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:33.635074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:33.635382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:33.636739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:33.644296 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 605/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:33.650059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:33.742426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d414a17-b6d3-49fb-bea6-a9b7b8c90c6f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:33.773039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:33.773875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:33.774149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:33.774413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] PATH_INFO: `/v3/users/6808f01ad6a347a39f2b2ecb2072dd54` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:33.776188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] RBAC: Authorizing `identity:get_user(user_id=6808f01ad6a347a39f2b2ecb2072dd54)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:33.777601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:33.779214 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 592/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Sat May 7 21:32:33 2022] GET /identity/v3/users/6808f01ad6a347a39f2b2ecb2072dd54 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:33.785453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:33.877380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bdfb5-3ba6-43b8-b408-277ba3386ce5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:33.909246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:33.909872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:33.910150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:33.910417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:33.971887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:33.973329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:34.063004 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 606/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:32:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 07 21:32:34.068980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:34.163635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ad511-5b8d-4036-bb35-585e6cb08688 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:34.194786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025fb62-34a5-4ee7-a0b5-16737f04837e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:34.195654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fb62-34a5-4ee7-a0b5-16737f04837e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:34.195935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fb62-34a5-4ee7-a0b5-16737f04837e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:34.196208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fb62-34a5-4ee7-a0b5-16737f04837e None admin] PATH_INFO: `/v3/projects/65c03a8f528a4514b9f1a6302a264c86` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:34.198018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025fb62-34a5-4ee7-a0b5-16737f04837e None admin] RBAC: Authorizing `identity:get_project(project_id=65c03a8f528a4514b9f1a6302a264c86)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:34.199707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025fb62-34a5-4ee7-a0b5-16737f04837e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:34.201171 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 593/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Sat May 7 21:32:34 2022] GET /identity/v3/projects/65c03a8f528a4514b9f1a6302a264c86 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:32:34.207204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:32:34.299140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fd4de-75c0-4014-ae36-672db59c94da None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:32:34.331197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157a182-9b91-4507-bf5e-c0dfa3907243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:32:34.331783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157a182-9b91-4507-bf5e-c0dfa3907243 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:32:34.332067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157a182-9b91-4507-bf5e-c0dfa3907243 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:32:34.332341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157a182-9b91-4507-bf5e-c0dfa3907243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:32:34.333156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157a182-9b91-4507-bf5e-c0dfa3907243 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=65c03a8f528a4514b9f1a6302a264c86, user.id=6808f01ad6a347a39f2b2ecb2072dd54) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:32:34.333466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157a182-9b91-4507-bf5e-c0dfa3907243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:32:34.335189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157a182-9b91-4507-bf5e-c0dfa3907243 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:32:34.340714 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 607/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:32:34 2022] GET /identity/v3/role_assignments?user.id=6808f01ad6a347a39f2b2ecb2072dd54&scope.project.id=65c03a8f528a4514b9f1a6302a264c86&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:36.238419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8ae31-4595-4c53-abaa-c0789485cd9a None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:36.239050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8ae31-4595-4c53-abaa-c0789485cd9a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:36.239050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8ae31-4595-4c53-abaa-c0789485cd9a None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:36.240622 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 594/1201] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:33:36.246076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb3c23-b8a2-4a01-bb73-fa392fbb7e6d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:36.246578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb3c23-b8a2-4a01-bb73-fa392fbb7e6d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:36.246699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb3c23-b8a2-4a01-bb73-fa392fbb7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:36.264763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-26eb3c23-b8a2-4a01-bb73-fa392fbb7e6d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:33:36.265994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-26eb3c23-b8a2-4a01-bb73-fa392fbb7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:33:36.338590 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 608/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:33:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:33:36.363679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8ae31-4595-4c53-abaa-c0789485cd9a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:36.478326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8ae31-4595-4c53-abaa-c0789485cd9a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:36.515059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:36.515850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:36.516127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:36.516421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:36.529489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:36.531125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:36.549330 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:36.550405 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:36.556808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:36.556808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:36.556808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:36.556808 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:36.556808 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 595/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:33:36.557123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb3c23-b8a2-4a01-bb73-fa392fbb7e6d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:36.682015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb3c23-b8a2-4a01-bb73-fa392fbb7e6d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:36.718790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4dda1-8503-4f57-a14b-8e4546fd1087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:36.719544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4dda1-8503-4f57-a14b-8e4546fd1087 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:36.719951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4dda1-8503-4f57-a14b-8e4546fd1087 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:36.720236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4dda1-8503-4f57-a14b-8e4546fd1087 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:36.721011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4dda1-8503-4f57-a14b-8e4546fd1087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:36.721348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4dda1-8503-4f57-a14b-8e4546fd1087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:36.722865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4dda1-8503-4f57-a14b-8e4546fd1087 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:36.740851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 609/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:36.742331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:36.854918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108fef8-bbee-4ebc-9ddc-c9f03954af90 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:36.894582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c4f39-00ea-42dd-9915-22b0fe9ec0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:36.895461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4f39-00ea-42dd-9915-22b0fe9ec0d7 None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:36.895801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4f39-00ea-42dd-9915-22b0fe9ec0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:36.896146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4f39-00ea-42dd-9915-22b0fe9ec0d7 None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:36.896876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c4f39-00ea-42dd-9915-22b0fe9ec0d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:36.898512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c4f39-00ea-42dd-9915-22b0fe9ec0d7 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:36.926852 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 596/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Sat May 7 21:33:36 2022] POST /identity/v3/users => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:33:39.438937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da75754-7a82-490b-b19a-be4279a36a72 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:39.439573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da75754-7a82-490b-b19a-be4279a36a72 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:39.439573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da75754-7a82-490b-b19a-be4279a36a72 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:39.441265 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 610/1206] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:33:39.447164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32148654-b3a4-4cb4-8e69-73b734277da2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:39.447627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32148654-b3a4-4cb4-8e69-73b734277da2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:39.447718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32148654-b3a4-4cb4-8e69-73b734277da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:39.465158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-32148654-b3a4-4cb4-8e69-73b734277da2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:33:39.466556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-32148654-b3a4-4cb4-8e69-73b734277da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:33:39.539040 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 597/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:33:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:33:39.566248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da75754-7a82-490b-b19a-be4279a36a72 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:39.683805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da75754-7a82-490b-b19a-be4279a36a72 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:39.722153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:39.723003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:39.723316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:39.723590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:39.735841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:33:39.745195 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:39.746647 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:39.748398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 611/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:39.753044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32148654-b3a4-4cb4-8e69-73b734277da2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:39.871033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32148654-b3a4-4cb4-8e69-73b734277da2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:39.913852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:39.913852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:39.914181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:39.914285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:39.915205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:39.915603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:39.917281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:39.927434 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 598/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:39.934527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:40.042703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbdfa5-8f6f-4c88-ad35-761d75bf93a2 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:40.084911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:40.085864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:40.086184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:40.086549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:40.098583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:40.100427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:40.121640 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:40.122862 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:40.124024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:40.124024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:40.124024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:40.124024 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:40.124024 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 612/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:40.129497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:40.244200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352671e-160e-4076-8e01-0d9a3a667f5e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:40.280535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:40.281278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:40.281557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:40.281827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:40.282531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:40.282920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:40.284313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:40.297269 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 599/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:40.302803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:40.408863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291110f-dfb8-4284-a2dd-574a4d82426e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:40.447377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:40.448342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:40.448702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:40.449039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] PATH_INFO: `/v3/users/placement` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:40.459867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:40.462311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:33:40.479416 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:40.480488 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:40.486268 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 613/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:40.486915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:40.619005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c14029-54e3-4dab-943a-3e4bfae47ffe None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:40.658521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:40.659392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:40.659702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:40.659954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:40.660989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:40.661328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:40.662999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:40.682761 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 600/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Sat May 7 21:33:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:40.688455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:40.799063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307ca58-7a72-4149-813f-e50e244a442e None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:40.834787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:40.835457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:40.835741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:40.836041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:40.921779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:40.923277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:41.052043 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 614/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:33:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 07 21:33:41.058593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:41.163301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93065fe-3c9e-4f57-b5f0-74b0307e2cee None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:41.200104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:41.200669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:41.201028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:41.201485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:41.213536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:41.215066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:41.235375 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:41.236744 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:41.238063 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:41.238063 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:41.238063 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:41.238063 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:41.244245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 601/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:41.245334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:41.347460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e358e-ed3e-4a23-9aca-013419065d3a None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:41.383520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:41.384345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:41.384727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:41.385123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:41.385947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:41.386352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:41.387851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:41.399846 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 615/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:33:41.405399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:41.513153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae7ea-e2a4-47fb-af9c-5bd40936676d None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:41.549938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:41.551239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:41.551801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:41.552330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:41.561032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:41.562997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:33:41.579888 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:41.581187 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:41.582414 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:41.585145 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 602/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:41.595892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:41.701015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ade44-04e0-4731-bc81-27e427ed63e8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:41.741497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d88bd-a42e-4f98-9cb5-b6b84b96b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:41.742864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d88bd-a42e-4f98-9cb5-b6b84b96b25f None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:41.742864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d88bd-a42e-4f98-9cb5-b6b84b96b25f None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:41.743088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d88bd-a42e-4f98-9cb5-b6b84b96b25f None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:41.743689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d88bd-a42e-4f98-9cb5-b6b84b96b25f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:41.743998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d88bd-a42e-4f98-9cb5-b6b84b96b25f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:41.745436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d88bd-a42e-4f98-9cb5-b6b84b96b25f None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:41.763138 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 616/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:41.764508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:41.872720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131f359-5897-44c9-952a-cf5f4785cea0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:41.910229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962aff7-b37e-4bcf-b903-711fca9bd673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:41.910926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962aff7-b37e-4bcf-b903-711fca9bd673 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:41.911253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962aff7-b37e-4bcf-b903-711fca9bd673 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:41.911536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962aff7-b37e-4bcf-b903-711fca9bd673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:41.912415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962aff7-b37e-4bcf-b903-711fca9bd673 None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=e834001baa424d24b5c9551a7cae7741) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:41.912759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962aff7-b37e-4bcf-b903-711fca9bd673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:41.915054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962aff7-b37e-4bcf-b903-711fca9bd673 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:41.930801 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 603/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:33:41 2022] GET /identity/v3/role_assignments?user.id=e834001baa424d24b5c9551a7cae7741&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:44.230893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cdd0-9962-46a7-a818-6123c0ee9c32 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:44.231478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cdd0-9962-46a7-a818-6123c0ee9c32 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:44.231478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cdd0-9962-46a7-a818-6123c0ee9c32 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:44.233202 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 617/1220] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:33:44.238577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa840a-c6a0-422b-aa8f-79f670c5a73a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:44.239106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa840a-c6a0-422b-aa8f-79f670c5a73a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:44.239308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa840a-c6a0-422b-aa8f-79f670c5a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:44.259452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-68aa840a-c6a0-422b-aa8f-79f670c5a73a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:33:44.260915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68aa840a-c6a0-422b-aa8f-79f670c5a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:33:44.330438 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 604/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:33:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:33:44.356064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9cdd0-9962-46a7-a818-6123c0ee9c32 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:44.471480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9cdd0-9962-46a7-a818-6123c0ee9c32 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:44.506500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:44.507461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:44.507752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:44.508031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:44.520176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:33:44.528566 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:44.529567 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:33:44.530499 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:44.534725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 618/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:44.536018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa840a-c6a0-422b-aa8f-79f670c5a73a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:44.636321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa840a-c6a0-422b-aa8f-79f670c5a73a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:44.672905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:44.673578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:44.673862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:44.674137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:44.675129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] RBAC: Adding query filter params (name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:44.675439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:44.676849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:44.690035 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 605/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:44.691377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:44.804959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2068ffc-f95f-4ab2-bd92-13e199a1a4a1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:44.843512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:44.844463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:44.844906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:44.845237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:44.858298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:44.860168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:44.878595 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:44.879626 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:44.880568 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:44.880568 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:44.880568 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:44.880568 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:44.880568 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 619/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:44.886416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:45.008866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad22036-d0f9-4ee9-9b35-96afd746e5ac None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:45.044652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90664a52-325a-45de-ad27-210a52876afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:45.045397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90664a52-325a-45de-ad27-210a52876afc None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:45.045771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90664a52-325a-45de-ad27-210a52876afc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:45.046052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90664a52-325a-45de-ad27-210a52876afc None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:45.046979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90664a52-325a-45de-ad27-210a52876afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:45.047323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90664a52-325a-45de-ad27-210a52876afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:45.049024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90664a52-325a-45de-ad27-210a52876afc None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:45.062251 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 606/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:45.068175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:45.180523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4ab97-3444-4a97-a49b-bb9665e45594 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:45.224586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:45.225711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:45.226021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:45.226420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:45.236405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:45.237895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:33:45.254629 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:45.255694 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:45.256750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:45.259605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 620/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:45.265212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90664a52-325a-45de-ad27-210a52876afc None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:45.371524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90664a52-325a-45de-ad27-210a52876afc None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:45.407036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:45.407730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:45.408011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:45.408283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:45.409204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:45.409487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:45.410941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:45.428533 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 607/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Sat May 7 21:33:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:45.434155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:45.551359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59287831-0826-4afc-b221-c596c5b7f5fd None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:45.586670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:45.587604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:45.587940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:45.588170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:45.599451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:45.600907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:45.617973 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:45.619487 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:45.620861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:45.620861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:45.620861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:45.620861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:45.620861 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 621/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:45.625122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:45.730697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c93f0a-a642-4422-85f2-400878456b2f None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:45.766584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:45.767309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:45.767591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:45.767878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:45.768585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:45.768890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:45.770275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:45.781959 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 608/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:33:45.787649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:45.893939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac37fe2-0f80-4711-871a-e5f49306e5d1 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:45.932583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:45.933697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:45.933984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:45.934397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:45.943258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:45.945269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:33:45.966668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:45.968707 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:45.970664 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:45.974804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 622/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:45.975844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:46.079975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de0478-c25d-4eef-b11e-ab9fb3a58269 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:46.114892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c96da-8e06-4a33-a269-fa4b07a925b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:46.115562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c96da-8e06-4a33-a269-fa4b07a925b8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:46.115915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c96da-8e06-4a33-a269-fa4b07a925b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:46.116258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c96da-8e06-4a33-a269-fa4b07a925b8 None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:46.117213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c96da-8e06-4a33-a269-fa4b07a925b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:46.118048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c96da-8e06-4a33-a269-fa4b07a925b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:46.119779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c96da-8e06-4a33-a269-fa4b07a925b8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:46.131863 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 609/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:46.139348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:46.251147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59c29-79a4-4623-8cd3-35de345863e8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:46.297404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24212f12-db63-4cef-8a1c-7e09e656910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:46.298798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24212f12-db63-4cef-8a1c-7e09e656910d None admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:46.299313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24212f12-db63-4cef-8a1c-7e09e656910d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:46.299805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24212f12-db63-4cef-8a1c-7e09e656910d None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/e834001baa424d24b5c9551a7cae7741/roles/77f0d0906e434f6dbaccba585bd68b27` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:46.321746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24212f12-db63-4cef-8a1c-7e09e656910d None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=e834001baa424d24b5c9551a7cae7741, role_id=77f0d0906e434f6dbaccba585bd68b27)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:46.323336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24212f12-db63-4cef-8a1c-7e09e656910d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:46.335891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 623/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:33:46 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/e834001baa424d24b5c9551a7cae7741/roles/77f0d0906e434f6dbaccba585bd68b27 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:33:48.825897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e1d6c-93d7-4655-90bc-2b0eb846e9ac None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:48.826464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e1d6c-93d7-4655-90bc-2b0eb846e9ac None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:48.826464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e1d6c-93d7-4655-90bc-2b0eb846e9ac None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:48.827840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 610/1233] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:33:48.834273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029da93-bf32-4753-b9dc-f0046647fdbd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:48.834831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029da93-bf32-4753-b9dc-f0046647fdbd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:48.834961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029da93-bf32-4753-b9dc-f0046647fdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:48.852426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3029da93-bf32-4753-b9dc-f0046647fdbd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:33:48.853696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3029da93-bf32-4753-b9dc-f0046647fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:33:48.941418 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 624/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:33:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:33:48.971828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e1d6c-93d7-4655-90bc-2b0eb846e9ac None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:49.074884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e1d6c-93d7-4655-90bc-2b0eb846e9ac None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:49.110964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:49.111681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:49.111978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:49.112237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:49.122786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:33:49.130430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:49.131655 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:49.132735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 611/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Sat May 7 21:33:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:49.140434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029da93-bf32-4753-b9dc-f0046647fdbd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:49.260049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029da93-bf32-4753-b9dc-f0046647fdbd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:49.295950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:49.296618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:49.296906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:49.297190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:49.298826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] RBAC: Adding query filter params (name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:49.299171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:49.300762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:49.309176 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 625/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Sat May 7 21:33:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:49.315426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:49.423093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47508d-e905-4608-9e32-f8311f94f2b8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:49.462372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:49.463202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:49.463480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:49.463755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:49.476700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:49.478210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:49.497592 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:49.498755 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:49.499928 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:49.499928 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:49.499928 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:49.499928 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:49.503559 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 612/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:49.504914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:49.611417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17824957-ec68-4de2-aca9-cd91812e41ff None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:49.647230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:49.647896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:49.648172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:49.648449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:49.649738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:49.650041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:49.651439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:49.663061 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 626/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:33:49.668935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:49.777587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3339e1e-d56d-48af-9d97-38154e285551 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:49.814948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:49.815943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:49.816336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:49.816652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:49.825550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:49.827218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:33:49.841572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:49.842620 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:49.843635 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 613/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:49.851582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:49.956896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7288b-005f-4223-aa3e-861d5020a1e7 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:49.994201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:49.994906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:49.995228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:49.995517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:49.996407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:49.996728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:49.998256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:50.016972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 627/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Sat May 7 21:33:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:33:50.023157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:50.128382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dc0b0-a748-439d-9e33-4b5c734fb1d1 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:50.166059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:50.166742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:50.167019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:50.167291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:50.240165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:50.241637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:50.343800 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 614/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:33:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:33:50.349515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:50.454132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b98c88-798e-4a9b-a823-2eacb62aa858 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:50.486783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:50.487662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:50.487913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:50.488187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:50.498666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:50.500185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:50.517599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:50.518762 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:50.524921 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:50.524921 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:50.524921 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:50.524921 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:50.524921 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 628/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:50.525342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:50.624068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848a98f-1e86-4136-b2b4-2f856a444348 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:50.660802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:50.661829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:50.662112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:50.662384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:50.663229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:50.663536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:50.665547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:50.676916 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 615/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:33:50.682954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:50.788795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355e698-d5a4-46bd-becb-e30a547f107d None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:50.822894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:50.823679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:50.823960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:50.824274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:50.830938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:50.832418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:33:50.847315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:50.848476 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:50.849636 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:50.850300 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 629/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:50.856360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:50.966930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3466333-75da-425f-bd0f-22a6b9ccb992 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:51.005879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427a6c6-f536-43f0-b791-0c9ada9f96bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:51.006846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427a6c6-f536-43f0-b791-0c9ada9f96bc None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:51.007279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427a6c6-f536-43f0-b791-0c9ada9f96bc None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:51.007609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427a6c6-f536-43f0-b791-0c9ada9f96bc None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:51.009255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427a6c6-f536-43f0-b791-0c9ada9f96bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:51.009700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427a6c6-f536-43f0-b791-0c9ada9f96bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:51.011319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427a6c6-f536-43f0-b791-0c9ada9f96bc None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:51.030715 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 616/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:51.034017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:51.141704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb970adc-b149-442d-8cc5-4968b2e710eb None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:51.176103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d9a16-57cc-407e-9b16-6076970ab6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:51.176786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9a16-57cc-407e-9b16-6076970ab6fb None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:51.177130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9a16-57cc-407e-9b16-6076970ab6fb None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:51.177406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9a16-57cc-407e-9b16-6076970ab6fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:51.178327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d9a16-57cc-407e-9b16-6076970ab6fb None admin] RBAC: Adding query filter params (role.id=77f0d0906e434f6dbaccba585bd68b27, scope.project.id=758d4dea899344b883971712aebe042f, user.id=e834001baa424d24b5c9551a7cae7741) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:51.178639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d9a16-57cc-407e-9b16-6076970ab6fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:51.180397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d9a16-57cc-407e-9b16-6076970ab6fb None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:51.186955 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 630/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:33:51 2022] GET /identity/v3/role_assignments?user.id=e834001baa424d24b5c9551a7cae7741&scope.project.id=758d4dea899344b883971712aebe042f&role.id=77f0d0906e434f6dbaccba585bd68b27 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:53.596722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c0890-f9f6-47a8-80bc-4080ef58e8f6 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:53.597258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c0890-f9f6-47a8-80bc-4080ef58e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:53.597390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c0890-f9f6-47a8-80bc-4080ef58e8f6 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:53.598860 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 617/1247] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:33:53.605037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3856d-f050-4538-961d-28c1ffd1b8f4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:53.605450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3856d-f050-4538-961d-28c1ffd1b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:53.605601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3856d-f050-4538-961d-28c1ffd1b8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:53.623969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-19d3856d-f050-4538-961d-28c1ffd1b8f4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:33:53.625171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-19d3856d-f050-4538-961d-28c1ffd1b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:33:53.696978 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 631/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:33:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:33:53.722300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c0890-f9f6-47a8-80bc-4080ef58e8f6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:53.827065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c0890-f9f6-47a8-80bc-4080ef58e8f6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:53.862311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:53.863043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:53.863316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:53.863592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:53.874577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:33:53.882163 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:53.884514 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:53.885996 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 618/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:53.889916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3856d-f050-4538-961d-28c1ffd1b8f4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:54.003451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3856d-f050-4538-961d-28c1ffd1b8f4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:54.036728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:54.037395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:54.037841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:54.038190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:54.039057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:54.039456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:54.041009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:54.050174 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 632/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:54.056868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:54.162146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf15b4d-14c2-471f-8336-57fa6d07e8c0 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:54.199095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:54.200133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:54.200133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:54.200457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:54.212383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:54.214023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:54.234343 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:54.235506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:54.236486 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:54.236486 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:54.236486 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:54.236486 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:54.236486 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 619/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:54.241254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:54.343024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a1b74-a49c-42b2-a71b-c131be04bc79 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:54.378532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:54.379239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:54.379520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:54.379820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:54.380558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:54.380838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:54.382208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:54.394920 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 633/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:33:54.400483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:54.503067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc05b8-2ef7-44f7-bf88-f96306078de3 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:54.540454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:54.541389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:54.541736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:54.542014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:54.550130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:54.551801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:33:54.568411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:54.569663 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:54.571430 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 620/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:54.576991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:54.688508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7200be-4498-40c8-8871-da7f2497b7c9 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:54.723448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:54.724116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:54.724433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:54.724715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:54.725550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:54.725831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:54.727811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:54.745091 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 634/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Sat May 7 21:33:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:33:54.751224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:54.850496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19ae07-9019-429a-aeb6-7344d5dfc824 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:54.885820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:54.886468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:54.886751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:54.887059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:54.964438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:54.966220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:55.082974 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 621/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:33:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:33:55.084478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:55.192855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c5f21-1173-40c9-ac9c-1e4ab6ccc2a5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:55.229956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:55.230875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:55.231199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:55.231475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:55.242036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:55.243744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:55.262598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:55.263803 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:55.264926 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:55.264926 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:55.264926 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:55.264926 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:55.264926 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 635/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:55.270243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:55.375478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c356c3-ac54-4d98-a7f4-05103df2689e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:55.411735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:55.412406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:55.412687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:55.412960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:55.413687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:55.413990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:55.415495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:55.427419 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 622/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:55.433084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:55.535277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05ce8-d236-4333-aae5-0dcb2c09f665 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:55.570113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:55.571451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:55.571731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:55.572001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:55.578978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:55.580452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:33:55.595344 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:55.596516 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:33:55.597455 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 636/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 21:33:55.602725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:55.707075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acec740-7cde-4fb6-a90d-2f5f60dec85a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:55.739738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8758e29-7468-480f-bc71-debe0a9a0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:55.740398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758e29-7468-480f-bc71-debe0a9a0dfe None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:55.740681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758e29-7468-480f-bc71-debe0a9a0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:55.740956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8758e29-7468-480f-bc71-debe0a9a0dfe None admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:55.741729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758e29-7468-480f-bc71-debe0a9a0dfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:55.742043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758e29-7468-480f-bc71-debe0a9a0dfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:55.743515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8758e29-7468-480f-bc71-debe0a9a0dfe None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:55.755340 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 623/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:55.761970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:55.860371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdcf1f-faa5-4c2f-8cca-3a3ccc147c25 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:55.897212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f64b7-b15c-492c-9bef-46fe0e555d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:55.898024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f64b7-b15c-492c-9bef-46fe0e555d58 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:55.898308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f64b7-b15c-492c-9bef-46fe0e555d58 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:55.898611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f64b7-b15c-492c-9bef-46fe0e555d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:55.899502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f64b7-b15c-492c-9bef-46fe0e555d58 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=758d4dea899344b883971712aebe042f, user.id=e834001baa424d24b5c9551a7cae7741) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:55.899802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f64b7-b15c-492c-9bef-46fe0e555d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:55.901224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f64b7-b15c-492c-9bef-46fe0e555d58 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:55.906612 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 637/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:33:55 2022] GET /identity/v3/role_assignments?user.id=e834001baa424d24b5c9551a7cae7741&scope.project.id=758d4dea899344b883971712aebe042f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:58.173435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f92e1-eafd-4f35-9029-632eb4893343 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:58.173985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f92e1-eafd-4f35-9029-632eb4893343 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:58.173985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f92e1-eafd-4f35-9029-632eb4893343 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:58.175350 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 624/1261] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:33:58.180344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3bc84-837f-4ea3-a856-c8cf233d3948 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:58.180789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3bc84-837f-4ea3-a856-c8cf233d3948 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:58.180886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3bc84-837f-4ea3-a856-c8cf233d3948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:58.197149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c3b3bc84-837f-4ea3-a856-c8cf233d3948 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:33:58.198336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c3b3bc84-837f-4ea3-a856-c8cf233d3948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:33:58.261596 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 638/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:33:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:33:58.285257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f92e1-eafd-4f35-9029-632eb4893343 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:58.380265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f92e1-eafd-4f35-9029-632eb4893343 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:58.412378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:58.413145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:58.413428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:58.413700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:58.423194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:33:58.430850 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:58.431955 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:58.432988 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 625/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:33:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:58.437600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3bc84-837f-4ea3-a856-c8cf233d3948 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:58.529508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3bc84-837f-4ea3-a856-c8cf233d3948 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:58.560496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:58.561151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:58.561437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:58.561714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:58.562446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:58.562751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:58.564149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:58.572293 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 639/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:33:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:58.577932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:58.674675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b079e9-da56-4f70-bdd2-1ff337be3e25 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:58.705440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:58.706139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:58.706419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:58.706684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:58.717330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:58.718755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:58.734641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:58.735786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:58.736929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:58.736929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:58.736929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:58.736929 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:58.736929 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 626/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:58.741508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:58.835137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865bea0-1fe7-4970-96f0-00fc38f50ec5 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:58.865605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:58.866240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:58.866517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:58.866814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:58.868051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:58.868351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:58.869699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:58.880526 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 640/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:58.886544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:58.999930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bef88e-6b72-451c-aa83-aa82317fd57b None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:59.031946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:59.032723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:59.033001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:59.033270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:59.040252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:59.041670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:33:59.055796 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:59.057041 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:59.058727 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 627/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:59.063310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:59.156264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e428e17-8654-43ae-83f5-a7a8895667aa None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:59.189064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:59.189719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:59.190000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:59.190275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:59.191126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:59.191432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:59.192865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:59.209559 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 641/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Sat May 7 21:33:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:59.215174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:59.318092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fad81-752b-4f24-8160-0e01b19d892a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:59.350131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:59.350929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:59.351209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:59.351479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:59.361640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:59.363096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:33:59.379586 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:59.380506 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:59.381446 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:33:59.381446 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:33:59.381446 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:33:59.381446 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:59.381446 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 628/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:59.386438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:59.494308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba76a11-97f4-49cb-b9c5-e2cd47408b37 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:59.531154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:59.531936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:59.532212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:59.532478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:59.533263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:59.533686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:59.535667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:59.550517 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 642/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:59.556222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:59.664148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f222792-4e72-447b-9362-6e8c98164192 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:59.707056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:59.708252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:59.708967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:59.709407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:59.719668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:59.721857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:33:59.742232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:33:59.743312 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:33:59.744461 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 629/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:33:59.749806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:33:59.842511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088b5d-c2c7-429a-b584-75b9c1797e30 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:33:59.873976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76db16d-cc8c-442c-bb42-a06358c0f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:33:59.874631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db16d-cc8c-442c-bb42-a06358c0f034 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:33:59.874949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db16d-cc8c-442c-bb42-a06358c0f034 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:33:59.875228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76db16d-cc8c-442c-bb42-a06358c0f034 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:33:59.876007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76db16d-cc8c-442c-bb42-a06358c0f034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:33:59.876317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76db16d-cc8c-442c-bb42-a06358c0f034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:33:59.877759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76db16d-cc8c-442c-bb42-a06358c0f034 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:33:59.889847 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 643/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:33:59.895888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:00.000863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c0363-70a7-46f9-ad5f-0713e893a76e None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:00.043815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2ef56-30f9-41e0-b6a3-4c0f1662efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:00.045077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ef56-30f9-41e0-b6a3-4c0f1662efaf None admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:00.045459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ef56-30f9-41e0-b6a3-4c0f1662efaf None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:00.045831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ef56-30f9-41e0-b6a3-4c0f1662efaf None admin] PATH_INFO: `/v3/projects/758d4dea899344b883971712aebe042f/users/e834001baa424d24b5c9551a7cae7741/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:00.048463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ef56-30f9-41e0-b6a3-4c0f1662efaf None admin] RBAC: Authorizing `identity:create_grant(project_id=758d4dea899344b883971712aebe042f, user_id=e834001baa424d24b5c9551a7cae7741, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:00.050512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ef56-30f9-41e0-b6a3-4c0f1662efaf None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:00.063912 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 630/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Sat May 7 21:33:59 2022] PUT /identity/v3/projects/758d4dea899344b883971712aebe042f/users/e834001baa424d24b5c9551a7cae7741/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:34:02.339661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02d87-fe7c-4d8d-a3c9-2d7eebc9e0f0 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:02.340189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02d87-fe7c-4d8d-a3c9-2d7eebc9e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:02.340189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02d87-fe7c-4d8d-a3c9-2d7eebc9e0f0 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:02.341557 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 644/1274] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:34:02.347663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa510c-5ff3-4bc5-afa8-418b433cf866 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:02.348079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa510c-5ff3-4bc5-afa8-418b433cf866 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:02.348213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa510c-5ff3-4bc5-afa8-418b433cf866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:02.368523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7ffa510c-5ff3-4bc5-afa8-418b433cf866 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:34:02.369687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7ffa510c-5ff3-4bc5-afa8-418b433cf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:34:02.446316 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 631/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:34:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:34:02.470596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b02d87-fe7c-4d8d-a3c9-2d7eebc9e0f0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:02.566228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b02d87-fe7c-4d8d-a3c9-2d7eebc9e0f0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:02.598177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:02.598976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:02.599259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:02.599534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:02.609568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(role_id) May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 07 21:34:02.617108 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:02.618341 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:02.619473 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 645/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Sat May 7 21:34:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:02.624341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa510c-5ff3-4bc5-afa8-418b433cf866 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:02.716582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa510c-5ff3-4bc5-afa8-418b433cf866 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:02.748041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:02.748693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:02.748971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:02.749239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:02.749959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:02.750259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:02.751640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:02.759188 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 632/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Sat May 7 21:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:02.764876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:02.857854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ebfe3-3d42-46f1-aa5f-8cbe0a54afa3 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:02.888756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:02.889521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:02.889804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:02.890077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:02.900445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:02.901882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:34:02.921508 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:02.922498 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:02.923533 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:34:02.923533 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:34:02.923533 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:34:02.923533 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:02.923533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 646/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:02.930383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:03.043107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80583a-36c2-478f-ac53-39facc825cd8 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:03.074669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:03.075359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:03.075643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:03.075917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:03.076624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:03.076928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:03.078340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:03.090273 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 633/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:34:03.096135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:03.199924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e1b5-8314-4763-80d2-aa4bc4f2726c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:03.232256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:03.233043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:03.233322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:03.233595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:03.240702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:03.242174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:34:03.255750 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:03.256934 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:03.258492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 647/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:34:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:03.263493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:03.375492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeee03d-a87e-4548-971d-5fad836bc481 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:03.409617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:03.410275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:03.410560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:03.410861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:03.411686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:03.411985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:03.413397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:03.435035 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 634/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Sat May 7 21:34:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:03.440785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:03.536065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5d83c-a155-48a5-9eea-2ddbb962bc28 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:03.568881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:03.569573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:03.569852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:03.570122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:03.641486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:03.642981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:03.773477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 648/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Sat May 7 21:34:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 07 21:34:03.779199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:03.871076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2bd7-f6d7-4d29-851f-168e5c6fa9ff None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:03.901939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:03.902643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:03.902955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:03.903228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:03.912939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:03.915196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:34:03.932411 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:03.933503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:03.934844 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 07 21:34:03.934844 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:34:03.934844 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 07 21:34:03.934844 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:34:03.934844 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 635/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:03.939176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:04.043684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450582f-7750-487f-b668-11de1d0166e6 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:04.075153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:04.075800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:04.076079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:04.076350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:04.077062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:04.077364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:04.078730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:04.090104 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 649/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Sat May 7 21:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:04.095724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:04.189411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8a0f-44fd-4b62-93dc-001a4212c00a None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:04.224988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:04.226271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:04.226853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:04.227339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:04.238949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:04.240396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(project_id) May 07 21:34:04.253980 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:04.255096 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:34:04.256253 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 636/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Sat May 7 21:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:04.261561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:04.377915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128008cf-1aa3-41ad-b4fe-3dcec6ae1057 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:04.409012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820be85-6e31-4730-9354-ee544483e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:04.409655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820be85-6e31-4730-9354-ee544483e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:04.409933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820be85-6e31-4730-9354-ee544483e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:04.410201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820be85-6e31-4730-9354-ee544483e3a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:04.410997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820be85-6e31-4730-9354-ee544483e3a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:04.411299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820be85-6e31-4730-9354-ee544483e3a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:04.412736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820be85-6e31-4730-9354-ee544483e3a7 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:04.425004 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 650/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Sat May 7 21:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:04.431615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:04.525521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12c379-a193-485f-8147-21c7fb995f37 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:04.559183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02962671-c953-4146-b67e-0bc1c6588674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:04.559829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962671-c953-4146-b67e-0bc1c6588674 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:04.560164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962671-c953-4146-b67e-0bc1c6588674 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:04.560445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962671-c953-4146-b67e-0bc1c6588674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:04.561303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962671-c953-4146-b67e-0bc1c6588674 None admin] RBAC: Adding query filter params (role.id=c9eb15c85a974dd28e3374b8d701947e, scope.project.id=758d4dea899344b883971712aebe042f, user.id=e834001baa424d24b5c9551a7cae7741) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:04.561629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962671-c953-4146-b67e-0bc1c6588674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:04.563290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02962671-c953-4146-b67e-0bc1c6588674 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:04.568996 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 637/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Sat May 7 21:34:04 2022] GET /identity/v3/role_assignments?user.id=e834001baa424d24b5c9551a7cae7741&scope.project.id=758d4dea899344b883971712aebe042f&role.id=c9eb15c85a974dd28e3374b8d701947e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:06.855440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c742-3256-4fdf-8987-169b4f192c84 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:06.856016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c742-3256-4fdf-8987-169b4f192c84 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:06.856016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6c742-3256-4fdf-8987-169b4f192c84 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:06.857339 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 651/1288] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:34:06.862706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b2ea-5e1b-4b47-8292-14b5e924173d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:06.863111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b2ea-5e1b-4b47-8292-14b5e924173d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:06.863281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110b2ea-5e1b-4b47-8292-14b5e924173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:06.879772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f110b2ea-5e1b-4b47-8292-14b5e924173d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:34:06.880931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f110b2ea-5e1b-4b47-8292-14b5e924173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:34:06.952962 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 638/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:34:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:34:06.979648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6c742-3256-4fdf-8987-169b4f192c84 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:07.076795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6c742-3256-4fdf-8987-169b4f192c84 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:07.111450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:07.112166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:07.112450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:07.112724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] PATH_INFO: `/v3/services/placement` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:07.113366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:07.114746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:07.126315 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:07.127609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:07.128483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 652/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:34:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:07.133684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b2ea-5e1b-4b47-8292-14b5e924173d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:07.225203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110b2ea-5e1b-4b47-8292-14b5e924173d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:07.256646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a64ce-0306-454e-8dce-31ef56921615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:07.257299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a64ce-0306-454e-8dce-31ef56921615 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:07.257579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a64ce-0306-454e-8dce-31ef56921615 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:07.257877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a64ce-0306-454e-8dce-31ef56921615 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:07.258569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a64ce-0306-454e-8dce-31ef56921615 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:07.258901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a64ce-0306-454e-8dce-31ef56921615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:07.260259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a64ce-0306-454e-8dce-31ef56921615 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:07.264817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 639/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Sat May 7 21:34:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:07.270412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:07.376177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27ce82-4ba2-421f-9406-883ed496645c None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:07.408915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9717e5-6afd-4f53-b722-00bd0d709523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:07.409588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9717e5-6afd-4f53-b722-00bd0d709523 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:07.409871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9717e5-6afd-4f53-b722-00bd0d709523 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:07.410145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9717e5-6afd-4f53-b722-00bd0d709523 None admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:07.410870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9717e5-6afd-4f53-b722-00bd0d709523 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:07.411178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9717e5-6afd-4f53-b722-00bd0d709523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:07.412551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9717e5-6afd-4f53-b722-00bd0d709523 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:07.416835 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 653/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Sat May 7 21:34:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:09.662727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13894b79-1111-4fc9-aa67-9415e0b7eddd None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:09.663302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13894b79-1111-4fc9-aa67-9415e0b7eddd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:09.663302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13894b79-1111-4fc9-aa67-9415e0b7eddd None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:09.664648 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 640/1293] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:34:09.669784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9ab8-031e-40fe-90dd-71633148c374 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:09.670209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9ab8-031e-40fe-90dd-71633148c374 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:09.670351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb9ab8-031e-40fe-90dd-71633148c374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:09.686513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-00cb9ab8-031e-40fe-90dd-71633148c374 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:34:09.687744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00cb9ab8-031e-40fe-90dd-71633148c374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:34:09.750623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 654/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:34:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:34:09.774269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13894b79-1111-4fc9-aa67-9415e0b7eddd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:09.867249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13894b79-1111-4fc9-aa67-9415e0b7eddd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:09.899735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282fd57-97f7-4e6a-bdad-352911d1a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:09.900383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282fd57-97f7-4e6a-bdad-352911d1a3ec None admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:09.900667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282fd57-97f7-4e6a-bdad-352911d1a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:09.900945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282fd57-97f7-4e6a-bdad-352911d1a3ec None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:09.901667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282fd57-97f7-4e6a-bdad-352911d1a3ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:09.903064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282fd57-97f7-4e6a-bdad-352911d1a3ec None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:09.916084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 641/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Sat May 7 21:34:09 2022] POST /identity/v3/services => generated 246 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:34:12.225153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d26f93-07f7-45b2-b753-9539e4100289 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:12.225582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d26f93-07f7-45b2-b753-9539e4100289 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:12.225704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d26f93-07f7-45b2-b753-9539e4100289 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:12.227638 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 655/1296] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:34:12.232913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4cd7-d90a-4984-b297-cd2f632abfce None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:12.233329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4cd7-d90a-4984-b297-cd2f632abfce None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:12.233469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4cd7-d90a-4984-b297-cd2f632abfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:12.250074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-93db4cd7-d90a-4984-b297-cd2f632abfce None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:34:12.251274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-93db4cd7-d90a-4984-b297-cd2f632abfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:34:12.318449 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 642/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:34:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:34:12.342444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d26f93-07f7-45b2-b753-9539e4100289 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:12.436674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d26f93-07f7-45b2-b753-9539e4100289 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:12.468156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:12.468860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:12.469140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:12.469414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:12.470052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:12.471448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:12.483400 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:12.484606 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:12.485823 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 656/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:34:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:12.490436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4cd7-d90a-4984-b297-cd2f632abfce None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:12.584797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4cd7-d90a-4984-b297-cd2f632abfce None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:12.616688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:12.617404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:12.617685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:12.617956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:12.618650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:12.618975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:12.620348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:12.625173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 643/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Sat May 7 21:34:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:12.631062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:12.726010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa17a1-55ee-4ff3-879d-74c7fee13582 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:12.756336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3f45-98aa-4813-8ae5-c1a52eda142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:12.756976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3f45-98aa-4813-8ae5-c1a52eda142c None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:12.757258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3f45-98aa-4813-8ae5-c1a52eda142c None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:12.758046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3f45-98aa-4813-8ae5-c1a52eda142c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:12.758909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c3f45-98aa-4813-8ae5-c1a52eda142c None admin] RBAC: Adding query filter params (interface=public, service_id=54581b47d5ad4e52a0d1215f080dbf43, region_id=RegionOne) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:12.759221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c3f45-98aa-4813-8ae5-c1a52eda142c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:12.760581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c3f45-98aa-4813-8ae5-c1a52eda142c None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:12.765293 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 657/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Sat May 7 21:34:12 2022] GET /identity/v3/endpoints?service_id=54581b47d5ad4e52a0d1215f080dbf43&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:12.771006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:12.865854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc848e-53a5-42a5-b9e7-5170e5ec6ca4 None admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:12.896664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dfeee-4bb7-498d-8e60-cb33ce610f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:12.897307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dfeee-4bb7-498d-8e60-cb33ce610f4f None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:12.897588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dfeee-4bb7-498d-8e60-cb33ce610f4f None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:12.897861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dfeee-4bb7-498d-8e60-cb33ce610f4f None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:12.899113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dfeee-4bb7-498d-8e60-cb33ce610f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:12.900482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dfeee-4bb7-498d-8e60-cb33ce610f4f None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:12.906961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 644/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Sat May 7 21:34:12 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:34:15.179787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df5ea-78da-437c-900d-2a68b9a6b69c None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:15.180356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df5ea-78da-437c-900d-2a68b9a6b69c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:15.180356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df5ea-78da-437c-900d-2a68b9a6b69c None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:15.181697 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 658/1302] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:34:15.186962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af7332-a19f-41e2-8b88-0e055eb41aad None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:15.187353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af7332-a19f-41e2-8b88-0e055eb41aad None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:15.187523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af7332-a19f-41e2-8b88-0e055eb41aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:15.204321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-00af7332-a19f-41e2-8b88-0e055eb41aad None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:34:15.205495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00af7332-a19f-41e2-8b88-0e055eb41aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:34:15.267884 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 645/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:34:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 07 21:34:15.291718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df5ea-78da-437c-900d-2a68b9a6b69c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:15.388444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df5ea-78da-437c-900d-2a68b9a6b69c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:15.419176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:15.419949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:15.420242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:15.420507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:15.421150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:15.422529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:34:15.434490 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:34:15.435879 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:34:15.437119 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 659/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Sat May 7 21:34:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 21:34:15.441626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af7332-a19f-41e2-8b88-0e055eb41aad None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:15.533683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af7332-a19f-41e2-8b88-0e055eb41aad None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:15.564657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67850bc1-358a-4b40-87e5-2174bb1cf375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:15.565324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67850bc1-358a-4b40-87e5-2174bb1cf375 None admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:15.565599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67850bc1-358a-4b40-87e5-2174bb1cf375 None admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:15.565867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67850bc1-358a-4b40-87e5-2174bb1cf375 None admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:15.566548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67850bc1-358a-4b40-87e5-2174bb1cf375 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:34:15.566873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67850bc1-358a-4b40-87e5-2174bb1cf375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:15.568224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67850bc1-358a-4b40-87e5-2174bb1cf375 None admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:15.573661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 646/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Sat May 7 21:34:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:34:15.579291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:34:15.679165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2b03e-48e0-4cbb-97a4-051c43a6bed8 None admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:34:15.710969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03943ff6-23c4-4f59-9105-86fdad5026d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:34:15.711658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03943ff6-23c4-4f59-9105-86fdad5026d3 None admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:34:15.711939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03943ff6-23c4-4f59-9105-86fdad5026d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:34:15.712212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03943ff6-23c4-4f59-9105-86fdad5026d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:34:15.712944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03943ff6-23c4-4f59-9105-86fdad5026d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:34:15.714311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03943ff6-23c4-4f59-9105-86fdad5026d3 None admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:34:15.732669 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 660/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Sat May 7 21:34:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:35:26.761357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59fb98-a251-4113-b930-70ab8d3273e7 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:26.762413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59fb98-a251-4113-b930-70ab8d3273e7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:26.762954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59fb98-a251-4113-b930-70ab8d3273e7 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:26.770182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8649854-f071-4e70-b627-85cc6d026d94 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:26.771256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8649854-f071-4e70-b627-85cc6d026d94 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:26.771745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8649854-f071-4e70-b627-85cc6d026d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:26.775076 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 647/1307] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:26.857847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c8649854-f071-4e70-b627-85cc6d026d94 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:26.859556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c8649854-f071-4e70-b627-85cc6d026d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:27.011162 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 661/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:27.050419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb0356-887a-4d82-922e-cafc08bbd2a9 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:27.050710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb0356-887a-4d82-922e-cafc08bbd2a9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:27.051019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb0356-887a-4d82-922e-cafc08bbd2a9 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:27.052402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 648/1309] 10.222.0.32 () {54 vars in 964 bytes} [Sat May 7 21:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:27.058711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b9768-94c8-4180-ab61-607c5864d063 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:27.058996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b9768-94c8-4180-ab61-607c5864d063 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:27.059280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b9768-94c8-4180-ab61-607c5864d063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:27.141568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e17b9768-94c8-4180-ab61-607c5864d063 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:27.142842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e17b9768-94c8-4180-ab61-607c5864d063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:27.248324 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 662/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Sat May 7 21:35:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:35:27.249041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb0356-887a-4d82-922e-cafc08bbd2a9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:27.250804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-77fb0356-887a-4d82-922e-cafc08bbd2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:27.400350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb0356-887a-4d82-922e-cafc08bbd2a9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:27.483447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37182c9-7ca5-4742-aca3-76b3ad9aa2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:27.484160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37182c9-7ca5-4742-aca3-76b3ad9aa2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:27.484553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37182c9-7ca5-4742-aca3-76b3ad9aa2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:27.484841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37182c9-7ca5-4742-aca3-76b3ad9aa2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:27.486477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a37182c9-7ca5-4742-aca3-76b3ad9aa2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:27.612310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37182c9-7ca5-4742-aca3-76b3ad9aa2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:27.613684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37182c9-7ca5-4742-aca3-76b3ad9aa2b4 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:27.634458 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 649/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:35:30.266653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135691a4-c5cb-42d1-adfc-45ab832a8f81 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:30.267206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135691a4-c5cb-42d1-adfc-45ab832a8f81 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:30.267289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135691a4-c5cb-42d1-adfc-45ab832a8f81 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:30.268616 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 663/1312] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:30.273798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1186-5ab7-4f52-8e3f-bcdf344a0725 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:30.274200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1186-5ab7-4f52-8e3f-bcdf344a0725 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:30.274418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1186-5ab7-4f52-8e3f-bcdf344a0725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:30.352970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b56b1186-5ab7-4f52-8e3f-bcdf344a0725 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:30.354189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b56b1186-5ab7-4f52-8e3f-bcdf344a0725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:30.446880 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 650/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:30.485057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135691a4-c5cb-42d1-adfc-45ab832a8f81 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:30.486746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-135691a4-c5cb-42d1-adfc-45ab832a8f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:30.590017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135691a4-c5cb-42d1-adfc-45ab832a8f81 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:30.665927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006ddd0-28d8-41f9-ae07-450624bc8718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:30.666577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ddd0-28d8-41f9-ae07-450624bc8718 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:30.666887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ddd0-28d8-41f9-ae07-450624bc8718 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:30.667163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006ddd0-28d8-41f9-ae07-450624bc8718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:30.668822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0006ddd0-28d8-41f9-ae07-450624bc8718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:30.773820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ddd0-28d8-41f9-ae07-450624bc8718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:30.775223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006ddd0-28d8-41f9-ae07-450624bc8718 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:30.793190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 664/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:33.415270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cacaa-1f5b-4b2f-8551-710763efe805 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:33.415805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cacaa-1f5b-4b2f-8551-710763efe805 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:33.415805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cacaa-1f5b-4b2f-8551-710763efe805 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:33.417213 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 651/1315] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:33.422453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fbaca-d4b6-4d0f-b24e-09febd1411fd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:33.422898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fbaca-d4b6-4d0f-b24e-09febd1411fd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:33.423115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fbaca-d4b6-4d0f-b24e-09febd1411fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:33.485644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-147fbaca-d4b6-4d0f-b24e-09febd1411fd None None] MFA Rules not processed for user `d4ae286683f4427bbb0fd3bca4d1021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:33.486888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-147fbaca-d4b6-4d0f-b24e-09febd1411fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:33.579031 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 665/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:33.635899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e0a4-5ff9-47c5-8bfe-a47f2c9fd599 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:33.636186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e0a4-5ff9-47c5-8bfe-a47f2c9fd599 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:33.636461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e0a4-5ff9-47c5-8bfe-a47f2c9fd599 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:33.637815 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 652/1317] 10.222.0.32 () {54 vars in 964 bytes} [Sat May 7 21:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:33.643637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd39d5-1dfe-43d6-a37b-73b02a45b85b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:33.643993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd39d5-1dfe-43d6-a37b-73b02a45b85b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:33.644271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd39d5-1dfe-43d6-a37b-73b02a45b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:33.717687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6fcd39d5-1dfe-43d6-a37b-73b02a45b85b None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:33.718831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6fcd39d5-1dfe-43d6-a37b-73b02a45b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:33.790001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 666/1318] 10.222.0.32 () {58 vars in 1061 bytes} [Sat May 7 21:35:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:35:33.799030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2e0a4-5ff9-47c5-8bfe-a47f2c9fd599 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:33.800597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-40c2e0a4-5ff9-47c5-8bfe-a47f2c9fd599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:33.898782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2e0a4-5ff9-47c5-8bfe-a47f2c9fd599 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:33.970249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3f5b7-a305-4653-91bc-1c9520993157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:33.970844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3f5b7-a305-4653-91bc-1c9520993157 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:33.971164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3f5b7-a305-4653-91bc-1c9520993157 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:33.971437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3f5b7-a305-4653-91bc-1c9520993157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:33.973056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7c3f5b7-a305-4653-91bc-1c9520993157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:34.074811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3f5b7-a305-4653-91bc-1c9520993157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:34.076241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3f5b7-a305-4653-91bc-1c9520993157 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:34.094356 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 653/1319] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:37.327983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d474e-d598-4233-96df-5e977083d6d8 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:37.328510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d474e-d598-4233-96df-5e977083d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:37.328510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d474e-d598-4233-96df-5e977083d6d8 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:37.329901 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 667/1320] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:37.335789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920cb4-876c-490b-b738-4abf1a8a2f38 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:37.336229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920cb4-876c-490b-b738-4abf1a8a2f38 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:37.336330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b920cb4-876c-490b-b738-4abf1a8a2f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:37.398224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5b920cb4-876c-490b-b738-4abf1a8a2f38 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:37.399520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b920cb4-876c-490b-b738-4abf1a8a2f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:37.495728 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 654/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:37.535446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d474e-d598-4233-96df-5e977083d6d8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:37.536960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-670d474e-d598-4233-96df-5e977083d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:37.637618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d474e-d598-4233-96df-5e977083d6d8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:37.705549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6050e5-e040-4cec-87f0-8e4fe8880a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:37.706184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6050e5-e040-4cec-87f0-8e4fe8880a2d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:37.706460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6050e5-e040-4cec-87f0-8e4fe8880a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:37.706727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6050e5-e040-4cec-87f0-8e4fe8880a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:37.708601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9d6050e5-e040-4cec-87f0-8e4fe8880a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:37.810560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6050e5-e040-4cec-87f0-8e4fe8880a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:37.811947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6050e5-e040-4cec-87f0-8e4fe8880a2d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:37.828760 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 668/1322] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:40.822013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe6cab-209e-41e9-9808-2314b57951d5 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:40.822547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe6cab-209e-41e9-9808-2314b57951d5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:40.822547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe6cab-209e-41e9-9808-2314b57951d5 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:40.823965 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 655/1323] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:40.829168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0491b-aa6a-4e14-811c-1856853566cb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:40.829568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0491b-aa6a-4e14-811c-1856853566cb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:40.829730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0491b-aa6a-4e14-811c-1856853566cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:40.892166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e6c0491b-aa6a-4e14-811c-1856853566cb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:40.893371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e6c0491b-aa6a-4e14-811c-1856853566cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:40.986464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 669/1324] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:41.023574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe6cab-209e-41e9-9808-2314b57951d5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:41.025177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-47fe6cab-209e-41e9-9808-2314b57951d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:41.124568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe6cab-209e-41e9-9808-2314b57951d5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:41.196945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc11178-88eb-4271-9a76-def8b6d5c517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:41.197597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc11178-88eb-4271-9a76-def8b6d5c517 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:41.197902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc11178-88eb-4271-9a76-def8b6d5c517 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:41.198129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc11178-88eb-4271-9a76-def8b6d5c517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:41.199794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8cc11178-88eb-4271-9a76-def8b6d5c517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:41.303073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc11178-88eb-4271-9a76-def8b6d5c517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:41.304977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc11178-88eb-4271-9a76-def8b6d5c517 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:41.322759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 656/1325] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:43.680441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fae772-6d2e-4b9e-a5e0-694a7f229d82 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:43.681026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fae772-6d2e-4b9e-a5e0-694a7f229d82 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:43.681026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fae772-6d2e-4b9e-a5e0-694a7f229d82 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:43.682665 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 670/1326] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:43.688615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217233-813d-4806-bb2f-ee66affea418 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:43.689112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217233-813d-4806-bb2f-ee66affea418 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:43.689211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217233-813d-4806-bb2f-ee66affea418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:43.751570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6d217233-813d-4806-bb2f-ee66affea418 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:43.752806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d217233-813d-4806-bb2f-ee66affea418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:43.848381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 657/1327] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:43.884983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fae772-6d2e-4b9e-a5e0-694a7f229d82 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:43.886503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-32fae772-6d2e-4b9e-a5e0-694a7f229d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:43.985990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fae772-6d2e-4b9e-a5e0-694a7f229d82 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:44.056114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9449299f-55bf-4156-b630-e4a4eff1a2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:44.056752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449299f-55bf-4156-b630-e4a4eff1a2cb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:44.057028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449299f-55bf-4156-b630-e4a4eff1a2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:44.057295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9449299f-55bf-4156-b630-e4a4eff1a2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:44.058928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9449299f-55bf-4156-b630-e4a4eff1a2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:44.166880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449299f-55bf-4156-b630-e4a4eff1a2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:44.168333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9449299f-55bf-4156-b630-e4a4eff1a2cb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:44.185465 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 671/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:46.538257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64e9b-2a7c-4e6d-a68b-4401aaf2914b None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:46.538882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64e9b-2a7c-4e6d-a68b-4401aaf2914b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:46.538882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c64e9b-2a7c-4e6d-a68b-4401aaf2914b None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:46.540204 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 658/1329] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:46.545390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7df7cd-7fe5-4aa5-97ff-0676029c8e66 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:46.545842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7df7cd-7fe5-4aa5-97ff-0676029c8e66 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:46.546076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7df7cd-7fe5-4aa5-97ff-0676029c8e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:46.608810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ff7df7cd-7fe5-4aa5-97ff-0676029c8e66 None None] MFA Rules not processed for user `d4ae286683f4427bbb0fd3bca4d1021a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:46.610019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ff7df7cd-7fe5-4aa5-97ff-0676029c8e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:46.706868 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 672/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:46.743107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c64e9b-2a7c-4e6d-a68b-4401aaf2914b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:46.744714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-17c64e9b-2a7c-4e6d-a68b-4401aaf2914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:46.853135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c64e9b-2a7c-4e6d-a68b-4401aaf2914b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:46.924231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f95e73-1bb4-496f-bc21-93bf3a2eed35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:46.924882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95e73-1bb4-496f-bc21-93bf3a2eed35 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:46.925163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95e73-1bb4-496f-bc21-93bf3a2eed35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:46.925441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f95e73-1bb4-496f-bc21-93bf3a2eed35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:46.927087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b5f95e73-1bb4-496f-bc21-93bf3a2eed35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:47.030438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f95e73-1bb4-496f-bc21-93bf3a2eed35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:47.031932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f95e73-1bb4-496f-bc21-93bf3a2eed35 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:47.051295 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 659/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:49.578120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ad75-0d00-402f-b1a7-26eb8a2df9f7 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:49.578623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ad75-0d00-402f-b1a7-26eb8a2df9f7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:49.578731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601ad75-0d00-402f-b1a7-26eb8a2df9f7 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:49.580047 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 673/1332] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:49.586187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e76e6-8bd9-461a-b2ac-d1646d44fd3b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:49.586584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e76e6-8bd9-461a-b2ac-d1646d44fd3b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:49.586869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e76e6-8bd9-461a-b2ac-d1646d44fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:49.655519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3e7e76e6-8bd9-461a-b2ac-d1646d44fd3b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:49.655519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3e7e76e6-8bd9-461a-b2ac-d1646d44fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:49.758205 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 660/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:49.794329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ad75-0d00-402f-b1a7-26eb8a2df9f7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:49.795923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1601ad75-0d00-402f-b1a7-26eb8a2df9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:49.896804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601ad75-0d00-402f-b1a7-26eb8a2df9f7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:49.967433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fae1c-a6d4-4d1c-a382-54e704f18ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:49.968076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fae1c-a6d4-4d1c-a382-54e704f18ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:49.968359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fae1c-a6d4-4d1c-a382-54e704f18ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:49.968633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fae1c-a6d4-4d1c-a382-54e704f18ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:49.970258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba3fae1c-a6d4-4d1c-a382-54e704f18ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:50.075827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fae1c-a6d4-4d1c-a382-54e704f18ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:50.077275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3fae1c-a6d4-4d1c-a382-54e704f18ff7 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:50.095719 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 674/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:52.482286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0bb9-a0b5-4340-b45c-35bcf41a1ec3 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:52.482898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0bb9-a0b5-4340-b45c-35bcf41a1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:52.482898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0bb9-a0b5-4340-b45c-35bcf41a1ec3 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:52.484232 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 661/1335] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:52.490014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b780cf-df2d-4d7b-9af0-ec444c95b769 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:52.490508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b780cf-df2d-4d7b-9af0-ec444c95b769 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:52.490626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b780cf-df2d-4d7b-9af0-ec444c95b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:52.562320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-53b780cf-df2d-4d7b-9af0-ec444c95b769 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:52.563538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53b780cf-df2d-4d7b-9af0-ec444c95b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:52.653923 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 675/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:52.694698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0bb9-a0b5-4340-b45c-35bcf41a1ec3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:52.696257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-681e0bb9-a0b5-4340-b45c-35bcf41a1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:52.799077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0bb9-a0b5-4340-b45c-35bcf41a1ec3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:52.882201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74cf18-803f-4a10-b7f0-0980babb0d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:52.882873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74cf18-803f-4a10-b7f0-0980babb0d4d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:52.883157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74cf18-803f-4a10-b7f0-0980babb0d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:52.883431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74cf18-803f-4a10-b7f0-0980babb0d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:52.885064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4f74cf18-803f-4a10-b7f0-0980babb0d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:52.987577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74cf18-803f-4a10-b7f0-0980babb0d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:52.989062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74cf18-803f-4a10-b7f0-0980babb0d4d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:53.006420 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 662/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:35:55.662188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953969-d3bc-4df4-81fc-becef17a36ef None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:55.663306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953969-d3bc-4df4-81fc-becef17a36ef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:55.663306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953969-d3bc-4df4-81fc-becef17a36ef None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:55.664671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 676/1338] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:35:55.669833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535015-202c-4ff1-9533-6d43aad073e3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:55.670280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535015-202c-4ff1-9533-6d43aad073e3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:55.670387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535015-202c-4ff1-9533-6d43aad073e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:55.733592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-79535015-202c-4ff1-9533-6d43aad073e3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:35:55.734926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-79535015-202c-4ff1-9533-6d43aad073e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:55.826429 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 663/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:35:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:35:55.863177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82953969-d3bc-4df4-81fc-becef17a36ef None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:35:55.864694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-82953969-d3bc-4df4-81fc-becef17a36ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:55.967338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82953969-d3bc-4df4-81fc-becef17a36ef None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:35:56.037669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55478867-253d-4713-83f8-b37451c995bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:35:56.038889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55478867-253d-4713-83f8-b37451c995bb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:35:56.039181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55478867-253d-4713-83f8-b37451c995bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:35:56.039457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55478867-253d-4713-83f8-b37451c995bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:35:56.041080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-55478867-253d-4713-83f8-b37451c995bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:35:56.144327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55478867-253d-4713-83f8-b37451c995bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:35:56.145766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55478867-253d-4713-83f8-b37451c995bb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:35:56.163584 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 677/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:35:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:00.492597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb891a-69fc-4de9-b13f-ebd68f035988 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:00.493132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb891a-69fc-4de9-b13f-ebd68f035988 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:00.493132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb891a-69fc-4de9-b13f-ebd68f035988 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:00.494517 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 664/1341] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:00.499680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1deb83-2976-45da-bfa2-fe8707511b5f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:00.500101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1deb83-2976-45da-bfa2-fe8707511b5f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:00.500241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1deb83-2976-45da-bfa2-fe8707511b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:00.568892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8c1deb83-2976-45da-bfa2-fe8707511b5f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:00.570639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8c1deb83-2976-45da-bfa2-fe8707511b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:00.670544 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 678/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:00.710960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb891a-69fc-4de9-b13f-ebd68f035988 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:00.713105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-50fb891a-69fc-4de9-b13f-ebd68f035988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:00.804987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb891a-69fc-4de9-b13f-ebd68f035988 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:00.808542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec2087-4d01-4d2d-870b-3a6b46523241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:00.809187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec2087-4d01-4d2d-870b-3a6b46523241 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:00.809468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec2087-4d01-4d2d-870b-3a6b46523241 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:00.809743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec2087-4d01-4d2d-870b-3a6b46523241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:00.818666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec2087-4d01-4d2d-870b-3a6b46523241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:00.820168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec2087-4d01-4d2d-870b-3a6b46523241 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:00.829457 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 665/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:36:03.727742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86d07-dc34-4c8a-8e9d-19f6278b29f9 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:03.728265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86d07-dc34-4c8a-8e9d-19f6278b29f9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:03.728265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a86d07-dc34-4c8a-8e9d-19f6278b29f9 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:03.729554 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 679/1344] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:03.734792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a596b-5d31-4554-b39f-f958e7aa3072 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:03.735187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a596b-5d31-4554-b39f-f958e7aa3072 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:03.735365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a596b-5d31-4554-b39f-f958e7aa3072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:03.762106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-db2a596b-5d31-4554-b39f-f958e7aa3072 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:03.763305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db2a596b-5d31-4554-b39f-f958e7aa3072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:03.836677 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 666/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:03.874884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a86d07-dc34-4c8a-8e9d-19f6278b29f9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:03.885204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a86d07-dc34-4c8a-8e9d-19f6278b29f9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:03.888700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aef38a-1850-43cb-abbf-bca1efec6467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:03.889324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef38a-1850-43cb-abbf-bca1efec6467 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:03.889605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef38a-1850-43cb-abbf-bca1efec6467 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:03.889878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aef38a-1850-43cb-abbf-bca1efec6467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:03.898494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aef38a-1850-43cb-abbf-bca1efec6467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:03.899960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aef38a-1850-43cb-abbf-bca1efec6467 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:03.909008 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 680/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:08.333569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba2d1-c4c2-40f5-818f-4e3d478dea9a None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:08.334013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba2d1-c4c2-40f5-818f-4e3d478dea9a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:08.334150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ba2d1-c4c2-40f5-818f-4e3d478dea9a None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:08.335601 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 667/1347] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:08.340951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6c20-9e3d-4352-811e-8e498cdf5939 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:08.341349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6c20-9e3d-4352-811e-8e498cdf5939 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:08.341503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b6c20-9e3d-4352-811e-8e498cdf5939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:08.359416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4b2b6c20-9e3d-4352-811e-8e498cdf5939 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:08.360523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4b2b6c20-9e3d-4352-811e-8e498cdf5939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:08.368940 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 681/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:08.406744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ba2d1-c4c2-40f5-818f-4e3d478dea9a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:08.417724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ba2d1-c4c2-40f5-818f-4e3d478dea9a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:08.421221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8a866-4f17-41a3-bf85-03e607bfdcf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:08.421854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8a866-4f17-41a3-bf85-03e607bfdcf1 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:08.422133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8a866-4f17-41a3-bf85-03e607bfdcf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:08.422405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8a866-4f17-41a3-bf85-03e607bfdcf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:08.432038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8a866-4f17-41a3-bf85-03e607bfdcf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:08.433464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8a866-4f17-41a3-bf85-03e607bfdcf1 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:08.442706 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 668/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:13.934527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87f06-4743-47df-99bf-7792543c9293 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:13.934527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87f06-4743-47df-99bf-7792543c9293 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:13.935172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d87f06-4743-47df-99bf-7792543c9293 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:13.943074 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 682/1350] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:36:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:13.962830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e12d-b444-4f0b-a65b-8db85b6387ed None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:13.962830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e12d-b444-4f0b-a65b-8db85b6387ed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:13.962830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e12d-b444-4f0b-a65b-8db85b6387ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:14.043976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5a20e12d-b444-4f0b-a65b-8db85b6387ed None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:14.045404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5a20e12d-b444-4f0b-a65b-8db85b6387ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:14.122882 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 669/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:36:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:18.730969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81215a3f-bc2c-444e-8e3a-b359fa692edf None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:18.731573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81215a3f-bc2c-444e-8e3a-b359fa692edf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:18.731772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81215a3f-bc2c-444e-8e3a-b359fa692edf None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:18.733684 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 683/1352] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:18.741156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdfe82-82a1-4fb6-b800-a72ecd8ada93 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:18.741743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdfe82-82a1-4fb6-b800-a72ecd8ada93 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:18.741743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdfe82-82a1-4fb6-b800-a72ecd8ada93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:18.759701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-82bdfe82-82a1-4fb6-b800-a72ecd8ada93 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:18.760899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-82bdfe82-82a1-4fb6-b800-a72ecd8ada93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:18.770803 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 670/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:20.149892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb672-fa02-4d71-9b06-3c975dbb5990 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:20.150452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb672-fa02-4d71-9b06-3c975dbb5990 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:20.150452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb672-fa02-4d71-9b06-3c975dbb5990 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:20.151808 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 684/1354] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:20.156950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591e02-9169-40a8-a3ec-94e017665a0e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:20.157386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591e02-9169-40a8-a3ec-94e017665a0e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:20.157642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0591e02-9169-40a8-a3ec-94e017665a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:20.176253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d0591e02-9169-40a8-a3ec-94e017665a0e None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:20.177432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d0591e02-9169-40a8-a3ec-94e017665a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:20.185940 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 671/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:36:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:24.322948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d77392-c5bd-4b44-aeb2-a6012b76d011 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:24.323489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d77392-c5bd-4b44-aeb2-a6012b76d011 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:24.323489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d77392-c5bd-4b44-aeb2-a6012b76d011 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:24.324888 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 685/1356] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:24.330077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e821bb-f7dd-420d-a91c-27c3b376bab5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:24.330470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e821bb-f7dd-420d-a91c-27c3b376bab5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:24.330632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e821bb-f7dd-420d-a91c-27c3b376bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:24.349655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-81e821bb-f7dd-420d-a91c-27c3b376bab5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:24.351126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-81e821bb-f7dd-420d-a91c-27c3b376bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:24.368741 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 672/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:24.411814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8c0fe-983f-44df-bc0d-a5ed5c958177 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:24.412364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8c0fe-983f-44df-bc0d-a5ed5c958177 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:24.412649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8c0fe-983f-44df-bc0d-a5ed5c958177 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:24.414001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 686/1358] 10.222.0.32 () {54 vars in 961 bytes} [Sat May 7 21:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:24.419557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a646c-c4de-4156-9b63-a070fa33620a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:24.419950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a646c-c4de-4156-9b63-a070fa33620a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:24.420329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a646c-c4de-4156-9b63-a070fa33620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:24.468050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e54a646c-c4de-4156-9b63-a070fa33620a None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:24.469220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e54a646c-c4de-4156-9b63-a070fa33620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:24.549419 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 673/1359] 10.222.0.32 () {58 vars in 1058 bytes} [Sat May 7 21:36:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:36:24.557699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8c0fe-983f-44df-bc0d-a5ed5c958177 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:24.573109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8c0fe-983f-44df-bc0d-a5ed5c958177 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:24.578729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa0128-81c1-4b05-a009-36b2be2aaf06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:24.579509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0128-81c1-4b05-a009-36b2be2aaf06 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:24.579891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0128-81c1-4b05-a009-36b2be2aaf06 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:24.580266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa0128-81c1-4b05-a009-36b2be2aaf06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:24.589517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0128-81c1-4b05-a009-36b2be2aaf06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:24.591268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa0128-81c1-4b05-a009-36b2be2aaf06 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:24.601375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 687/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:36:27.107589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd386-d56f-4549-b34d-0e90d7235e18 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:27.108106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd386-d56f-4549-b34d-0e90d7235e18 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:27.108106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd386-d56f-4549-b34d-0e90d7235e18 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:27.109427 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 674/1361] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:27.114607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7af2-86db-482c-9461-fec4037c05cd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:27.115135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7af2-86db-482c-9461-fec4037c05cd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:27.115251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a7af2-86db-482c-9461-fec4037c05cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:27.133602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3a5a7af2-86db-482c-9461-fec4037c05cd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:27.134820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a5a7af2-86db-482c-9461-fec4037c05cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:27.143054 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 688/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:36:27.187768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd386-d56f-4549-b34d-0e90d7235e18 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:27.205527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd386-d56f-4549-b34d-0e90d7235e18 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:27.215613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55daf9-e7d5-4200-90b7-3fa30a2c4ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:27.216293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55daf9-e7d5-4200-90b7-3fa30a2c4ab3 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:27.216646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55daf9-e7d5-4200-90b7-3fa30a2c4ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:27.217091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55daf9-e7d5-4200-90b7-3fa30a2c4ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:27.227123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55daf9-e7d5-4200-90b7-3fa30a2c4ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:27.228928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55daf9-e7d5-4200-90b7-3fa30a2c4ab3 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:27.250985 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 675/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:29.836806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe086-7a5a-48d8-92c4-6c81b59962d6 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:29.837355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe086-7a5a-48d8-92c4-6c81b59962d6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:29.837454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe086-7a5a-48d8-92c4-6c81b59962d6 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:29.838842 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 689/1364] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:29.844128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5162-b36c-401b-83fa-f90601836205 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:29.844840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5162-b36c-401b-83fa-f90601836205 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:29.845275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5162-b36c-401b-83fa-f90601836205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:29.864067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-281f5162-b36c-401b-83fa-f90601836205 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:29.865915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-281f5162-b36c-401b-83fa-f90601836205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:29.873899 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 676/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:29.928787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d64d8-a33c-440d-bad7-161e0838a958 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:29.929385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d64d8-a33c-440d-bad7-161e0838a958 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:29.929767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d64d8-a33c-440d-bad7-161e0838a958 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:29.931451 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 690/1366] 10.222.0.32 () {54 vars in 961 bytes} [Sat May 7 21:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:29.937465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7ca7d-2cf5-4718-83d5-b9e2b7fff2c2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:29.937751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7ca7d-2cf5-4718-83d5-b9e2b7fff2c2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:29.938032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7ca7d-2cf5-4718-83d5-b9e2b7fff2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:29.955918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5ed7ca7d-2cf5-4718-83d5-b9e2b7fff2c2 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:29.957075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ed7ca7d-2cf5-4718-83d5-b9e2b7fff2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:29.967135 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 677/1367] 10.222.0.32 () {58 vars in 1058 bytes} [Sat May 7 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:29.975327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d64d8-a33c-440d-bad7-161e0838a958 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:29.989136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d64d8-a33c-440d-bad7-161e0838a958 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:29.995166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f6069-d4da-4dfd-a5df-5e73d05b240f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:29.995791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f6069-d4da-4dfd-a5df-5e73d05b240f service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:29.996067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f6069-d4da-4dfd-a5df-5e73d05b240f service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:29.996338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f6069-d4da-4dfd-a5df-5e73d05b240f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:30.004181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f6069-d4da-4dfd-a5df-5e73d05b240f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:30.005796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f6069-d4da-4dfd-a5df-5e73d05b240f service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:30.014961 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 691/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:32.388722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328527d-5c1d-4093-bd68-1632e6665858 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:32.390611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328527d-5c1d-4093-bd68-1632e6665858 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:32.393375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328527d-5c1d-4093-bd68-1632e6665858 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:32.399460 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 678/1369] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:32.401679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95e65-5375-44ee-b559-6e0769f3354f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:32.402459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95e65-5375-44ee-b559-6e0769f3354f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:32.402955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95e65-5375-44ee-b559-6e0769f3354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:32.431233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-74f95e65-5375-44ee-b559-6e0769f3354f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:32.433057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-74f95e65-5375-44ee-b559-6e0769f3354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:32.453827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 692/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:32.495452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328527d-5c1d-4093-bd68-1632e6665858 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:32.512466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328527d-5c1d-4093-bd68-1632e6665858 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:32.519983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f2ef9-68db-432a-9c66-f5847c8d5bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:32.520822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f2ef9-68db-432a-9c66-f5847c8d5bd2 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:32.521309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f2ef9-68db-432a-9c66-f5847c8d5bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:32.521751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f2ef9-68db-432a-9c66-f5847c8d5bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:32.532332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f2ef9-68db-432a-9c66-f5847c8d5bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:32.534487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f2ef9-68db-432a-9c66-f5847c8d5bd2 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:32.552250 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 679/1371] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:35.217492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955360b-eba8-4318-89c8-df31c316d9f5 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:35.218379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955360b-eba8-4318-89c8-df31c316d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:35.218501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955360b-eba8-4318-89c8-df31c316d9f5 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:35.220025 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 693/1372] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:35.227530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58425b8-b756-4503-966f-72272d4d083d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:35.228387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58425b8-b756-4503-966f-72272d4d083d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:35.228833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58425b8-b756-4503-966f-72272d4d083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:35.248775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d58425b8-b756-4503-966f-72272d4d083d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:35.250224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d58425b8-b756-4503-966f-72272d4d083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:35.264992 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 680/1373] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:35.312483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955360b-eba8-4318-89c8-df31c316d9f5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:35.327767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955360b-eba8-4318-89c8-df31c316d9f5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:35.333955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ef635-fda0-4a19-bf24-4c355657c5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:35.334826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ef635-fda0-4a19-bf24-4c355657c5a5 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:35.335283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ef635-fda0-4a19-bf24-4c355657c5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:35.335727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ef635-fda0-4a19-bf24-4c355657c5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:35.344711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ef635-fda0-4a19-bf24-4c355657c5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:35.346520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ef635-fda0-4a19-bf24-4c355657c5a5 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:35.367493 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 694/1374] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:36.562909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a84637-e17b-4f08-a362-7f481421e66f None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:36.565474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a84637-e17b-4f08-a362-7f481421e66f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:36.565474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a84637-e17b-4f08-a362-7f481421e66f None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:36.565474 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 681/1375] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:36:36.571806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ba10a-e546-4e06-af80-e411a86460ae None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:36.572291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ba10a-e546-4e06-af80-e411a86460ae None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:36.572569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ba10a-e546-4e06-af80-e411a86460ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:36.590355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d03ba10a-e546-4e06-af80-e411a86460ae None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:36.591710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d03ba10a-e546-4e06-af80-e411a86460ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:36.600564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 695/1376] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:36.917811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed39f-92c2-427c-99eb-da8b86e417b3 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:36.918142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed39f-92c2-427c-99eb-da8b86e417b3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:36.918420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ed39f-92c2-427c-99eb-da8b86e417b3 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:36.920029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 682/1377] 10.222.0.32 () {54 vars in 963 bytes} [Sat May 7 21:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:36.925105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3546d0-65e0-4921-bf7b-19dd5357cd84 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:36.925401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3546d0-65e0-4921-bf7b-19dd5357cd84 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:36.925683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3546d0-65e0-4921-bf7b-19dd5357cd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:36.980261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ee3546d0-65e0-4921-bf7b-19dd5357cd84 None None] MFA Rules not processed for user `cf4eae7f407e44ecbe525049b262e3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:36.981467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee3546d0-65e0-4921-bf7b-19dd5357cd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:37.046566 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 696/1378] 10.222.0.32 () {58 vars in 1060 bytes} [Sat May 7 21:36:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:37.054195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed39f-92c2-427c-99eb-da8b86e417b3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:37.064552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ed39f-92c2-427c-99eb-da8b86e417b3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:37.068177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fc959-0470-41fc-a900-3d1b30daf705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:37.068810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fc959-0470-41fc-a900-3d1b30daf705 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:37.069093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fc959-0470-41fc-a900-3d1b30daf705 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:37.069370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fc959-0470-41fc-a900-3d1b30daf705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:37.078675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fc959-0470-41fc-a900-3d1b30daf705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:37.080158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fc959-0470-41fc-a900-3d1b30daf705 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:37.090637 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 683/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:38.186295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c59a-f853-4df1-8796-9b3677adfbe6 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:38.186295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c59a-f853-4df1-8796-9b3677adfbe6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:38.186295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8c59a-f853-4df1-8796-9b3677adfbe6 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:38.186295 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 697/1380] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:38.188479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11bf67-a3f9-4514-8af6-24a9c49266dd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:38.189050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11bf67-a3f9-4514-8af6-24a9c49266dd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:38.190717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11bf67-a3f9-4514-8af6-24a9c49266dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:38.220484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fd11bf67-a3f9-4514-8af6-24a9c49266dd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:38.221705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd11bf67-a3f9-4514-8af6-24a9c49266dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:38.233435 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 684/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:38.281360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8c59a-f853-4df1-8796-9b3677adfbe6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:38.314990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8c59a-f853-4df1-8796-9b3677adfbe6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:38.322223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137170f-0859-43c4-a750-46bdcfcf1d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:38.322959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137170f-0859-43c4-a750-46bdcfcf1d37 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:38.323156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137170f-0859-43c4-a750-46bdcfcf1d37 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:38.323805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137170f-0859-43c4-a750-46bdcfcf1d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:38.334384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137170f-0859-43c4-a750-46bdcfcf1d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:38.336311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e137170f-0859-43c4-a750-46bdcfcf1d37 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:38.359399 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 698/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:40.803330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734bc6-1aed-4c80-8b75-680c2373acd7 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:40.803891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734bc6-1aed-4c80-8b75-680c2373acd7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:40.803891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43734bc6-1aed-4c80-8b75-680c2373acd7 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:40.805267 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 685/1383] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:40.810521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc508e2-7143-4ccf-bcf5-ae5068b20755 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:40.811078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc508e2-7143-4ccf-bcf5-ae5068b20755 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:40.811167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc508e2-7143-4ccf-bcf5-ae5068b20755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:40.828911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cfc508e2-7143-4ccf-bcf5-ae5068b20755 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:40.830105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cfc508e2-7143-4ccf-bcf5-ae5068b20755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:40.838486 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 699/1384] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:40.880079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43734bc6-1aed-4c80-8b75-680c2373acd7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:40.902458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43734bc6-1aed-4c80-8b75-680c2373acd7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:40.908294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a5c13-aa3b-4816-9335-1873435d5101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:40.909017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5c13-aa3b-4816-9335-1873435d5101 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:40.909403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5c13-aa3b-4816-9335-1873435d5101 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:40.909926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5c13-aa3b-4816-9335-1873435d5101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:40.920060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a5c13-aa3b-4816-9335-1873435d5101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:40.923230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a5c13-aa3b-4816-9335-1873435d5101 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:40.935587 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 686/1385] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:43.294735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19aa8e-33cb-4183-8727-21947dd2cc89 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:43.295376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19aa8e-33cb-4183-8727-21947dd2cc89 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:43.295376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19aa8e-33cb-4183-8727-21947dd2cc89 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:43.296864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 700/1386] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:43.302131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef66a-b6f0-4f33-bbf2-3166a441f3ad None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:43.302618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef66a-b6f0-4f33-bbf2-3166a441f3ad None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:43.302717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef66a-b6f0-4f33-bbf2-3166a441f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:43.320856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5a2ef66a-b6f0-4f33-bbf2-3166a441f3ad None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:43.322038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5a2ef66a-b6f0-4f33-bbf2-3166a441f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:43.329932 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 687/1387] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:43.375888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19aa8e-33cb-4183-8727-21947dd2cc89 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:43.390965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19aa8e-33cb-4183-8727-21947dd2cc89 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:43.397050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f194ffe-77c0-427a-8f91-205ac0801877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:43.397687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194ffe-77c0-427a-8f91-205ac0801877 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:43.397970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194ffe-77c0-427a-8f91-205ac0801877 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:43.398243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194ffe-77c0-427a-8f91-205ac0801877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:43.406700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f194ffe-77c0-427a-8f91-205ac0801877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:43.408310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f194ffe-77c0-427a-8f91-205ac0801877 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:43.417703 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 701/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:45.796306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef621e2-0970-4d6c-bbdc-5bebf0376010 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:45.797180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef621e2-0970-4d6c-bbdc-5bebf0376010 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:45.797180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef621e2-0970-4d6c-bbdc-5bebf0376010 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:45.799456 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 688/1389] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:45.805270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c47e2-edd4-434e-bbb6-2a84e315f5ed None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:45.805932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c47e2-edd4-434e-bbb6-2a84e315f5ed None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:45.805932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c47e2-edd4-434e-bbb6-2a84e315f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:45.824108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b61c47e2-edd4-434e-bbb6-2a84e315f5ed None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:45.825320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b61c47e2-edd4-434e-bbb6-2a84e315f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:45.836278 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 702/1390] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:45.888471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef621e2-0970-4d6c-bbdc-5bebf0376010 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:45.906397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef621e2-0970-4d6c-bbdc-5bebf0376010 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:45.913759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb3e45-79a2-4d25-946e-ed7a2ba6e389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:45.914542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3e45-79a2-4d25-946e-ed7a2ba6e389 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:45.914922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3e45-79a2-4d25-946e-ed7a2ba6e389 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:45.915271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb3e45-79a2-4d25-946e-ed7a2ba6e389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:45.925701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb3e45-79a2-4d25-946e-ed7a2ba6e389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:45.928368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb3e45-79a2-4d25-946e-ed7a2ba6e389 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:45.939920 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 689/1391] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:48.439852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da35966-0c85-4f56-8640-aa9caafdd7e3 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:48.440746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da35966-0c85-4f56-8640-aa9caafdd7e3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:48.440746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da35966-0c85-4f56-8640-aa9caafdd7e3 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:48.441863 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 703/1392] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:48.447383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb3d9a-b13a-4ad1-9a97-5a67b520d126 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:48.447990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb3d9a-b13a-4ad1-9a97-5a67b520d126 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:48.447990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb3d9a-b13a-4ad1-9a97-5a67b520d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:48.467245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-efcb3d9a-b13a-4ad1-9a97-5a67b520d126 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:48.468413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-efcb3d9a-b13a-4ad1-9a97-5a67b520d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:48.477334 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 690/1393] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:48.523679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da35966-0c85-4f56-8640-aa9caafdd7e3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:48.539876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da35966-0c85-4f56-8640-aa9caafdd7e3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:48.545561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f72831-01c2-443c-b25d-791f8cbde120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:48.546229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f72831-01c2-443c-b25d-791f8cbde120 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:48.546513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f72831-01c2-443c-b25d-791f8cbde120 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:48.546837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f72831-01c2-443c-b25d-791f8cbde120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:48.555829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f72831-01c2-443c-b25d-791f8cbde120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:48.557459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f72831-01c2-443c-b25d-791f8cbde120 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:48.567430 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 704/1394] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:51.348319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f8bd4-8fea-4be8-8c24-34c633861771 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:51.349532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f8bd4-8fea-4be8-8c24-34c633861771 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:51.349532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f8bd4-8fea-4be8-8c24-34c633861771 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:51.350997 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 691/1395] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:51.356454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35406a-4353-4b5b-baa6-2983ebc3a83e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:51.356973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35406a-4353-4b5b-baa6-2983ebc3a83e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:51.357087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35406a-4353-4b5b-baa6-2983ebc3a83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:51.374391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8a35406a-4353-4b5b-baa6-2983ebc3a83e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:51.378630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a35406a-4353-4b5b-baa6-2983ebc3a83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:51.386667 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 705/1396] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:51.431478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f8bd4-8fea-4be8-8c24-34c633861771 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:51.446138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f8bd4-8fea-4be8-8c24-34c633861771 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:51.451668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199dd27-b3a5-4696-bb69-a59bbbbe211e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:51.452245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199dd27-b3a5-4696-bb69-a59bbbbe211e service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:51.452554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199dd27-b3a5-4696-bb69-a59bbbbe211e service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:51.452834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199dd27-b3a5-4696-bb69-a59bbbbe211e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:51.461719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199dd27-b3a5-4696-bb69-a59bbbbe211e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:51.463333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199dd27-b3a5-4696-bb69-a59bbbbe211e service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:51.472670 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 692/1397] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:53.509119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2942-5f2e-46ee-b901-0e8e3e02359d None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.509119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2942-5f2e-46ee-b901-0e8e3e02359d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.509119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba2942-5f2e-46ee-b901-0e8e3e02359d None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.509119 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 706/1398] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:53.509960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c845087-900d-4367-9dff-fd5ad406aa33 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.509960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c845087-900d-4367-9dff-fd5ad406aa33 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.509960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c845087-900d-4367-9dff-fd5ad406aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.525391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7c845087-900d-4367-9dff-fd5ad406aa33 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:53.527235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7c845087-900d-4367-9dff-fd5ad406aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:53.534932 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 693/1399] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:53.591426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e80c1-d78b-49af-81b2-8e186ecbeeba None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.591975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e80c1-d78b-49af-81b2-8e186ecbeeba None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.592186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e80c1-d78b-49af-81b2-8e186ecbeeba None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.593598 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 707/1400] 10.222.0.32 () {54 vars in 962 bytes} [Sat May 7 21:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:53.599985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651e72-734b-4d01-bd05-4b8e4e6c9b3d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.600272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651e72-734b-4d01-bd05-4b8e4e6c9b3d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.600547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651e72-734b-4d01-bd05-4b8e4e6c9b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.652500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-33651e72-734b-4d01-bd05-4b8e4e6c9b3d None None] MFA Rules not processed for user `0275c43e4d7744b4a556c30662b7e84f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:53.653686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-33651e72-734b-4d01-bd05-4b8e4e6c9b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:53.713272 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 694/1401] 10.222.0.32 () {58 vars in 1059 bytes} [Sat May 7 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:53.720852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e80c1-d78b-49af-81b2-8e186ecbeeba None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:53.731853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e80c1-d78b-49af-81b2-8e186ecbeeba None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:53.735340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f30d-41f3-42c0-af14-00c3ac398b77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:53.735971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f30d-41f3-42c0-af14-00c3ac398b77 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.736260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f30d-41f3-42c0-af14-00c3ac398b77 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.736534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f30d-41f3-42c0-af14-00c3ac398b77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.745665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f30d-41f3-42c0-af14-00c3ac398b77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:53.747205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8f30d-41f3-42c0-af14-00c3ac398b77 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:53.759547 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 708/1402] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:53.801550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf317b-978b-436b-a329-6b4621384922 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.801550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf317b-978b-436b-a329-6b4621384922 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.802282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf317b-978b-436b-a329-6b4621384922 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.803202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 695/1403] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:36:53.808563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e5196-fdba-4011-881f-83c67196f656 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.808858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e5196-fdba-4011-881f-83c67196f656 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.809139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e5196-fdba-4011-881f-83c67196f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.826574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-894e5196-fdba-4011-881f-83c67196f656 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:53.827795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-894e5196-fdba-4011-881f-83c67196f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:53.836565 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 709/1404] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:36:53.881805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf317b-978b-436b-a329-6b4621384922 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:53.897567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf317b-978b-436b-a329-6b4621384922 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:53.902479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece859a-fff6-45c5-a592-f1c7baf30718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:53.903538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece859a-fff6-45c5-a592-f1c7baf30718 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:53.903538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece859a-fff6-45c5-a592-f1c7baf30718 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:53.903967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece859a-fff6-45c5-a592-f1c7baf30718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:53.912577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece859a-fff6-45c5-a592-f1c7baf30718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:53.914172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece859a-fff6-45c5-a592-f1c7baf30718 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:53.923668 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 696/1405] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:36:54.204742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a27f95-8522-4d8f-b6c1-3bdd17934471 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:54.205275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a27f95-8522-4d8f-b6c1-3bdd17934471 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:54.205577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a27f95-8522-4d8f-b6c1-3bdd17934471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:54.255650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e4a27f95-8522-4d8f-b6c1-3bdd17934471 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:54.256883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4a27f95-8522-4d8f-b6c1-3bdd17934471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:54.318081 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 710/1406] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:36:54.365139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a1ce-a074-4c51-a924-69e1d875ffda None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:54.365431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a1ce-a074-4c51-a924-69e1d875ffda None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:54.365707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22a1ce-a074-4c51-a924-69e1d875ffda None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:54.367140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 697/1407] 10.222.0.32 () {54 vars in 942 bytes} [Sat May 7 21:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:36:54.373399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64565bf7-62bd-46e2-9f75-e76898894f31 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:54.373708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64565bf7-62bd-46e2-9f75-e76898894f31 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:54.373991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64565bf7-62bd-46e2-9f75-e76898894f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:54.429798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-64565bf7-62bd-46e2-9f75-e76898894f31 None None] MFA Rules not processed for user `ddea6c1eb8764f1a9f0a310a78128460`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:36:54.431044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-64565bf7-62bd-46e2-9f75-e76898894f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:36:54.503032 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 711/1408] 10.222.0.32 () {58 vars in 1039 bytes} [Sat May 7 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:36:54.513719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a1ce-a074-4c51-a924-69e1d875ffda None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:36:54.526850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22a1ce-a074-4c51-a924-69e1d875ffda None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:36:54.531943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e3b07-3fc5-49a9-858b-b9340f97b281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:36:54.532569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3b07-3fc5-49a9-858b-b9340f97b281 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:36:54.532845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3b07-3fc5-49a9-858b-b9340f97b281 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:36:54.533115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e3b07-3fc5-49a9-858b-b9340f97b281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:36:54.540922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3b07-3fc5-49a9-858b-b9340f97b281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:36:54.542518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e3b07-3fc5-49a9-858b-b9340f97b281 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:36:54.550100 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 698/1409] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:36:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 21:37:17.686470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ba67-7683-45f4-9b05-d74701906455 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:17.687163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ba67-7683-45f4-9b05-d74701906455 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:17.687163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ba67-7683-45f4-9b05-d74701906455 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:17.688516 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 712/1410] 10.222.0.32 () {54 vars in 918 bytes} [Sat May 7 21:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:17.694142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13c35-fc05-4ca3-a74c-0edea7f16a79 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:17.694572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13c35-fc05-4ca3-a74c-0edea7f16a79 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:17.694815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c13c35-fc05-4ca3-a74c-0edea7f16a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:17.712324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-62c13c35-fc05-4ca3-a74c-0edea7f16a79 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:17.713544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-62c13c35-fc05-4ca3-a74c-0edea7f16a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:17.721973 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 699/1411] 10.222.0.32 () {58 vars in 1015 bytes} [Sat May 7 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:17.736259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc843ea3-89c0-482a-8323-ab0906d202e5 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:17.736552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc843ea3-89c0-482a-8323-ab0906d202e5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:17.736833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc843ea3-89c0-482a-8323-ab0906d202e5 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:17.738181 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 713/1412] 10.222.0.32 () {54 vars in 918 bytes} [Sat May 7 21:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:17.743392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff9c6d-904f-4c81-8ef8-1ba5c550b49c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:17.743678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff9c6d-904f-4c81-8ef8-1ba5c550b49c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:17.743979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff9c6d-904f-4c81-8ef8-1ba5c550b49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:17.761474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-73ff9c6d-904f-4c81-8ef8-1ba5c550b49c None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:17.762636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-73ff9c6d-904f-4c81-8ef8-1ba5c550b49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:17.772013 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 700/1413] 10.222.0.32 () {58 vars in 1015 bytes} [Sat May 7 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:20.573240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d9f0-b27c-4e58-ade5-62b2993447df None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:20.573836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d9f0-b27c-4e58-ade5-62b2993447df None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:20.573836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d9f0-b27c-4e58-ade5-62b2993447df None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:20.575164 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:20.580325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3047c-68bb-422e-87bd-1619d5269f80 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:20.580737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3047c-68bb-422e-87bd-1619d5269f80 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:20.580996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3047c-68bb-422e-87bd-1619d5269f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:20.598416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d5c3047c-68bb-422e-87bd-1619d5269f80 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:20.599640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d5c3047c-68bb-422e-87bd-1619d5269f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:20.607405 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:20.649754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d9f0-b27c-4e58-ade5-62b2993447df None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:20.663502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d9f0-b27c-4e58-ade5-62b2993447df None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:20.668744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2902d4a-40a9-423d-a4f0-5b284ba937c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:20.669360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2902d4a-40a9-423d-a4f0-5b284ba937c5 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:20.669640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2902d4a-40a9-423d-a4f0-5b284ba937c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:20.669914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2902d4a-40a9-423d-a4f0-5b284ba937c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:20.679380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2902d4a-40a9-423d-a4f0-5b284ba937c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:20.680966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2902d4a-40a9-423d-a4f0-5b284ba937c5 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:20.690156 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 715/1416] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:21.734425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402827f9-6de3-4fea-8388-addbe4121f36 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:21.735025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402827f9-6de3-4fea-8388-addbe4121f36 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:21.735154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402827f9-6de3-4fea-8388-addbe4121f36 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:21.736605 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:21.741618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2c08-5f98-45f2-bc67-f48d93f74334 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:21.742072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2c08-5f98-45f2-bc67-f48d93f74334 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:21.742172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e2c08-5f98-45f2-bc67-f48d93f74334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:21.761560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e54e2c08-5f98-45f2-bc67-f48d93f74334 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:21.762844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e54e2c08-5f98-45f2-bc67-f48d93f74334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:21.771305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:22.028721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402827f9-6de3-4fea-8388-addbe4121f36 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:22.044329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402827f9-6de3-4fea-8388-addbe4121f36 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:22.049860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce818a7-041a-4833-86ef-255bd34bdfc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:22.050496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce818a7-041a-4833-86ef-255bd34bdfc9 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:22.050865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce818a7-041a-4833-86ef-255bd34bdfc9 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:22.051213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce818a7-041a-4833-86ef-255bd34bdfc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:22.060159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce818a7-041a-4833-86ef-255bd34bdfc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:22.061772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce818a7-041a-4833-86ef-255bd34bdfc9 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:22.071770 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 703/1419] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:23.046313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af674e3-be68-457c-9f50-071aa6d45371 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:23.046866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af674e3-be68-457c-9f50-071aa6d45371 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:23.046866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af674e3-be68-457c-9f50-071aa6d45371 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:23.048179 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:23.053004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb676-e9a6-4b1d-9b69-758c5624d79d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:23.053414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb676-e9a6-4b1d-9b69-758c5624d79d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:23.053564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb676-e9a6-4b1d-9b69-758c5624d79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:23.071500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d2adb676-e9a6-4b1d-9b69-758c5624d79d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:23.072706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d2adb676-e9a6-4b1d-9b69-758c5624d79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:23.080474 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:23.236840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af674e3-be68-457c-9f50-071aa6d45371 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:23.251074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af674e3-be68-457c-9f50-071aa6d45371 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:23.257033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa650e-5cdf-4a7c-83cb-db13f013e07a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:23.257663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa650e-5cdf-4a7c-83cb-db13f013e07a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:23.257946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa650e-5cdf-4a7c-83cb-db13f013e07a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:23.258241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa650e-5cdf-4a7c-83cb-db13f013e07a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:23.266113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa650e-5cdf-4a7c-83cb-db13f013e07a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:23.267719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa650e-5cdf-4a7c-83cb-db13f013e07a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:23.277416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 718/1422] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:24.215859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427b2c-048e-4646-a912-28672b3aa0b9 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:24.216318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427b2c-048e-4646-a912-28672b3aa0b9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:24.216441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427b2c-048e-4646-a912-28672b3aa0b9 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:24.217818 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:24.222822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41d5a-d972-405b-831c-10c3dcdf3604 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:24.223226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41d5a-d972-405b-831c-10c3dcdf3604 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:24.223383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f41d5a-d972-405b-831c-10c3dcdf3604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:24.241366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a1f41d5a-d972-405b-831c-10c3dcdf3604 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:24.242545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a1f41d5a-d972-405b-831c-10c3dcdf3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:24.250497 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:24.412366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb427b2c-048e-4646-a912-28672b3aa0b9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:24.427664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb427b2c-048e-4646-a912-28672b3aa0b9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:24.433817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc881d-891b-4079-8f93-5da41c5a9ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:24.433817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc881d-891b-4079-8f93-5da41c5a9ace service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:24.434084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc881d-891b-4079-8f93-5da41c5a9ace service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:24.434408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc881d-891b-4079-8f93-5da41c5a9ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:24.443814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc881d-891b-4079-8f93-5da41c5a9ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:24.445666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc881d-891b-4079-8f93-5da41c5a9ace service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:24.459612 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 706/1425] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:25.415579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705d94f-de0c-457f-801c-4339642e51ef None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:25.416421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705d94f-de0c-457f-801c-4339642e51ef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:25.416421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705d94f-de0c-457f-801c-4339642e51ef None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:25.417480 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:37:25.422594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6264f3-ad09-486d-b4e3-ed26868bb43f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:25.423080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6264f3-ad09-486d-b4e3-ed26868bb43f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:25.423185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6264f3-ad09-486d-b4e3-ed26868bb43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:25.441539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6a6264f3-ad09-486d-b4e3-ed26868bb43f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:25.442792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6a6264f3-ad09-486d-b4e3-ed26868bb43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:25.450706 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:25.609647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705d94f-de0c-457f-801c-4339642e51ef None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:25.624449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705d94f-de0c-457f-801c-4339642e51ef None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:25.629777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b76f-61db-41c3-81a5-c4d9bdb8a228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:25.630403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b76f-61db-41c3-81a5-c4d9bdb8a228 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:25.630684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b76f-61db-41c3-81a5-c4d9bdb8a228 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:25.630989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b76f-61db-41c3-81a5-c4d9bdb8a228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:25.639197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b76f-61db-41c3-81a5-c4d9bdb8a228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:25.640773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b76f-61db-41c3-81a5-c4d9bdb8a228 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:25.650197 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 721/1428] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:26.532352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50775c-2761-4183-b029-1f9fd66a36b1 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:26.532873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50775c-2761-4183-b029-1f9fd66a36b1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:26.532873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50775c-2761-4183-b029-1f9fd66a36b1 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:26.534176 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:26.539088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f49b24-a900-45c4-b053-024efac9fd47 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:26.539506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f49b24-a900-45c4-b053-024efac9fd47 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:26.539667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f49b24-a900-45c4-b053-024efac9fd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:26.557644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c5f49b24-a900-45c4-b053-024efac9fd47 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:26.558865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c5f49b24-a900-45c4-b053-024efac9fd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:26.566563 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:26.722700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50775c-2761-4183-b029-1f9fd66a36b1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:26.736745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50775c-2761-4183-b029-1f9fd66a36b1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:26.742625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b6c87-a579-4901-854c-12870b318c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:26.743290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b6c87-a579-4901-854c-12870b318c0e service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:26.743577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b6c87-a579-4901-854c-12870b318c0e service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:26.743858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b6c87-a579-4901-854c-12870b318c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:26.751794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b6c87-a579-4901-854c-12870b318c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:26.753369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b6c87-a579-4901-854c-12870b318c0e service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:26.763232 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 709/1431] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:27.645234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b213-d2b5-4eb8-9e1d-9571fc631d77 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:27.646286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b213-d2b5-4eb8-9e1d-9571fc631d77 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:27.646390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85b213-d2b5-4eb8-9e1d-9571fc631d77 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:27.647766 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:27.652681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742a5e-2097-47f4-92cb-551eefa19376 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:27.653088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742a5e-2097-47f4-92cb-551eefa19376 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:27.653236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34742a5e-2097-47f4-92cb-551eefa19376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:27.670526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-34742a5e-2097-47f4-92cb-551eefa19376 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:27.671749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-34742a5e-2097-47f4-92cb-551eefa19376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:27.679470 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:27.836263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85b213-d2b5-4eb8-9e1d-9571fc631d77 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:27.850282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85b213-d2b5-4eb8-9e1d-9571fc631d77 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:27.855672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790bee1-9f7a-469c-ac53-464f78a6e8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:27.856306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790bee1-9f7a-469c-ac53-464f78a6e8d5 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:27.856590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790bee1-9f7a-469c-ac53-464f78a6e8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:27.856869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790bee1-9f7a-469c-ac53-464f78a6e8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:27.864747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790bee1-9f7a-469c-ac53-464f78a6e8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:27.866334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790bee1-9f7a-469c-ac53-464f78a6e8d5 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:27.875464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 724/1434] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:28.754191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa3c7-dcc2-4a76-94c2-d4445ef8f9e9 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:28.754743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa3c7-dcc2-4a76-94c2-d4445ef8f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:28.754885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa3c7-dcc2-4a76-94c2-d4445ef8f9e9 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:28.756151 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:28.761294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea7c50-688e-4c04-a200-95ba82d00acf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:28.761771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea7c50-688e-4c04-a200-95ba82d00acf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:28.761882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea7c50-688e-4c04-a200-95ba82d00acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:28.780748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7bea7c50-688e-4c04-a200-95ba82d00acf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:28.782127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7bea7c50-688e-4c04-a200-95ba82d00acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:28.790495 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:37:28.947592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa3c7-dcc2-4a76-94c2-d4445ef8f9e9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:28.962552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa3c7-dcc2-4a76-94c2-d4445ef8f9e9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:28.967957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cefc5-39e8-4472-a9e2-7a0739bf574a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:28.968587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cefc5-39e8-4472-a9e2-7a0739bf574a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:28.968866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cefc5-39e8-4472-a9e2-7a0739bf574a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:28.969144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cefc5-39e8-4472-a9e2-7a0739bf574a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:28.977574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cefc5-39e8-4472-a9e2-7a0739bf574a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:28.979184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cefc5-39e8-4472-a9e2-7a0739bf574a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:28.988205 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 712/1437] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:29.875765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869669c-f80b-47f5-a4ce-bd83dbfe6296 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:29.876346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869669c-f80b-47f5-a4ce-bd83dbfe6296 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:29.876346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869669c-f80b-47f5-a4ce-bd83dbfe6296 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:29.877718 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:29.882603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cc6a7-8841-4185-9c1f-5581c8143071 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:29.883032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cc6a7-8841-4185-9c1f-5581c8143071 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:29.883202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cc6a7-8841-4185-9c1f-5581c8143071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:29.900609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-061cc6a7-8841-4185-9c1f-5581c8143071 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:29.901794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-061cc6a7-8841-4185-9c1f-5581c8143071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:29.909686 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:30.076670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869669c-f80b-47f5-a4ce-bd83dbfe6296 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:30.091408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869669c-f80b-47f5-a4ce-bd83dbfe6296 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:30.096776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbf916-3fb4-4c3d-b06f-622ab071f060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:30.097410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbf916-3fb4-4c3d-b06f-622ab071f060 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:30.097690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbf916-3fb4-4c3d-b06f-622ab071f060 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:30.097965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbf916-3fb4-4c3d-b06f-622ab071f060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:30.106311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbf916-3fb4-4c3d-b06f-622ab071f060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:30.107958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbf916-3fb4-4c3d-b06f-622ab071f060 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:30.117862 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 727/1440] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:32.304130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590a7e-2233-412b-9116-3b58fddd9b60 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:32.304700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590a7e-2233-412b-9116-3b58fddd9b60 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:32.304700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590a7e-2233-412b-9116-3b58fddd9b60 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:32.306022 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:32.311705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d01956-8de6-4d96-9007-1d03b210c188 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:32.312131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d01956-8de6-4d96-9007-1d03b210c188 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:32.312260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d01956-8de6-4d96-9007-1d03b210c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:32.330390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f9d01956-8de6-4d96-9007-1d03b210c188 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:32.331896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f9d01956-8de6-4d96-9007-1d03b210c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:32.339857 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:32.382271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590a7e-2233-412b-9116-3b58fddd9b60 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:32.392678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590a7e-2233-412b-9116-3b58fddd9b60 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:32.396196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69148d-52a6-46d0-86af-59bdd5836cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:32.396818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69148d-52a6-46d0-86af-59bdd5836cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:32.397094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69148d-52a6-46d0-86af-59bdd5836cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:32.397360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69148d-52a6-46d0-86af-59bdd5836cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:32.406088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69148d-52a6-46d0-86af-59bdd5836cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:32.407601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69148d-52a6-46d0-86af-59bdd5836cc2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:32.418262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 715/1443] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:34.888771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349139b0-d759-4c55-bfdd-6fa0d5a04fc9 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:34.889289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349139b0-d759-4c55-bfdd-6fa0d5a04fc9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:34.889408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349139b0-d759-4c55-bfdd-6fa0d5a04fc9 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:34.890695 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:34.896021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b2912-9527-45cf-8a14-356383b48785 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:34.896455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b2912-9527-45cf-8a14-356383b48785 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:34.896570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b2912-9527-45cf-8a14-356383b48785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:34.913845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-549b2912-9527-45cf-8a14-356383b48785 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:34.915075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-549b2912-9527-45cf-8a14-356383b48785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:34.922958 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:34.963110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349139b0-d759-4c55-bfdd-6fa0d5a04fc9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:34.973714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349139b0-d759-4c55-bfdd-6fa0d5a04fc9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:34.977257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9773b-f7c5-4541-a420-f13f0c688bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:34.977884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9773b-f7c5-4541-a420-f13f0c688bcf service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:34.978167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9773b-f7c5-4541-a420-f13f0c688bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:34.978445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9773b-f7c5-4541-a420-f13f0c688bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:34.987297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9773b-f7c5-4541-a420-f13f0c688bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:34.988737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9773b-f7c5-4541-a420-f13f0c688bcf service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:34.998581 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 730/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:37.604794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dc0d6-3d92-4962-939f-b29ea898e73a None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:37.605427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dc0d6-3d92-4962-939f-b29ea898e73a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:37.605427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dc0d6-3d92-4962-939f-b29ea898e73a None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:37.606700 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:37.612371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c313715-2e5b-4252-a371-037c599e9d1d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:37.612782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c313715-2e5b-4252-a371-037c599e9d1d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:37.612925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c313715-2e5b-4252-a371-037c599e9d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:37.630555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2c313715-2e5b-4252-a371-037c599e9d1d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:37.631777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2c313715-2e5b-4252-a371-037c599e9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:37.639541 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:37.678735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dc0d6-3d92-4962-939f-b29ea898e73a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:37.689173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dc0d6-3d92-4962-939f-b29ea898e73a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:37.692913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ab7a2-24b6-4d09-a966-d451436c2c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:37.693557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab7a2-24b6-4d09-a966-d451436c2c3e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:37.693840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab7a2-24b6-4d09-a966-d451436c2c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:37.694118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab7a2-24b6-4d09-a966-d451436c2c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:37.703142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ab7a2-24b6-4d09-a966-d451436c2c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:37.704554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ab7a2-24b6-4d09-a966-d451436c2c3e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:37.714392 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 718/1449] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:40.143805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8d5f-0fbd-4ac0-a4e5-a891eeee23e9 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:40.144393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8d5f-0fbd-4ac0-a4e5-a891eeee23e9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:40.144393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8d5f-0fbd-4ac0-a4e5-a891eeee23e9 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:40.145764 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:40.151100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357e22-5fb5-4df2-91e3-ef5545074ca3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:40.151522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357e22-5fb5-4df2-91e3-ef5545074ca3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:40.151710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62357e22-5fb5-4df2-91e3-ef5545074ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:40.168826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-62357e22-5fb5-4df2-91e3-ef5545074ca3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:40.170018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-62357e22-5fb5-4df2-91e3-ef5545074ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:40.178956 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:40.220041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8d5f-0fbd-4ac0-a4e5-a891eeee23e9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:40.231335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8d5f-0fbd-4ac0-a4e5-a891eeee23e9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:40.234829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013fbb9-23c3-4aab-8db5-bebb8c22f1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:40.235454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013fbb9-23c3-4aab-8db5-bebb8c22f1de service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:40.235758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013fbb9-23c3-4aab-8db5-bebb8c22f1de service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:40.236030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013fbb9-23c3-4aab-8db5-bebb8c22f1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:40.245139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013fbb9-23c3-4aab-8db5-bebb8c22f1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:40.246564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013fbb9-23c3-4aab-8db5-bebb8c22f1de service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:40.256285 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 733/1452] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:37:42.608851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a1e88-7ebc-4f35-8747-f4671acf9ec5 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:42.609418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a1e88-7ebc-4f35-8747-f4671acf9ec5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:42.609524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a1e88-7ebc-4f35-8747-f4671acf9ec5 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:42.610917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:42.616318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8ae6-c51f-4abd-80f0-8f04a274ea9a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:42.616733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8ae6-c51f-4abd-80f0-8f04a274ea9a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:42.616889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8ae6-c51f-4abd-80f0-8f04a274ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:42.634544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e77a8ae6-c51f-4abd-80f0-8f04a274ea9a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:42.635768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e77a8ae6-c51f-4abd-80f0-8f04a274ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:42.643471 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:42.682293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a1e88-7ebc-4f35-8747-f4671acf9ec5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:42.694582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a1e88-7ebc-4f35-8747-f4671acf9ec5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:42.698163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910199b-217d-4a30-a7bd-c603b3667967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:42.698821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910199b-217d-4a30-a7bd-c603b3667967 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:42.699109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910199b-217d-4a30-a7bd-c603b3667967 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:42.699382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910199b-217d-4a30-a7bd-c603b3667967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:42.709079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910199b-217d-4a30-a7bd-c603b3667967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:42.710617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910199b-217d-4a30-a7bd-c603b3667967 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:42.719888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 721/1455] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:45.066327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41031c-7cd4-4855-b21b-116ae2fd6ae6 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:45.066880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41031c-7cd4-4855-b21b-116ae2fd6ae6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:45.066880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41031c-7cd4-4855-b21b-116ae2fd6ae6 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:45.068240 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:45.073515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb745a4-d97a-4a92-b0e4-fd059b0483d7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:45.073934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb745a4-d97a-4a92-b0e4-fd059b0483d7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:45.074075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb745a4-d97a-4a92-b0e4-fd059b0483d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:45.092175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2bb745a4-d97a-4a92-b0e4-fd059b0483d7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:45.093379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2bb745a4-d97a-4a92-b0e4-fd059b0483d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:45.101660 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:45.141440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41031c-7cd4-4855-b21b-116ae2fd6ae6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:45.151902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41031c-7cd4-4855-b21b-116ae2fd6ae6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:45.155347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcfbba-5618-4d3a-8c15-3a4d64fb19bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:45.155968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcfbba-5618-4d3a-8c15-3a4d64fb19bc service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:45.156249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcfbba-5618-4d3a-8c15-3a4d64fb19bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:45.156523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcfbba-5618-4d3a-8c15-3a4d64fb19bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:45.165821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcfbba-5618-4d3a-8c15-3a4d64fb19bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:45.167294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcfbba-5618-4d3a-8c15-3a4d64fb19bc service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:45.176969 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 736/1458] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:47.528696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c667-949d-427b-a786-1a5136ef589e None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:47.529267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c667-949d-427b-a786-1a5136ef589e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:47.529267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446c667-949d-427b-a786-1a5136ef589e None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:47.530639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:47.536131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8231-a347-4b9a-89a3-6bbaad50769c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:47.536709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8231-a347-4b9a-89a3-6bbaad50769c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:47.536709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8231-a347-4b9a-89a3-6bbaad50769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:47.557880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-558b8231-a347-4b9a-89a3-6bbaad50769c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:47.559147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-558b8231-a347-4b9a-89a3-6bbaad50769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:47.569278 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:47.607575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c667-949d-427b-a786-1a5136ef589e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:47.618616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446c667-949d-427b-a786-1a5136ef589e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:47.622140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1921d-a7a0-48d2-bff3-28b4162c294f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:47.622837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1921d-a7a0-48d2-bff3-28b4162c294f service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:47.623124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1921d-a7a0-48d2-bff3-28b4162c294f service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:47.623395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1921d-a7a0-48d2-bff3-28b4162c294f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:47.632777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1921d-a7a0-48d2-bff3-28b4162c294f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:47.634217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1921d-a7a0-48d2-bff3-28b4162c294f service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:47.643264 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 724/1461] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:49.990291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b73b-1087-4f1d-b3b7-4c344a6c1f04 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:49.990895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b73b-1087-4f1d-b3b7-4c344a6c1f04 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:49.990895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26b73b-1087-4f1d-b3b7-4c344a6c1f04 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:49.992285 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:49.997472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98c21-d8d2-4f5e-8871-b25c174b809e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:49.997906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98c21-d8d2-4f5e-8871-b25c174b809e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:49.998018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb98c21-d8d2-4f5e-8871-b25c174b809e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:50.015345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ebb98c21-d8d2-4f5e-8871-b25c174b809e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:50.016534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ebb98c21-d8d2-4f5e-8871-b25c174b809e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:50.024793 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:50.062664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26b73b-1087-4f1d-b3b7-4c344a6c1f04 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:50.073586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26b73b-1087-4f1d-b3b7-4c344a6c1f04 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:50.077176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ee0f0-9899-412d-b978-6721cecc1066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:50.077804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee0f0-9899-412d-b978-6721cecc1066 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:50.078088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee0f0-9899-412d-b978-6721cecc1066 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:50.078364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee0f0-9899-412d-b978-6721cecc1066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:50.087912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee0f0-9899-412d-b978-6721cecc1066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:50.089348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ee0f0-9899-412d-b978-6721cecc1066 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:50.098576 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 739/1464] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:52.453701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ac9e-3506-49bd-a10c-8d3c499400ef None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:52.454231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ac9e-3506-49bd-a10c-8d3c499400ef None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:52.454231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88ac9e-3506-49bd-a10c-8d3c499400ef None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:52.455561 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:52.461244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99666fd-e404-4a83-9a63-d5c3f5f6f87a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:52.461665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99666fd-e404-4a83-9a63-d5c3f5f6f87a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:52.461799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99666fd-e404-4a83-9a63-d5c3f5f6f87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:52.479449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f99666fd-e404-4a83-9a63-d5c3f5f6f87a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:52.480627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f99666fd-e404-4a83-9a63-d5c3f5f6f87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:52.488306 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:52.525555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88ac9e-3506-49bd-a10c-8d3c499400ef None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:52.536689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88ac9e-3506-49bd-a10c-8d3c499400ef None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:52.540260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d8e2d-9fd1-407f-8ce0-8c27a786a666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:52.540885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d8e2d-9fd1-407f-8ce0-8c27a786a666 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:52.541164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d8e2d-9fd1-407f-8ce0-8c27a786a666 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:52.541436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d8e2d-9fd1-407f-8ce0-8c27a786a666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:52.550076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d8e2d-9fd1-407f-8ce0-8c27a786a666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:52.552079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d8e2d-9fd1-407f-8ce0-8c27a786a666 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:52.561176 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 727/1467] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:37:54.858507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edace11-8899-43ae-af6a-43b335d93b13 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:54.859054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edace11-8899-43ae-af6a-43b335d93b13 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:54.859054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edace11-8899-43ae-af6a-43b335d93b13 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:54.860490 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:37:54.865823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342188a-d261-4a4b-a1b8-0e47499433ad None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:54.866257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342188a-d261-4a4b-a1b8-0e47499433ad None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:54.866357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342188a-d261-4a4b-a1b8-0e47499433ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:54.883876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a342188a-d261-4a4b-a1b8-0e47499433ad None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:37:54.885508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a342188a-d261-4a4b-a1b8-0e47499433ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:37:54.903680 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:37:54.942121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edace11-8899-43ae-af6a-43b335d93b13 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:37:54.953171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edace11-8899-43ae-af6a-43b335d93b13 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:37:54.958142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afd8eb-8ec5-4a17-9e03-e0eaba0c3071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:37:54.958805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd8eb-8ec5-4a17-9e03-e0eaba0c3071 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:37:54.959096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd8eb-8ec5-4a17-9e03-e0eaba0c3071 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:37:54.959407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afd8eb-8ec5-4a17-9e03-e0eaba0c3071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:37:54.968092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd8eb-8ec5-4a17-9e03-e0eaba0c3071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:37:54.969538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5afd8eb-8ec5-4a17-9e03-e0eaba0c3071 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:37:54.978746 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 742/1470] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:38:29.831981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60198-47ae-4677-b4e4-28555a158e2d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:29.832583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60198-47ae-4677-b4e4-28555a158e2d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:29.832583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca60198-47ae-4677-b4e4-28555a158e2d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:29.833911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 729/1471] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:29.839316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe4438-26cb-4ffd-9281-777e1a8e2712 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:29.839772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe4438-26cb-4ffd-9281-777e1a8e2712 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:29.839888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe4438-26cb-4ffd-9281-777e1a8e2712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:29.857045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-defe4438-26cb-4ffd-9281-777e1a8e2712 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:29.858236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-defe4438-26cb-4ffd-9281-777e1a8e2712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:29.866087 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 743/1472] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:38:29.914231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ee46-a51b-4c11-9d47-7eca17cb2128 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:29.914540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ee46-a51b-4c11-9d47-7eca17cb2128 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:29.914848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275ee46-a51b-4c11-9d47-7eca17cb2128 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:29.916318 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 730/1473] 10.222.0.32 () {54 vars in 962 bytes} [Sat May 7 21:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:29.921350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e117fb-b1ac-4870-ac33-c04ffa3fbe35 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:29.921643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e117fb-b1ac-4870-ac33-c04ffa3fbe35 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:29.921924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e117fb-b1ac-4870-ac33-c04ffa3fbe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:29.940865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-52e117fb-b1ac-4870-ac33-c04ffa3fbe35 None None] MFA Rules not processed for user `0275c43e4d7744b4a556c30662b7e84f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:29.942080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-52e117fb-b1ac-4870-ac33-c04ffa3fbe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:29.949009 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 744/1474] 10.222.0.32 () {58 vars in 1059 bytes} [Sat May 7 21:38:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:38:29.957428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275ee46-a51b-4c11-9d47-7eca17cb2128 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:38:29.967875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275ee46-a51b-4c11-9d47-7eca17cb2128 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:38:29.971333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bd1a3-6502-4511-8b91-ed4634d5d888 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:38:29.972080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd1a3-6502-4511-8b91-ed4634d5d888 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:29.972364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd1a3-6502-4511-8b91-ed4634d5d888 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:29.972639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bd1a3-6502-4511-8b91-ed4634d5d888 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:29.981181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bd1a3-6502-4511-8b91-ed4634d5d888 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:38:29.982679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bd1a3-6502-4511-8b91-ed4634d5d888 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:38:29.991900 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 731/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:38:32.402754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96e51-4ca2-4447-bb27-bb827f942984 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:32.403441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96e51-4ca2-4447-bb27-bb827f942984 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:32.403441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa96e51-4ca2-4447-bb27-bb827f942984 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:32.404706 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 745/1476] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:32.410380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67b5b4-e554-413a-b97b-a576e94c767b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:32.410808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67b5b4-e554-413a-b97b-a576e94c767b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:32.410956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67b5b4-e554-413a-b97b-a576e94c767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:32.428511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7b67b5b4-e554-413a-b97b-a576e94c767b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:32.429692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b67b5b4-e554-413a-b97b-a576e94c767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:32.437322 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 732/1477] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:38:32.462147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa96e51-4ca2-4447-bb27-bb827f942984 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:38:32.474797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa96e51-4ca2-4447-bb27-bb827f942984 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:38:32.479244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45807-101a-47f0-8172-046eadb121c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:38:32.479878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45807-101a-47f0-8172-046eadb121c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:32.480151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45807-101a-47f0-8172-046eadb121c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:32.480425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45807-101a-47f0-8172-046eadb121c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:32.481143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45807-101a-47f0-8172-046eadb121c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:38:32.482922 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-ebf45807-101a-47f0-8172-046eadb121c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:38:32.482922 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:38:32.482922 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:38:32.484081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45807-101a-47f0-8172-046eadb121c2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:38:32.502275 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 746/1478] 10.222.0.32 () {56 vars in 1108 bytes} [Sat May 7 21:38:32 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:38:34.838925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c966b-ab86-4f69-b9c2-0a4fa05c61f0 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:34.839452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c966b-ab86-4f69-b9c2-0a4fa05c61f0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:34.839452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c966b-ab86-4f69-b9c2-0a4fa05c61f0 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:34.840837 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 733/1479] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:34.845980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176398be-eeb0-46ec-a1bf-ab7dfbb62b61 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:34.846401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176398be-eeb0-46ec-a1bf-ab7dfbb62b61 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:34.846594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176398be-eeb0-46ec-a1bf-ab7dfbb62b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:34.865394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-176398be-eeb0-46ec-a1bf-ab7dfbb62b61 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:34.866596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-176398be-eeb0-46ec-a1bf-ab7dfbb62b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:34.874287 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 747/1480] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:38:34.916523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c966b-ab86-4f69-b9c2-0a4fa05c61f0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:38:34.931324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c966b-ab86-4f69-b9c2-0a4fa05c61f0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:38:34.936890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaca9a-0cd3-4707-8dbe-9069fdceb8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:38:34.937528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaca9a-0cd3-4707-8dbe-9069fdceb8e8 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:34.937818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaca9a-0cd3-4707-8dbe-9069fdceb8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:34.938095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaca9a-0cd3-4707-8dbe-9069fdceb8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:34.946652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaca9a-0cd3-4707-8dbe-9069fdceb8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:38:34.948311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaca9a-0cd3-4707-8dbe-9069fdceb8e8 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:38:34.957829 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 734/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:38:37.464821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd00f95-6b57-44e6-8e18-e803e17bab52 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:37.465345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd00f95-6b57-44e6-8e18-e803e17bab52 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:37.465345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd00f95-6b57-44e6-8e18-e803e17bab52 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:37.466684 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 748/1482] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:37.471868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429ce6-1365-48c8-a7e3-c7ad61e461fc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:37.472312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429ce6-1365-48c8-a7e3-c7ad61e461fc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:37.472413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429ce6-1365-48c8-a7e3-c7ad61e461fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:37.489533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-30429ce6-1365-48c8-a7e3-c7ad61e461fc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:37.490717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30429ce6-1365-48c8-a7e3-c7ad61e461fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:37.498439 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 735/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:38:37.535702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd00f95-6b57-44e6-8e18-e803e17bab52 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:38:37.550448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd00f95-6b57-44e6-8e18-e803e17bab52 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:38:37.554014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2e57e-ce27-44dc-8e7f-04c94df82aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:38:37.554650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e57e-ce27-44dc-8e7f-04c94df82aad service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:37.554972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e57e-ce27-44dc-8e7f-04c94df82aad service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:37.555250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2e57e-ce27-44dc-8e7f-04c94df82aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:37.569424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2e57e-ce27-44dc-8e7f-04c94df82aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:38:37.570997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2e57e-ce27-44dc-8e7f-04c94df82aad service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:38:37.585909 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 749/1484] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:38:39.926048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b89f-2207-4cc7-a496-f9fbcc6e24a0 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:39.926663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b89f-2207-4cc7-a496-f9fbcc6e24a0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:39.926663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5b89f-2207-4cc7-a496-f9fbcc6e24a0 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:39.928005 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 736/1485] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:39.933253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7c09-2e82-4620-984b-db301d5bd013 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:39.933716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7c09-2e82-4620-984b-db301d5bd013 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:39.933825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a7c09-2e82-4620-984b-db301d5bd013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:39.952423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-db3a7c09-2e82-4620-984b-db301d5bd013 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:39.953651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-db3a7c09-2e82-4620-984b-db301d5bd013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:39.962967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 750/1486] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:38:40.002102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b89f-2207-4cc7-a496-f9fbcc6e24a0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:38:40.004393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-add5b89f-2207-4cc7-a496-f9fbcc6e24a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:40.016964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5b89f-2207-4cc7-a496-f9fbcc6e24a0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:38:40.020534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a6bcd-1064-4009-8a61-45f9242f7700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:38:40.021167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a6bcd-1064-4009-8a61-45f9242f7700 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:40.021449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a6bcd-1064-4009-8a61-45f9242f7700 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:40.021725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a6bcd-1064-4009-8a61-45f9242f7700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:40.030377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a6bcd-1064-4009-8a61-45f9242f7700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:38:40.031834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a6bcd-1064-4009-8a61-45f9242f7700 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:38:40.041050 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 737/1487] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:38:42.505064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12a4d6-6242-4e64-9254-2105c1716034 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:42.505614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12a4d6-6242-4e64-9254-2105c1716034 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:42.505614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12a4d6-6242-4e64-9254-2105c1716034 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:42.507023 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 751/1488] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:42.512372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524c0f9-603c-442e-bfbe-2e2388c8b1ce None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:42.512779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524c0f9-603c-442e-bfbe-2e2388c8b1ce None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:42.512936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524c0f9-603c-442e-bfbe-2e2388c8b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:42.530561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3524c0f9-603c-442e-bfbe-2e2388c8b1ce None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:42.531824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3524c0f9-603c-442e-bfbe-2e2388c8b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:42.552873 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 738/1489] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:38:42.599494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12a4d6-6242-4e64-9254-2105c1716034 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:38:42.610241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12a4d6-6242-4e64-9254-2105c1716034 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:38:42.613761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e3439-d974-4550-be6f-2bd174be83ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:38:42.614397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e3439-d974-4550-be6f-2bd174be83ca service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:42.614678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e3439-d974-4550-be6f-2bd174be83ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:42.614992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e3439-d974-4550-be6f-2bd174be83ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:42.623539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e3439-d974-4550-be6f-2bd174be83ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:38:42.624966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e3439-d974-4550-be6f-2bd174be83ca service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:38:42.634557 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 752/1490] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:38:45.095513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481d75b-e11d-4550-83e5-12515bd38120 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:45.096069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481d75b-e11d-4550-83e5-12515bd38120 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:45.096069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481d75b-e11d-4550-83e5-12515bd38120 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:45.097365 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 739/1491] 10.222.0.32 () {54 vars in 926 bytes} [Sat May 7 21:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:38:45.102682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eeed5-3559-4f1b-9e18-7fc5b5d5e4f9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:45.103130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eeed5-3559-4f1b-9e18-7fc5b5d5e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:45.103260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259eeed5-3559-4f1b-9e18-7fc5b5d5e4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:45.120329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-259eeed5-3559-4f1b-9e18-7fc5b5d5e4f9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:38:45.121525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-259eeed5-3559-4f1b-9e18-7fc5b5d5e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:38:45.129894 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 753/1492] 10.222.0.32 () {58 vars in 1023 bytes} [Sat May 7 21:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:38:45.168807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481d75b-e11d-4550-83e5-12515bd38120 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:38:45.179377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481d75b-e11d-4550-83e5-12515bd38120 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:38:45.182886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa291-6de1-45c3-9a14-513db9e10c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:38:45.183520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa291-6de1-45c3-9a14-513db9e10c9a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:38:45.183803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa291-6de1-45c3-9a14-513db9e10c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:38:45.184107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa291-6de1-45c3-9a14-513db9e10c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:38:45.193351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa291-6de1-45c3-9a14-513db9e10c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:38:45.194799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa291-6de1-45c3-9a14-513db9e10c9a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:38:45.204173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 740/1493] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:40:19.841996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fdfc6-482f-46b8-a6bf-d3e525cdfe2f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:19.842641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fdfc6-482f-46b8-a6bf-d3e525cdfe2f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:19.842641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fdfc6-482f-46b8-a6bf-d3e525cdfe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:19.862342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2b2fdfc6-482f-46b8-a6bf-d3e525cdfe2f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:40:19.863603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b2fdfc6-482f-46b8-a6bf-d3e525cdfe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:40:19.871304 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 754/1494] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:40:19.880395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc429-5cd6-4875-b128-c4e9fd6d72f2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:19.880899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc429-5cd6-4875-b128-c4e9fd6d72f2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:19.881017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dbc429-5cd6-4875-b128-c4e9fd6d72f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:19.898906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-16dbc429-5cd6-4875-b128-c4e9fd6d72f2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:40:19.900092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-16dbc429-5cd6-4875-b128-c4e9fd6d72f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:40:19.908507 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 741/1495] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:40:19.912907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fdfc6-482f-46b8-a6bf-d3e525cdfe2f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:19.922323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fdfc6-482f-46b8-a6bf-d3e525cdfe2f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:19.926794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:19.927442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:19.927717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:19.928003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:19.928723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:40:19.929028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:19.930036 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:19.930036 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:40:19.930036 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:40:19.930968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:19.942067 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 755/1496] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:40:19.949689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbc429-5cd6-4875-b128-c4e9fd6d72f2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:19.959264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dbc429-5cd6-4875-b128-c4e9fd6d72f2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:19.963911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:19.964551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:19.964828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:19.965095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:19.965777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:19.967572 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:19.967572 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:40:19.967572 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:40:19.969604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.002325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 742/1497] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:40:19 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:40:20.006549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:20.016893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e7dc9-87ea-43c0-b020-d2f70ceeea81 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:20.070096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:20.070756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.071071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.071347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.072033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:20.073041 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:20.073041 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:40:20.073041 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:40:20.074248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.093667 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 756/1498] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:40:20 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:40:20.098153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:20.108060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f44bc-c723-4b43-8966-65de8d1e1b18 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:20.112726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:20.113375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.113666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.113940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.114664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:20.115712 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:20.115712 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:40:20.115712 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:40:20.116597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.129822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 743/1499] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:40:20.133687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:20.144112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6407a0f-54b5-4b39-b7a4-310c349dad1a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:20.148592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea1a42f-189d-46ce-be95-2d0db19bff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:20.149237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1a42f-189d-46ce-be95-2d0db19bff89 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.149521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1a42f-189d-46ce-be95-2d0db19bff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.149799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1a42f-189d-46ce-be95-2d0db19bff89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.150516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1a42f-189d-46ce-be95-2d0db19bff89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:20.151576 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-cea1a42f-189d-46ce-be95-2d0db19bff89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:20.151576 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:40:20.151576 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:40:20.152463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea1a42f-189d-46ce-be95-2d0db19bff89 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.165368 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 757/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:40:20.169393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:20.178940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de6b1-2573-43cc-8783-7c361251c297 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:20.183348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1693fad-8abc-4757-8935-ada6eb88daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:20.184213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693fad-8abc-4757-8935-ada6eb88daf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.184495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693fad-8abc-4757-8935-ada6eb88daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.184767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1693fad-8abc-4757-8935-ada6eb88daf6 admin admin] PATH_INFO: `/v3/projects/a113725432824641b4ff52188066a66a/users/6aabd2a9e8264d659b93f68f57f0290e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.199395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1693fad-8abc-4757-8935-ada6eb88daf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a113725432824641b4ff52188066a66a, user_id=6aabd2a9e8264d659b93f68f57f0290e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:20.200422 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-d1693fad-8abc-4757-8935-ada6eb88daf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:20.200422 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:40:20.200422 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:40:20.202361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1693fad-8abc-4757-8935-ada6eb88daf6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.216222 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 744/1501] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:40:20 2022] PUT /identity/v3/projects/a113725432824641b4ff52188066a66a/users/6aabd2a9e8264d659b93f68f57f0290e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:40:20.227348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5885f-19f3-4e70-a90e-780d25168350 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.227644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5885f-19f3-4e70-a90e-780d25168350 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.227928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5885f-19f3-4e70-a90e-780d25168350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.253558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-21f5885f-19f3-4e70-a90e-780d25168350 None None] MFA Rules not processed for user `6aabd2a9e8264d659b93f68f57f0290e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:40:20.254760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21f5885f-19f3-4e70-a90e-780d25168350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:40:20.315487 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 758/1502] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:40:20.329777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7219-fce3-4162-bffd-e59099d2ab52 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.330072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7219-fce3-4162-bffd-e59099d2ab52 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.330350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7219-fce3-4162-bffd-e59099d2ab52 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.331743 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 745/1503] 10.222.0.32 () {54 vars in 963 bytes} [Sat May 7 21:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:40:20.336592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b50999-5a15-4e66-bd8f-caf6736607e1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.336879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b50999-5a15-4e66-bd8f-caf6736607e1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.337158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b50999-5a15-4e66-bd8f-caf6736607e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.354707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-34b50999-5a15-4e66-bd8f-caf6736607e1 None None] MFA Rules not processed for user `cf4eae7f407e44ecbe525049b262e3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:40:20.356030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-34b50999-5a15-4e66-bd8f-caf6736607e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:40:20.404500 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 759/1504] 10.222.0.32 () {58 vars in 1060 bytes} [Sat May 7 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:40:20.411868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b7219-fce3-4162-bffd-e59099d2ab52 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:20.422319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b7219-fce3-4162-bffd-e59099d2ab52 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:20.425810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:20.426466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.426765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.427062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.435066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:20.436490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.445538 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 746/1505] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:40:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:40:20.487366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73e824-ca72-4662-9e60-4ef2496e0124 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.487662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73e824-ca72-4662-9e60-4ef2496e0124 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.487943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73e824-ca72-4662-9e60-4ef2496e0124 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.489234 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 760/1506] 10.222.0.32 () {52 vars in 829 bytes} [Sat May 7 21:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:40:20.492755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:20.551458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045ccb1-1895-45e6-bd13-73319f649cb9 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:20.555939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:20.556792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.557075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.557348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] PATH_INFO: `/v3/users/6aabd2a9e8264d659b93f68f57f0290e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.558519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aabd2a9e8264d659b93f68f57f0290e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:20.559568 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:20.559568 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:40:20.559568 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:40:20.560794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.621551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aabd2a9e8264d659b93f68f57f0290e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:20.634455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aabd2a9e8264d659b93f68f57f0290e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:20.635151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aabd2a9e8264d659b93f68f57f0290e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:20.635879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aabd2a9e8264d659b93f68f57f0290e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:20.645231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aabd2a9e8264d659b93f68f57f0290e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:20.668550 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 747/1507] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:40:20 2022] DELETE /identity/v3/users/6aabd2a9e8264d659b93f68f57f0290e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:40:20.673083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.673374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.673652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.690290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:40:20.691507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:40:20.753441 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 761/1508] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:40:20.762887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:20.764283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:40:20.820426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdac939-8984-40ed-9878-eb0703e3df33 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:20.824016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397ff5b-18a6-4c59-8b17-e0f55d899439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:20.824657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397ff5b-18a6-4c59-8b17-e0f55d899439 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:20.824943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397ff5b-18a6-4c59-8b17-e0f55d899439 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:20.825222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397ff5b-18a6-4c59-8b17-e0f55d899439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:20.834732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397ff5b-18a6-4c59-8b17-e0f55d899439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:20.836202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397ff5b-18a6-4c59-8b17-e0f55d899439 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:20.845274 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 748/1509] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:40:21.160848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:40:21.162920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:40:21.175368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa244d-8bd4-45c8-a2e8-0c3e680b873f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:40:21.180454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:40:21.181463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:40:21.181873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:40:21.182275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] PATH_INFO: `/v3/projects/a113725432824641b4ff52188066a66a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:40:21.183667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a113725432824641b4ff52188066a66a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:40:21.184749 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:40:21.184749 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:40:21.184749 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:40:21.186117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:40:21.246595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a113725432824641b4ff52188066a66a', 'request_id': 'req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:21.260013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a113725432824641b4ff52188066a66a', 'request_id': 'req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:21.269446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a113725432824641b4ff52188066a66a', 'request_id': 'req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:21.281865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] The token cache is being invalidate because project a113725432824641b4ff52188066a66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:40:21.282152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:21.282890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c3f85dff-dc5d-4c73-9883-3a3bd5a71ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:40:21.284533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 762/1510] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:40:21 2022] DELETE /identity/v3/projects/a113725432824641b4ff52188066a66a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:43:23.194607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c051cf4-c41a-445a-9570-239d2d188ea8 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:23.195244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c051cf4-c41a-445a-9570-239d2d188ea8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:23.195244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c051cf4-c41a-445a-9570-239d2d188ea8 None None] PATH_INFO: `/v3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:23.196539 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 749/1511] 10.222.0.55 () {54 vars in 925 bytes} [Sat May 7 21:43:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:43:23.202589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8ebd8-89c4-4e7e-80b7-d49399975d0c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:23.203049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8ebd8-89c4-4e7e-80b7-d49399975d0c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:23.203167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8ebd8-89c4-4e7e-80b7-d49399975d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:23.221632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-04d8ebd8-89c4-4e7e-80b7-d49399975d0c None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:43:23.222756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-04d8ebd8-89c4-4e7e-80b7-d49399975d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:43:23.282192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 763/1512] 10.222.0.55 () {58 vars in 1015 bytes} [Sat May 7 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:43:25.586024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145b33d-939c-4c71-9835-c5ecd32f05ec None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:25.586568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145b33d-939c-4c71-9835-c5ecd32f05ec None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:25.586676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145b33d-939c-4c71-9835-c5ecd32f05ec None None] PATH_INFO: `/v3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:25.587955 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 750/1513] 10.222.0.59 () {54 vars in 925 bytes} [Sat May 7 21:43:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:43:25.593961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301eff4-1832-44f6-8ed9-91effb00a744 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:25.594406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301eff4-1832-44f6-8ed9-91effb00a744 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:25.594556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301eff4-1832-44f6-8ed9-91effb00a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:25.612996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a301eff4-1832-44f6-8ed9-91effb00a744 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:43:25.614208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a301eff4-1832-44f6-8ed9-91effb00a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:43:25.622737 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 764/1514] 10.222.0.59 () {58 vars in 1015 bytes} [Sat May 7 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:43:27.199016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee751ab2-0f31-4cfa-b157-c4244adab672 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:27.199538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee751ab2-0f31-4cfa-b157-c4244adab672 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:27.200138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee751ab2-0f31-4cfa-b157-c4244adab672 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:27.201232 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 751/1515] 10.222.0.32 () {54 vars in 960 bytes} [Sat May 7 21:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:43:27.206703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a203-6aba-4ca1-99c3-4d3002bb6de9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:27.207179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a203-6aba-4ca1-99c3-4d3002bb6de9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:27.207280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a203-6aba-4ca1-99c3-4d3002bb6de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:27.225231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8de5a203-6aba-4ca1-99c3-4d3002bb6de9 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:43:27.226414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8de5a203-6aba-4ca1-99c3-4d3002bb6de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:43:27.234758 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 765/1516] 10.222.0.32 () {58 vars in 1057 bytes} [Sat May 7 21:43:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:43:27.242042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee751ab2-0f31-4cfa-b157-c4244adab672 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:43:27.256210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee751ab2-0f31-4cfa-b157-c4244adab672 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:43:27.261186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012ea7-fef9-4ba1-bcb6-038fb3747737 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:43:27.261828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012ea7-fef9-4ba1-bcb6-038fb3747737 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:27.262112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012ea7-fef9-4ba1-bcb6-038fb3747737 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:27.262388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012ea7-fef9-4ba1-bcb6-038fb3747737 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:27.271736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8012ea7-fef9-4ba1-bcb6-038fb3747737 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:43:27.273521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8012ea7-fef9-4ba1-bcb6-038fb3747737 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:43:27.284015 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 752/1517] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:43:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:43:29.159968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6c8e-c596-458b-ae3e-4d32862a8bfa None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:29.160420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6c8e-c596-458b-ae3e-4d32862a8bfa None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:29.160530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad6c8e-c596-458b-ae3e-4d32862a8bfa None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:29.161881 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 766/1518] 10.222.0.32 () {54 vars in 960 bytes} [Sat May 7 21:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:43:29.167207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b35dc2-c17d-48c5-8b85-d6ccdbdca5f6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:29.167644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b35dc2-c17d-48c5-8b85-d6ccdbdca5f6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:29.167762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b35dc2-c17d-48c5-8b85-d6ccdbdca5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:29.185884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d9b35dc2-c17d-48c5-8b85-d6ccdbdca5f6 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:43:29.187160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9b35dc2-c17d-48c5-8b85-d6ccdbdca5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:43:29.195770 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 753/1519] 10.222.0.32 () {58 vars in 1057 bytes} [Sat May 7 21:43:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:43:29.203631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6c8e-c596-458b-ae3e-4d32862a8bfa None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:43:29.216770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad6c8e-c596-458b-ae3e-4d32862a8bfa None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:43:29.222247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf1427-12eb-4e57-810e-c35d6bc03d81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:43:29.222913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1427-12eb-4e57-810e-c35d6bc03d81 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:29.223201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1427-12eb-4e57-810e-c35d6bc03d81 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:29.223476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1427-12eb-4e57-810e-c35d6bc03d81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:29.231579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf1427-12eb-4e57-810e-c35d6bc03d81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:43:29.233163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf1427-12eb-4e57-810e-c35d6bc03d81 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:43:29.243126 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 767/1520] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:43:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:43:58.936149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155578e-6a08-4054-a768-0a544658bcee None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:58.936744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155578e-6a08-4054-a768-0a544658bcee None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:58.936900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155578e-6a08-4054-a768-0a544658bcee None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:58.938278 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 754/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:43:58.943364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e635c-6a72-4048-86ca-e4842626cdf4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:58.943812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e635c-6a72-4048-86ca-e4842626cdf4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:58.943948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e635c-6a72-4048-86ca-e4842626cdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:58.963377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a93e635c-6a72-4048-86ca-e4842626cdf4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:43:58.964597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a93e635c-6a72-4048-86ca-e4842626cdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:43:59.022763 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 768/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:43:59.197131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155578e-6a08-4054-a768-0a544658bcee None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:43:59.198892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b155578e-6a08-4054-a768-0a544658bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:43:59.271028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155578e-6a08-4054-a768-0a544658bcee None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:43:59.276448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8071f2-300f-4d5f-aedb-541869dcd2ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:43:59.277090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8071f2-300f-4d5f-aedb-541869dcd2ca service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:43:59.277376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8071f2-300f-4d5f-aedb-541869dcd2ca service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:43:59.277654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8071f2-300f-4d5f-aedb-541869dcd2ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:43:59.285497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8071f2-300f-4d5f-aedb-541869dcd2ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:43:59.287634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8071f2-300f-4d5f-aedb-541869dcd2ca service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:43:59.296717 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 755/1523] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:44:00.203608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb6ca-60ec-4777-b5eb-b9c79680e7d6 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:00.204040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb6ca-60ec-4777-b5eb-b9c79680e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:00.204139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb6ca-60ec-4777-b5eb-b9c79680e7d6 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:00.205515 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 769/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 7 21:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:44:00.210244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84794e38-e06e-4125-bd61-7f7338a678f7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:00.210642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84794e38-e06e-4125-bd61-7f7338a678f7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:00.210812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84794e38-e06e-4125-bd61-7f7338a678f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:00.228671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-84794e38-e06e-4125-bd61-7f7338a678f7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:44:00.229800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-84794e38-e06e-4125-bd61-7f7338a678f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:44:00.237423 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 756/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 7 21:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:44:00.397441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fb6ca-60ec-4777-b5eb-b9c79680e7d6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:44:00.411538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fb6ca-60ec-4777-b5eb-b9c79680e7d6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:44:00.416903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1a7a-b820-4349-bc64-f316935148ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:44:00.417526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1a7a-b820-4349-bc64-f316935148ea service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:00.417807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1a7a-b820-4349-bc64-f316935148ea service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:00.418084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1a7a-b820-4349-bc64-f316935148ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:00.425809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1a7a-b820-4349-bc64-f316935148ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:44:00.427946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1a7a-b820-4349-bc64-f316935148ea service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:44:00.436976 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 770/1526] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:44:04.410587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9827ce-d8cc-4ab4-a3f9-1abfc7b2edf0 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:04.411190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9827ce-d8cc-4ab4-a3f9-1abfc7b2edf0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:04.411190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9827ce-d8cc-4ab4-a3f9-1abfc7b2edf0 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:04.413141 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 757/1527] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:44:04.418561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951f35-f656-406d-ad8c-a3d790384b90 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:04.419038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951f35-f656-406d-ad8c-a3d790384b90 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:04.419146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75951f35-f656-406d-ad8c-a3d790384b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:04.437198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-75951f35-f656-406d-ad8c-a3d790384b90 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:44:04.438387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-75951f35-f656-406d-ad8c-a3d790384b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:44:04.446185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 771/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:44:04.483923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9827ce-d8cc-4ab4-a3f9-1abfc7b2edf0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:44:04.485588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7d9827ce-d8cc-4ab4-a3f9-1abfc7b2edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:44:04.539270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9827ce-d8cc-4ab4-a3f9-1abfc7b2edf0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:44:04.542731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448942c3-bbdf-44ba-9159-615860f72f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:44:04.543389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448942c3-bbdf-44ba-9159-615860f72f1c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:04.543665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448942c3-bbdf-44ba-9159-615860f72f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:04.543934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448942c3-bbdf-44ba-9159-615860f72f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:04.553006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448942c3-bbdf-44ba-9159-615860f72f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:44:04.554416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448942c3-bbdf-44ba-9159-615860f72f1c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:44:04.563392 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 758/1529] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:44:06.865842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93f6a-b182-4df0-8da5-02d924b3cf7a None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:06.866415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93f6a-b182-4df0-8da5-02d924b3cf7a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:06.866415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d93f6a-b182-4df0-8da5-02d924b3cf7a None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:06.867817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 772/1530] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 7 21:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:44:06.873015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27c34-25ed-499d-bb07-4e02b2a8a193 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:06.873428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27c34-25ed-499d-bb07-4e02b2a8a193 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:06.873574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27c34-25ed-499d-bb07-4e02b2a8a193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:06.891110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b3e27c34-25ed-499d-bb07-4e02b2a8a193 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:44:06.892312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b3e27c34-25ed-499d-bb07-4e02b2a8a193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:44:06.899970 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 759/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 7 21:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:44:06.937353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d93f6a-b182-4df0-8da5-02d924b3cf7a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:44:06.939037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-86d93f6a-b182-4df0-8da5-02d924b3cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:44:06.952307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d93f6a-b182-4df0-8da5-02d924b3cf7a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:44:06.955961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ae478-9a24-482b-8820-20afb452c87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:44:06.956596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae478-9a24-482b-8820-20afb452c87b service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:06.956882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae478-9a24-482b-8820-20afb452c87b service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:06.957162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ae478-9a24-482b-8820-20afb452c87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:06.965920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ae478-9a24-482b-8820-20afb452c87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:44:06.967377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ae478-9a24-482b-8820-20afb452c87b service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:44:06.977464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 773/1532] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:44:55.913797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf94745-cb75-4ead-a727-3222ce807450 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:55.914403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf94745-cb75-4ead-a727-3222ce807450 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:55.914403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf94745-cb75-4ead-a727-3222ce807450 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:55.915767 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 760/1533] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:44:55.921011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecbc12-e775-40bf-a923-83d7f2f41ad8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:44:55.921492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecbc12-e775-40bf-a923-83d7f2f41ad8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:44:55.921744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecbc12-e775-40bf-a923-83d7f2f41ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:44:55.939155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-08ecbc12-e775-40bf-a923-83d7f2f41ad8 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:44:55.940399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-08ecbc12-e775-40bf-a923-83d7f2f41ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:44:55.948655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 774/1534] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.272988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40612-d7af-4da0-b559-f8141ef33ee2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.273552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40612-d7af-4da0-b559-f8141ef33ee2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.273552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40612-d7af-4da0-b559-f8141ef33ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.294808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-92b40612-d7af-4da0-b559-f8141ef33ee2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:34.296026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-92b40612-d7af-4da0-b559-f8141ef33ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:34.310694 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 761/1535] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.326075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8633-5190-47ca-bc39-c46e333713f0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.327102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8633-5190-47ca-bc39-c46e333713f0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.327652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8633-5190-47ca-bc39-c46e333713f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.356538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2aae8633-5190-47ca-bc39-c46e333713f0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:34.357985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2aae8633-5190-47ca-bc39-c46e333713f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:34.372252 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 775/1536] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.376928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b40612-d7af-4da0-b559-f8141ef33ee2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:34.393994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b40612-d7af-4da0-b559-f8141ef33ee2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:34.400240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:34.400960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.401244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.402535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.402535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:34.402701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:34.403741 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:34.403741 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:45:34.403741 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:45:34.404643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27469fe5-ce37-4270-8c6e-48c1e32461b0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:34.421989 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 762/1537] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:34.431389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8633-5190-47ca-bc39-c46e333713f0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:34.442721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e751-4a3f-4929-9c25-3abc5898659c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.443031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e751-4a3f-4929-9c25-3abc5898659c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.443306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e751-4a3f-4929-9c25-3abc5898659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.446610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8633-5190-47ca-bc39-c46e333713f0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:34.455349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:34.456107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.456507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.456782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.457541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:34.458578 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:34.458578 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:45:34.458578 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:45:34.459838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:34.485229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8272e751-4a3f-4929-9c25-3abc5898659c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:34.489425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8272e751-4a3f-4929-9c25-3abc5898659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:34.506259 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 763/1538] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.520614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0b75-7fbe-4424-8c09-b9536d2beaec None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.520931 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 776/1539] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:34.521034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0b75-7fbe-4424-8c09-b9536d2beaec None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.521188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec0b75-7fbe-4424-8c09-b9536d2beaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.525432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:34.560311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c7ec0b75-7fbe-4424-8c09-b9536d2beaec None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:34.561558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c7ec0b75-7fbe-4424-8c09-b9536d2beaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:34.679627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bc685-98b3-4e89-9e7e-34b6dc28fb7b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:34.689361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc5ba2-e23c-4d8a-ae1f-bfd771afb4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:34.690051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5ba2-e23c-4d8a-ae1f-bfd771afb4da admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.690337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5ba2-e23c-4d8a-ae1f-bfd771afb4da admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.690616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5ba2-e23c-4d8a-ae1f-bfd771afb4da admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.691355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc5ba2-e23c-4d8a-ae1f-bfd771afb4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:34.693942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc5ba2-e23c-4d8a-ae1f-bfd771afb4da admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:34.728209 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 764/1540] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.733993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0b75-7fbe-4424-8c09-b9536d2beaec None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:34.747821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec0b75-7fbe-4424-8c09-b9536d2beaec None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:34.757157 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 777/1541] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/users => generated 291 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:45:34.758470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6205f-f30a-4b9d-9eaf-4ef83d17db55 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.758764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6205f-f30a-4b9d-9eaf-4ef83d17db55 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.759069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6205f-f30a-4b9d-9eaf-4ef83d17db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.762810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:34.763596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.763873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.764231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.765100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:34.765409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:34.767630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:34.786052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e8e6205f-f30a-4b9d-9eaf-4ef83d17db55 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:34.787533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e8e6205f-f30a-4b9d-9eaf-4ef83d17db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:34.792419 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 765/1542] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:45:34.805619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:34.818836 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 778/1543] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.820158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153c9b-66a3-439a-b7d2-05b93af9b623 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.820447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153c9b-66a3-439a-b7d2-05b93af9b623 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.820725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81153c9b-66a3-439a-b7d2-05b93af9b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.825565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d18ecc-1d2a-4b9c-9bc9-4530bad513bc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:34.840505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad5a7-e5fb-45b2-a342-fc307fef1cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:34.841595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad5a7-e5fb-45b2-a342-fc307fef1cec admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.841882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad5a7-e5fb-45b2-a342-fc307fef1cec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.842165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad5a7-e5fb-45b2-a342-fc307fef1cec admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.842945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad5a7-e5fb-45b2-a342-fc307fef1cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:34.844598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad5a7-e5fb-45b2-a342-fc307fef1cec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:34.864613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-81153c9b-66a3-439a-b7d2-05b93af9b623 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:34.866415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-81153c9b-66a3-439a-b7d2-05b93af9b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:34.876900 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 779/1544] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.878712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7080c-9614-4e1e-8a8d-24edd560fa6f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.880502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7080c-9614-4e1e-8a8d-24edd560fa6f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.881119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7080c-9614-4e1e-8a8d-24edd560fa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.913081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d9c7080c-9614-4e1e-8a8d-24edd560fa6f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:34.914750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d9c7080c-9614-4e1e-8a8d-24edd560fa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:34.925173 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 780/1545] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:34.927422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7080c-9614-4e1e-8a8d-24edd560fa6f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:34.939240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7080c-9614-4e1e-8a8d-24edd560fa6f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:34.953367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5802cfe-a7f7-45c5-b695-a2f70756458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:34.954063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802cfe-a7f7-45c5-b695-a2f70756458c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.954352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802cfe-a7f7-45c5-b695-a2f70756458c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.954631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802cfe-a7f7-45c5-b695-a2f70756458c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:34.955394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5802cfe-a7f7-45c5-b695-a2f70756458c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:34.957756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5802cfe-a7f7-45c5-b695-a2f70756458c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:34.993587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 781/1546] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:34.994929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace1d1d-ae7a-40ac-b129-89aebbd63f93 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:34.995227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace1d1d-ae7a-40ac-b129-89aebbd63f93 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:34.995509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace1d1d-ae7a-40ac-b129-89aebbd63f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.015592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1ace1d1d-ae7a-40ac-b129-89aebbd63f93 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.016810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ace1d1d-ae7a-40ac-b129-89aebbd63f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.017929 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 766/1547] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:35.019612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d685fe5-b6ad-4d42-bb26-e170dd73b68f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.020071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d685fe5-b6ad-4d42-bb26-e170dd73b68f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.020474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d685fe5-b6ad-4d42-bb26-e170dd73b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.041205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8d685fe5-b6ad-4d42-bb26-e170dd73b68f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.041205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8d685fe5-b6ad-4d42-bb26-e170dd73b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.089542 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 782/1548] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.090995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51c404-8cbf-47b4-ad46-1c96ea907771 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.091409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51c404-8cbf-47b4-ad46-1c96ea907771 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.091760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51c404-8cbf-47b4-ad46-1c96ea907771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.105452 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 767/1549] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.107040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825da8b-43a0-4b72-813b-8d67b4cdcefb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.107473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825da8b-43a0-4b72-813b-8d67b4cdcefb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.107890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825da8b-43a0-4b72-813b-8d67b4cdcefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.110309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ac51c404-8cbf-47b4-ad46-1c96ea907771 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.111629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac51c404-8cbf-47b4-ad46-1c96ea907771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.120107 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 783/1550] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.121460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef661c-6f1d-4007-a52d-76f5ee8681cd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.121749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef661c-6f1d-4007-a52d-76f5ee8681cd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.122030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef661c-6f1d-4007-a52d-76f5ee8681cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.130627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7825da8b-43a0-4b72-813b-8d67b4cdcefb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.131932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7825da8b-43a0-4b72-813b-8d67b4cdcefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.140060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-44ef661c-6f1d-4007-a52d-76f5ee8681cd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.140649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 768/1551] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.141237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-44ef661c-6f1d-4007-a52d-76f5ee8681cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.141871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31614-b766-4472-aa42-76cbde210762 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.142157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31614-b766-4472-aa42-76cbde210762 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.142429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd31614-b766-4472-aa42-76cbde210762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.149243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 784/1552] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.149996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef661c-6f1d-4007-a52d-76f5ee8681cd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.159477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef661c-6f1d-4007-a52d-76f5ee8681cd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.161158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1fd31614-b766-4472-aa42-76cbde210762 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.162347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1fd31614-b766-4472-aa42-76cbde210762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.164599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292318ce-d0e0-40ac-b80e-8fc324bfc699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.165259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292318ce-d0e0-40ac-b80e-8fc324bfc699 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.165544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292318ce-d0e0-40ac-b80e-8fc324bfc699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.165821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292318ce-d0e0-40ac-b80e-8fc324bfc699 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.166503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292318ce-d0e0-40ac-b80e-8fc324bfc699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.168733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292318ce-d0e0-40ac-b80e-8fc324bfc699 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.170395 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 769/1553] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.171277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31614-b766-4472-aa42-76cbde210762 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.181483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd31614-b766-4472-aa42-76cbde210762 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.186690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.187441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.187839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.188116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.188837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.189973 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 785/1554] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.190570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.191325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1591d2-64e4-4e27-a014-b6e0c5958f49 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.191791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1591d2-64e4-4e27-a014-b6e0c5958f49 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.192074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1591d2-64e4-4e27-a014-b6e0c5958f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.203138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 770/1555] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:35.204122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.210613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dd1591d2-64e4-4e27-a014-b6e0c5958f49 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.211849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dd1591d2-64e4-4e27-a014-b6e0c5958f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.216481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cf703-f724-4fbd-bee2-0b07ecaab3d9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.220016 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 786/1556] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.220931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1591d2-64e4-4e27-a014-b6e0c5958f49 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.224823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.225502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.225778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.226053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.226764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:35.227121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.228740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.230666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1591d2-64e4-4e27-a014-b6e0c5958f49 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.235220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618401f-8ec4-4159-a6ed-a1830f323f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.235856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618401f-8ec4-4159-a6ed-a1830f323f0c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.236139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618401f-8ec4-4159-a6ed-a1830f323f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.236411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618401f-8ec4-4159-a6ed-a1830f323f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.237120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618401f-8ec4-4159-a6ed-a1830f323f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:35.237451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618401f-8ec4-4159-a6ed-a1830f323f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.239116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618401f-8ec4-4159-a6ed-a1830f323f0c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.240757 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 771/1557] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:35.241552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.252202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c1295-ad2d-43e1-81a7-e4f5c9d0ced1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.260659 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 787/1558] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:35.260659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31ee3a-fb76-40cf-b5d6-a2b7aeadde2d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.260659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31ee3a-fb76-40cf-b5d6-a2b7aeadde2d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.260659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31ee3a-fb76-40cf-b5d6-a2b7aeadde2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.261018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18062c-4821-4a15-8ba2-711671e3d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.261018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18062c-4821-4a15-8ba2-711671e3d21b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.261018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18062c-4821-4a15-8ba2-711671e3d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.261018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18062c-4821-4a15-8ba2-711671e3d21b admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.261351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18062c-4821-4a15-8ba2-711671e3d21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:35.261351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18062c-4821-4a15-8ba2-711671e3d21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.261351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18062c-4821-4a15-8ba2-711671e3d21b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.272787 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 772/1559] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:35.274006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4e1e-1057-4ce8-babf-fbf9508ae6ea None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.274572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3c31ee3a-fb76-40cf-b5d6-a2b7aeadde2d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.274657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4e1e-1057-4ce8-babf-fbf9508ae6ea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.274657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c4e1e-1057-4ce8-babf-fbf9508ae6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.275230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3c31ee3a-fb76-40cf-b5d6-a2b7aeadde2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.285680 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 788/1560] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.286576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31ee3a-fb76-40cf-b5d6-a2b7aeadde2d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.291758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6f7c4e1e-1057-4ce8-babf-fbf9508ae6ea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.292933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6f7c4e1e-1057-4ce8-babf-fbf9508ae6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.295599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31ee3a-fb76-40cf-b5d6-a2b7aeadde2d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.300085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.300717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.301024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.301293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.301724 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 773/1561] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.302158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.302969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4e1e-1057-4ce8-babf-fbf9508ae6ea None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.303789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.312247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c4e1e-1057-4ce8-babf-fbf9508ae6ea None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.316425 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 789/1562] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:35.316425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.317535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.318403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.318684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.318988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] PATH_INFO: `/v3/projects/1de0d60dedbf4d3d9b62718381a675fd/users/191c435675094cd09dad05124abc1715/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.324208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b162ad-5c5c-446d-8887-0b774704c490 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.328582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.329215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.329463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.329737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.330714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:35.330714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.332895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.333941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de0d60dedbf4d3d9b62718381a675fd, user_id=191c435675094cd09dad05124abc1715, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.336627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.344857 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 790/1563] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:35.350177 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 774/1564] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:35 2022] PUT /identity/v3/projects/1de0d60dedbf4d3d9b62718381a675fd/users/191c435675094cd09dad05124abc1715/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:35.352715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.353322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.362903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f612-9419-4269-9b30-11bbf415b3f6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.415954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.416611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.416891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.417168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.417281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f495-fa91-48fd-8dc3-d9bcc7ce762a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.417852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.419814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.421984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.422787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.423081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.423352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.424032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.426058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.446126 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 791/1565] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.447110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.453069 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 775/1566] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.456872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.510621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b9c3-92b1-4d98-8506-42760f81cb8e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.515455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.515911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab6ea-f9d4-45df-a205-335473f97706 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.516104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.516385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.516656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.517333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.519283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.520525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.521183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.521476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.521777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.522628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:35.522967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.524577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.535786 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 776/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:35.536602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.546187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9a239-c277-4b35-be05-61ad365b82b0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.550654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.551646 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 792/1568] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.551816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.552132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.552437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.552530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.553274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:35.553580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.555323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.567592 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 777/1569] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:35.568373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.580599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ec77b-2ee9-410f-9f9c-7a1e4fdaae6d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.614680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24504ed-cb04-4c1e-af35-8b2574e107d0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.619568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f7c88-56d2-4321-9be7-dfb8a7cf13e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.620220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f7c88-56d2-4321-9be7-dfb8a7cf13e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.620507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f7c88-56d2-4321-9be7-dfb8a7cf13e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.620786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f7c88-56d2-4321-9be7-dfb8a7cf13e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.621508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f7c88-56d2-4321-9be7-dfb8a7cf13e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.623189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f7c88-56d2-4321-9be7-dfb8a7cf13e2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.633365 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 793/1570] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:35.634638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9c00-28ab-4dea-a8d5-453587c0c548 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.634958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9c00-28ab-4dea-a8d5-453587c0c548 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.635238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9c00-28ab-4dea-a8d5-453587c0c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.635414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.636129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.636539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.636883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.637636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.639649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.661127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-370a9c00-28ab-4dea-a8d5-453587c0c548 None None] MFA Rules not processed for user `191c435675094cd09dad05124abc1715`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:35.662314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-370a9c00-28ab-4dea-a8d5-453587c0c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:35.663782 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 778/1571] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.664655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.722625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b27cf-923a-440e-a7fe-bdebd267fdda admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.726621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 794/1572] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:35.727512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a9c00-28ab-4dea-a8d5-453587c0c548 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.727622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.728191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.728479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.728790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.729439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.730759 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:35.730759 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:45:35.730759 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:45:35.732049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.737332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a9c00-28ab-4dea-a8d5-453587c0c548 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.742477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.743207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.743557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.743838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.744497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.746470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.755029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 779/1573] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.755029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.764139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288036d6-e28a-46d8-bea4-bd7b0c18250b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.768916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.769560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.769871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.772889 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 795/1574] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.773016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.773099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.773180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.773180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.781678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c08198-215e-49a3-b523-1bc7d2926027 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.786063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.786708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.787139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.787415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.788205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.790158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.797454 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 780/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.798326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.812538 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 796/1576] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.813332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.823104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4c07-0039-4943-ad41-5b22851a5bc9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.858376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab485c-a9bb-49c0-848c-8440d85da113 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.863082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.864386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.864670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.864972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.865658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.867609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.877303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.878244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.878533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.878838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] PATH_INFO: `/v3/projects/fe2043e0dab64742bcf38b5dfe9b07bc/users/799d6070fafb4901b08626b9aeebd197/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.891907 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 781/1577] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:35.892800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.893503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2043e0dab64742bcf38b5dfe9b07bc, user_id=799d6070fafb4901b08626b9aeebd197, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.894602 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:35.894602 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:45:35.894602 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:45:35.896572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:35.909801 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 797/1578] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:35 2022] PUT /identity/v3/projects/fe2043e0dab64742bcf38b5dfe9b07bc/users/799d6070fafb4901b08626b9aeebd197/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:35.911164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:35.957924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d488f-b860-4444-891b-1369b77cd74c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.978707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8e45a-3836-4256-a16b-0c056fb691f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:35.983869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:35.984554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:35.984838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:35.985113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:35.985828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:35.987796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.011972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 798/1579] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:36.012795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.015680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.016452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.016765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.017042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.017726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.019689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.039184 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 782/1580] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:35 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:36.040132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.049510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bccba-6342-44f4-a7fc-4e11c859faf3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.078153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a3ec-8ba9-4322-bab6-b9eefbb73171 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.082680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.083362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.083647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.083928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.084658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.086305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.095941 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 799/1581] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.097180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.104222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.104891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.105169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.105470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.106183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.107047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23e37a-7133-46fd-b6e8-7b91e827ed5f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.107819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.112064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.112707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.113246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.113246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.114485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.116468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.118322 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 783/1582] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.119215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.128279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5bcaa-572c-4764-be91-8502ff8c2167 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.133211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40bedc-0f09-42d8-9897-fb9c56c7965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.133844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40bedc-0f09-42d8-9897-fb9c56c7965f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.134131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40bedc-0f09-42d8-9897-fb9c56c7965f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.134428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40bedc-0f09-42d8-9897-fb9c56c7965f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.135167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40bedc-0f09-42d8-9897-fb9c56c7965f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.136754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40bedc-0f09-42d8-9897-fb9c56c7965f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.139254 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 800/1583] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:36.140250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.146476 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 784/1584] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.147734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1486-614b-4544-9ba2-079f0dec05df None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.148022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1486-614b-4544-9ba2-079f0dec05df None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.148299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1486-614b-4544-9ba2-079f0dec05df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.149942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c499c6-57db-4e58-9265-877950031e64 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.154491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.155180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.155469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.155744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.156415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.158348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.174329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0ebc1486-614b-4544-9ba2-079f0dec05df None None] MFA Rules not processed for user `799d6070fafb4901b08626b9aeebd197`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:36.175575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0ebc1486-614b-4544-9ba2-079f0dec05df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:36.179227 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 801/1585] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/users => generated 302 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:36.180017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.189747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ce18e-4ed3-44aa-9a2f-022f518262e4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.194406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.195108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.195529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.195814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.196501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.199029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.219800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 802/1586] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:36.220451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.230301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a67488-6015-4148-ba0e-81a6968aeaea admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.235003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.235637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.235932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.236202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.236908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.238528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.241028 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 785/1587] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:36.242048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc1486-614b-4544-9ba2-079f0dec05df None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.248349 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 803/1588] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.249150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.252503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc1486-614b-4544-9ba2-079f0dec05df None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.257177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.257831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.258111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.258346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477d97c-22e4-4e3e-bc4b-0725de0b1015 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.258440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.259323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.260962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.263047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.263679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.263961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.264235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.264938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.266614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.271323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 786/1589] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.272419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.277297 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 804/1590] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.278101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.282864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc41d-117b-4bf7-baa8-b87248a1a16a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.287687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28948d38-be92-4c98-8ff0-bcb1f290dedf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.288037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.288678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.288989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.289262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.289961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.291616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.292223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.292847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.293127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.293406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.294106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.295697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.301540 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 787/1591] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.302343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.306827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 805/1592] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.308023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.312327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7aca4-e82a-4578-8a54-fbad9b7efaaa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.316913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.317554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.317668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a74292-5b29-489e-b9c6-fce22bf2d7b2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.317840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.318119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.318905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.320536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.322221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.322881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.323165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.323707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.324408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.325988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.331152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 788/1593] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.332087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.339173 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 806/1594] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.339173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.344159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80baad-3cfd-4fab-abb2-69e0042da2a2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.347472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fa824-b6f5-4298-8215-2b9ee3422c10 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.349431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.350182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.350468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.350745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.351453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.352837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.353349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.353567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.353852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.354156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.354891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.356473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.366835 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 807/1595] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.367814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.377810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bab809-6f27-4c67-8017-08cdac2c2f1f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.380529 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 789/1596] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:36.381338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.386315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.387242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.387524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.387804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] PATH_INFO: `/v3/projects/4baa57a3206141f5adcc7d0a3b3aaf13/users/70678f7095dc49a1b579ca1fbc4b0dbf/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.409027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baa57a3206141f5adcc7d0a3b3aaf13, user_id=70678f7095dc49a1b579ca1fbc4b0dbf, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.412341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.424673 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 808/1597] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:36 2022] PUT /identity/v3/projects/4baa57a3206141f5adcc7d0a3b3aaf13/users/70678f7095dc49a1b579ca1fbc4b0dbf/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:36.425433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.448157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9523-c484-430b-bfd0-fbdb0efa38a1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.497468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fbf20-566f-469d-a114-c64b444acfc8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.502280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.502971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.503262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.503494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.503605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.504270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.504381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.504632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.505036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] PATH_INFO: `/v3/projects/8d1a04907a264ef5bfa8bea4e1a3a704/users/b93356f25d9f4ff9ad89a80cab2853eb/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.505889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.515974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 809/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.516966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.519248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1a04907a264ef5bfa8bea4e1a3a704, user_id=b93356f25d9f4ff9ad89a80cab2853eb, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.522419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.527677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84684b-6967-41ac-bc68-10c61a829909 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.532606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.533467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.533746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.534018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] PATH_INFO: `/v3/projects/4a5c3e72c1f943bcb6256ddf95978995/users/e0e9f1939f084da58fc8a612ef31f6b2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.536316 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 790/1599] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:36 2022] PUT /identity/v3/projects/8d1a04907a264ef5bfa8bea4e1a3a704/users/b93356f25d9f4ff9ad89a80cab2853eb/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:36.537127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.549306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5c3e72c1f943bcb6256ddf95978995, user_id=e0e9f1939f084da58fc8a612ef31f6b2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.552059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.564833 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 810/1600] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:36 2022] PUT /identity/v3/projects/4a5c3e72c1f943bcb6256ddf95978995/users/e0e9f1939f084da58fc8a612ef31f6b2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:36.571604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.596787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d214b8-6d41-48c9-91f2-98602b9bf00f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.631231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f05546-d424-4e6e-9b62-c6b7056242f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.635812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.636697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.636982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.637257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] PATH_INFO: `/v3/projects/ec58efaaec5d4733b82ae683719b9caf/users/1508fe7b6fd84ac9ad5710433cfe4a5c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.650099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.650794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.651077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.651354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.651535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec58efaaec5d4733b82ae683719b9caf, user_id=1508fe7b6fd84ac9ad5710433cfe4a5c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.652068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.653648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.654219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.663754 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 791/1601] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:36.664617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.667037 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 811/1602] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:36 2022] PUT /identity/v3/projects/ec58efaaec5d4733b82ae683719b9caf/users/1508fe7b6fd84ac9ad5710433cfe4a5c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:36.667824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.674601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a59d8-c78a-4f5b-94ae-f2291b928582 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.727418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d95ef-2bba-40e5-ae57-faaa78ec86bb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.730028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.730967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.731245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.731518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] PATH_INFO: `/v3/projects/2224daefc94f40bb919f8052e55a8fe9/users/5abf38af9d8b41dc9871b612a06dfb05/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.732308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41912ee4-b33b-48b3-bcbb-7ac539fafe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.732945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ee4-b33b-48b3-bcbb-7ac539fafe36 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.733227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ee4-b33b-48b3-bcbb-7ac539fafe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.733646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41912ee4-b33b-48b3-bcbb-7ac539fafe36 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.734185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41912ee4-b33b-48b3-bcbb-7ac539fafe36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.736221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41912ee4-b33b-48b3-bcbb-7ac539fafe36 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.751263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2224daefc94f40bb919f8052e55a8fe9, user_id=5abf38af9d8b41dc9871b612a06dfb05, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.754702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.760484 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 812/1603] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:36.762052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba1a3-2304-4960-9d47-ac5e6e78ba4e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.762352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba1a3-2304-4960-9d47-ac5e6e78ba4e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.762633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba1a3-2304-4960-9d47-ac5e6e78ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.773244 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 792/1604] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:36 2022] PUT /identity/v3/projects/2224daefc94f40bb919f8052e55a8fe9/users/5abf38af9d8b41dc9871b612a06dfb05/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:36.773965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.794739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-38cba1a3-2304-4960-9d47-ac5e6e78ba4e None None] MFA Rules not processed for user `70678f7095dc49a1b579ca1fbc4b0dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:36.795979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-38cba1a3-2304-4960-9d47-ac5e6e78ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:36.845686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b53cdb-c619-43a4-b109-6c87fdc9ca73 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:36.850374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80962-bbc8-491b-a956-13ccae753c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:36.851324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80962-bbc8-491b-a956-13ccae753c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.851606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80962-bbc8-491b-a956-13ccae753c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.851883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80962-bbc8-491b-a956-13ccae753c12 admin admin] PATH_INFO: `/v3/projects/451d8752792a4106b2ea34d23ecc5593/users/92f1c2e2f8f44009b3ede81d9b970c85/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.857912 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 813/1605] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:36.859053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae1ff0-f362-4c31-b92c-818ea5232d1f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.859341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae1ff0-f362-4c31-b92c-818ea5232d1f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.859622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae1ff0-f362-4c31-b92c-818ea5232d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.866652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80962-bbc8-491b-a956-13ccae753c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451d8752792a4106b2ea34d23ecc5593, user_id=92f1c2e2f8f44009b3ede81d9b970c85, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:36.869453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80962-bbc8-491b-a956-13ccae753c12 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:36.882825 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 793/1606] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:36 2022] PUT /identity/v3/projects/451d8752792a4106b2ea34d23ecc5593/users/92f1c2e2f8f44009b3ede81d9b970c85/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:36.884474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7acb21-935e-4907-89b0-1b2a943c3b0e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:36.884660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7acb21-935e-4907-89b0-1b2a943c3b0e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:36.884925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7acb21-935e-4907-89b0-1b2a943c3b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:36.890998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-acae1ff0-f362-4c31-b92c-818ea5232d1f None None] MFA Rules not processed for user `b93356f25d9f4ff9ad89a80cab2853eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:36.892355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-acae1ff0-f362-4c31-b92c-818ea5232d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:36.916780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ed7acb21-935e-4907-89b0-1b2a943c3b0e None None] MFA Rules not processed for user `e0e9f1939f084da58fc8a612ef31f6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:36.917913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ed7acb21-935e-4907-89b0-1b2a943c3b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:36.955623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 814/1607] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:36.956671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae1ff0-f362-4c31-b92c-818ea5232d1f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:36.979319 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 794/1608] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:36.981984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7acb21-935e-4907-89b0-1b2a943c3b0e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.017801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae1ff0-f362-4c31-b92c-818ea5232d1f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.022345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.023314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.023546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.023849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] PATH_INFO: `/v3/projects/1412d53f87f74db2bad375bb6ff29901/users/474acbe7ce864bdfa6b213bf0f19e18a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.037579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1412d53f87f74db2bad375bb6ff29901, user_id=474acbe7ce864bdfa6b213bf0f19e18a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.039865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7acb21-935e-4907-89b0-1b2a943c3b0e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.040371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.044593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae820625-3c0d-48eb-b3b9-3cc50ef65b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.045623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820625-3c0d-48eb-b3b9-3cc50ef65b07 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.046202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820625-3c0d-48eb-b3b9-3cc50ef65b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.046487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae820625-3c0d-48eb-b3b9-3cc50ef65b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.047242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae820625-3c0d-48eb-b3b9-3cc50ef65b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.049135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae820625-3c0d-48eb-b3b9-3cc50ef65b07 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.053650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 815/1609] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:36 2022] PUT /identity/v3/projects/1412d53f87f74db2bad375bb6ff29901/users/474acbe7ce864bdfa6b213bf0f19e18a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:37.054622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.064921 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 795/1610] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:37.066323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7454b-c177-4a33-94b1-b8def532111b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.067290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7454b-c177-4a33-94b1-b8def532111b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.067689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7454b-c177-4a33-94b1-b8def532111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.098835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2eb7454b-c177-4a33-94b1-b8def532111b None None] MFA Rules not processed for user `5abf38af9d8b41dc9871b612a06dfb05`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:37.100150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2eb7454b-c177-4a33-94b1-b8def532111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:37.131110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce724494-f789-4762-815c-2ed7f1a91e10 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.135899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.136713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.137006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.137314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.138218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.139922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.149776 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 816/1611] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:37.150733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.167224 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 796/1612] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:37.168807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219029e-cf76-409b-b61b-a91641b05d11 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.169296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219029e-cf76-409b-b61b-a91641b05d11 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.169578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219029e-cf76-409b-b61b-a91641b05d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.199056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b219029e-cf76-409b-b61b-a91641b05d11 None None] MFA Rules not processed for user `92f1c2e2f8f44009b3ede81d9b970c85`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:37.200468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b219029e-cf76-409b-b61b-a91641b05d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:37.204411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84273b01-1a47-49d2-9352-6f2925a9e9d1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.208217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.208843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.212583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.212583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.263696 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 797/1613] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:37.264816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219029e-cf76-409b-b61b-a91641b05d11 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.267468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.268959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.275617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219029e-cf76-409b-b61b-a91641b05d11 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.277757 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 817/1614] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:37.278375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.280694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6635b-8443-45eb-9786-ecc987b2176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.281348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6635b-8443-45eb-9786-ecc987b2176c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.281634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6635b-8443-45eb-9786-ecc987b2176c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.281912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6635b-8443-45eb-9786-ecc987b2176c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.282596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6635b-8443-45eb-9786-ecc987b2176c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.284570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6635b-8443-45eb-9786-ecc987b2176c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.287980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cef5e-0aa3-4005-9469-04a15a87c872 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.292708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.293463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.293751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.294023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.294691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.296613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.312660 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 798/1615] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.314115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122692d-fed4-4c99-89ca-503a43f4d339 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.314408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122692d-fed4-4c99-89ca-503a43f4d339 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.314688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122692d-fed4-4c99-89ca-503a43f4d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.332935 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 818/1616] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.332935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.342370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5122692d-fed4-4c99-89ca-503a43f4d339 None None] MFA Rules not processed for user `474acbe7ce864bdfa6b213bf0f19e18a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:37.343595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5122692d-fed4-4c99-89ca-503a43f4d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:37.394473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a9586-5856-4f61-899e-ef3c973e5ac3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.399852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.400738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.401016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.401291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] PATH_INFO: `/v3/projects/ec58efaaec5d4733b82ae683719b9caf/users/1508fe7b6fd84ac9ad5710433cfe4a5c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.403388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec58efaaec5d4733b82ae683719b9caf, user_id=1508fe7b6fd84ac9ad5710433cfe4a5c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.406357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.430890 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 819/1617] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:37 2022] PUT /identity/v3/projects/ec58efaaec5d4733b82ae683719b9caf/users/1508fe7b6fd84ac9ad5710433cfe4a5c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:37.435047 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 799/1618] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:37.435200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.435329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122692d-fed4-4c99-89ca-503a43f4d339 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.448930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122692d-fed4-4c99-89ca-503a43f4d339 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.503598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7502d1b-7e4f-4cf4-bec4-163fccd8edc4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.508352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.508489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.509148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.509302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.509434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.509546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.509713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.509806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] PATH_INFO: `/v3/projects/894b035e2d7f492892e2b866e5f474a2/users/75347057109e40d09c0e5152fd8605ef/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.510397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.512614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.525228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894b035e2d7f492892e2b866e5f474a2, user_id=75347057109e40d09c0e5152fd8605ef, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.529755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.541331 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 800/1619] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/projects => generated 397 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.542269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.546552 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 820/1620] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:37 2022] PUT /identity/v3/projects/894b035e2d7f492892e2b866e5f474a2/users/75347057109e40d09c0e5152fd8605ef/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:37.547321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.607026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f7551-a7ef-4f1e-b8d7-0d9d91efca2e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.612493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c77d5-7c4c-4804-82e5-5ff563937170 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.614620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.615636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.616176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.616568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.617310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.618566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.619525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.619878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.620220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.620465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.621037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.623076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.644097 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 821/1621] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.645259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.653445 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 801/1622] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.654708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.655697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03063a3c-14f8-4dbb-a565-3f57bc2f371d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.717576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158a263-1cb8-4d85-a9c4-694aa42b4df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.718408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a263-1cb8-4d85-a9c4-694aa42b4df2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.718690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a263-1cb8-4d85-a9c4-694aa42b4df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.719116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a263-1cb8-4d85-a9c4-694aa42b4df2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.719793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158a263-1cb8-4d85-a9c4-694aa42b4df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.722386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158a263-1cb8-4d85-a9c4-694aa42b4df2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.737467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423a172-f7ab-430f-8910-54de46b0642c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.742594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.743318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.743638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.744216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.744940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.746904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.752132 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 822/1623] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.752132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e48f4-cb45-4ead-9bb3-e3a92b8bb467 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.752132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e48f4-cb45-4ead-9bb3-e3a92b8bb467 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.752132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e48f4-cb45-4ead-9bb3-e3a92b8bb467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.784505 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 802/1624] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.784690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a66e48f4-cb45-4ead-9bb3-e3a92b8bb467 None None] MFA Rules not processed for user `1508fe7b6fd84ac9ad5710433cfe4a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:37.784773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.784855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a66e48f4-cb45-4ead-9bb3-e3a92b8bb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:37.843573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910f99-2db6-46de-bc4f-41388adef096 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.848988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.849648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.849949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.850218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.850923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.851451 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 823/1625] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:37.852064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e48f4-cb45-4ead-9bb3-e3a92b8bb467 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.852850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.861977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e48f4-cb45-4ead-9bb3-e3a92b8bb467 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.868364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.868778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.869064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.869340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.870051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.871667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.875881 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 803/1626] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/users => generated 305 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.875881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.885225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 824/1627] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:37.885225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.885458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656930c-e43a-4091-8395-067649909e35 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.888566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.889213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.889493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.889765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.890473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.892097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.895140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a98db6-b4fb-403b-b093-c30f86d3f090 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.899807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.900444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.900724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.900996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.901669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.902717 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 804/1628] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:37.903400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.903630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.915644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418fc2b-8f31-40b0-8539-ad80d265fd09 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.920937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.921777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.922054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.922326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] PATH_INFO: `/v3/users/70678f7095dc49a1b579ca1fbc4b0dbf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.923580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=70678f7095dc49a1b579ca1fbc4b0dbf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.927517 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 825/1629] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/users => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.927652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.927743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.934582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743d7b1-b9ab-4b0a-b1a5-91d3af87d43e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.939334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.939971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.940252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.940525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.941233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.944552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.959593 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 826/1630] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:37.960441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:37.970102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b92e76-4b43-4040-b2b6-960690bca208 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:37.975228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7b1cf-3af5-4619-af26-01b5a81dd7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:37.975864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b1cf-3af5-4619-af26-01b5a81dd7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.976152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b1cf-3af5-4619-af26-01b5a81dd7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:37.976429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7b1cf-3af5-4619-af26-01b5a81dd7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:37.977119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7b1cf-3af5-4619-af26-01b5a81dd7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:37.977752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70678f7095dc49a1b579ca1fbc4b0dbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:37.979043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7b1cf-3af5-4619-af26-01b5a81dd7b0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:37.984544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70678f7095dc49a1b579ca1fbc4b0dbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:37.985221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70678f7095dc49a1b579ca1fbc4b0dbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:37.985845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70678f7095dc49a1b579ca1fbc4b0dbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:37.993517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70678f7095dc49a1b579ca1fbc4b0dbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:37.998083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 827/1631] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:37 2022] POST /identity/v3/users => generated 308 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:37.999519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9a05-d402-4560-905e-86e6bed67aeb None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:37.999810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9a05-d402-4560-905e-86e6bed67aeb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.000088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9a05-d402-4560-905e-86e6bed67aeb None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.001307 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 828/1632] 10.222.0.32 () {54 vars in 961 bytes} [Sat May 7 21:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:38.002006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9a05-d402-4560-905e-86e6bed67aeb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.004238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b85a9a05-d402-4560-905e-86e6bed67aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.012628 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 805/1633] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:37 2022] DELETE /identity/v3/users/70678f7095dc49a1b579ca1fbc4b0dbf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.013895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.015812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.019506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9a05-d402-4560-905e-86e6bed67aeb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.080401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.081347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.083201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.083201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.083405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.084923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.086930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cec57-6dbd-40f3-ac03-2821e4e324fa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.093919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.093919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.093919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.093919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] PATH_INFO: `/v3/projects/894b035e2d7f492892e2b866e5f474a2/users/75347057109e40d09c0e5152fd8605ef/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.095147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] RBAC: Authorizing `identity:create_grant(project_id=894b035e2d7f492892e2b866e5f474a2, user_id=75347057109e40d09c0e5152fd8605ef, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.095953 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 829/1634] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.096901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.098159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.100656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.108375 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 806/1635] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/894b035e2d7f492892e2b866e5f474a2/users/75347057109e40d09c0e5152fd8605ef/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.109290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.110852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.112736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17706-a51b-4990-9959-3a7ebfff7014 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.166729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.167635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.167918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.168188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] PATH_INFO: `/v3/projects/ab23e2f0d5f0443fa1e3fc7dcaf82162/users/b9739d9c6d794558bad9218157a5bb21/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.173561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b5d17-5582-4fe8-b23f-f574b148caea admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.178219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.178909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.179187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.179457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.180192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.181781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.182972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab23e2f0d5f0443fa1e3fc7dcaf82162, user_id=b9739d9c6d794558bad9218157a5bb21, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.185638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.192340 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 807/1636] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.192340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.195911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.200915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 830/1637] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/ab23e2f0d5f0443fa1e3fc7dcaf82162/users/b9739d9c6d794558bad9218157a5bb21/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.201954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.203571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.209518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeece90-8451-47b7-80ce-e9139e388f5e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.262429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a961e9-7564-42d6-ab1c-fb1d2bcf30fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.263463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a961e9-7564-42d6-ab1c-fb1d2bcf30fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.263744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a961e9-7564-42d6-ab1c-fb1d2bcf30fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.264014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a961e9-7564-42d6-ab1c-fb1d2bcf30fe admin admin] PATH_INFO: `/v3/projects/f5b2b5193166455a8bb67322e81b3f67/users/388aea58343b4c0c994dcf4f861a4250/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.265278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6af6a-2b19-46ff-9e9b-a2c2b2fdc7f7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.270680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9c60-f825-4273-b7fe-37c1083ccd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.271391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9c60-f825-4273-b7fe-37c1083ccd6f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.271675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9c60-f825-4273-b7fe-37c1083ccd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.271954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9c60-f825-4273-b7fe-37c1083ccd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.272668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9c60-f825-4273-b7fe-37c1083ccd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.274266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c9c60-f825-4273-b7fe-37c1083ccd6f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.278313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a961e9-7564-42d6-ab1c-fb1d2bcf30fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b2b5193166455a8bb67322e81b3f67, user_id=388aea58343b4c0c994dcf4f861a4250, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.281003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a961e9-7564-42d6-ab1c-fb1d2bcf30fe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.283875 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 831/1638] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.285075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346185-533b-4a7c-a17a-54f224bf90ac None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.285366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346185-533b-4a7c-a17a-54f224bf90ac None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.285637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346185-533b-4a7c-a17a-54f224bf90ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.297240 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 808/1639] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/f5b2b5193166455a8bb67322e81b3f67/users/388aea58343b4c0c994dcf4f861a4250/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.298814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c807-e27a-4463-b492-6a2176a97b19 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.299103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c807-e27a-4463-b492-6a2176a97b19 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.299375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c807-e27a-4463-b492-6a2176a97b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.305042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-04346185-533b-4a7c-a17a-54f224bf90ac None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:38.306267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-04346185-533b-4a7c-a17a-54f224bf90ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.316098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7f30c807-e27a-4463-b492-6a2176a97b19 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:38.317768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7f30c807-e27a-4463-b492-6a2176a97b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.372048 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 832/1640] 10.222.0.32 () {58 vars in 1058 bytes} [Sat May 7 21:45:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:38.372807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346185-533b-4a7c-a17a-54f224bf90ac None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.381466 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 809/1641] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:38.384332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c4f7-df49-46f1-a1e5-e65ef2f11765 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.384754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c4f7-df49-46f1-a1e5-e65ef2f11765 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.385036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c4f7-df49-46f1-a1e5-e65ef2f11765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.387369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346185-533b-4a7c-a17a-54f224bf90ac None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.392590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.393475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.393761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.394034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] PATH_INFO: `/v3/projects/50678f73696e47c2869fc66ab77513b2/users/dd7910f30f6d41eeabc3f17ef1b6cdde/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.408722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50678f73696e47c2869fc66ab77513b2, user_id=dd7910f30f6d41eeabc3f17ef1b6cdde, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.411444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.414095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d258c4f7-df49-46f1-a1e5-e65ef2f11765 None None] MFA Rules not processed for user `75347057109e40d09c0e5152fd8605ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:38.415332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d258c4f7-df49-46f1-a1e5-e65ef2f11765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.424143 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 833/1642] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/50678f73696e47c2869fc66ab77513b2/users/dd7910f30f6d41eeabc3f17ef1b6cdde/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.424919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.481514 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 810/1643] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:38.482654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c4f7-df49-46f1-a1e5-e65ef2f11765 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.484533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3ffc-83dd-4a2f-b602-911ede29a013 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.490035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.490950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.491239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.491518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] PATH_INFO: `/v3/projects/1f0ad2f96d95448ba36acd91f9effa57/users/f5deaeebfbd04e56b626030c324b62db/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.493312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c4f7-df49-46f1-a1e5-e65ef2f11765 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.498547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.499509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.499509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.499861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.500511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.502106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.506897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0ad2f96d95448ba36acd91f9effa57, user_id=f5deaeebfbd04e56b626030c324b62db, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.509574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.512632 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 811/1644] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.513421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.523411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f24ab-9ef0-4db3-939a-027a77896963 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.524714 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 834/1645] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/1f0ad2f96d95448ba36acd91f9effa57/users/f5deaeebfbd04e56b626030c324b62db/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.525702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.580103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.580984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.581264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.581536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] PATH_INFO: `/v3/projects/5ffced8ba6984ba0b2e3677b6c2a5fcd/users/7a35695d8b8d425fa36b2e8f9883c3a6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.591799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9163d7-8a8f-4f7f-8cee-91e59cbb7ecf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.595375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffced8ba6984ba0b2e3677b6c2a5fcd, user_id=7a35695d8b8d425fa36b2e8f9883c3a6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.596783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.597469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.597756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.598049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.598144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.598754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.600430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.610804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 835/1646] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.614812 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 812/1647] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/5ffced8ba6984ba0b2e3677b6c2a5fcd/users/7a35695d8b8d425fa36b2e8f9883c3a6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.614950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.615027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.615027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.670359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf924a-9ec2-49d8-82ba-a6b696193a03 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.673865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.674535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.674842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.675117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.683419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2987cd-912a-4c55-930e-ee8e4cf0b7f9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.735331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.736796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.746397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.746649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 813/1648] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:38.747084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.747372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.747563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.747765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.749676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:38.757253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216ee68-16c6-4e3d-b098-0c4075179443 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.762381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414a8f9-b4ad-47c8-9fc6-10d80527946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.763083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414a8f9-b4ad-47c8-9fc6-10d80527946b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.763509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414a8f9-b4ad-47c8-9fc6-10d80527946b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.763792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414a8f9-b4ad-47c8-9fc6-10d80527946b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.764512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414a8f9-b4ad-47c8-9fc6-10d80527946b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.766131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414a8f9-b4ad-47c8-9fc6-10d80527946b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.779235 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 814/1649] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.779235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5397-e51d-4e3f-b09b-1eec3dc940cf None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.779235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5397-e51d-4e3f-b09b-1eec3dc940cf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.779235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d5397-e51d-4e3f-b09b-1eec3dc940cf None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.780090 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 815/1650] 10.222.0.32 () {54 vars in 961 bytes} [Sat May 7 21:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:38.780875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5397-e51d-4e3f-b09b-1eec3dc940cf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.793667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d5397-e51d-4e3f-b09b-1eec3dc940cf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.799317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.800350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.800481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.800746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] PATH_INFO: `/v3/projects/ab23e2f0d5f0443fa1e3fc7dcaf82162/users/b9739d9c6d794558bad9218157a5bb21/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.804167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab23e2f0d5f0443fa1e3fc7dcaf82162, user_id=b9739d9c6d794558bad9218157a5bb21, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.806980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.818896 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 816/1651] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/ab23e2f0d5f0443fa1e3fc7dcaf82162/users/b9739d9c6d794558bad9218157a5bb21/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.828497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.828674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.828674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.834748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 836/1652] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:38.842521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.856649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ee3d9-1de6-42e2-a56b-cc2b6e05ced5 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.895174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c174d-58bf-4719-b71f-33967b2c3d01 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.900458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.900852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.901153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.901433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.902157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.903814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.914958 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 817/1653] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.915860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.921169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.921900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.922283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.923000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.923808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.925588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.926853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ad04e-4df1-4e06-8033-06fc693e8a7e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.931752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d11cc-30b4-4965-a3f8-0fbebff6bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:38.932628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d11cc-30b4-4965-a3f8-0fbebff6bf8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.932913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d11cc-30b4-4965-a3f8-0fbebff6bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.933252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d11cc-30b4-4965-a3f8-0fbebff6bf8a admin admin] PATH_INFO: `/v3/projects/f5b2b5193166455a8bb67322e81b3f67/users/388aea58343b4c0c994dcf4f861a4250/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.935225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d11cc-30b4-4965-a3f8-0fbebff6bf8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b2b5193166455a8bb67322e81b3f67, user_id=388aea58343b4c0c994dcf4f861a4250, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:38.938031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d11cc-30b4-4965-a3f8-0fbebff6bf8a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:38.941345 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 837/1654] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:38.941345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:38.953412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5479d3-fb42-4313-8638-46444a15bc5d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:38.958849 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 818/1655] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/f5b2b5193166455a8bb67322e81b3f67/users/388aea58343b4c0c994dcf4f861a4250/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:38.964482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54426f8a-2a00-45ff-a607-43b1410b8fec None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:38.964770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54426f8a-2a00-45ff-a607-43b1410b8fec None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:38.965062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54426f8a-2a00-45ff-a607-43b1410b8fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:38.987282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-54426f8a-2a00-45ff-a607-43b1410b8fec None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:38.989138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54426f8a-2a00-45ff-a607-43b1410b8fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.041401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.043617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.044435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.044854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] PATH_INFO: `/v3/projects/50678f73696e47c2869fc66ab77513b2/users/dd7910f30f6d41eeabc3f17ef1b6cdde/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.048892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50678f73696e47c2869fc66ab77513b2, user_id=dd7910f30f6d41eeabc3f17ef1b6cdde, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.053941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.066592 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 819/1656] 10.222.0.32 () {58 vars in 1058 bytes} [Sat May 7 21:45:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:39.076833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693738-bf84-4dce-b317-5e03a0470a1f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.076833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693738-bf84-4dce-b317-5e03a0470a1f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.076833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693738-bf84-4dce-b317-5e03a0470a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.077153 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 838/1657] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:38 2022] PUT /identity/v3/projects/50678f73696e47c2869fc66ab77513b2/users/dd7910f30f6d41eeabc3f17ef1b6cdde/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:39.077153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.104977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a2693738-bf84-4dce-b317-5e03a0470a1f None None] MFA Rules not processed for user `b9739d9c6d794558bad9218157a5bb21`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:39.106402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a2693738-bf84-4dce-b317-5e03a0470a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.180100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ee23e-7772-4a6a-9ce7-ae9b5f0ce645 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.192153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af634762-f0f0-41d1-8c9f-d728e3c51b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.193636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634762-f0f0-41d1-8c9f-d728e3c51b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.194437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634762-f0f0-41d1-8c9f-d728e3c51b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.194901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af634762-f0f0-41d1-8c9f-d728e3c51b91 admin admin] PATH_INFO: `/v3/projects/1f0ad2f96d95448ba36acd91f9effa57/users/f5deaeebfbd04e56b626030c324b62db/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.200860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af634762-f0f0-41d1-8c9f-d728e3c51b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0ad2f96d95448ba36acd91f9effa57, user_id=f5deaeebfbd04e56b626030c324b62db, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.203662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af634762-f0f0-41d1-8c9f-d728e3c51b91 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.206087 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 820/1658] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:39.213473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693738-bf84-4dce-b317-5e03a0470a1f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.222220 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 839/1659] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:39 2022] PUT /identity/v3/projects/1f0ad2f96d95448ba36acd91f9effa57/users/f5deaeebfbd04e56b626030c324b62db/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:39.223520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693738-bf84-4dce-b317-5e03a0470a1f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.225510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926927e-77e5-4f70-be8e-2c7ae8595328 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.225933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926927e-77e5-4f70-be8e-2c7ae8595328 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.226356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926927e-77e5-4f70-be8e-2c7ae8595328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.263823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b926927e-77e5-4f70-be8e-2c7ae8595328 None None] MFA Rules not processed for user `388aea58343b4c0c994dcf4f861a4250`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:39.265262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b926927e-77e5-4f70-be8e-2c7ae8595328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.288024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.288921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.289201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.289473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] PATH_INFO: `/v3/projects/5ffced8ba6984ba0b2e3677b6c2a5fcd/users/7a35695d8b8d425fa36b2e8f9883c3a6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.291486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffced8ba6984ba0b2e3677b6c2a5fcd, user_id=7a35695d8b8d425fa36b2e8f9883c3a6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.294164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.304600 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 821/1660] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:39 2022] PUT /identity/v3/projects/5ffced8ba6984ba0b2e3677b6c2a5fcd/users/7a35695d8b8d425fa36b2e8f9883c3a6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:39.305587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.345894 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 840/1661] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:39.347328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.347612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.348491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.373067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] MFA Rules not processed for user `dd7910f30f6d41eeabc3f17ef1b6cdde`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:39.374250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.374525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1157e-7dce-4b9c-a373-ade0e58c49c8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.380524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdd9ed-7ace-42c0-acf8-399320a75867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.381324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd9ed-7ace-42c0-acf8-399320a75867 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.381609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd9ed-7ace-42c0-acf8-399320a75867 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.381886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd9ed-7ace-42c0-acf8-399320a75867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.439210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 841/1662] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:39.439725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdd9ed-7ace-42c0-acf8-399320a75867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.440181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.440856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdd9ed-7ace-42c0-acf8-399320a75867 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.441665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.451149 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 822/1663] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:39.452461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9bf1-8ca7-4b73-880e-6665ca5603e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.452755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9bf1-8ca7-4b73-880e-6665ca5603e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.453032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa9bf1-8ca7-4b73-880e-6665ca5603e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.478941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-10aa9bf1-8ca7-4b73-880e-6665ca5603e6 None None] MFA Rules not processed for user `f5deaeebfbd04e56b626030c324b62db`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:39.480269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-10aa9bf1-8ca7-4b73-880e-6665ca5603e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.508455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a522e0-7441-4fcf-a8af-afe7ca0317b6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.513100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.513944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.514226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.514498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] PATH_INFO: `/v3/projects/4baa57a3206141f5adcc7d0a3b3aaf13` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.515747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baa57a3206141f5adcc7d0a3b3aaf13)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.517640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.562203 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 823/1664] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:39.562203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa9bf1-8ca7-4b73-880e-6665ca5603e6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.570044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baa57a3206141f5adcc7d0a3b3aaf13', 'request_id': 'req-9df0a667-5d5d-4e56-8d42-8f63e883b1db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:39.574011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa9bf1-8ca7-4b73-880e-6665ca5603e6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.576692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baa57a3206141f5adcc7d0a3b3aaf13', 'request_id': 'req-9df0a667-5d5d-4e56-8d42-8f63e883b1db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:39.586804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baa57a3206141f5adcc7d0a3b3aaf13', 'request_id': 'req-9df0a667-5d5d-4e56-8d42-8f63e883b1db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:39.599466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] The token cache is being invalidate because project 4baa57a3206141f5adcc7d0a3b3aaf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:39.600048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:39.600718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9df0a667-5d5d-4e56-8d42-8f63e883b1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:39.606862 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 842/1665] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:39 2022] DELETE /identity/v3/projects/4baa57a3206141f5adcc7d0a3b3aaf13 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:39.609265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff3f3-8250-490f-9303-50842db21d81 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.609768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff3f3-8250-490f-9303-50842db21d81 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.610262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff3f3-8250-490f-9303-50842db21d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.636909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2d6ff3f3-8250-490f-9303-50842db21d81 None None] MFA Rules not processed for user `7a35695d8b8d425fa36b2e8f9883c3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:39.638338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2d6ff3f3-8250-490f-9303-50842db21d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.647770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46d12-4f56-41bc-a1f8-c7546f7eca9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.648591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46d12-4f56-41bc-a1f8-c7546f7eca9c service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.648940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46d12-4f56-41bc-a1f8-c7546f7eca9c service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.649382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46d12-4f56-41bc-a1f8-c7546f7eca9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.651544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-21d46d12-4f56-41bc-a1f8-c7546f7eca9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.710914 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 843/1666] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:39.713254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f244-3827-4d3c-9534-7daed39112bb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.713714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f244-3827-4d3c-9534-7daed39112bb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.713989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8f244-3827-4d3c-9534-7daed39112bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.719049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46d12-4f56-41bc-a1f8-c7546f7eca9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.720724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46d12-4f56-41bc-a1f8-c7546f7eca9c service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.731329 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 824/1667] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:39.733398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-aab8f244-3827-4d3c-9534-7daed39112bb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:39.734579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aab8f244-3827-4d3c-9534-7daed39112bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.809857 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 844/1668] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:39.811163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b4c3-9f16-44e6-b462-f5ac3f7b27f8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.811448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b4c3-9f16-44e6-b462-f5ac3f7b27f8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.811717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64b4c3-9f16-44e6-b462-f5ac3f7b27f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.830599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dd64b4c3-9f16-44e6-b462-f5ac3f7b27f8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:39.831809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd64b4c3-9f16-44e6-b462-f5ac3f7b27f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:39.842830 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 825/1669] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:45:39.845129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8f244-3827-4d3c-9534-7daed39112bb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.855269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8f244-3827-4d3c-9534-7daed39112bb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.859949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.860699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.861078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.861445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.862258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:39.862656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.864416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.875875 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 845/1670] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:39.880813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b4c3-9f16-44e6-b462-f5ac3f7b27f8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.889972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64b4c3-9f16-44e6-b462-f5ac3f7b27f8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.894584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:39.895757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:39.896033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:39.896304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:39.896985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:39.898907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:39.923651 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 826/1671] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:45:39.927744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.937301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebac6d-bc90-43f3-b3d5-4be2450f2aa6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:39.973898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:39.976936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.017828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.018526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.018838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.019117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.019824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.021993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.043823 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 846/1672] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:39 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:45:40.048164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.051773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74649e7-38e8-4d9f-8512-f1af83e57022 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.058008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.058653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.058789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058e230-a122-4456-8730-805a943e6544 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.058995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.059270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.061068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.063984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.064617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.064899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.065170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.065873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.068076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.078944 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 847/1673] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:40.081943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.091144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39873d2-8bd2-4a8e-b519-c88df78c9795 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.096254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.097000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.097284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.097555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.098287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.099885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.110292 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 848/1674] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:45:40.115393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.125547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.126404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741c737-e1a5-4a9f-81c4-43851bd3a8ea admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.127277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.132341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e7037-f7dc-4cae-90b1-2eba7cb03eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.133373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e7037-f7dc-4cae-90b1-2eba7cb03eda admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.133936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e7037-f7dc-4cae-90b1-2eba7cb03eda admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.134446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e7037-f7dc-4cae-90b1-2eba7cb03eda admin admin] PATH_INFO: `/v3/projects/0a424bf597be4f4aacb918a4e9770c8c/users/c9d2b452a2b7434e96ce0fb54e28f437/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.137666 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 827/1675] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:45:40.152684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e7037-f7dc-4cae-90b1-2eba7cb03eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a424bf597be4f4aacb918a4e9770c8c, user_id=c9d2b452a2b7434e96ce0fb54e28f437, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.155491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.156952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.157062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e7037-f7dc-4cae-90b1-2eba7cb03eda admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.171827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 849/1676] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:40 2022] PUT /identity/v3/projects/0a424bf597be4f4aacb918a4e9770c8c/users/c9d2b452a2b7434e96ce0fb54e28f437/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:40.172601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83846ebe-cc55-4bb0-a995-6b6082375594 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.184374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2d833-c7ba-4cd2-a961-b1f18d4ab728 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.184728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2d833-c7ba-4cd2-a961-b1f18d4ab728 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.185007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2d833-c7ba-4cd2-a961-b1f18d4ab728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.220333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-78c2d833-c7ba-4cd2-a961-b1f18d4ab728 None None] MFA Rules not processed for user `c9d2b452a2b7434e96ce0fb54e28f437`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:40.221446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-78c2d833-c7ba-4cd2-a961-b1f18d4ab728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.244113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.244769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.245055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.245334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.247206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.282926 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 850/1677] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:40.283843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2d833-c7ba-4cd2-a961-b1f18d4ab728 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.297199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2d833-c7ba-4cd2-a961-b1f18d4ab728 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.303344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.303971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.304250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.304525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.306295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.306731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.308928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.319258 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 828/1678] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:40.320031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.364895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.366863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.382141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 851/1679] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:40.382731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c93d71-ea91-4a93-8d39-100618e6175a service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.383070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.387446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.388108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.388391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.388795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.389616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.391570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.393726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05310a-05f2-4cec-9e4e-7f2c29eb47d0 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.403960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.404781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.405090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.405359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.423682 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 829/1680] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:40 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:40.424571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.426764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.474268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.476011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.486012 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 852/1681] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:40.487940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.490413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883589b0-ac23-4d22-bb00-806778646a37 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.495249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.496129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.496405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.496674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] PATH_INFO: `/v3/users/92f1c2e2f8f44009b3ede81d9b970c85` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.498520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f1c2e2f8f44009b3ede81d9b970c85)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.500528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.502754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f83601c-a490-4e7f-96c0-90bd883e3f4a service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.509611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.510392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.510677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.511316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.512084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.514449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.554600 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 853/1682] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:40 2022] POST /identity/v3/users => generated 292 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:40.555730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.566464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4e66e-dac0-4432-9a51-29df192140f2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.567916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f1c2e2f8f44009b3ede81d9b970c85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.576082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f1c2e2f8f44009b3ede81d9b970c85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.576607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.576742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f1c2e2f8f44009b3ede81d9b970c85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.577363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f1c2e2f8f44009b3ede81d9b970c85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.577459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.577660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.578051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.578800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.580421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.586158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f1c2e2f8f44009b3ede81d9b970c85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.596967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 854/1683] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:40.598464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.603547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.619258 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 830/1684] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:40 2022] DELETE /identity/v3/users/92f1c2e2f8f44009b3ede81d9b970c85 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:40.620134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.621711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.627703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ad782-9ee1-4864-b7b3-6ef6982e1398 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.699076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd13d4c-4934-4deb-b4b2-0a584116d565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.699977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13d4c-4934-4deb-b4b2-0a584116d565 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.700260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13d4c-4934-4deb-b4b2-0a584116d565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.700660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd13d4c-4934-4deb-b4b2-0a584116d565 admin admin] PATH_INFO: `/v3/projects/424ccc0f77ea47d58288725670e1b704/users/1b802cd76c374f6dbbec29b9fc75eee7/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.709019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f9363-2a65-417b-b66c-84640867c530 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.715544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.716703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.717261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.717848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] PATH_INFO: `/v3/users/b93356f25d9f4ff9ad89a80cab2853eb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.719612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93356f25d9f4ff9ad89a80cab2853eb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.720627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd13d4c-4934-4deb-b4b2-0a584116d565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424ccc0f77ea47d58288725670e1b704, user_id=1b802cd76c374f6dbbec29b9fc75eee7, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.722193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.726378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd13d4c-4934-4deb-b4b2-0a584116d565 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.743374 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 855/1685] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:40 2022] PUT /identity/v3/projects/424ccc0f77ea47d58288725670e1b704/users/1b802cd76c374f6dbbec29b9fc75eee7/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:40.743374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.743374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.743374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.760986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:40.762288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.777767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93356f25d9f4ff9ad89a80cab2853eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.784760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93356f25d9f4ff9ad89a80cab2853eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.786103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93356f25d9f4ff9ad89a80cab2853eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.786755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93356f25d9f4ff9ad89a80cab2853eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.794372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b72f96b-a805-431c-8b9b-4ed676cc7ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93356f25d9f4ff9ad89a80cab2853eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:40.811699 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 831/1686] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:40 2022] DELETE /identity/v3/users/b93356f25d9f4ff9ad89a80cab2853eb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:40.813097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33bfe-83b2-4b22-b671-118bd86d0007 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.813454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33bfe-83b2-4b22-b671-118bd86d0007 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.813799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33bfe-83b2-4b22-b671-118bd86d0007 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.815474 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 832/1687] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:40.816134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33bfe-83b2-4b22-b671-118bd86d0007 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.817872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08c33bfe-83b2-4b22-b671-118bd86d0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.828515 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 856/1688] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:40.829422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:40.830765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.885664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33bfe-83b2-4b22-b671-118bd86d0007 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.890596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be7248-e8e7-4aed-bc70-aa67abcded5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.891290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7248-e8e7-4aed-bc70-aa67abcded5e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.891576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7248-e8e7-4aed-bc70-aa67abcded5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.891849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be7248-e8e7-4aed-bc70-aa67abcded5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.892569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be7248-e8e7-4aed-bc70-aa67abcded5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:40.894200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be7248-e8e7-4aed-bc70-aa67abcded5e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:40.901709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fd432-43b1-4d5d-b2ac-5984d2bbcd9f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:40.904212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 833/1689] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:40.905400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e03712-c12b-478a-834a-c36e978f310a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.905678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e03712-c12b-478a-834a-c36e978f310a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.905952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e03712-c12b-478a-834a-c36e978f310a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.922743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-00e03712-c12b-478a-834a-c36e978f310a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:40.924240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00e03712-c12b-478a-834a-c36e978f310a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.931795 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 834/1690] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:40.932968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.933256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.933531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.952054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:40.953228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:40.964248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:40.964903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:40.965189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:40.965467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:40.967269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.014758 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 835/1691] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:41.015649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.016995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.022727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.024371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.033730 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 857/1692] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:41.034522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.045638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7693c-7ae2-4ac1-8c96-de057fa35e67 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.050921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.051809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.052094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.052372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] PATH_INFO: `/v3/projects/424ccc0f77ea47d58288725670e1b704/users/1b802cd76c374f6dbbec29b9fc75eee7/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.055087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424ccc0f77ea47d58288725670e1b704, user_id=1b802cd76c374f6dbbec29b9fc75eee7, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.057754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.070323 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 858/1693] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:41 2022] PUT /identity/v3/projects/424ccc0f77ea47d58288725670e1b704/users/1b802cd76c374f6dbbec29b9fc75eee7/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:41.071497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.072683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.075353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998f531-0f1c-43a1-a8e5-01269499c067 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.133011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.133825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.134110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.134392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.137173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff3fbe-42a8-4245-9d9e-a3c7e366e504 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.141046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d7b7-1a04-428d-8448-988a5ad242a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.141695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d7b7-1a04-428d-8448-988a5ad242a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.141985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d7b7-1a04-428d-8448-988a5ad242a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.142262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d7b7-1a04-428d-8448-988a5ad242a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.198648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.198648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.213422 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 836/1694] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:41.213422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.216969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.217826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d7b7-1a04-428d-8448-988a5ad242a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.219383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d7b7-1a04-428d-8448-988a5ad242a7 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.230551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 859/1695] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:41.232123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10e866-8c23-4c64-a951-fda5180af86f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.232500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10e866-8c23-4c64-a951-fda5180af86f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.232837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10e866-8c23-4c64-a951-fda5180af86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.266168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3b10e866-8c23-4c64-a951-fda5180af86f None None] MFA Rules not processed for user `1b802cd76c374f6dbbec29b9fc75eee7`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:41.267714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3b10e866-8c23-4c64-a951-fda5180af86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.350334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3dbf8-62ed-4c6b-bd61-cfb4ae1a3cca service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.357158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.357681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.358039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.358415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.372694 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 860/1696] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:41.372886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.372886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.384334 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 837/1697] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:41.458575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10e866-8c23-4c64-a951-fda5180af86f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.564259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.565148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10e866-8c23-4c64-a951-fda5180af86f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.565805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.593344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.594145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.594459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.594799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.601349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f0d6a-593f-461e-9d42-57a978dea602 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.609930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.611902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.616121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.616998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.617264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.617547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] PATH_INFO: `/v3/projects/8d1a04907a264ef5bfa8bea4e1a3a704` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.619689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1a04907a264ef5bfa8bea4e1a3a704)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.621862 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.621862 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:45:41.621862 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:45:41.624968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.627383 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 861/1698] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:41.628376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.630411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.658384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379ddc-c91b-4282-9422-4acb7fd092c3 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.664216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.666505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.667199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.668009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] PATH_INFO: `/v3/projects/451d8752792a4106b2ea34d23ecc5593` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.669868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=451d8752792a4106b2ea34d23ecc5593)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.672241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.712285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1a04907a264ef5bfa8bea4e1a3a704', 'request_id': 'req-f91b164b-8526-437c-b422-4fdc6d872ac0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.729844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1a04907a264ef5bfa8bea4e1a3a704', 'request_id': 'req-f91b164b-8526-437c-b422-4fdc6d872ac0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.739106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1a04907a264ef5bfa8bea4e1a3a704', 'request_id': 'req-f91b164b-8526-437c-b422-4fdc6d872ac0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.758019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] The token cache is being invalidate because project 8d1a04907a264ef5bfa8bea4e1a3a704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:41.758313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.759381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.760085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451d8752792a4106b2ea34d23ecc5593', 'request_id': 'req-39e63666-b33a-4467-a95b-c7854c0bdb0f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.761879 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 838/1699] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:41 2022] DELETE /identity/v3/projects/8d1a04907a264ef5bfa8bea4e1a3a704 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:41.767724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.769158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451d8752792a4106b2ea34d23ecc5593', 'request_id': 'req-39e63666-b33a-4467-a95b-c7854c0bdb0f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.769273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.781750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451d8752792a4106b2ea34d23ecc5593', 'request_id': 'req-39e63666-b33a-4467-a95b-c7854c0bdb0f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.793599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] The token cache is being invalidate because project 451d8752792a4106b2ea34d23ecc5593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:41.793891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.794584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:41.796597 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 862/1700] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:41 2022] DELETE /identity/v3/projects/451d8752792a4106b2ea34d23ecc5593 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:41.806243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:41.806243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:41.871140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b164b-8526-437c-b422-4fdc6d872ac0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.909703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e63666-b33a-4467-a95b-c7854c0bdb0f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:41.916238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.917282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.917608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.917881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] PATH_INFO: `/v3/users/f5deaeebfbd04e56b626030c324b62db` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.919147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5deaeebfbd04e56b626030c324b62db)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.920212 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:45:41.920212 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:45:41.920212 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:45:41.921438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:41.967323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:41.968216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:41.968500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:41.968965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] PATH_INFO: `/v3/users/b9739d9c6d794558bad9218157a5bb21` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:41.974228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9739d9c6d794558bad9218157a5bb21)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:41.976039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.020324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5deaeebfbd04e56b626030c324b62db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.021263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5deaeebfbd04e56b626030c324b62db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.033278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5deaeebfbd04e56b626030c324b62db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.033899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5deaeebfbd04e56b626030c324b62db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.044021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9739d9c6d794558bad9218157a5bb21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.046065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5deaeebfbd04e56b626030c324b62db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.051608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9739d9c6d794558bad9218157a5bb21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.052353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9739d9c6d794558bad9218157a5bb21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.053012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9739d9c6d794558bad9218157a5bb21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.061452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9739d9c6d794558bad9218157a5bb21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.074815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 863/1701] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:41 2022] DELETE /identity/v3/users/f5deaeebfbd04e56b626030c324b62db => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.075660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.077053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.079427 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 839/1702] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:41 2022] DELETE /identity/v3/users/b9739d9c6d794558bad9218157a5bb21 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.080389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.081648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.149275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f260bc-d457-40d9-bed4-216a96e42d65 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.154278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.155304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.155595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.155876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] PATH_INFO: `/v3/users/799d6070fafb4901b08626b9aeebd197` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.157185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799d6070fafb4901b08626b9aeebd197)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.159477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.161395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1840eb-1170-468a-b714-64b2b5760cf6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.169066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.170415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.170880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.171416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] PATH_INFO: `/v3/users/c9d2b452a2b7434e96ce0fb54e28f437` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.172967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d2b452a2b7434e96ce0fb54e28f437)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.176651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.231433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799d6070fafb4901b08626b9aeebd197'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.244295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799d6070fafb4901b08626b9aeebd197'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.245287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799d6070fafb4901b08626b9aeebd197'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.246257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799d6070fafb4901b08626b9aeebd197'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.257037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799d6070fafb4901b08626b9aeebd197'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.261668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d2b452a2b7434e96ce0fb54e28f437'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.262390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d2b452a2b7434e96ce0fb54e28f437'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.271734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d2b452a2b7434e96ce0fb54e28f437'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.272451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d2b452a2b7434e96ce0fb54e28f437'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.285790 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 840/1703] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:42 2022] DELETE /identity/v3/users/799d6070fafb4901b08626b9aeebd197 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.286221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d2b452a2b7434e96ce0fb54e28f437'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.286716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.288458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.314562 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 864/1704] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:42 2022] DELETE /identity/v3/users/c9d2b452a2b7434e96ce0fb54e28f437 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.318457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.319894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.373265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce421ea5-9c60-44d3-9153-dd64af066da3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.389613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76255b5-cb28-465c-b0d5-a297162a624c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.395308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.396344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.396714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.397088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] PATH_INFO: `/v3/users/474acbe7ce864bdfa6b213bf0f19e18a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.398483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474acbe7ce864bdfa6b213bf0f19e18a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.400858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.444463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.445345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.445629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.445906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] PATH_INFO: `/v3/users/191c435675094cd09dad05124abc1715` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.447186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=191c435675094cd09dad05124abc1715)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.449449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.466664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474acbe7ce864bdfa6b213bf0f19e18a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.467559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474acbe7ce864bdfa6b213bf0f19e18a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.476734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474acbe7ce864bdfa6b213bf0f19e18a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.477801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474acbe7ce864bdfa6b213bf0f19e18a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.486855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5904585-f562-480a-a17e-eb59409249d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474acbe7ce864bdfa6b213bf0f19e18a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.505412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191c435675094cd09dad05124abc1715'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.505918 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 865/1705] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:42 2022] DELETE /identity/v3/users/474acbe7ce864bdfa6b213bf0f19e18a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.507248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc802-a011-459f-ae6d-32378ac689f1 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.507646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc802-a011-459f-ae6d-32378ac689f1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.508000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cc802-a011-459f-ae6d-32378ac689f1 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.509674 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 866/1706] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:42.510734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.511115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.511487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.513236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191c435675094cd09dad05124abc1715'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.514119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191c435675094cd09dad05124abc1715'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.514835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191c435675094cd09dad05124abc1715'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.531375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4dcbf83e-ec37-476d-b57f-4a566c6b67ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191c435675094cd09dad05124abc1715'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.531975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:42.533290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.550936 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 841/1707] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:42 2022] DELETE /identity/v3/users/191c435675094cd09dad05124abc1715 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.552350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.552643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.552922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.570529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:42.571806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.593256 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 867/1708] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:42.594697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.596186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.607737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221adf8a-2f8f-4e53-b697-8fa10dae1908 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.630434 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 842/1709] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:42.631513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.632498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.645396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8e498-2312-40c2-947f-f0923965c665 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.650118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.651107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.651412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.651684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] PATH_INFO: `/v3/projects/1f0ad2f96d95448ba36acd91f9effa57` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.652859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0ad2f96d95448ba36acd91f9effa57)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.654790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.663182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.664043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.664328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.664607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] PATH_INFO: `/v3/projects/ab23e2f0d5f0443fa1e3fc7dcaf82162` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.665807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab23e2f0d5f0443fa1e3fc7dcaf82162)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.667763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.701507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0ad2f96d95448ba36acd91f9effa57', 'request_id': 'req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.708216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0ad2f96d95448ba36acd91f9effa57', 'request_id': 'req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.712422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab23e2f0d5f0443fa1e3fc7dcaf82162', 'request_id': 'req-dad387be-d309-4be2-854b-4d850727633e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.715351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0ad2f96d95448ba36acd91f9effa57', 'request_id': 'req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.718669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab23e2f0d5f0443fa1e3fc7dcaf82162', 'request_id': 'req-dad387be-d309-4be2-854b-4d850727633e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.725578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab23e2f0d5f0443fa1e3fc7dcaf82162', 'request_id': 'req-dad387be-d309-4be2-854b-4d850727633e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.727045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] The token cache is being invalidate because project 1f0ad2f96d95448ba36acd91f9effa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:42.727402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.728105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dda4c5f9-5340-4cd9-a603-4b3ca306d9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.729665 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 843/1710] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:42 2022] DELETE /identity/v3/projects/1f0ad2f96d95448ba36acd91f9effa57 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.730986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea205c-a2aa-43a5-9ab8-23884de89593 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.731267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea205c-a2aa-43a5-9ab8-23884de89593 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.731567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea205c-a2aa-43a5-9ab8-23884de89593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.736502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] The token cache is being invalidate because project ab23e2f0d5f0443fa1e3fc7dcaf82162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:42.736789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.737458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad387be-d309-4be2-854b-4d850727633e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:42.739021 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 868/1711] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:42 2022] DELETE /identity/v3/projects/ab23e2f0d5f0443fa1e3fc7dcaf82162 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:42.740288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.740575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.740848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.748917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-58ea205c-a2aa-43a5-9ab8-23884de89593 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:42.750098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-58ea205c-a2aa-43a5-9ab8-23884de89593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.758967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:42.760125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.808139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 844/1712] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:42.812914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.812914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.812914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.822044 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 869/1713] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:42.822930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.824494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.838590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:42.839811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.848491 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 845/1714] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:42.849296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.850523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.882135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b124fbd-8a32-4a50-8613-bbb3295914af None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.885972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d881046-d929-426b-976d-a7f52c70456a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.886611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881046-d929-426b-976d-a7f52c70456a service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.886931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881046-d929-426b-976d-a7f52c70456a service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.887231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881046-d929-426b-976d-a7f52c70456a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.889087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1d881046-d929-426b-976d-a7f52c70456a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.901542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d881046-d929-426b-976d-a7f52c70456a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.903031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d881046-d929-426b-976d-a7f52c70456a service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.905571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bbf80-626f-4082-93c8-f82e7549707b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.909180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b831bfb-b9cd-4d28-899d-7eaf0242898a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.909828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831bfb-b9cd-4d28-899d-7eaf0242898a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.910137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831bfb-b9cd-4d28-899d-7eaf0242898a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.910413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831bfb-b9cd-4d28-899d-7eaf0242898a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.912217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b831bfb-b9cd-4d28-899d-7eaf0242898a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.912346 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 870/1715] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:42.913470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.913729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.914005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.924682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b831bfb-b9cd-4d28-899d-7eaf0242898a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.926301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b831bfb-b9cd-4d28-899d-7eaf0242898a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.933040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:42.934287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.936237 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 846/1716] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:42.937338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.937821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.938106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.943348 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 871/1717] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:42.944154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.945463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.957939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588efa4-50d3-4218-9fbe-816b1edc9c19 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:42.961866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:42.962532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:42.962841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:42.963113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:42.964294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:42.965521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.972929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:42.974520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:42.982351 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 847/1718] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:42.982351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.983897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:42.987022 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 872/1719] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:42.988822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:42.997947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317f23d-fa4b-4d62-a937-ed80f640d3a3 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.002354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47246d0f-7218-44a1-9550-b455a68e3758 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.003205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b3ff-fc5a-4f33-9e91-799a6399c0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.005354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b3ff-fc5a-4f33-9e91-799a6399c0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.006195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b3ff-fc5a-4f33-9e91-799a6399c0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.006714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b3ff-fc5a-4f33-9e91-799a6399c0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.009458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea5b35-f348-44ef-a255-554b43a3da2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.010564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5b35-f348-44ef-a255-554b43a3da2f service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.011043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5b35-f348-44ef-a255-554b43a3da2f service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.011413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea5b35-f348-44ef-a255-554b43a3da2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.019598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b3ff-fc5a-4f33-9e91-799a6399c0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.021934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b3ff-fc5a-4f33-9e91-799a6399c0a3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.023085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea5b35-f348-44ef-a255-554b43a3da2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.024848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea5b35-f348-44ef-a255-554b43a3da2f service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.036771 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 873/1720] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:43.038296 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 848/1721] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:43.039626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095723c-3952-41f5-b180-d32d6aef3818 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.040064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095723c-3952-41f5-b180-d32d6aef3818 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.040397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244652a8-b2a5-4fce-86e8-f73e46b70cbc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.040724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095723c-3952-41f5-b180-d32d6aef3818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.041154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244652a8-b2a5-4fce-86e8-f73e46b70cbc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.041575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244652a8-b2a5-4fce-86e8-f73e46b70cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.063517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0095723c-3952-41f5-b180-d32d6aef3818 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:43.065872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-244652a8-b2a5-4fce-86e8-f73e46b70cbc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:43.068038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-244652a8-b2a5-4fce-86e8-f73e46b70cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.078827 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 849/1722] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:43.083565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244652a8-b2a5-4fce-86e8-f73e46b70cbc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.088643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0095723c-3952-41f5-b180-d32d6aef3818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.096384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244652a8-b2a5-4fce-86e8-f73e46b70cbc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.104570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.105489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.105868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.106348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.107672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:43.108128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.110550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.119429 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 874/1723] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:43.120789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095723c-3952-41f5-b180-d32d6aef3818 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.129684 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 850/1724] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:43.134347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.136634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095723c-3952-41f5-b180-d32d6aef3818 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.149412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.150487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.150803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.151337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.151966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6dcef-0643-48b4-8548-45e0e65bccb3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.152324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:43.152898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.155385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.161383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.168630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.169060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.169353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.170142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.176845 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 875/1725] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:43.176945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.177795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.192201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6e5f-e28c-412c-9131-4febb3dfc252 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.199872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.200910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.201923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.202362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.203095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.205180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.223511 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 851/1726] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:43 2022] POST /identity/v3/projects => generated 361 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:43.227194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.247554 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 876/1727] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:43 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:43.251470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.312098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94240027-cbc5-4eb6-b660-3f82f827edcb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.337620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042293ef-f91c-4172-9ea5-6f9185c99f63 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.344243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.345049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.345456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.345819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.346601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.349584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.383428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.384143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.384551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.384834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.385673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.388145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.399393 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 877/1728] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:43 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:43.400474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.415916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0f19-2744-446b-92a4-d9788fd09668 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.422395 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 852/1729] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:43 2022] POST /identity/v3/users => generated 281 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:45:43.423947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.426254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.427115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.427467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.427797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.428732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.430596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.443405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd28e5-e3db-4c20-9757-0177ed796220 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.446985 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 878/1730] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:43.448784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.458262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.459055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.459370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.459648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.460417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.465428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac05c0-1b4a-4b9f-a5a6-a162e4ad4e20 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.466373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.484780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.485768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.486037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.486335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.487093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.489325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.507896 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 879/1731] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:43.509020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.511476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.515120 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 853/1732] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:45:43.517586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.528253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544cefe-bc19-4018-8b1a-281a110e519a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.534639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.536122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.536411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.536680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] PATH_INFO: `/v3/projects/0a424bf597be4f4aacb918a4e9770c8c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.537875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a424bf597be4f4aacb918a4e9770c8c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.540573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.545456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075a438-a489-47f2-8ee9-2598c76fb482 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.553972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.554948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.555442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.555729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] PATH_INFO: `/v3/projects/05873dc89d2c4c48b8528d394c8a8f17/users/ba669cb0f9b54772b034133b733b3045/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.589581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05873dc89d2c4c48b8528d394c8a8f17, user_id=ba669cb0f9b54772b034133b733b3045, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.600747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.626831 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 854/1733] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:43 2022] PUT /identity/v3/projects/05873dc89d2c4c48b8528d394c8a8f17/users/ba669cb0f9b54772b034133b733b3045/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:43.633251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.640899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a424bf597be4f4aacb918a4e9770c8c', 'request_id': 'req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.649745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a424bf597be4f4aacb918a4e9770c8c', 'request_id': 'req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.678406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a424bf597be4f4aacb918a4e9770c8c', 'request_id': 'req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.699874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] The token cache is being invalidate because project 0a424bf597be4f4aacb918a4e9770c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:43.699874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.700607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d2e9bc3-ec8e-4efd-8f2e-7d1892e8d758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.705819 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 880/1734] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:43 2022] DELETE /identity/v3/projects/0a424bf597be4f4aacb918a4e9770c8c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:43.708673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.709173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.711085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.717826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20bd11-48d4-4a19-804b-cff9b7c2b256 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.729351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.733485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.733485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.733919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.734670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.736347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.748799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 855/1735] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:43.749978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.752320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.757624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] MFA Rules not processed for user `ba669cb0f9b54772b034133b733b3045`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:43.759241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.878447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093aa6-0462-4831-9c9c-76240660c118 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.879824 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 881/1736] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:43.880761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.882266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.885332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.886478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.886478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.886720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.888905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.897819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46660-45d8-4e45-8063-aa541415eeab None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:43.906914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:43.908369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:43.908986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:43.909458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] PATH_INFO: `/v3/users/1b802cd76c374f6dbbec29b9fc75eee7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:43.911898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b802cd76c374f6dbbec29b9fc75eee7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.914445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.962699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:43.964456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:43.965125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b802cd76c374f6dbbec29b9fc75eee7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.965733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b802cd76c374f6dbbec29b9fc75eee7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.973746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b802cd76c374f6dbbec29b9fc75eee7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.974463 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 856/1737] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:43.974572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b802cd76c374f6dbbec29b9fc75eee7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.975225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:43.976561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:43.983659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b802cd76c374f6dbbec29b9fc75eee7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:43.995533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87bcd2-2789-429b-8de5-2bc72caa305c service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.004533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.005569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.005851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.006239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] PATH_INFO: `/v3/projects/fe2043e0dab64742bcf38b5dfe9b07bc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.008680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2043e0dab64742bcf38b5dfe9b07bc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.010623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.015208 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 882/1738] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:43 2022] DELETE /identity/v3/users/1b802cd76c374f6dbbec29b9fc75eee7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:44.016186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.018260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.084729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2043e0dab64742bcf38b5dfe9b07bc', 'request_id': 'req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.095012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2043e0dab64742bcf38b5dfe9b07bc', 'request_id': 'req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.108638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2043e0dab64742bcf38b5dfe9b07bc', 'request_id': 'req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.133405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] The token cache is being invalidate because project fe2043e0dab64742bcf38b5dfe9b07bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:44.133694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.134537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.135520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c06dda-0fdc-46e6-9d53-dd65c704a5a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.138822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 857/1739] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:43 2022] DELETE /identity/v3/projects/fe2043e0dab64742bcf38b5dfe9b07bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:44.138950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.141114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.219162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.221540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.222205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.223141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] PATH_INFO: `/v3/projects/7e415e6a8ff2442ea06aeb06e01ea9d0/users/3b23e023dac548ad86ceaec477451ba5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.247147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e415e6a8ff2442ea06aeb06e01ea9d0, user_id=3b23e023dac548ad86ceaec477451ba5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.250470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.261816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14e9b4-e539-497b-8e28-ea45c06cb8f9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.269726 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 883/1740] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:44 2022] PUT /identity/v3/projects/7e415e6a8ff2442ea06aeb06e01ea9d0/users/3b23e023dac548ad86ceaec477451ba5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:44.271299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.272553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.353453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.355380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.355674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.355953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] PATH_INFO: `/v3/projects/1412d53f87f74db2bad375bb6ff29901` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.357197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1412d53f87f74db2bad375bb6ff29901)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.359692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.360352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06370b-8885-4402-8c39-473cd44e821a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.384097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.384992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.385712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.385999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] PATH_INFO: `/v3/projects/1de0d60dedbf4d3d9b62718381a675fd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.387781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de0d60dedbf4d3d9b62718381a675fd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.389672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.449856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de0d60dedbf4d3d9b62718381a675fd', 'request_id': 'req-5ca0132b-ea9f-4943-b637-2c22005384f3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.452583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1412d53f87f74db2bad375bb6ff29901', 'request_id': 'req-40ea989e-996d-49b6-b486-e91518c037b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.456437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de0d60dedbf4d3d9b62718381a675fd', 'request_id': 'req-5ca0132b-ea9f-4943-b637-2c22005384f3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.461036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1412d53f87f74db2bad375bb6ff29901', 'request_id': 'req-40ea989e-996d-49b6-b486-e91518c037b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.467238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de0d60dedbf4d3d9b62718381a675fd', 'request_id': 'req-5ca0132b-ea9f-4943-b637-2c22005384f3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.476500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1412d53f87f74db2bad375bb6ff29901', 'request_id': 'req-40ea989e-996d-49b6-b486-e91518c037b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.480485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] The token cache is being invalidate because project 1de0d60dedbf4d3d9b62718381a675fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:44.480785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.481481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.483640 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 884/1741] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:44 2022] DELETE /identity/v3/projects/1de0d60dedbf4d3d9b62718381a675fd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:44.484472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.485943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.492420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] The token cache is being invalidate because project 1412d53f87f74db2bad375bb6ff29901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:44.493146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.494144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40ea989e-996d-49b6-b486-e91518c037b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.496237 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 858/1742] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:44 2022] DELETE /identity/v3/projects/1412d53f87f74db2bad375bb6ff29901 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:44.498282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.498282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.498282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.517209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] MFA Rules not processed for user `e0e9f1939f084da58fc8a612ef31f6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:44.518447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.563885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0132b-ea9f-4943-b637-2c22005384f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.587224 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 859/1743] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:44.590006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.592873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.631494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5b109-abbe-403a-accf-a192b12f253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.632158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b109-abbe-403a-accf-a192b12f253f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.632442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b109-abbe-403a-accf-a192b12f253f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.632719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5b109-abbe-403a-accf-a192b12f253f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.633405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5b109-abbe-403a-accf-a192b12f253f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.635358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5b109-abbe-403a-accf-a192b12f253f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.664381 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 885/1744] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:44 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:44.664381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.664381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.664381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.666789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d383af1-f83d-429f-8e35-6d929efabab9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.692255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] MFA Rules not processed for user `3b23e023dac548ad86ceaec477451ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:44.693471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.721522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.723429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.723719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.723994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] PATH_INFO: `/v3/users/75347057109e40d09c0e5152fd8605ef` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.725215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75347057109e40d09c0e5152fd8605ef)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.727372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.757813 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 886/1745] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:44.758670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.760003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.775320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1228-fd3b-453b-b3c0-9be6ae807c14 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.779929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.780756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.781041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.781313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] PATH_INFO: `/v3/projects/424ccc0f77ea47d58288725670e1b704` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.782481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=424ccc0f77ea47d58288725670e1b704)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.784447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.785645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75347057109e40d09c0e5152fd8605ef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.792247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75347057109e40d09c0e5152fd8605ef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.793303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75347057109e40d09c0e5152fd8605ef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.793927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75347057109e40d09c0e5152fd8605ef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.801050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75347057109e40d09c0e5152fd8605ef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.819766 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 860/1746] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:44 2022] DELETE /identity/v3/users/75347057109e40d09c0e5152fd8605ef => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:44.821166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.822854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.840466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424ccc0f77ea47d58288725670e1b704', 'request_id': 'req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.847283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424ccc0f77ea47d58288725670e1b704', 'request_id': 'req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.856998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424ccc0f77ea47d58288725670e1b704', 'request_id': 'req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.867951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] The token cache is being invalidate because project 424ccc0f77ea47d58288725670e1b704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:44.868238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.868895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.870812 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 887/1747] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:44 2022] DELETE /identity/v3/projects/424ccc0f77ea47d58288725670e1b704 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:44.871416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:44.872748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:44.895900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0fa5-b997-4000-bba0-e5f9f280b39c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.901614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.902633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.903033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.903329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] PATH_INFO: `/v3/users/1508fe7b6fd84ac9ad5710433cfe4a5c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.904569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1508fe7b6fd84ac9ad5710433cfe4a5c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.906884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.942361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d1fc0-c476-4b2d-b533-0eb5e3ba4c85 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:44.947650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:44.948788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:44.949077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:44.949348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] PATH_INFO: `/v3/users/7a35695d8b8d425fa36b2e8f9883c3a6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:44.950542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a35695d8b8d425fa36b2e8f9883c3a6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:44.952560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:44.960237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1508fe7b6fd84ac9ad5710433cfe4a5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.967585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1508fe7b6fd84ac9ad5710433cfe4a5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.968420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1508fe7b6fd84ac9ad5710433cfe4a5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.969068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1508fe7b6fd84ac9ad5710433cfe4a5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:44.980409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1508fe7b6fd84ac9ad5710433cfe4a5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.005177 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 861/1748] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:44 2022] DELETE /identity/v3/users/1508fe7b6fd84ac9ad5710433cfe4a5c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:45.005177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.005177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.011502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a35695d8b8d425fa36b2e8f9883c3a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.012228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a35695d8b8d425fa36b2e8f9883c3a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.020228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a35695d8b8d425fa36b2e8f9883c3a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.021121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a35695d8b8d425fa36b2e8f9883c3a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.029255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a35695d8b8d425fa36b2e8f9883c3a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.058862 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 888/1749] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:44 2022] DELETE /identity/v3/users/7a35695d8b8d425fa36b2e8f9883c3a6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:45.061450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.063617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.087042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe33c8-411e-4a4c-af64-92d6268a6dee admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.168951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bbc13-d545-4183-834c-89e3f72f7a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.169983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bbc13-d545-4183-834c-89e3f72f7a43 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.170155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bbc13-d545-4183-834c-89e3f72f7a43 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.170592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bbc13-d545-4183-834c-89e3f72f7a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.173667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-768bbc13-d545-4183-834c-89e3f72f7a43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.202362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c649b-e465-49cd-b585-2abbc2fbc770 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.210453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.211169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.211452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.212243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.212463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.215423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.268161 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 889/1750] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:45.269156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bbc13-d545-4183-834c-89e3f72f7a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.269280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.271196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bbc13-d545-4183-834c-89e3f72f7a43 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.272158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.283843 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 862/1751] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:45.286423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.286806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.287175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.300420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c9ac-5e6a-48bc-ae15-32f140db5bd8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.308840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.309631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:45.311198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.320393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.320720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.321005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.323604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.326872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.329895 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 863/1752] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:45.337145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.337145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.348328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9142c3-3e7c-4ccf-a67a-c9d6a5e85893 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.354069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.355065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.356048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.357010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] PATH_INFO: `/v3/projects/894b035e2d7f492892e2b866e5f474a2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.360029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=894b035e2d7f492892e2b866e5f474a2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.368452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.382363 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 890/1753] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/projects => generated 359 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:45.382363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.440136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894b035e2d7f492892e2b866e5f474a2', 'request_id': 'req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.447831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894b035e2d7f492892e2b866e5f474a2', 'request_id': 'req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.456147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b560a-dc5d-43f4-97a9-95ed358b1770 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.460221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894b035e2d7f492892e2b866e5f474a2', 'request_id': 'req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.474343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] The token cache is being invalidate because project 894b035e2d7f492892e2b866e5f474a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:45.474933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.475793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b8bfe2-6e5f-42fb-8c3a-cbc9cd4fced3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.477859 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 864/1754] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:45 2022] DELETE /identity/v3/projects/894b035e2d7f492892e2b866e5f474a2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:45.479395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.480283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.480837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.503170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:45.504957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.520502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f519a1-2928-4385-8ad9-6cb5e0f398ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.521172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f519a1-2928-4385-8ad9-6cb5e0f398ce admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.521644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f519a1-2928-4385-8ad9-6cb5e0f398ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.521937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f519a1-2928-4385-8ad9-6cb5e0f398ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.522816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f519a1-2928-4385-8ad9-6cb5e0f398ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.524469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f519a1-2928-4385-8ad9-6cb5e0f398ce admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.534092 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 891/1755] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:45.534092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192167b-5328-4bce-a237-62cfa4e0019f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.534092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192167b-5328-4bce-a237-62cfa4e0019f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.534092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192167b-5328-4bce-a237-62cfa4e0019f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.537679 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 892/1756] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:45.542487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192167b-5328-4bce-a237-62cfa4e0019f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.544224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4192167b-5328-4bce-a237-62cfa4e0019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.559595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192167b-5328-4bce-a237-62cfa4e0019f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.562748 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 865/1757] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:45.563962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.565273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.567765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.568423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.568711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.568992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.570138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.572103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.577963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ce6f3-19cd-459f-89d0-2d44719cc050 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.582621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.583505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.583792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.584074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] PATH_INFO: `/v3/projects/ec58efaaec5d4733b82ae683719b9caf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.585256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec58efaaec5d4733b82ae683719b9caf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.587234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.595601 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 893/1758] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/users => generated 286 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:45.595601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.595601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.607499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da749b8-42b5-4146-81d3-f4010776244d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.612181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.613015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.613863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.614140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] PATH_INFO: `/v3/projects/5ffced8ba6984ba0b2e3677b6c2a5fcd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.615375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffced8ba6984ba0b2e3677b6c2a5fcd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.617314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.633219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec58efaaec5d4733b82ae683719b9caf', 'request_id': 'req-92c19e72-c7d2-48e6-a37c-379f970c0915'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.639328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec58efaaec5d4733b82ae683719b9caf', 'request_id': 'req-92c19e72-c7d2-48e6-a37c-379f970c0915'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.646717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec58efaaec5d4733b82ae683719b9caf', 'request_id': 'req-92c19e72-c7d2-48e6-a37c-379f970c0915'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.656841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] The token cache is being invalidate because project ec58efaaec5d4733b82ae683719b9caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:45.657129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.657769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92c19e72-c7d2-48e6-a37c-379f970c0915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.659364 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 866/1759] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:45 2022] DELETE /identity/v3/projects/ec58efaaec5d4733b82ae683719b9caf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:45.661191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a73d-46ca-47ce-ac20-823899384b04 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.661482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a73d-46ca-47ce-ac20-823899384b04 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.661762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a73d-46ca-47ce-ac20-823899384b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.663052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffced8ba6984ba0b2e3677b6c2a5fcd', 'request_id': 'req-a706b504-5097-4fc7-8d84-d19bf03f98bf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.669484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffced8ba6984ba0b2e3677b6c2a5fcd', 'request_id': 'req-a706b504-5097-4fc7-8d84-d19bf03f98bf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.677308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffced8ba6984ba0b2e3677b6c2a5fcd', 'request_id': 'req-a706b504-5097-4fc7-8d84-d19bf03f98bf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.680760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5dd6a73d-46ca-47ce-ac20-823899384b04 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:45.681951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5dd6a73d-46ca-47ce-ac20-823899384b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.688214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] The token cache is being invalidate because project 5ffced8ba6984ba0b2e3677b6c2a5fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:45.688504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.689151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:45.690814 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 894/1760] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:45 2022] DELETE /identity/v3/projects/5ffced8ba6984ba0b2e3677b6c2a5fcd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:45.694880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.696199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.754232 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 867/1761] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:45.756458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.757190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.757674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.764490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706b504-5097-4fc7-8d84-d19bf03f98bf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.769340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.770261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.770559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.770866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] PATH_INFO: `/v3/projects/2147ed0494474a4b8836038aa1ac5b29/users/5e8523f37063452ab582df38ae260af5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.776862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:45.778047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.785999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2147ed0494474a4b8836038aa1ac5b29, user_id=5e8523f37063452ab582df38ae260af5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.788710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.804142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 895/1762] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:45 2022] PUT /identity/v3/projects/2147ed0494474a4b8836038aa1ac5b29/users/5e8523f37063452ab582df38ae260af5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:45.804985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.806560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.848285 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 868/1763] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:45.849132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.850579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.864958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c3a63-71f6-4afd-b94e-d003a349e6cc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.869587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e06e-92ce-4a69-9185-11bc78db7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.870253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e06e-92ce-4a69-9185-11bc78db7cfe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.870556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e06e-92ce-4a69-9185-11bc78db7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.870883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e06e-92ce-4a69-9185-11bc78db7cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.871367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818a7a1-1989-4aac-82b2-8c45ff98a4b0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.871612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e06e-92ce-4a69-9185-11bc78db7cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.873215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e06e-92ce-4a69-9185-11bc78db7cfe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.876708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de811e-e273-44cd-8f0e-e4a74961ee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.877388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de811e-e273-44cd-8f0e-e4a74961ee41 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.877667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de811e-e273-44cd-8f0e-e4a74961ee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.877939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de811e-e273-44cd-8f0e-e4a74961ee41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.878683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de811e-e273-44cd-8f0e-e4a74961ee41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:45.879029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de811e-e273-44cd-8f0e-e4a74961ee41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.880878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de811e-e273-44cd-8f0e-e4a74961ee41 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.883326 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 869/1764] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:45.884631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0821771-6b34-4b5d-b3b4-f2bd394a1a2b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.884917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0821771-6b34-4b5d-b3b4-f2bd394a1a2b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.885187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0821771-6b34-4b5d-b3b4-f2bd394a1a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.892145 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 896/1765] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:45.893377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7ce08-f39d-4ba5-882b-d036ff1ce902 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.893663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7ce08-f39d-4ba5-882b-d036ff1ce902 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.893939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7ce08-f39d-4ba5-882b-d036ff1ce902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.904857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d0821771-6b34-4b5d-b3b4-f2bd394a1a2b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:45.906062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d0821771-6b34-4b5d-b3b4-f2bd394a1a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.911406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d0e7ce08-f39d-4ba5-882b-d036ff1ce902 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:45.912543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d0e7ce08-f39d-4ba5-882b-d036ff1ce902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.914681 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 870/1766] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:45.915998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.916292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.916578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.920512 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 897/1767] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:45.921423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7ce08-f39d-4ba5-882b-d036ff1ce902 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.931639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7ce08-f39d-4ba5-882b-d036ff1ce902 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.934813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:45.936003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.936157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.936812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.937080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.937353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.938061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.939672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.944242 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 871/1768] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:45.945000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.946441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:45.952704 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 898/1769] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:45.952704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:45.960467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fced55-4f8d-4290-88b3-63e969ab001f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:45.964977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:45.965814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:45.966092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:45.966362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] PATH_INFO: `/v3/projects/bb609d402d4f408dabb0f27e7ee7a818/users/5f8b94411826435884a571edb45c4f1e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:45.981544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb609d402d4f408dabb0f27e7ee7a818, user_id=5f8b94411826435884a571edb45c4f1e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:45.984287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:45.999952 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 899/1770] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:45 2022] PUT /identity/v3/projects/bb609d402d4f408dabb0f27e7ee7a818/users/5f8b94411826435884a571edb45c4f1e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:45.999952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.003712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6822-81bb-4220-b7b2-b16f84a732bf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.055359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67ddef-7849-4064-9dc0-55eac7623dc5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.056011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ddef-7849-4064-9dc0-55eac7623dc5 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.056294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ddef-7849-4064-9dc0-55eac7623dc5 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.056589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67ddef-7849-4064-9dc0-55eac7623dc5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.059298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1426284-3a1a-4550-b7db-633012ae67ca admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.063988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14fe61-8025-4522-8171-9e9eac243f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.064639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14fe61-8025-4522-8171-9e9eac243f63 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.064931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14fe61-8025-4522-8171-9e9eac243f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.065579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14fe61-8025-4522-8171-9e9eac243f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.065890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14fe61-8025-4522-8171-9e9eac243f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.067907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d14fe61-8025-4522-8171-9e9eac243f63 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.095508 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 900/1771] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:45 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.095508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5cdf-d125-4bf9-a6af-a1249e964e1f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.095508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5cdf-d125-4bf9-a6af-a1249e964e1f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.095508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5cdf-d125-4bf9-a6af-a1249e964e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.112240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-48af5cdf-d125-4bf9-a6af-a1249e964e1f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:46.113432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-48af5cdf-d125-4bf9-a6af-a1249e964e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:46.122170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67ddef-7849-4064-9dc0-55eac7623dc5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.123649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67ddef-7849-4064-9dc0-55eac7623dc5 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.134260 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 872/1772] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:46.135701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56928b-61da-42ca-91df-d4d00b16ac87 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.136023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56928b-61da-42ca-91df-d4d00b16ac87 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.136281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56928b-61da-42ca-91df-d4d00b16ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.154518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-aa56928b-61da-42ca-91df-d4d00b16ac87 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:46.155749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aa56928b-61da-42ca-91df-d4d00b16ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:46.175670 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 901/1773] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:46.176533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af5cdf-d125-4bf9-a6af-a1249e964e1f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.188057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af5cdf-d125-4bf9-a6af-a1249e964e1f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.193209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.193874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.194164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.194498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.195208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:46.195520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.197152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.210102 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 902/1774] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:46.210964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.221637 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 873/1775] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:46.224451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc962840-a93f-4a7a-b60c-34acd5b13a6e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.226027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56928b-61da-42ca-91df-d4d00b16ac87 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.229544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.230495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.231069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.231482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] PATH_INFO: `/v3/projects/2147ed0494474a4b8836038aa1ac5b29/users/5e8523f37063452ab582df38ae260af5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.233664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2147ed0494474a4b8836038aa1ac5b29, user_id=5e8523f37063452ab582df38ae260af5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.236125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56928b-61da-42ca-91df-d4d00b16ac87 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.236885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.240954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.241617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.241904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.242162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.243148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.244635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.258555 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 903/1776] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:46 2022] PUT /identity/v3/projects/2147ed0494474a4b8836038aa1ac5b29/users/5e8523f37063452ab582df38ae260af5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:46.258555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.264693 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 874/1777] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:46.265608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.276124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada4edd-6d7e-4e2e-bb45-2b78b6a9b925 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.323838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08ffe5-f3b9-4362-8efc-dc7b32fc08e6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.328799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.329461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.329737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.330010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.330691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.333309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.339024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.339693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.340124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.340247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.341239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:46.341403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.343038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.354407 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 904/1778] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.355338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.356478 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 875/1779] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:46.357610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.365542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59778a27-f8c7-4c6b-b75a-0f52c234f237 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.367597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602e56e-7f97-46e5-8f40-ec47d23397ca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.371473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.372366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b614b-3344-49ef-bcf4-7a0f71d31d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.372494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.372677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.372961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.373074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b614b-3344-49ef-bcf4-7a0f71d31d52 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.373289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b614b-3344-49ef-bcf4-7a0f71d31d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.373562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b614b-3344-49ef-bcf4-7a0f71d31d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.373652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.374315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b614b-3344-49ef-bcf4-7a0f71d31d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:46.374621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b614b-3344-49ef-bcf4-7a0f71d31d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.375668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.376253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b614b-3344-49ef-bcf4-7a0f71d31d52 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.392504 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 876/1780] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:46.392504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43675e8d-0050-4ae5-aadf-87ef57ee5071 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.392504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43675e8d-0050-4ae5-aadf-87ef57ee5071 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.392504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43675e8d-0050-4ae5-aadf-87ef57ee5071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.405378 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 905/1781] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.406471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.418378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-43675e8d-0050-4ae5-aadf-87ef57ee5071 None None] MFA Rules not processed for user `5e8523f37063452ab582df38ae260af5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:46.419646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-43675e8d-0050-4ae5-aadf-87ef57ee5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:46.477593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc07314-e870-4481-a4f6-15f67d5a420e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.482496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.483419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.483703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.483979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] PATH_INFO: `/v3/projects/bb609d402d4f408dabb0f27e7ee7a818/users/5f8b94411826435884a571edb45c4f1e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.486080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb609d402d4f408dabb0f27e7ee7a818, user_id=5f8b94411826435884a571edb45c4f1e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.488871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.495445 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 877/1782] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:46.496319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43675e8d-0050-4ae5-aadf-87ef57ee5071 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.500659 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 906/1783] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:46 2022] PUT /identity/v3/projects/bb609d402d4f408dabb0f27e7ee7a818/users/5f8b94411826435884a571edb45c4f1e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:46.511042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.511322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43675e8d-0050-4ae5-aadf-87ef57ee5071 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.572729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.574195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.574195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.574534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.575370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.577382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.588857 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 878/1784] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:46.589916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.600131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a7ea33-29d8-46c7-8474-084d354510d9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.603057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5e117-2554-4c96-ba89-a9ab1ef09b25 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.605643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.606307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.606588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.606901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.607598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.609618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.611569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34453630-9299-40a1-a1ba-24a0937321ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.612606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453630-9299-40a1-a1ba-24a0937321ff admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.613138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453630-9299-40a1-a1ba-24a0937321ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.613592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34453630-9299-40a1-a1ba-24a0937321ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.614451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453630-9299-40a1-a1ba-24a0937321ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.616661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34453630-9299-40a1-a1ba-24a0937321ff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.637831 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 907/1785] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/projects => generated 401 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.642655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.649382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 879/1786] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.651800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.652431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.652951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.684817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] MFA Rules not processed for user `5f8b94411826435884a571edb45c4f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:46.686572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:46.720423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d4ca6-a33b-4be5-b792-1d0fc21e2701 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.763405 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 880/1787] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:46.763405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.764080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:46.779527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.780205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.780491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.780768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.781458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.783453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.807069 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 908/1788] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.807069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.814179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dc493-494c-43ad-860c-3d943be885eb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.820129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.820721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.821008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.821288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.822006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.823891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.833502 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 909/1789] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:46.834358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.835972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08196446-d218-40c0-86cb-40af4ce2cddf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.841948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.842526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.842848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.843127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.846110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f663161-d5c7-4a96-ae5f-a17b1d9be3a1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.850971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.851622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.851906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.852185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.852902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.854847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.875437 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 910/1790] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/users => generated 301 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.876226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.887733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60e931-4bc2-4e3f-9167-176df968c6c9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.892414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.893069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.893345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.893621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.894320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.896269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.904871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.906453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.916329 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 881/1791] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:46.916854 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 911/1792] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:46 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:46.918008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.919820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:46.920303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.921626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:46.936902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e17d23-dd4b-496c-b8c1-5f06b143e290 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.943158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.943938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.944228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.944504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.953792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.955591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.965308 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 912/1793] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:46.966021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:46.976529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7d9e-4396-4480-ad5f-4810ad2e1762 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.981083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:46.981726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:46.982010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:46.986138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:46.986138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:46.986138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:46.997550 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 913/1794] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:46.998010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072266-6570-4a15-b48e-08a2129fe6a7 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:46.998446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.004638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.005294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.006048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.006048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.007666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.009336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f494a-c1a6-487e-b0f0-b763471ad7c4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.013960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.014865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.015153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.015431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] PATH_INFO: `/v3/projects/b77b751b750c4c20a0ef1d7630974b65/users/aec785dd8cf14794a8537c60733aac70/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.022372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.024014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.030895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77b751b750c4c20a0ef1d7630974b65, user_id=aec785dd8cf14794a8537c60733aac70, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.033570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.035242 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 882/1795] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:47.036122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.047438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153ae4a-e1aa-4a93-9516-f1281544599d service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.054456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.055168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.055451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.055800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.056521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.058263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.072866 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 914/1796] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:46 2022] PUT /identity/v3/projects/b77b751b750c4c20a0ef1d7630974b65/users/aec785dd8cf14794a8537c60733aac70/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:47.073959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.087096 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 883/1797] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:47.087591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.109069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca2622-526d-4238-b8e5-8ae3ecd85505 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.183746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25844c-3648-4f6a-9ac7-a2bd7f80be74 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.189805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2bfdb-b375-4d78-9b59-e39817a75708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.190781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2bfdb-b375-4d78-9b59-e39817a75708 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.191424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2bfdb-b375-4d78-9b59-e39817a75708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.191906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2bfdb-b375-4d78-9b59-e39817a75708 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.193135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2bfdb-b375-4d78-9b59-e39817a75708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.198604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2bfdb-b375-4d78-9b59-e39817a75708 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.208469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.209199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.213487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.213487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.213487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.214636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.215916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 915/1798] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:47.217955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b793-f0fa-492e-8f64-b80efa0be23d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.218250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b793-f0fa-492e-8f64-b80efa0be23d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.218530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8b793-f0fa-492e-8f64-b80efa0be23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.248382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 884/1799] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:47.249474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.258049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-39c8b793-f0fa-492e-8f64-b80efa0be23d None None] MFA Rules not processed for user `aec785dd8cf14794a8537c60733aac70`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:47.259307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-39c8b793-f0fa-492e-8f64-b80efa0be23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.273439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1af9ca-52fa-4be0-8a0a-c0fceaa86030 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.295414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.296098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.296374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.296643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.297366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.309004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.322819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 885/1800] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:47.322819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.332803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614611-1294-4891-a910-f45dd8fc4ce4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.338383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.339129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.339509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.339716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.341170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.343283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.348445 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 916/1801] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:47.349183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8b793-f0fa-492e-8f64-b80efa0be23d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.360369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8b793-f0fa-492e-8f64-b80efa0be23d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.366701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.367855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.368192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.368574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] PATH_INFO: `/v3/projects/4db49857a44d4f399959ac625886505a/users/99e9b91d4fb949f18cc61bf2bbd63ab6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.369136 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 886/1802] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:47.370085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.383907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27fc32-856b-407f-b645-c1cb054c4d2e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.387293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db49857a44d4f399959ac625886505a, user_id=99e9b91d4fb949f18cc61bf2bbd63ab6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.390147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.390381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.391370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.391781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.392282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] PATH_INFO: `/v3/users/ba669cb0f9b54772b034133b733b3045` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.393569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba669cb0f9b54772b034133b733b3045)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.396224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.411335 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 917/1803] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:47 2022] PUT /identity/v3/projects/4db49857a44d4f399959ac625886505a/users/99e9b91d4fb949f18cc61bf2bbd63ab6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:47.411335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.469395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba669cb0f9b54772b034133b733b3045'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:47.476792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba669cb0f9b54772b034133b733b3045'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:47.477163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816492-73b7-4e18-a954-b8b53f6b7430 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.477738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba669cb0f9b54772b034133b733b3045'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:47.478314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba669cb0f9b54772b034133b733b3045'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:47.482444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.483453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.483796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.484138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] PATH_INFO: `/v3/projects/d7a25055f3544e5c95bacd3a07611e1d/users/85eeaeaf9f1c464f8d45eff93bab41cb/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.487646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba669cb0f9b54772b034133b733b3045'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:47.499827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a25055f3544e5c95bacd3a07611e1d, user_id=85eeaeaf9f1c464f8d45eff93bab41cb, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.502528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.511371 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 887/1804] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:47 2022] DELETE /identity/v3/users/ba669cb0f9b54772b034133b733b3045 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:47.512425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.514126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.517372 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 918/1805] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:47 2022] PUT /identity/v3/projects/d7a25055f3544e5c95bacd3a07611e1d/users/85eeaeaf9f1c464f8d45eff93bab41cb/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:47.518158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.523250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.595136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4726502-c3eb-482b-afcb-08956deb3a67 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.598613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c257b-ee81-4a2b-8a50-89ba6e6be221 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.601789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c92b1a-f2a7-4640-80e2-feb1c0c31933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.602831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92b1a-f2a7-4640-80e2-feb1c0c31933 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.603097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92b1a-f2a7-4640-80e2-feb1c0c31933 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.603386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c92b1a-f2a7-4640-80e2-feb1c0c31933 admin admin] PATH_INFO: `/v3/projects/ffd4c66aec4241d8af652f8ffed78e63/users/87a8315a918f43078742989e2e16d786/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.604191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc38e0-8f49-4818-97c1-81e2bf22bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.604908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc38e0-8f49-4818-97c1-81e2bf22bec5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.605197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc38e0-8f49-4818-97c1-81e2bf22bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.605471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc38e0-8f49-4818-97c1-81e2bf22bec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.607291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc38e0-8f49-4818-97c1-81e2bf22bec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.608520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc38e0-8f49-4818-97c1-81e2bf22bec5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.619396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c92b1a-f2a7-4640-80e2-feb1c0c31933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd4c66aec4241d8af652f8ffed78e63, user_id=87a8315a918f43078742989e2e16d786, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.622331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c92b1a-f2a7-4640-80e2-feb1c0c31933 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.635770 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 888/1806] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:47.636142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 919/1807] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:47 2022] PUT /identity/v3/projects/ffd4c66aec4241d8af652f8ffed78e63/users/87a8315a918f43078742989e2e16d786/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:47.637073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f490a-3546-441b-befb-9c8d1dcdf728 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.637367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f490a-3546-441b-befb-9c8d1dcdf728 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.637647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f490a-3546-441b-befb-9c8d1dcdf728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.639608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851f33-3e3f-44c2-a57b-1b5a5043dc62 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.640167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851f33-3e3f-44c2-a57b-1b5a5043dc62 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.640650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14851f33-3e3f-44c2-a57b-1b5a5043dc62 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.648263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 920/1808] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:45:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:47.649589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bfa8b-4f8d-4a11-8bc7-5a9f3b5295bc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.649881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bfa8b-4f8d-4a11-8bc7-5a9f3b5295bc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.650162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bfa8b-4f8d-4a11-8bc7-5a9f3b5295bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.656038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d87f490a-3546-441b-befb-9c8d1dcdf728 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:47.657257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d87f490a-3546-441b-befb-9c8d1dcdf728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.668189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-261bfa8b-4f8d-4a11-8bc7-5a9f3b5295bc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:47.669412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-261bfa8b-4f8d-4a11-8bc7-5a9f3b5295bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.731257 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 889/1809] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:47.733105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a20db-4517-49f6-af8a-7c45a12192fc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.733468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a20db-4517-49f6-af8a-7c45a12192fc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.733856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a20db-4517-49f6-af8a-7c45a12192fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.745256 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 921/1810] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:47.749301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bfa8b-4f8d-4a11-8bc7-5a9f3b5295bc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.760877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bfa8b-4f8d-4a11-8bc7-5a9f3b5295bc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.767755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d794be-41c5-4691-b7b5-99477e5e21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.768438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d794be-41c5-4691-b7b5-99477e5e21e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.768792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d794be-41c5-4691-b7b5-99477e5e21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.769146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d794be-41c5-4691-b7b5-99477e5e21e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.770609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d794be-41c5-4691-b7b5-99477e5e21e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.772862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d794be-41c5-4691-b7b5-99477e5e21e4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.779421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-642a20db-4517-49f6-af8a-7c45a12192fc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:47.781228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-642a20db-4517-49f6-af8a-7c45a12192fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.793933 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 890/1811] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:47.795195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.795480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.795756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.808968 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 922/1812] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/users => generated 294 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:47.808968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.808968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.808968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.821882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:47.823462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.837124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] MFA Rules not processed for user `87a8315a918f43078742989e2e16d786`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:47.838442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.907333 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 891/1813] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:47.908341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.909820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.912661 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 923/1814] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:47.914271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.916014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:47.969552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6f52-8928-47e4-84e8-fa69203f420d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.973931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.974603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.974931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.975202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.981545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45e7da-c3e1-4dbd-b2ab-d9d1bee3938d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:47.984870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.985733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:47.986319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:47.986424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:47.986655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:47.986967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:47.996694 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 892/1815] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:47.996865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:47.997727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:47.998552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.009183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655df381-b5af-4fe4-ab00-d8cae76d4095 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.012170 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 924/1816] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:48.013349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.016068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.016734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.017013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.017278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.029159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd3b1-e484-4abe-9a80-9beec98b1a47 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.041306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.042733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.043215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.043759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.044225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.045176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.045756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.047061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.056970 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 893/1817] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:48.057565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.065970 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 925/1818] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:48.065970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.072739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350dce58-9333-4b1b-a29c-b0b6e2dbf192 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.075178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055afa-5b2d-493b-a4b2-38d2fd4f63a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.079119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.079372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.079943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.080238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.080513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.080917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.081337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.081777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.082672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.084853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.092211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.094121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.111276 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 926/1819] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:48.112263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.120333 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 894/1820] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:48 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:48.124278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.126211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa1e98-0271-48d6-8e1c-7068d08b9eb8 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.206543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb186435-05de-4cd6-85e9-da40cb38fd03 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.208845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.212309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.212309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.212578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] PATH_INFO: `/v3/projects/c533e85dd29c4ae58fddd41aa59e87fd/users/015b1f7622da43e6ae057690ff2fc639/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.214671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.215374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.215652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.215921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.218389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.222445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.239887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c533e85dd29c4ae58fddd41aa59e87fd, user_id=015b1f7622da43e6ae057690ff2fc639, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.243344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.250345 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 895/1821] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:48 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:45:48.256949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.273268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae82e51-90d1-4f06-9b22-366a7a6da6ac admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.275580 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 927/1822] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:48 2022] PUT /identity/v3/projects/c533e85dd29c4ae58fddd41aa59e87fd/users/015b1f7622da43e6ae057690ff2fc639/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:48.276156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.357970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.360018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.360583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.361193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.362595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.364945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.366596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd231da-9d27-4f59-9f22-549110a504d8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.378977 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 896/1823] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:48.383836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.384318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.385151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.385508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.385893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.386859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.389708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.398548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a401-21d7-486c-953d-ad24b9915a1b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.404025 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 928/1824] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:48.407524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.408445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.408753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.408859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.409205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] PATH_INFO: `/v3/projects/7231a031d45e4868af45945a77a32eda/users/824b86b63609435bbf3d712c4fe437db/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.421071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab010ef-69b5-4d79-b264-14cebba0191c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.426218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7231a031d45e4868af45945a77a32eda, user_id=824b86b63609435bbf3d712c4fe437db, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.427436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.428585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.428695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.428856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.429341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] PATH_INFO: `/v3/projects/c533e85dd29c4ae58fddd41aa59e87fd/users/015b1f7622da43e6ae057690ff2fc639/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.432043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c533e85dd29c4ae58fddd41aa59e87fd, user_id=015b1f7622da43e6ae057690ff2fc639, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.436246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.443750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 897/1825] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:48 2022] PUT /identity/v3/projects/7231a031d45e4868af45945a77a32eda/users/824b86b63609435bbf3d712c4fe437db/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:48.447588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.451476 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 929/1826] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:48 2022] PUT /identity/v3/projects/c533e85dd29c4ae58fddd41aa59e87fd/users/015b1f7622da43e6ae057690ff2fc639/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:48.464310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.464310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:48.522811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3660b-e9b9-4d4e-a1b1-87128285cbdb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.529681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62546d57-2daa-4f01-a7bf-a030b0810150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.530375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546d57-2daa-4f01-a7bf-a030b0810150 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.530644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546d57-2daa-4f01-a7bf-a030b0810150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.530952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546d57-2daa-4f01-a7bf-a030b0810150 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.531951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0f89-7d7d-4b24-a492-0b8c59a8839b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.532289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546d57-2daa-4f01-a7bf-a030b0810150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.533931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546d57-2daa-4f01-a7bf-a030b0810150 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.537910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.538949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.539436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.539880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] PATH_INFO: `/v3/users/3b23e023dac548ad86ceaec477451ba5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.541218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b23e023dac548ad86ceaec477451ba5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.543408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.547129 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 898/1827] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:45:48.548688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.548980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.549259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.583780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] MFA Rules not processed for user `015b1f7622da43e6ae057690ff2fc639`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:48.585236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:48.630701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b23e023dac548ad86ceaec477451ba5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:48.632410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b23e023dac548ad86ceaec477451ba5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:48.643254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b23e023dac548ad86ceaec477451ba5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:48.650220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b23e023dac548ad86ceaec477451ba5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:48.668275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b81d1f64-60f6-4c10-8d89-1f9544ebea5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b23e023dac548ad86ceaec477451ba5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:48.697723 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 899/1828] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:48.697723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.701841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:48.705771 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 930/1829] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:48 2022] DELETE /identity/v3/users/3b23e023dac548ad86ceaec477451ba5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:48.708008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.709256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.709552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.727319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29035f6a-dc21-4a6c-a8c3-bdd8178e6a75 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:48.736332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:48.738516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:48.842090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:48.842559 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 931/1830] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:48.843512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.844504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:48.844845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:48.845121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] PATH_INFO: `/v3/projects/7231a031d45e4868af45945a77a32eda/users/824b86b63609435bbf3d712c4fe437db/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:48.847062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:48.850797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7231a031d45e4868af45945a77a32eda, user_id=824b86b63609435bbf3d712c4fe437db, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:48.856733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:48.890005 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 900/1831] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:48 2022] PUT /identity/v3/projects/7231a031d45e4868af45945a77a32eda/users/824b86b63609435bbf3d712c4fe437db/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:48.893040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:48.897632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.022810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9ef4f-f762-4dc3-b5b9-785ad5326be8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:49.023474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4b58f-8682-4a42-9171-8ac4854edcc3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:49.027053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110882b-8d80-4a29-9e48-38cdd9423888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:49.027709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110882b-8d80-4a29-9e48-38cdd9423888 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.027989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110882b-8d80-4a29-9e48-38cdd9423888 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.028913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110882b-8d80-4a29-9e48-38cdd9423888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.123145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:49.123815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.124101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.125444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.164456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110882b-8d80-4a29-9e48-38cdd9423888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:49.165932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110882b-8d80-4a29-9e48-38cdd9423888 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:49.192404 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 901/1832] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:49.193602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738427-c091-4298-a197-ae9b70e460ce None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.193914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738427-c091-4298-a197-ae9b70e460ce None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.198536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f738427-c091-4298-a197-ae9b70e460ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.223652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5f738427-c091-4298-a197-ae9b70e460ce None None] MFA Rules not processed for user `824b86b63609435bbf3d712c4fe437db`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:49.224862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5f738427-c091-4298-a197-ae9b70e460ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.254838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:49.256431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:49.292534 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 932/1833] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:49.293558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:49.294939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.325038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c7d5-0c04-42c9-b50e-e60b795948f4 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:49.332167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:49.334649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.335218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.336234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] PATH_INFO: `/v3/projects/05873dc89d2c4c48b8528d394c8a8f17` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.337933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=05873dc89d2c4c48b8528d394c8a8f17)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:49.341051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:49.385152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 902/1834] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:49.386600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.386853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.387135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.413861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:49.415160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.442286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05873dc89d2c4c48b8528d394c8a8f17', 'request_id': 'req-19cae9c2-fd16-4af7-af98-df4d318ab0ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.450233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05873dc89d2c4c48b8528d394c8a8f17', 'request_id': 'req-19cae9c2-fd16-4af7-af98-df4d318ab0ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.461982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05873dc89d2c4c48b8528d394c8a8f17', 'request_id': 'req-19cae9c2-fd16-4af7-af98-df4d318ab0ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.476856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] The token cache is being invalidate because project 05873dc89d2c4c48b8528d394c8a8f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:49.477151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.478557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-19cae9c2-fd16-4af7-af98-df4d318ab0ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.480844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 933/1835] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:49 2022] DELETE /identity/v3/projects/05873dc89d2c4c48b8528d394c8a8f17 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:49.482191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84beec7-6215-4001-8173-3cfffe6365bc None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.482478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84beec7-6215-4001-8173-3cfffe6365bc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.482752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84beec7-6215-4001-8173-3cfffe6365bc None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.490074 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 934/1836] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:45:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:49.491625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84beec7-6215-4001-8173-3cfffe6365bc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:49.493635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d84beec7-6215-4001-8173-3cfffe6365bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.511922 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 903/1837] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:45:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:49.512833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:49.516354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.596207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84beec7-6215-4001-8173-3cfffe6365bc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:49.604088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:49.605089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.605383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.605672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.607748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.689449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:49.691887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:49.695214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d613e-bf08-45fa-bbda-29b33fba6cb6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:49.703658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:49.705000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.705431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.706317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] PATH_INFO: `/v3/users/5e8523f37063452ab582df38ae260af5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.708473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8523f37063452ab582df38ae260af5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:49.709062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 935/1838] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:49.710282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:45:49.711675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:49.713402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.742855 ncdv-master-1 devstack@keystone.service[91076]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 07 21:45:49.743228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:49.746257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.847045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8523f37063452ab582df38ae260af5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.869072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ca7c6-198f-4e74-9cab-06cc3ae7c85d service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:49.874988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015b1f7622da43e6ae057690ff2fc639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c533e85dd29c4ae58fddd41aa59e87fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:49.875920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:49.876205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:49.876486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] PATH_INFO: `/v3/projects/b77b751b750c4c20a0ef1d7630974b65` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:49.876861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8523f37063452ab582df38ae260af5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.877803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] RBAC: Authorizing `identity:get_project(project_id=b77b751b750c4c20a0ef1d7630974b65)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:49.880533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:49.883082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8523f37063452ab582df38ae260af5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.884888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8523f37063452ab582df38ae260af5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.887503 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 936/1839] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:45:49 2022] GET /identity/v3/projects/b77b751b750c4c20a0ef1d7630974b65 => generated 379 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:49.894097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:49.897268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:49.908134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8523f37063452ab582df38ae260af5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:49.961876 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 904/1840] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:49 2022] DELETE /identity/v3/users/5e8523f37063452ab582df38ae260af5 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:49.963424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:49.969068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.053357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b17e8-8065-4b0b-84f4-e4e7e662053a tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:50.098294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012c935-ad61-47f1-82dc-42f75354f592 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:50.116606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:50.117642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:50.118068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:50.118349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:50.121871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.155111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:50.156031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:50.156514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:50.156891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:50.159140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.260519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:50.262293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:50.275145 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 937/1841] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:45:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:45:50.276388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:50.278070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.278997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:50.289382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:50.328854 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 905/1842] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:50.330924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:50.338656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.410928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aeb237-7c31-42b9-b505-5ab8fc10eb36 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:50.470274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d1c04-8b59-4cdf-a9fb-82ce9c5fe18a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:50.475301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1c04-8b59-4cdf-a9fb-82ce9c5fe18a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:50.475733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1c04-8b59-4cdf-a9fb-82ce9c5fe18a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:50.476116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d1c04-8b59-4cdf-a9fb-82ce9c5fe18a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:50.478992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a6d1c04-8b59-4cdf-a9fb-82ce9c5fe18a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.537941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f020b6d-0e63-4cad-947b-2dc35a94489b service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:50.589516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:50.596579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:50.597097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:50.600383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] PATH_INFO: `/v3/projects/7e415e6a8ff2442ea06aeb06e01ea9d0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:50.604676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e415e6a8ff2442ea06aeb06e01ea9d0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:50.608750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:50.653180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d1c04-8b59-4cdf-a9fb-82ce9c5fe18a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:50.656710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d1c04-8b59-4cdf-a9fb-82ce9c5fe18a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:50.678578 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 906/1843] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:50.682713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:50.683051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:50.684502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:50.740920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e415e6a8ff2442ea06aeb06e01ea9d0', 'request_id': 'req-04ddba06-2453-4594-9b4a-e3c7606cc005'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:50.762258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e415e6a8ff2442ea06aeb06e01ea9d0', 'request_id': 'req-04ddba06-2453-4594-9b4a-e3c7606cc005'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:50.780890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] MFA Rules not processed for user `99e9b91d4fb949f18cc61bf2bbd63ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:50.785629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.786343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e415e6a8ff2442ea06aeb06e01ea9d0', 'request_id': 'req-04ddba06-2453-4594-9b4a-e3c7606cc005'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:50.822319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] The token cache is being invalidate because project 7e415e6a8ff2442ea06aeb06e01ea9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:50.822639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:50.838331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:50.838331 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 938/1844] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:50 2022] DELETE /identity/v3/projects/7e415e6a8ff2442ea06aeb06e01ea9d0 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:50.839438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:50.841054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:50.954062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddba06-2453-4594-9b4a-e3c7606cc005 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:50.960582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:50.961658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:50.962017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:50.962406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] PATH_INFO: `/v3/users/5f8b94411826435884a571edb45c4f1e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:50.963834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8b94411826435884a571edb45c4f1e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:50.966020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:50.967769 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 907/1845] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:50.972156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:50.973686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:51.006168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d087fc-3b13-472e-b1dc-9c4ea9c9453f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:51.013548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27336d0-928d-4537-a1b3-8479d5be648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:51.014449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27336d0-928d-4537-a1b3-8479d5be648a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:51.014739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27336d0-928d-4537-a1b3-8479d5be648a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:51.015054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27336d0-928d-4537-a1b3-8479d5be648a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:51.015767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27336d0-928d-4537-a1b3-8479d5be648a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:51.020781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27336d0-928d-4537-a1b3-8479d5be648a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:51.071639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8b94411826435884a571edb45c4f1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.100502 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 908/1846] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:50 2022] POST /identity/v3/projects => generated 395 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:45:51.101901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ec2b3-7b73-49d7-ae29-401616a5a68a None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:51.102193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ec2b3-7b73-49d7-ae29-401616a5a68a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:51.102471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ec2b3-7b73-49d7-ae29-401616a5a68a None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:51.103740 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 909/1847] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:51.108402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8b94411826435884a571edb45c4f1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.110809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ec2b3-7b73-49d7-ae29-401616a5a68a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:51.118724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8b94411826435884a571edb45c4f1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.119593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8b94411826435884a571edb45c4f1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.124427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d7ec2b3-7b73-49d7-ae29-401616a5a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:51.154508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8b94411826435884a571edb45c4f1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.220878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 939/1848] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:50 2022] DELETE /identity/v3/users/5f8b94411826435884a571edb45c4f1e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:45:51.221488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:45:51.239858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:51.436250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ec2b3-7b73-49d7-ae29-401616a5a68a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:51.480248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:51.484469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:51.537203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:51.538389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:51.538959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:51.539450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:51.541172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:51.543789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:51.604495 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 910/1849] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:51 2022] POST /identity/v3/users => generated 304 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:51.609209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:51.616393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:51.649345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f5873-1159-406b-86c8-3098d9eabe52 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:51.662382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:51.664344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:51.664730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:51.665158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] PATH_INFO: `/v3/users/87a8315a918f43078742989e2e16d786` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:51.667660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a8315a918f43078742989e2e16d786)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:51.667866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22945c-7f71-4ce4-a629-134724add492 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:51.669979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:51.686477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '015b1f7622da43e6ae057690ff2fc639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c533e85dd29c4ae58fddd41aa59e87fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:51.688689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:51.688984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:51.689277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] PATH_INFO: `/v3/projects/b77b751b750c4c20a0ef1d7630974b65` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:51.692479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] RBAC: Authorizing `identity:get_project(project_id=b77b751b750c4c20a0ef1d7630974b65)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:51.694671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:51.702787 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 940/1850] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:45:51 2022] GET /identity/v3/projects/b77b751b750c4c20a0ef1d7630974b65 => generated 379 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:51.703714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:51.711014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:51.779190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7af184-87b0-46c4-8bb9-ca721d9c14d0 tempest-FlavorsAccessTestJSON-71847774 tempest-FlavorsAccessTestJSON-71847774-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:51.797752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:51.798676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:51.801187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:51.801433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] PATH_INFO: `/v3/projects/2147ed0494474a4b8836038aa1ac5b29` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:51.803946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2147ed0494474a4b8836038aa1ac5b29)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:51.811726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:51.825548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a8315a918f43078742989e2e16d786'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.859234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a8315a918f43078742989e2e16d786'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.860899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a8315a918f43078742989e2e16d786'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.872190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a8315a918f43078742989e2e16d786'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.899989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-01de8882-03f1-40a5-95d3-f3bae37284a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a8315a918f43078742989e2e16d786'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:51.949726 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 911/1851] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:51 2022] DELETE /identity/v3/users/87a8315a918f43078742989e2e16d786 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:51.949726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97cc55-a81d-4072-80f0-fc5b672ac7dd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:51.949726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97cc55-a81d-4072-80f0-fc5b672ac7dd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:51.949726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97cc55-a81d-4072-80f0-fc5b672ac7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:52.012046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2147ed0494474a4b8836038aa1ac5b29', 'request_id': 'req-c803ad2a-f738-4b91-85b0-0c060884e3a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.029207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2147ed0494474a4b8836038aa1ac5b29', 'request_id': 'req-c803ad2a-f738-4b91-85b0-0c060884e3a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.060627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5c97cc55-a81d-4072-80f0-fc5b672ac7dd None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:52.063530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2147ed0494474a4b8836038aa1ac5b29', 'request_id': 'req-c803ad2a-f738-4b91-85b0-0c060884e3a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.063968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5c97cc55-a81d-4072-80f0-fc5b672ac7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:52.099294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] The token cache is being invalidate because project 2147ed0494474a4b8836038aa1ac5b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:52.100749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.102442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.108748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 941/1852] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:51 2022] DELETE /identity/v3/projects/2147ed0494474a4b8836038aa1ac5b29 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:52.110259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:52.112187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:52.218309 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 912/1853] 10.222.0.55 () {58 vars in 1015 bytes} [Sat May 7 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:52.220087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168be8-8e3b-470f-ac63-2fa9b8a801a2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:52.224602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168be8-8e3b-470f-ac63-2fa9b8a801a2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:52.225407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e168be8-8e3b-470f-ac63-2fa9b8a801a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:52.281015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0e168be8-8e3b-470f-ac63-2fa9b8a801a2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:52.286487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0e168be8-8e3b-470f-ac63-2fa9b8a801a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:52.311564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803ad2a-f738-4b91-85b0-0c060884e3a5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:52.452706 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 913/1854] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:52.455539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:52.456518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:52.456987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:52.498926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:52.516123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:52.551739 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 914/1855] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:52.554509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:52.559741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:52.583871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:52.585629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a21553-b5dd-486a-a07f-c6bc2ffc4dd4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:52.586591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:52.587042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:52.588116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:52.589108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:52.591574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:52.600846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:52.601605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:52.602016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:52.602432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:52.615361 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 942/1856] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:52.626435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:52.628173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:52.630864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:52.642337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:52.662117 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 915/1857] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:52.663290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:52.667262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:52.674823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74c2c2-faa9-487b-8040-9ec8faed5d80 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:52.690921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:52.692132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:52.692666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:52.693011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] PATH_INFO: `/v3/projects/bb609d402d4f408dabb0f27e7ee7a818` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:52.695472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb609d402d4f408dabb0f27e7ee7a818)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:52.699208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:52.700844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256717b4-5001-40ac-8f05-3e6c28eae55e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:52.719387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:52.720557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:52.721005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:52.721491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] PATH_INFO: `/v3/users/aec785dd8cf14794a8537c60733aac70` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:52.725450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec785dd8cf14794a8537c60733aac70)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:52.727884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:52.896472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec785dd8cf14794a8537c60733aac70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.914390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb609d402d4f408dabb0f27e7ee7a818', 'request_id': 'req-c6bdacb9-1ae3-40fc-af31-e49062f191e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.935222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec785dd8cf14794a8537c60733aac70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.939546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec785dd8cf14794a8537c60733aac70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.944559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec785dd8cf14794a8537c60733aac70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:52.976463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec785dd8cf14794a8537c60733aac70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:53.045934 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 916/1858] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:52 2022] DELETE /identity/v3/users/aec785dd8cf14794a8537c60733aac70 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:53.049709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:53.059865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.275277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e5687-9a0c-46f6-b328-5d40ec4252eb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:53.287028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:53.288711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.289582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.289874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.296183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb609d402d4f408dabb0f27e7ee7a818', 'request_id': 'req-c6bdacb9-1ae3-40fc-af31-e49062f191e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:53.296759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.312397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb609d402d4f408dabb0f27e7ee7a818', 'request_id': 'req-c6bdacb9-1ae3-40fc-af31-e49062f191e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:53.342830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] The token cache is being invalidate because project bb609d402d4f408dabb0f27e7ee7a818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:53.343248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:53.345086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6bdacb9-1ae3-40fc-af31-e49062f191e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:53.356173 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 943/1859] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:52 2022] DELETE /identity/v3/projects/bb609d402d4f408dabb0f27e7ee7a818 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:53.357933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51664-9d95-427b-9978-07d2fc5167e1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.358227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51664-9d95-427b-9978-07d2fc5167e1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.358546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a51664-9d95-427b-9978-07d2fc5167e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.424151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e8a51664-9d95-427b-9978-07d2fc5167e1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:53.427330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e8a51664-9d95-427b-9978-07d2fc5167e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.448778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:53.450349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:53.463371 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 917/1860] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:53.464314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:53.465466 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 944/1861] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:53.466078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.467159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d625df-f04c-41a9-b52d-cd17f6f8f2fe None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.467607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d625df-f04c-41a9-b52d-cd17f6f8f2fe None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.468037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d625df-f04c-41a9-b52d-cd17f6f8f2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.480782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ac40b-3204-4c6d-a057-18f4d3786b57 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:53.487729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cbea9-0ad0-4b95-a419-99ad22b5b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:53.489597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbea9-0ad0-4b95-a419-99ad22b5b4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.490103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbea9-0ad0-4b95-a419-99ad22b5b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.490485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbea9-0ad0-4b95-a419-99ad22b5b4ef admin admin] PATH_INFO: `/v3/projects/c5a38eb0075c4feebad21ad0840ceea3/users/78d0f0ba350c45788a39dabf047ac6b0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.520385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cbea9-0ad0-4b95-a419-99ad22b5b4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a38eb0075c4feebad21ad0840ceea3, user_id=78d0f0ba350c45788a39dabf047ac6b0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:53.533509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cbea9-0ad0-4b95-a419-99ad22b5b4ef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:53.537026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-09d625df-f04c-41a9-b52d-cd17f6f8f2fe None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:53.538292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09d625df-f04c-41a9-b52d-cd17f6f8f2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.554751 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 918/1862] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:53 2022] PUT /identity/v3/projects/c5a38eb0075c4feebad21ad0840ceea3/users/78d0f0ba350c45788a39dabf047ac6b0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:53.556153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.556441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.556714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.582523 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 945/1863] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:53.582984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d625df-f04c-41a9-b52d-cd17f6f8f2fe None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:53.605414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:53.607138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.623138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d625df-f04c-41a9-b52d-cd17f6f8f2fe None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:53.688684 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 919/1864] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:53.689551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:53.691983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.708892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ae759-d08b-447c-9854-81d9de3350f9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:53.731816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:53.734594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.736063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.737175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.738669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:53.742271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:53.746248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120cbd-e785-45b7-8fae-56b57d1ed0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:53.746943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:53.747803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120cbd-e785-45b7-8fae-56b57d1ed0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.748231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120cbd-e785-45b7-8fae-56b57d1ed0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.748846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120cbd-e785-45b7-8fae-56b57d1ed0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.749732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120cbd-e785-45b7-8fae-56b57d1ed0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:53.751884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120cbd-e785-45b7-8fae-56b57d1ed0b4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:53.766217 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 920/1865] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:53.768192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600b3e-9aee-451e-b1e4-6d806d904fde None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.768731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600b3e-9aee-451e-b1e4-6d806d904fde None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.769721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a600b3e-9aee-451e-b1e4-6d806d904fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.776913 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 946/1866] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:53.779106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:53.783645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.815380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8a600b3e-9aee-451e-b1e4-6d806d904fde None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:53.817679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8a600b3e-9aee-451e-b1e4-6d806d904fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:53.837092 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 921/1867] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:53.837092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a600b3e-9aee-451e-b1e4-6d806d904fde None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:53.862663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a600b3e-9aee-451e-b1e4-6d806d904fde None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:53.869826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:53.876998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:53.877189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:53.877548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] PATH_INFO: `/v3/projects/c5a38eb0075c4feebad21ad0840ceea3/users/78d0f0ba350c45788a39dabf047ac6b0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:53.879929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a38eb0075c4feebad21ad0840ceea3, user_id=78d0f0ba350c45788a39dabf047ac6b0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:53.882797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:53.913352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 922/1868] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:53 2022] PUT /identity/v3/projects/c5a38eb0075c4feebad21ad0840ceea3/users/78d0f0ba350c45788a39dabf047ac6b0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:53.915308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:53.942316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554397fd-fad1-484d-bdd9-df74ef502eff admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.070854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544e70d-cc89-4f9a-ac25-6a2568d50019 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.081148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.082832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.084835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.085203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.086148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.088471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.098496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.099473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.099764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.100050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.129505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.133877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.153703 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 923/1869] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:53 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:54.154861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.161113 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 947/1870] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:54.163409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.194907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e5cbd-5007-4aae-9cd2-ec67fcb6cb6d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.361636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff56f-9318-4fa5-8fc6-4fcc4e1aa9e6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.367437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.371272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.371745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.372031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.373251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:54.373748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.380892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.409059 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 924/1871] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:54.410030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.414254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.414994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.419766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.420063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.420830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.431179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119b7d-1976-439e-9bee-1db303c0f344 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.433896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.443293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.443978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.447078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.447324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.448465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.456097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.508847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 925/1872] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:54 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:54.512050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 948/1873] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:54 2022] POST /identity/v3/users => generated 286 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:54.513810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.513957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.540897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b7459-0b39-4b30-975f-de55ad4aae84 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.651911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.653019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.653501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.653954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.655506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.658139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.683438 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 949/1874] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:54.688393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.711550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e166e7-f174-45e0-8897-be12025dac62 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.718667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.719774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.720260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.720922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.722919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.724842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.743304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10eadb-94d1-4178-aa83-c4fae21c3d33 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.747312 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 950/1875] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:54.751134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.756821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.757521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.757727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.758189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.758703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.774074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dec55-76ad-4f8e-8031-e8fd5ba5eeb3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.775220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.790514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e45675-0568-4851-b181-ee0b2bc47ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.791586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45675-0568-4851-b181-ee0b2bc47ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.793305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45675-0568-4851-b181-ee0b2bc47ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.793609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e45675-0568-4851-b181-ee0b2bc47ae7 admin admin] PATH_INFO: `/v3/projects/24373ce58ace40578f0a63f2bdff3118/users/960370ae93bb47dfb3ec8ef5ac86e675/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.831788 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 926/1876] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:54 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:54.835940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.843992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e45675-0568-4851-b181-ee0b2bc47ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24373ce58ace40578f0a63f2bdff3118, user_id=960370ae93bb47dfb3ec8ef5ac86e675, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.851248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e45675-0568-4851-b181-ee0b2bc47ae7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.861031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3d68-a545-4c0b-8ced-f21ce01563f7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.884083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:54.884874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.886715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.887044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.890821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 951/1877] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:54 2022] PUT /identity/v3/projects/24373ce58ace40578f0a63f2bdff3118/users/960370ae93bb47dfb3ec8ef5ac86e675/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:54.890977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:54.890977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:54.898066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1047c-1fde-4b90-a7eb-e5b81c313e1f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:54.898351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1047c-1fde-4b90-a7eb-e5b81c313e1f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:54.898632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1047c-1fde-4b90-a7eb-e5b81c313e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:54.937453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 927/1878] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:54.941776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:54.984916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f95aa5-e2a4-486d-989d-1b0caa61cd14 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:54.998338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8be1047c-1fde-4b90-a7eb-e5b81c313e1f None None] MFA Rules not processed for user `960370ae93bb47dfb3ec8ef5ac86e675`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:55.002128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8be1047c-1fde-4b90-a7eb-e5b81c313e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:55.207666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:55.208366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.211231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.211529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.213688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:55.216127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:55.266560 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 928/1879] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:55.272137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:55.319937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e389df-2058-4172-b0b2-4c0011686817 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:55.330302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeccaef-dfe7-4111-b370-154d790f1102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:55.334552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeccaef-dfe7-4111-b370-154d790f1102 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.335107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeccaef-dfe7-4111-b370-154d790f1102 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.335593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeccaef-dfe7-4111-b370-154d790f1102 admin admin] PATH_INFO: `/v3/projects/e319fb6c72864e1997a9f30a5f09f36c/users/f7c66dcdb16748bd900fb2a0501d7d72/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.340150 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 952/1880] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:55.343822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1047c-1fde-4b90-a7eb-e5b81c313e1f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:55.370573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1047c-1fde-4b90-a7eb-e5b81c313e1f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:55.383547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeccaef-dfe7-4111-b370-154d790f1102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e319fb6c72864e1997a9f30a5f09f36c, user_id=f7c66dcdb16748bd900fb2a0501d7d72, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:55.389704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:55.390919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.391518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.391934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.392530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:55.397045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:55.413989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeccaef-dfe7-4111-b370-154d790f1102 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:55.452570 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 929/1881] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:55 2022] PUT /identity/v3/projects/e319fb6c72864e1997a9f30a5f09f36c/users/f7c66dcdb16748bd900fb2a0501d7d72/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:55.466464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256850ef-c309-4339-8010-ef303bed69b3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.468952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256850ef-c309-4339-8010-ef303bed69b3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.469325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256850ef-c309-4339-8010-ef303bed69b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.480009 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 953/1882] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:55 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:55.483436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:55.573887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-256850ef-c309-4339-8010-ef303bed69b3 None None] MFA Rules not processed for user `f7c66dcdb16748bd900fb2a0501d7d72`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:55.582572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-256850ef-c309-4339-8010-ef303bed69b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:55.724610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd79c6-f0dc-4632-91ec-43b013847f0b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:55.742145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ce394-e229-4841-af91-e9b74d4e3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:55.742837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce394-e229-4841-af91-e9b74d4e3564 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.743125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce394-e229-4841-af91-e9b74d4e3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.743457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce394-e229-4841-af91-e9b74d4e3564 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.744194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ce394-e229-4841-af91-e9b74d4e3564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:55.748415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ce394-e229-4841-af91-e9b74d4e3564 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:55.805496 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 954/1883] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:55 2022] POST /identity/v3/users => generated 292 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:55.809864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeaf6c-ecfb-498b-89ea-ec1adead5ed9 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.810151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeaf6c-ecfb-498b-89ea-ec1adead5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.810427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faeaf6c-ecfb-498b-89ea-ec1adead5ed9 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.817890 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 955/1884] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:45:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:45:55.818925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeaf6c-ecfb-498b-89ea-ec1adead5ed9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:55.823983 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 930/1885] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:55.823983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256850ef-c309-4339-8010-ef303bed69b3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:55.824225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3faeaf6c-ecfb-498b-89ea-ec1adead5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:55.847622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faeaf6c-ecfb-498b-89ea-ec1adead5ed9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:55.853792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:55.855345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.856130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.856630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] PATH_INFO: `/v3/projects/ffd4c66aec4241d8af652f8ffed78e63` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.858263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd4c66aec4241d8af652f8ffed78e63)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:55.860494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:55.874318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256850ef-c309-4339-8010-ef303bed69b3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:55.899455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:55.900773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:55.901328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:55.901617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:55.902411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:55.904971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:55.919255 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 931/1886] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:55.920189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:55.963432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f595a0d-a672-4337-9014-b0acd0a87caf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:56.025188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd4c66aec4241d8af652f8ffed78e63', 'request_id': 'req-e49ebf37-008d-4bfc-822e-c103ee14d3e9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.047561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd4c66aec4241d8af652f8ffed78e63', 'request_id': 'req-e49ebf37-008d-4bfc-822e-c103ee14d3e9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.064588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd4c66aec4241d8af652f8ffed78e63', 'request_id': 'req-e49ebf37-008d-4bfc-822e-c103ee14d3e9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.096735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] The token cache is being invalidate because project ffd4c66aec4241d8af652f8ffed78e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:56.097037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.107166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e49ebf37-008d-4bfc-822e-c103ee14d3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.116265 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 956/1887] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:55 2022] DELETE /identity/v3/projects/ffd4c66aec4241d8af652f8ffed78e63 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:56.118627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:56.121324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:56.121612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:56.127850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:56.128873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:56.129160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:56.129435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:56.132566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:56.135240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:56.207097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:56.218393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:56.238986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 932/1888] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:55 2022] POST /identity/v3/projects => generated 375 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:56.238986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:56.248417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:56.378511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe72b1-a258-43ae-a231-7ce7c07f2ea9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:56.385655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:56.387112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:56.387576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:56.388002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] PATH_INFO: `/v3/projects/53d94c79ef1f4bcb910bf28e32ee0b26/users/76016fb9ad9448bf9bac9e25ecabf80a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:56.401556 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 957/1889] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:45:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:56.402549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:56.404863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:56.422626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d94c79ef1f4bcb910bf28e32ee0b26, user_id=76016fb9ad9448bf9bac9e25ecabf80a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:56.427795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:56.437908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa600-4b4f-41fe-8fe3-01d9e9289bac None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:56.448739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:56.449675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:56.449953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:56.450315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] PATH_INFO: `/v3/users/824b86b63609435bbf3d712c4fe437db` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:56.458037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824b86b63609435bbf3d712c4fe437db)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:56.458139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:56.468763 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 933/1890] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:56 2022] PUT /identity/v3/projects/53d94c79ef1f4bcb910bf28e32ee0b26/users/76016fb9ad9448bf9bac9e25ecabf80a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:56.471154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:56.479226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:56.557136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824b86b63609435bbf3d712c4fe437db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.557963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824b86b63609435bbf3d712c4fe437db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.584586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824b86b63609435bbf3d712c4fe437db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.586281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824b86b63609435bbf3d712c4fe437db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.602031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824b86b63609435bbf3d712c4fe437db'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:56.642903 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 958/1891] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:56 2022] DELETE /identity/v3/users/824b86b63609435bbf3d712c4fe437db => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:56.645852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:56.648271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87305fe2-a052-4826-b303-1382befdcae8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:56.653104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:56.803024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:56.803812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:56.804225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:56.804635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:56.805676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:56.811869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:56.827471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6570d6c-03a2-4093-b9e8-6c66921764a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:56.834182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:56.835222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:56.835671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:56.836208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:56.837197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:56.841277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:56.870711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 934/1892] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:56 2022] POST /identity/v3/users => generated 294 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:56.871227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:56.875733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:56.897915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 959/1893] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:56.900389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:56.904915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:56.939899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db5f86-2330-43fa-99ac-5ade590bd143 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:56.958900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:56.960033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:56.960445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:56.960829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:56.961713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:56.965985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:57.000774 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 960/1894] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:57.002353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:57.030346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c246f-1f05-4f14-8b24-0e1c07db401f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:57.045478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:57.047480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:57.049604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:57.050964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] PATH_INFO: `/v3/projects/53d94c79ef1f4bcb910bf28e32ee0b26/users/76016fb9ad9448bf9bac9e25ecabf80a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:57.056445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d94c79ef1f4bcb910bf28e32ee0b26, user_id=76016fb9ad9448bf9bac9e25ecabf80a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:57.073452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:57.095715 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 961/1895] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:56 2022] PUT /identity/v3/projects/53d94c79ef1f4bcb910bf28e32ee0b26/users/76016fb9ad9448bf9bac9e25ecabf80a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:57.109305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:57.127111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9501a6-3efc-4040-be50-7a86c6380306 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:57.270126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae817cf-f2fb-4fc4-8094-1fc63fdd0545 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:57.282738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605b609-446f-420e-93c6-aa3b6046b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:57.283802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b609-446f-420e-93c6-aa3b6046b0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:57.286330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b609-446f-420e-93c6-aa3b6046b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:57.286705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605b609-446f-420e-93c6-aa3b6046b0bd admin admin] PATH_INFO: `/v3/projects/9a6e01ee83e641049cd363a84b35804e/users/34d0670ceea34106bee3718cff0a6bb6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:57.318627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:57.319367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:57.319649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:57.319918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:57.328667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:57.330131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605b609-446f-420e-93c6-aa3b6046b0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6e01ee83e641049cd363a84b35804e, user_id=34d0670ceea34106bee3718cff0a6bb6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:57.337223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605b609-446f-420e-93c6-aa3b6046b0bd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:57.357446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:57.360426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:57.371584 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 962/1896] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:57 2022] PUT /identity/v3/projects/9a6e01ee83e641049cd363a84b35804e/users/34d0670ceea34106bee3718cff0a6bb6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:57.373295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713148f-ce8d-4758-9e0e-b0fdaec6d3e3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:57.376285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713148f-ce8d-4758-9e0e-b0fdaec6d3e3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:57.376849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713148f-ce8d-4758-9e0e-b0fdaec6d3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:57.403085 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 935/1897] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:57.406035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:57.417765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:57.447317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b713148f-ce8d-4758-9e0e-b0fdaec6d3e3 None None] MFA Rules not processed for user `76016fb9ad9448bf9bac9e25ecabf80a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:57.449329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b713148f-ce8d-4758-9e0e-b0fdaec6d3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:57.457547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214c242-8b5a-4a37-8c63-4d122b1bf8e4 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:57.660265 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 963/1898] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:57.668825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713148f-ce8d-4758-9e0e-b0fdaec6d3e3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:57.670928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:57.671978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:57.672090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:57.672337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] PATH_INFO: `/v3/projects/b77b751b750c4c20a0ef1d7630974b65` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:57.673792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77b751b750c4c20a0ef1d7630974b65)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:57.676022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:57.734752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713148f-ce8d-4758-9e0e-b0fdaec6d3e3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:57.768098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:57.768826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:57.771166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77b751b750c4c20a0ef1d7630974b65', 'request_id': 'req-481abca0-8737-4441-8e21-6e9f7d8543ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:57.775777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:57.776014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:57.776831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:57.783646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:57.809840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77b751b750c4c20a0ef1d7630974b65', 'request_id': 'req-481abca0-8737-4441-8e21-6e9f7d8543ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:57.817980 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 964/1899] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:45:57.819560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:57.827687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77b751b750c4c20a0ef1d7630974b65', 'request_id': 'req-481abca0-8737-4441-8e21-6e9f7d8543ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:57.857418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] The token cache is being invalidate because project b77b751b750c4c20a0ef1d7630974b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:57.857768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:57.859384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:57.864583 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 936/1900] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:57 2022] DELETE /identity/v3/projects/b77b751b750c4c20a0ef1d7630974b65 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:57.866167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:57.871046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:58.004270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc95dc-96be-4d54-b1f6-c32f84202ffa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:58.055141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481abca0-8737-4441-8e21-6e9f7d8543ed admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:58.069833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:58.071138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.071416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.071695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] PATH_INFO: `/v3/projects/9a6e01ee83e641049cd363a84b35804e/users/34d0670ceea34106bee3718cff0a6bb6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.076829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6e01ee83e641049cd363a84b35804e, user_id=34d0670ceea34106bee3718cff0a6bb6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:58.089527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:58.131939 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 937/1901] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:57 2022] PUT /identity/v3/projects/9a6e01ee83e641049cd363a84b35804e/users/34d0670ceea34106bee3718cff0a6bb6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:58.133938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:58.144806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:58.180035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecacc1-925e-4728-af25-195ef2afc695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:58.182183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecacc1-925e-4728-af25-195ef2afc695 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.183233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecacc1-925e-4728-af25-195ef2afc695 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.184488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecacc1-925e-4728-af25-195ef2afc695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.189698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-99ecacc1-925e-4728-af25-195ef2afc695 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:58.293046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680a4f6-239a-487f-b288-790794bcaf3a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:58.306573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:58.307671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.307952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.309461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] PATH_INFO: `/v3/users/015b1f7622da43e6ae057690ff2fc639` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.311073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=015b1f7622da43e6ae057690ff2fc639)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:58.314047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:58.342666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecacc1-925e-4728-af25-195ef2afc695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:58.344655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecacc1-925e-4728-af25-195ef2afc695 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:58.367941 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 965/1902] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:58.369503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012b046-5ba9-4c9f-a40d-ee9ae777dbf1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.369932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012b046-5ba9-4c9f-a40d-ee9ae777dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.370680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012b046-5ba9-4c9f-a40d-ee9ae777dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.427960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b012b046-5ba9-4c9f-a40d-ee9ae777dbf1 None None] MFA Rules not processed for user `78d0f0ba350c45788a39dabf047ac6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:58.429302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b012b046-5ba9-4c9f-a40d-ee9ae777dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:58.443937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015b1f7622da43e6ae057690ff2fc639'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.461959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015b1f7622da43e6ae057690ff2fc639'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.467755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015b1f7622da43e6ae057690ff2fc639'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.469340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015b1f7622da43e6ae057690ff2fc639'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.490927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015b1f7622da43e6ae057690ff2fc639'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.552910 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 938/1903] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:45:58 2022] DELETE /identity/v3/users/015b1f7622da43e6ae057690ff2fc639 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:58.556601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:58.560708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:58.627829 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 966/1904] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:58.632024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98bce-aa08-440d-91c5-8f4f97f87269 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.632503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98bce-aa08-440d-91c5-8f4f97f87269 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.632795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98bce-aa08-440d-91c5-8f4f97f87269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.687546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-72e98bce-aa08-440d-91c5-8f4f97f87269 None None] MFA Rules not processed for user `34d0670ceea34106bee3718cff0a6bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:58.688953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-72e98bce-aa08-440d-91c5-8f4f97f87269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:58.754201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b30ebe-354e-4ce2-928f-93b4c62e4b6e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:58.762831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:58.764178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.764629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.765078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] PATH_INFO: `/v3/projects/7231a031d45e4868af45945a77a32eda` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.766713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7231a031d45e4868af45945a77a32eda)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:58.769824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:58.857580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7231a031d45e4868af45945a77a32eda', 'request_id': 'req-04c2928a-d73d-481f-ab2e-d4268f57bdef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.862039 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 967/1905] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:58.879544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7231a031d45e4868af45945a77a32eda', 'request_id': 'req-04c2928a-d73d-481f-ab2e-d4268f57bdef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.883929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd7a7e-707a-4423-be6e-5879f0b021c2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.884643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd7a7e-707a-4423-be6e-5879f0b021c2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.885198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd7a7e-707a-4423-be6e-5879f0b021c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.889934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7231a031d45e4868af45945a77a32eda', 'request_id': 'req-04c2928a-d73d-481f-ab2e-d4268f57bdef'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.903900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] The token cache is being invalidate because project 7231a031d45e4868af45945a77a32eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:45:58.904490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.905449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04c2928a-d73d-481f-ab2e-d4268f57bdef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:45:58.909468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 939/1906] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:58 2022] DELETE /identity/v3/projects/7231a031d45e4868af45945a77a32eda => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:45:58.911105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:58.911634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:58.912169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:58.934152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-28fd7a7e-707a-4423-be6e-5879f0b021c2 None None] MFA Rules not processed for user `99e9b91d4fb949f18cc61bf2bbd63ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:58.935479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-28fd7a7e-707a-4423-be6e-5879f0b021c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:58.947285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] MFA Rules not processed for user `f7c66dcdb16748bd900fb2a0501d7d72`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:58.949240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.087747 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 968/1907] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:59.090156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.090922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.094223 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 940/1908] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:59.115222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.119835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.121618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.142014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:59.143306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.250158 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 969/1909] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:59.251249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.257568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.279893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a63f5-a60f-4bf3-a8cc-db9648ed5d1a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.288024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78eba63-f110-48da-87b8-ece0d0eeea13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:59.288804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eba63-f110-48da-87b8-ece0d0eeea13 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.288977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eba63-f110-48da-87b8-ece0d0eeea13 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.289299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78eba63-f110-48da-87b8-ece0d0eeea13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.291465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c78eba63-f110-48da-87b8-ece0d0eeea13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.298443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02516322-fe01-4b5e-9fc8-796d5ab1f8ed None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.311935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eba63-f110-48da-87b8-ece0d0eeea13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:59.313957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78eba63-f110-48da-87b8-ece0d0eeea13 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:59.315594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:59.318916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.319978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.320619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.323565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.334868 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 970/1910] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:45:59.336402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11ab3-b950-413c-884e-75c38ffb9ea0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.336762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11ab3-b950-413c-884e-75c38ffb9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.337119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce11ab3-b950-413c-884e-75c38ffb9ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.339544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:59.341941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:59.361433 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 941/1911] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:45:59.363169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4ce11ab3-b950-413c-884e-75c38ffb9ea0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:45:59.364551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4ce11ab3-b950-413c-884e-75c38ffb9ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.383755 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 971/1912] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:45:59.390261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.405654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d3e22-5c8d-47d7-b3ce-2fe0c7af6a71 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.413084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:59.413762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.414045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.414321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.417973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:45:59.418185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:59.422160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:59.485274 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 942/1913] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:45:59.490035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11ab3-b950-413c-884e-75c38ffb9ea0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.507073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce11ab3-b950-413c-884e-75c38ffb9ea0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.533654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:59.534607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.535084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.536158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.537037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:59.540184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:59.583757 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 972/1914] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:45:59 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:59.588154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.606951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e34c72-c3bd-4a47-aca4-c15c9e6dd198 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.686363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:59.687167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.687456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.687828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.688544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:59.691631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:59.729804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 943/1915] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:45:59 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:45:59.734084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.757534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac65b3e-cc18-43a9-9673-5be11b9e7b84 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.772165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:59.772863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.773170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.773430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.774174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:59.777310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:59.813769 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 973/1916] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:45:59.819631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.848886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29b4c5-e3c5-41ac-9755-0e945e2073bf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.888391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:45:59.888391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:45:59.888391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:45:59.888391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:45:59.888906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:45:59.891658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:45:59.962037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 944/1917] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:45:59.962244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.962244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37924a-a80d-480c-acb3-63a978f28f09 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:45:59.963668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:45:59.965639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:45:59.995306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eac23-2c1a-4519-98b9-2d3fd611ebcd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:00.013337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:00.014444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142e8c2-070c-4202-8466-cbac4bf6adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:00.015401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e8c2-070c-4202-8466-cbac4bf6adae admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:00.015675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e8c2-070c-4202-8466-cbac4bf6adae admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:00.015949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142e8c2-070c-4202-8466-cbac4bf6adae admin admin] PATH_INFO: `/v3/projects/95946c2e9a5c4a72905d75010a9bb7a5/users/e1333f2166c947a4a37dd6865f532f24/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:00.023253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:00.024612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:00.028414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] PATH_INFO: `/v3/projects/c533e85dd29c4ae58fddd41aa59e87fd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:00.033318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c533e85dd29c4ae58fddd41aa59e87fd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:00.037725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:00.070630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142e8c2-070c-4202-8466-cbac4bf6adae admin admin] RBAC: Authorizing `identity:create_grant(project_id=95946c2e9a5c4a72905d75010a9bb7a5, user_id=e1333f2166c947a4a37dd6865f532f24, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:00.074284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142e8c2-070c-4202-8466-cbac4bf6adae admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:00.108381 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 974/1918] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:45:59 2022] PUT /identity/v3/projects/95946c2e9a5c4a72905d75010a9bb7a5/users/e1333f2166c947a4a37dd6865f532f24/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:00.126157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:00.126450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:00.126747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:00.214370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] MFA Rules not processed for user `e1333f2166c947a4a37dd6865f532f24`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:00.218132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:00.295436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c533e85dd29c4ae58fddd41aa59e87fd', 'request_id': 'req-658a1847-b6af-4062-a67f-d595886dc5de'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:00.317913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c533e85dd29c4ae58fddd41aa59e87fd', 'request_id': 'req-658a1847-b6af-4062-a67f-d595886dc5de'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:00.355650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c533e85dd29c4ae58fddd41aa59e87fd', 'request_id': 'req-658a1847-b6af-4062-a67f-d595886dc5de'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:00.385253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] The token cache is being invalidate because project c533e85dd29c4ae58fddd41aa59e87fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:00.385554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:00.389102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-658a1847-b6af-4062-a67f-d595886dc5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:00.396313 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 945/1919] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:45:59 2022] DELETE /identity/v3/projects/c533e85dd29c4ae58fddd41aa59e87fd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:00.410183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cdc9-1e46-4254-9c6b-e0edcf704f02 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:00.410588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cdc9-1e46-4254-9c6b-e0edcf704f02 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:00.410899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67cdc9-1e46-4254-9c6b-e0edcf704f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:00.423872 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 975/1920] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:00.433284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:00.435381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:00.490971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7c67cdc9-1e46-4254-9c6b-e0edcf704f02 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:00.492229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7c67cdc9-1e46-4254-9c6b-e0edcf704f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:00.580937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71494f0d-2220-4078-8059-6478e05afd3d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:00.780885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:00.781893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:00.781893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:00.782221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:00.783492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:00.796425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:00.797895 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 946/1921] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:00.799944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c3f12-1ea9-40b8-9112-c64868977af2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:00.800503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c3f12-1ea9-40b8-9112-c64868977af2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:00.805399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c3f12-1ea9-40b8-9112-c64868977af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:00.936204 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 976/1922] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:00 2022] POST /identity/v3/projects => generated 375 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:00.941452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:00.947438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d53c3f12-1ea9-40b8-9112-c64868977af2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:00.949697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d53c3f12-1ea9-40b8-9112-c64868977af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:01.147684 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 947/1923] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:01.152689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcdb6-5873-4711-baf0-a9949ce89618 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.154485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcdb6-5873-4711-baf0-a9949ce89618 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.155711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bcdb6-5873-4711-baf0-a9949ce89618 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.156235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11728091-8f96-4f3f-98ca-441bc81cd83a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.162363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 948/1924] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:46:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:01.164213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75d11-26a3-474a-8dd2-8d2f47a58442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:01.164933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75d11-26a3-474a-8dd2-8d2f47a58442 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.165193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75d11-26a3-474a-8dd2-8d2f47a58442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.165466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75d11-26a3-474a-8dd2-8d2f47a58442 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.165722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcdb6-5873-4711-baf0-a9949ce89618 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:01.182795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75d11-26a3-474a-8dd2-8d2f47a58442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:01.182795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75d11-26a3-474a-8dd2-8d2f47a58442 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:01.216853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bcdb6-5873-4711-baf0-a9949ce89618 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.229008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:01.229982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.230799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.231072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.232274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:01.238574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:01.244747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:01.250905 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 977/1925] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:00 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:01.252583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6a3f-5691-4d32-b51d-16b545c1f991 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.252893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6a3f-5691-4d32-b51d-16b545c1f991 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.254452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b6a3f-5691-4d32-b51d-16b545c1f991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.284343 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 949/1926] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:01.287448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:01.320849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567c9ce-861f-47a1-9dfe-e36a8152902c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.336115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:01.339359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.341484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.342031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.344410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:01.353543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:01.373053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6b2b6a3f-5691-4d32-b51d-16b545c1f991 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:01.378688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b2b6a3f-5691-4d32-b51d-16b545c1f991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:01.392553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 950/1927] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:01.398687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:01.429169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89ba13-8cbe-4f4a-830a-8d8a054b8bdd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.451300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:01.452122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.452539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.453162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.453968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:01.456040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:01.535012 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 951/1928] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:01 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:01.536986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:01.674221 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 978/1929] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:46:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:01.676212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6a3f-5691-4d32-b51d-16b545c1f991 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:01.709196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b6a3f-5691-4d32-b51d-16b545c1f991 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.738613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee560a4-6ac9-40af-b03b-184912627544 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.755619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:01.756720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.757406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.757796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] PATH_INFO: `/v3/projects/3f76a01201d14762b196350691f865bf/users/2cc85c70e1094bff978c7ef711f2bed3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.795268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f76a01201d14762b196350691f865bf, user_id=2cc85c70e1094bff978c7ef711f2bed3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:01.805122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:01.829717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:01.830451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.830739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.832052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:01.833581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:01.835862 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 952/1930] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:01 2022] PUT /identity/v3/projects/3f76a01201d14762b196350691f865bf/users/2cc85c70e1094bff978c7ef711f2bed3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:01.837255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:01.838153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:01.842103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:01.883664 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 979/1931] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:01 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:01.887609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:01.903939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d5296-7243-4f0f-a9ca-7bad70fc94c0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.970907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a6767-0830-4b7b-b913-599ec6422802 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:01.985551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:01.986316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:01.986607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:01.986996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.007098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.008958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.018115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.019907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.021154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.021444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.022200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.027653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.029058 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 953/1932] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:02.029610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.047264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fb097-dca7-4e43-b6e0-c691249d7a0b service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.058988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.059717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.059944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.060214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.060947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.066799 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 980/1933] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:02.068346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.069826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.084603 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 954/1934] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:02.089036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.106402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6a143-907a-4398-ab46-736f786bf1b3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.120706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1536de-a8fc-4631-8d8d-1b95655a42fd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.124135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e954c7-90d8-4e5e-9026-12e3fad7768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.125086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e954c7-90d8-4e5e-9026-12e3fad7768c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.125368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e954c7-90d8-4e5e-9026-12e3fad7768c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.125642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e954c7-90d8-4e5e-9026-12e3fad7768c admin admin] PATH_INFO: `/v3/projects/3f76a01201d14762b196350691f865bf/users/2cc85c70e1094bff978c7ef711f2bed3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.125972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.126927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.127216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.127494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.127827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e954c7-90d8-4e5e-9026-12e3fad7768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f76a01201d14762b196350691f865bf, user_id=2cc85c70e1094bff978c7ef711f2bed3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.128256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.130543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.131565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e954c7-90d8-4e5e-9026-12e3fad7768c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.147480 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 981/1935] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:02 2022] PUT /identity/v3/projects/3f76a01201d14762b196350691f865bf/users/2cc85c70e1094bff978c7ef711f2bed3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:02.160058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac282f-ad77-4d61-b9af-96b56211ee5d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.160345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac282f-ad77-4d61-b9af-96b56211ee5d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.160621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac282f-ad77-4d61-b9af-96b56211ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.173933 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 955/1936] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:02.177771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.193741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-daac282f-ad77-4d61-b9af-96b56211ee5d None None] MFA Rules not processed for user `2cc85c70e1094bff978c7ef711f2bed3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:02.195007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-daac282f-ad77-4d61-b9af-96b56211ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:02.204774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb837a-d406-451a-867f-878d3b564b16 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.317394 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 982/1937] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:02.328739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.329801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.330276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.345537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b44b3-b537-4542-b542-2e53564bbc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.347448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b44b3-b537-4542-b542-2e53564bbc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.347655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b44b3-b537-4542-b542-2e53564bbc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.347927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b44b3-b537-4542-b542-2e53564bbc5b admin admin] PATH_INFO: `/v3/projects/5e71c9d87dc34c3092056a7444894997/users/9f305ebcf43c41d0a64a96e76bb326be/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.351492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] MFA Rules not processed for user `e1333f2166c947a4a37dd6865f532f24`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:02.352714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:02.364934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b44b3-b537-4542-b542-2e53564bbc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e71c9d87dc34c3092056a7444894997, user_id=9f305ebcf43c41d0a64a96e76bb326be, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.367997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b44b3-b537-4542-b542-2e53564bbc5b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.391051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 956/1938] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:02 2022] PUT /identity/v3/projects/5e71c9d87dc34c3092056a7444894997/users/9f305ebcf43c41d0a64a96e76bb326be/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:02.394739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81dcd-7ca0-4531-a458-7cc8fca133d1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.395050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81dcd-7ca0-4531-a458-7cc8fca133d1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.395320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b81dcd-7ca0-4531-a458-7cc8fca133d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.419028 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 983/1939] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:02.430614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.434800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:02.447649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-87b81dcd-7ca0-4531-a458-7cc8fca133d1 None None] MFA Rules not processed for user `9f305ebcf43c41d0a64a96e76bb326be`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:02.450100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-87b81dcd-7ca0-4531-a458-7cc8fca133d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:02.521480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efef50f-57cb-4c84-bbf0-a8daffbedf08 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.537320 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 957/1940] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:02.542246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81dcd-7ca0-4531-a458-7cc8fca133d1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.612304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.613010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.613295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.613577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.627598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b81dcd-7ca0-4531-a458-7cc8fca133d1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.632680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.633408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.633704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.634028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.634909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.637060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.668733 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 958/1941] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:02 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:02.672794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.689429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.691653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.702648 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 984/1942] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:02.768202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2c750-fba6-4f80-a4f0-f1978ca45dd7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.777191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.778092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.781500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.781912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.782876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.784989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.815637 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 959/1943] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:02 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:02.819837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.835292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77beba9-ffb1-4b82-b677-dd7fd27f45b6 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.849382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.850066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.850317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.850594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.851396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.852983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.876169 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 985/1944] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:02.877441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.892273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af50a2-e55f-4351-b86c-bc81d1989df0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:02.903084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:02.904088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:02.904608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:02.904723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] PATH_INFO: `/v3/projects/202ee41be9df4b1da11d77b623a7994b/users/3b7c0cbb245546258350de063c4d0707/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:02.923543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=202ee41be9df4b1da11d77b623a7994b, user_id=3b7c0cbb245546258350de063c4d0707, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:02.927216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:02.953347 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 960/1945] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:02 2022] PUT /identity/v3/projects/202ee41be9df4b1da11d77b623a7994b/users/3b7c0cbb245546258350de063c4d0707/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:02.954707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:02.973421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6118a-0e80-4f4f-add2-54a4abb100ef admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:03.185992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc848b2-c5a9-4589-a4e7-f6db6fb0c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:03.190222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc848b2-c5a9-4589-a4e7-f6db6fb0c24a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:03.190518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc848b2-c5a9-4589-a4e7-f6db6fb0c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:03.200491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc848b2-c5a9-4589-a4e7-f6db6fb0c24a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:03.202263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc848b2-c5a9-4589-a4e7-f6db6fb0c24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:03.204521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc848b2-c5a9-4589-a4e7-f6db6fb0c24a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:03.244502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:03.246192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 986/1946] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:03.261345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2128b9b5-d391-4928-8922-98d9f56264bc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:03.281445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9550c-2ecd-40fe-99f9-1411fb483141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:03.283063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9550c-2ecd-40fe-99f9-1411fb483141 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:03.283450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9550c-2ecd-40fe-99f9-1411fb483141 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:03.283828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9550c-2ecd-40fe-99f9-1411fb483141 admin admin] PATH_INFO: `/v3/projects/202ee41be9df4b1da11d77b623a7994b/users/3b7c0cbb245546258350de063c4d0707/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:03.290115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9550c-2ecd-40fe-99f9-1411fb483141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202ee41be9df4b1da11d77b623a7994b, user_id=3b7c0cbb245546258350de063c4d0707, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:03.293944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9550c-2ecd-40fe-99f9-1411fb483141 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:03.317736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:03.318033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:03.318416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:03.323402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 961/1947] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:03 2022] PUT /identity/v3/projects/202ee41be9df4b1da11d77b623a7994b/users/3b7c0cbb245546258350de063c4d0707/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:03.387259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] MFA Rules not processed for user `3b7c0cbb245546258350de063c4d0707`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:03.388724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:03.585781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d66be-75f9-446e-8026-9129d996a693 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:03.586303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d66be-75f9-446e-8026-9129d996a693 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:03.586387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d66be-75f9-446e-8026-9129d996a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:03.640946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d14d66be-75f9-446e-8026-9129d996a693 None None] MFA Rules not processed for user `e1333f2166c947a4a37dd6865f532f24`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:03.641911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d14d66be-75f9-446e-8026-9129d996a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:03.689867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 987/1948] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:03.754807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:03.756647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:03.777971 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 962/1949] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:03.890388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e94b-74f2-4c85-b5cd-0d84a8c039a4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:03.892481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e94b-74f2-4c85-b5cd-0d84a8c039a4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:03.892876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63e94b-74f2-4c85-b5cd-0d84a8c039a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:03.935848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44aed1-51b4-45f8-8e76-faf7e6950e8c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:03.943160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:03.944517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:03.944958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:03.945395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:03.948817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6a63e94b-74f2-4c85-b5cd-0d84a8c039a4 None None] MFA Rules not processed for user `85eeaeaf9f1c464f8d45eff93bab41cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:03.952607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6a63e94b-74f2-4c85-b5cd-0d84a8c039a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:03.960154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:03.962206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:03.975560 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 988/1950] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:04.156544 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 963/1951] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:04.161855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:04.163464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:04.307778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9af97-aee4-482b-83e8-ae4572922ea7 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:04.314380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:04.315583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:04.316729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:04.317494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:04.319672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:04.325451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:04.407353 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 989/1952] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:04 2022] POST /identity/v3/projects => generated 397 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:04.412462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e94b-74f2-4c85-b5cd-0d84a8c039a4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:04.431622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63e94b-74f2-4c85-b5cd-0d84a8c039a4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:04.550981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:04.553396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:04.553739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:04.554031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:04.554788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:04.561870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:04.590140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 964/1953] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:04 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:04.594376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:04.610743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a22d35-fb78-49ec-a3f9-cf74887f52fe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:04.618985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:04.621083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:04.621300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:04.621577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:04.622310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:04.632113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:04.655718 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 990/1954] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:04.656705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:04.669008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbaac6d-1edd-41ab-ac05-2363a28a76ee admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:04.675010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:04.676434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:04.676713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:04.676987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] PATH_INFO: `/v3/projects/12dbc8ee204548bba46b92b913aeed3a/users/bc43b06076df4cfaae8e4a5a4328b60c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:04.697653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dbc8ee204548bba46b92b913aeed3a, user_id=bc43b06076df4cfaae8e4a5a4328b60c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:04.713561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:04.732902 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 965/1955] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:04 2022] PUT /identity/v3/projects/12dbc8ee204548bba46b92b913aeed3a/users/bc43b06076df4cfaae8e4a5a4328b60c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:04.738370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:04.750755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f7c35-05dd-4d6b-9605-4683f37032f9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:04.777623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:04.912262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:04.912970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:04.913251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:04.913529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:04.914343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:04.918971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:04.920915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a0c25-6785-4b6e-a31e-409483f899ed admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:04.932558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:04.933642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:04.934001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:04.934349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] PATH_INFO: `/v3/users/9f305ebcf43c41d0a64a96e76bb326be` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:04.938549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f305ebcf43c41d0a64a96e76bb326be)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:04.938549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:04.981568 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 991/1956] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:04.996276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:05.011630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55be346-00fb-4c53-8faf-9d11e2b1bbc1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:05.017458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd90eb-7451-4a64-b934-8fcf49ebe446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:05.019272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd90eb-7451-4a64-b934-8fcf49ebe446 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:05.019645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd90eb-7451-4a64-b934-8fcf49ebe446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:05.019977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd90eb-7451-4a64-b934-8fcf49ebe446 admin admin] PATH_INFO: `/v3/projects/12dbc8ee204548bba46b92b913aeed3a/users/bc43b06076df4cfaae8e4a5a4328b60c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:05.022239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd90eb-7451-4a64-b934-8fcf49ebe446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12dbc8ee204548bba46b92b913aeed3a, user_id=bc43b06076df4cfaae8e4a5a4328b60c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:05.026663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd90eb-7451-4a64-b934-8fcf49ebe446 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:05.046497 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 992/1957] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:04 2022] PUT /identity/v3/projects/12dbc8ee204548bba46b92b913aeed3a/users/bc43b06076df4cfaae8e4a5a4328b60c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:05.059264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f305ebcf43c41d0a64a96e76bb326be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:05.077182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f305ebcf43c41d0a64a96e76bb326be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:05.079644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f305ebcf43c41d0a64a96e76bb326be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:05.080587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f305ebcf43c41d0a64a96e76bb326be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:05.091377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f305ebcf43c41d0a64a96e76bb326be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:05.123423 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 966/1958] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:04 2022] DELETE /identity/v3/users/9f305ebcf43c41d0a64a96e76bb326be => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:05.128590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:05.129328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:05.129328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:05.149698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:05.150996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:05.229396 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 993/1959] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:05.245508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:05.257368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:05.401497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd752122-9cfb-470c-b89c-f7a51edef545 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:05.405956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:05.407209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:05.407571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:05.407958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:05.425877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:05.428199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:05.443360 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 967/1960] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:06.032924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:06.035016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:06.057820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24b93-79d6-4f89-a7bc-412c01532b65 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:06.068902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:06.069964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:06.070358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:06.070702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] PATH_INFO: `/v3/projects/5e71c9d87dc34c3092056a7444894997` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:06.079342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e71c9d87dc34c3092056a7444894997)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:06.082224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:06.178183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e71c9d87dc34c3092056a7444894997', 'request_id': 'req-cb1cc1df-aabc-4008-918b-f1c6024a0a03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.194249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e71c9d87dc34c3092056a7444894997', 'request_id': 'req-cb1cc1df-aabc-4008-918b-f1c6024a0a03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.208375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e71c9d87dc34c3092056a7444894997', 'request_id': 'req-cb1cc1df-aabc-4008-918b-f1c6024a0a03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.222959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] The token cache is being invalidate because project 5e71c9d87dc34c3092056a7444894997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:06.223408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.224302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.226701 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 994/1961] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:06 2022] DELETE /identity/v3/projects/5e71c9d87dc34c3092056a7444894997 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:06.230732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:06.244200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6702f9-c8ac-4079-a39f-83c852c631c1 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:06.335965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:06.336849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:06.337130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:06.337401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] PATH_INFO: `/v3/users/3b7c0cbb245546258350de063c4d0707` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:06.338845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7c0cbb245546258350de063c4d0707)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:06.340811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:06.418309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7c0cbb245546258350de063c4d0707'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.439510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7c0cbb245546258350de063c4d0707'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.440302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7c0cbb245546258350de063c4d0707'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.441464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7c0cbb245546258350de063c4d0707'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.458217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e067f9ff-bfa9-49ad-8a28-f1d9ff64d4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7c0cbb245546258350de063c4d0707'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:06.483812 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 968/1962] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:06 2022] DELETE /identity/v3/users/3b7c0cbb245546258350de063c4d0707 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:06.908053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:06.910618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:06.946519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc1df-aabc-4008-918b-f1c6024a0a03 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:07.152673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:07.154205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:07.154646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:07.155138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] PATH_INFO: `/v3/projects/202ee41be9df4b1da11d77b623a7994b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:07.173862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] RBAC: Authorizing `identity:delete_project(project_id=202ee41be9df4b1da11d77b623a7994b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:07.176413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:07.308097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202ee41be9df4b1da11d77b623a7994b', 'request_id': 'req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:07.322137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202ee41be9df4b1da11d77b623a7994b', 'request_id': 'req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:07.349338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202ee41be9df4b1da11d77b623a7994b', 'request_id': 'req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:07.390655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] The token cache is being invalidate because project 202ee41be9df4b1da11d77b623a7994b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:07.390995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:07.394673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4aaef8c0-c164-42cf-a44c-ff2abc3a18de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:07.399630 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 995/1963] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:06 2022] DELETE /identity/v3/projects/202ee41be9df4b1da11d77b623a7994b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:07.404618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eba2a-3721-4f68-a571-9a30863a49b0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:07.405205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eba2a-3721-4f68-a571-9a30863a49b0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:07.405205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6eba2a-3721-4f68-a571-9a30863a49b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:07.437891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2e6eba2a-3721-4f68-a571-9a30863a49b0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:07.439465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2e6eba2a-3721-4f68-a571-9a30863a49b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:07.588634 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 969/1964] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:07.596711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fe62-914f-451d-9985-dbb95b26a323 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:07.597009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fe62-914f-451d-9985-dbb95b26a323 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:07.597289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8fe62-914f-451d-9985-dbb95b26a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:07.631264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-99b8fe62-914f-451d-9985-dbb95b26a323 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:07.634176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-99b8fe62-914f-451d-9985-dbb95b26a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:07.645621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 996/1965] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:07.650144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eba2a-3721-4f68-a571-9a30863a49b0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:07.661966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6eba2a-3721-4f68-a571-9a30863a49b0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:07.667536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:07.668219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:07.668500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:07.668770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:07.669506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:07.669807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:07.671545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:07.689471 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 970/1966] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:07.691335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fe62-914f-451d-9985-dbb95b26a323 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:07.704425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8fe62-914f-451d-9985-dbb95b26a323 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:07.745848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:07.750715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:07.750964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:07.751227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:07.751952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:07.774392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:07.848934 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 997/1967] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:07 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:07.853041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:07.912225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430d0c4-de3c-4988-9f9e-ed7dcf2ca23c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.028387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.029358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.029785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.030213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.031839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.034536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.074453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 971/1968] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:07 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:08.078252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.089892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae1492-b444-46db-9a25-64e87cecf20d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.095500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.096417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.097295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.097741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.098808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.101199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.123734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 998/1969] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:08.128294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.145630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba6883-d9a9-4d5a-8ee0-96e6c7080515 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.164446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f605f4-f3d3-479b-85fd-d3d637893a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.165139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f605f4-f3d3-479b-85fd-d3d637893a74 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.165426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f605f4-f3d3-479b-85fd-d3d637893a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.165705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f605f4-f3d3-479b-85fd-d3d637893a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.166431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f605f4-f3d3-479b-85fd-d3d637893a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.169770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f605f4-f3d3-479b-85fd-d3d637893a74 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.185826 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 972/1970] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:08.190065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.212294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8409e-9726-4e68-b815-e2dcf5bf0ac5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.220240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.222253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.223330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.223899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] PATH_INFO: `/v3/projects/a75ae77f081d4c0dba4761e3f5bac5e9/users/e4bae09fb6ed4da0b84c81b452128a78/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.273915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75ae77f081d4c0dba4761e3f5bac5e9, user_id=e4bae09fb6ed4da0b84c81b452128a78, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.280695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.312622 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 999/1971] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:08 2022] PUT /identity/v3/projects/a75ae77f081d4c0dba4761e3f5bac5e9/users/e4bae09fb6ed4da0b84c81b452128a78/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:08.324664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050f85e-5b62-407c-8d78-3f7695e0183a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.324954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050f85e-5b62-407c-8d78-3f7695e0183a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.325245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050f85e-5b62-407c-8d78-3f7695e0183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.420040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9050f85e-5b62-407c-8d78-3f7695e0183a None None] MFA Rules not processed for user `e4bae09fb6ed4da0b84c81b452128a78`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:08.432709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9050f85e-5b62-407c-8d78-3f7695e0183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:08.570204 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 973/1972] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:08.575039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.684246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f087-7b1c-4d40-accc-1262fc4702f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.693924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.694608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.694990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.695192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.695885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.698061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.726216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1000/1973] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:08 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:08.730112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050f85e-5b62-407c-8d78-3f7695e0183a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.746825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050f85e-5b62-407c-8d78-3f7695e0183a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.814258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.814980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.815262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.816068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.816774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.819209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.839585 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 974/1974] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:08 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:08.843514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.854001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d2f9f-9c4c-437a-b494-a04ca5b74bf0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.858988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.859648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.859923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.860191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.860938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.862559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.873608 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1001/1975] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:08.877457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.890013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea8bf8-39a6-4892-b59a-1814a9608173 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:08.896430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:08.897342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:08.897618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:08.897893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] PATH_INFO: `/v3/projects/90fd48b668454dfab0d7207527c42fb9/users/89655f7cdd704d718e495e9f0e7c41ed/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:08.914504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fd48b668454dfab0d7207527c42fb9, user_id=89655f7cdd704d718e495e9f0e7c41ed, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:08.917541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:08.933391 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 975/1976] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:08 2022] PUT /identity/v3/projects/90fd48b668454dfab0d7207527c42fb9/users/89655f7cdd704d718e495e9f0e7c41ed/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:08.937432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:08.969081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5263d8-deb2-4135-a551-33f0513d8a85 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:09.114296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a382b-d0fd-48e7-a547-f9453ae953d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:09.115024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a382b-d0fd-48e7-a547-f9453ae953d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:09.115343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a382b-d0fd-48e7-a547-f9453ae953d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:09.115573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a382b-d0fd-48e7-a547-f9453ae953d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:09.116312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a382b-d0fd-48e7-a547-f9453ae953d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:09.117948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a382b-d0fd-48e7-a547-f9453ae953d0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:09.144720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1002/1977] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:09.149289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:09.161570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110d5f6-07e5-46fa-a4f6-a817e4a6d6cc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:09.169420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:09.175605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:09.176020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:09.176541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] PATH_INFO: `/v3/projects/90fd48b668454dfab0d7207527c42fb9/users/89655f7cdd704d718e495e9f0e7c41ed/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:09.179271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fd48b668454dfab0d7207527c42fb9, user_id=89655f7cdd704d718e495e9f0e7c41ed, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:09.182210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:09.210444 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 976/1978] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:09 2022] PUT /identity/v3/projects/90fd48b668454dfab0d7207527c42fb9/users/89655f7cdd704d718e495e9f0e7c41ed/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:09.215612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f9e6-068e-4f96-9ecf-86e4497c39c0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:09.216073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f9e6-068e-4f96-9ecf-86e4497c39c0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:09.216150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f9e6-068e-4f96-9ecf-86e4497c39c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:09.260675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a450f9e6-068e-4f96-9ecf-86e4497c39c0 None None] MFA Rules not processed for user `89655f7cdd704d718e495e9f0e7c41ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:09.265752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a450f9e6-068e-4f96-9ecf-86e4497c39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:09.453525 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1003/1979] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:09.460918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:09.481983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee66112-6f95-44e3-8fc7-a5e6464e8f2f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:09.499967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:09.501252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:09.501799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:09.502502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:09.503671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:09.504222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:09.506126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:09.535117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f9e6-068e-4f96-9ecf-86e4497c39c0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:09.536479 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 977/1980] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:09.551443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f9e6-068e-4f96-9ecf-86e4497c39c0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:09.564663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:09.565936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:09.566253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:09.566528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:09.569224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:09.574511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:09.651276 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1004/1981] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:09 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:09.654354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:09.671304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43925988-61f0-479e-94ac-45bef9cbb114 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:09.802363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f00d-e28c-463b-80e1-245ee134bc4d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:09.803296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f00d-e28c-463b-80e1-245ee134bc4d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:09.804277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f00d-e28c-463b-80e1-245ee134bc4d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:09.804717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f00d-e28c-463b-80e1-245ee134bc4d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:09.814499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f00d-e28c-463b-80e1-245ee134bc4d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:09.814850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f00d-e28c-463b-80e1-245ee134bc4d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:09.817830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f00d-e28c-463b-80e1-245ee134bc4d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:09.835533 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 978/1982] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:09.846465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:09.848551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:09.933067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20e40-0500-4b5a-9656-c65357e8dec8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:09.933534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20e40-0500-4b5a-9656-c65357e8dec8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:09.934406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20e40-0500-4b5a-9656-c65357e8dec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:09.990939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e4a20e40-0500-4b5a-9656-c65357e8dec8 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:09.992294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e4a20e40-0500-4b5a-9656-c65357e8dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:10.009403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f6bb3-87ab-4f67-8c9d-e163fdbbe312 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.020772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35342318-3d9f-4ade-8b21-397b1b25745e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.025900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342318-3d9f-4ade-8b21-397b1b25745e service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.026255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342318-3d9f-4ade-8b21-397b1b25745e service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.026477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35342318-3d9f-4ade-8b21-397b1b25745e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.048676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35342318-3d9f-4ade-8b21-397b1b25745e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.050907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35342318-3d9f-4ade-8b21-397b1b25745e service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.070530 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1005/1983] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:10.093095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6c36-4390-4947-90c9-12c17785851f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.093387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6c36-4390-4947-90c9-12c17785851f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.093666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6c36-4390-4947-90c9-12c17785851f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.097434 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1006/1984] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:46:10.122015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6c36-4390-4947-90c9-12c17785851f None None] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:46:10.140813 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 979/1985] 10.222.0.59 () {58 vars in 1015 bytes} [Sat May 7 21:46:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:10.171660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6c36-4390-4947-90c9-12c17785851f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:10.199043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6c36-4390-4947-90c9-12c17785851f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.214696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1728a0-7bd9-4960-b4da-630707fc2988 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.215740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1728a0-7bd9-4960-b4da-630707fc2988 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.216302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1728a0-7bd9-4960-b4da-630707fc2988 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.217399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1728a0-7bd9-4960-b4da-630707fc2988 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.219822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1728a0-7bd9-4960-b4da-630707fc2988 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:get_project(project_id=2d38ca0e7b5444e28aec5bbc4b370ecd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.224556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1728a0-7bd9-4960-b4da-630707fc2988 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.232005 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1007/1986] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:46:10 2022] GET /identity/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd => generated 369 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:10.395734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d667-6688-4796-9f4e-52f11a64063a None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.396021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d667-6688-4796-9f4e-52f11a64063a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.396500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d667-6688-4796-9f4e-52f11a64063a None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.397917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 980/1987] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:10.419821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.420123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.420402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.439298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c628-08b8-4bd3-b68f-0f0e82dc3128 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.439589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c628-08b8-4bd3-b68f-0f0e82dc3128 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.439841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c628-08b8-4bd3-b68f-0f0e82dc3128 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.441626 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 981/1988] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:10.451106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c628-08b8-4bd3-b68f-0f0e82dc3128 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:46:10.496082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:10.501248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:10.505127 ncdv-master-1 devstack@keystone.service[91075]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-f090c628-08b8-4bd3-b68f-0f0e82dc3128 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 07 21:46:10.505611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c628-08b8-4bd3-b68f-0f0e82dc3128 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:10.548209 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1008/1989] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:46:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:10.548601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c628-08b8-4bd3-b68f-0f0e82dc3128 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.553224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:10.560003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:10.564627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.565869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.566998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.568593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.574359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:get_project(project_id=2d38ca0e7b5444e28aec5bbc4b370ecd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.578298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.589738 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 982/1990] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:46:10 2022] GET /identity/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd => generated 369 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:10.598718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbe1b3-e5a9-4b63-bb3e-4b7411b2a4ea None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.611546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.613090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.613522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.613968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.635197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.637016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.662133 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1009/1991] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:10.704842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:10.713193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:10.720466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713aacb6-bcbf-4017-9166-65e1f8f7d51d tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.729929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995eacf-ca8c-4c34-ac3a-39785e1bf697 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.744489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.745027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.745801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.746011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.746307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.746752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.746876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.746966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.747758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:10.748295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.750398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.771122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.774406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.795022 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 983/1992] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:10.799138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:10.805592 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1010/1993] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:10.831792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea712c-81fd-4151-92a5-ef60b08f4752 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.852665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76bc10-c346-4250-9fbd-40374a7e9a1a tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.855451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76bc10-c346-4250-9fbd-40374a7e9a1a tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.856528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76bc10-c346-4250-9fbd-40374a7e9a1a tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.856829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76bc10-c346-4250-9fbd-40374a7e9a1a tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.857589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76bc10-c346-4250-9fbd-40374a7e9a1a tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.861540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76bc10-c346-4250-9fbd-40374a7e9a1a tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.913683 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 984/1994] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:10 2022] POST /identity/v3/users => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:10.916342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:10.935455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c75f29-6af4-44d4-8859-33fbb35974f8 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:10.952741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:10.955613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:10.959085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:10.959590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:10.961319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:10.963998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:10.969715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:10.990827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1011/1995] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:11.271774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38885-b3a3-4eec-85da-aa367b6e5f96 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:11.272061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38885-b3a3-4eec-85da-aa367b6e5f96 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:11.272343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38885-b3a3-4eec-85da-aa367b6e5f96 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:11.273722 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 985/1996] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:11.279350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:46:11.336430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:11.355397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d8ca9-5811-42d1-bd16-9b3dfa0dd4af tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:11.373026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:11.377645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:11.377645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:11.377645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:11.377645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:get_project(project_id=2d38ca0e7b5444e28aec5bbc4b370ecd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:11.380953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:11.383536 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1012/1997] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:46:11 2022] GET /identity/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd => generated 369 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:11.665876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8675e-e32a-40fa-8a7c-d4aedad4d655 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:11.666410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8675e-e32a-40fa-8a7c-d4aedad4d655 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:11.666410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8675e-e32a-40fa-8a7c-d4aedad4d655 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:11.668311 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 986/1998] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:11.681711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:46:11.697400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:11.709942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f6567-18f7-42de-91b9-f6f4184c48bc tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:11.715887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:11.717036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:11.717556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:11.718039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:11.722209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:get_project(project_id=2d38ca0e7b5444e28aec5bbc4b370ecd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:11.724904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:11.726799 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1013/1999] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:46:11 2022] GET /identity/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:11.771668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8675e-e32a-40fa-8a7c-d4aedad4d655 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:11.786891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8675e-e32a-40fa-8a7c-d4aedad4d655 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:11.794857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:11.795908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:11.796201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:11.796471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/users/2f2ed2a9ee54442bbdeeebb35d99ec9f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:11.834796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2f2ed2a9ee54442bbdeeebb35d99ec9f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:11.836954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:11.923169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f2ed2a9ee54442bbdeeebb35d99ec9f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:11.935622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f2ed2a9ee54442bbdeeebb35d99ec9f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:11.936615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f2ed2a9ee54442bbdeeebb35d99ec9f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:11.940091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f2ed2a9ee54442bbdeeebb35d99ec9f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:11.954802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f2ed2a9ee54442bbdeeebb35d99ec9f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:11.988351 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 987/2000] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:11 2022] DELETE /identity/v3/users/2f2ed2a9ee54442bbdeeebb35d99ec9f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:11.990138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:11.993503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:12.022938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23653c-373a-4cd3-9d28-d76885c497ea tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:12.150700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89655f7cdd704d718e495e9f0e7c41ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90fd48b668454dfab0d7207527c42fb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:12.151688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:12.152003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:12.152278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] PATH_INFO: `/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:12.153479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d38ca0e7b5444e28aec5bbc4b370ecd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:12.155539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:12.232695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d38ca0e7b5444e28aec5bbc4b370ecd', 'request_id': 'req-7d43bcb4-f2a1-4769-9b37-171fb93662b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.244244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d38ca0e7b5444e28aec5bbc4b370ecd', 'request_id': 'req-7d43bcb4-f2a1-4769-9b37-171fb93662b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.265508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d38ca0e7b5444e28aec5bbc4b370ecd', 'request_id': 'req-7d43bcb4-f2a1-4769-9b37-171fb93662b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.300949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] The token cache is being invalidate because project 2d38ca0e7b5444e28aec5bbc4b370ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:12.301679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.305166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d43bcb4-f2a1-4769-9b37-171fb93662b7 tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.313585 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1014/2001] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:11 2022] DELETE /identity/v3/projects/2d38ca0e7b5444e28aec5bbc4b370ecd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:12.316300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:12.318751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:12.437894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ae3af-3869-4ff4-bf65-7887da6c45ff tempest-QuotasAdminTestV236-815774469 tempest-QuotasAdminTestV236-815774469-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:12.540046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:12.541184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:12.541304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:12.541505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] PATH_INFO: `/v3/users/e4bae09fb6ed4da0b84c81b452128a78` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:12.543601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bae09fb6ed4da0b84c81b452128a78)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:12.551661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:12.611757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bae09fb6ed4da0b84c81b452128a78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.622996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bae09fb6ed4da0b84c81b452128a78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.623791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bae09fb6ed4da0b84c81b452128a78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.624636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bae09fb6ed4da0b84c81b452128a78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.638761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bae09fb6ed4da0b84c81b452128a78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:12.670755 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 988/2002] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:12 2022] DELETE /identity/v3/users/e4bae09fb6ed4da0b84c81b452128a78 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:12.671387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:12.671387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:12.671387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:12.710217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:12.711705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:12.843143 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1015/2003] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:12.892938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:12.899126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:13.010864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc5695-3eea-4bfc-b00e-f61cd4a1cce9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:13.016170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:13.017243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:13.017626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:13.020066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:13.032565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:13.036953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:13.052614 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 989/2004] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:13.567354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:13.569842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:13.588331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0245b-e2e4-459d-b0d4-47360d9e2ce7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:13.597307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:13.598417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:13.598899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:13.599323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] PATH_INFO: `/v3/projects/a75ae77f081d4c0dba4761e3f5bac5e9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:13.600886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75ae77f081d4c0dba4761e3f5bac5e9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:13.603062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:13.698073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75ae77f081d4c0dba4761e3f5bac5e9', 'request_id': 'req-74d06301-1850-4b17-999d-80244078c825'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:13.717731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75ae77f081d4c0dba4761e3f5bac5e9', 'request_id': 'req-74d06301-1850-4b17-999d-80244078c825'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:13.744713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75ae77f081d4c0dba4761e3f5bac5e9', 'request_id': 'req-74d06301-1850-4b17-999d-80244078c825'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:13.765444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] The token cache is being invalidate because project a75ae77f081d4c0dba4761e3f5bac5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:13.768634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:13.775250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74d06301-1850-4b17-999d-80244078c825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:13.778167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1016/2005] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:13 2022] DELETE /identity/v3/projects/a75ae77f081d4c0dba4761e3f5bac5e9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:13.782051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:13.794605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c9932-97ca-4207-8377-a6f9a49c1bb4 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:13.944196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:13.945202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:13.945842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:13.945842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] PATH_INFO: `/v3/users/89655f7cdd704d718e495e9f0e7c41ed` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:13.947041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89655f7cdd704d718e495e9f0e7c41ed)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:13.949579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:14.017289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89655f7cdd704d718e495e9f0e7c41ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:14.060984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89655f7cdd704d718e495e9f0e7c41ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:14.061943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89655f7cdd704d718e495e9f0e7c41ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:14.062713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89655f7cdd704d718e495e9f0e7c41ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:14.080283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89655f7cdd704d718e495e9f0e7c41ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:14.119712 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 990/2006] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:13 2022] DELETE /identity/v3/users/89655f7cdd704d718e495e9f0e7c41ed => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:14.377421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099c7e-1bc7-417a-9805-f1a40beb6ad6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:14.377762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099c7e-1bc7-417a-9805-f1a40beb6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:14.378070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099c7e-1bc7-417a-9805-f1a40beb6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:14.440103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f6099c7e-1bc7-417a-9805-f1a40beb6ad6 None None] MFA Rules not processed for user `bc43b06076df4cfaae8e4a5a4328b60c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:14.441790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f6099c7e-1bc7-417a-9805-f1a40beb6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:14.584217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1017/2007] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:14.595183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:14.597512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:14.796086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a255371-593e-4e5f-a2b4-2499df633020 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:14.807554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:14.830904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:14.831230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:14.831473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:14.838145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:14.965925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:14.968385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:14.986231 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 991/2008] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:15.191992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099c7e-1bc7-417a-9805-f1a40beb6ad6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:15.218485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099c7e-1bc7-417a-9805-f1a40beb6ad6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:15.234168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0a53-bed8-460d-9221-1d7fe8d57c91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:15.235306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0a53-bed8-460d-9221-1d7fe8d57c91 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:15.235620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0a53-bed8-460d-9221-1d7fe8d57c91 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:15.236187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0a53-bed8-460d-9221-1d7fe8d57c91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:15.243289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:15.245380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:15.261615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0a53-bed8-460d-9221-1d7fe8d57c91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:15.263810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0a53-bed8-460d-9221-1d7fe8d57c91 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:15.275542 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1018/2009] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:15.456042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26c496-71fa-4cfb-b660-225b0c19ed12 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:15.467458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:15.468318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:15.468599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:15.468875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] PATH_INFO: `/v3/projects/90fd48b668454dfab0d7207527c42fb9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:15.480776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fd48b668454dfab0d7207527c42fb9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:15.482750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:15.569886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fd48b668454dfab0d7207527c42fb9', 'request_id': 'req-407b2775-c1e5-40c7-b096-ddde95dcfb29'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:15.580217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fd48b668454dfab0d7207527c42fb9', 'request_id': 'req-407b2775-c1e5-40c7-b096-ddde95dcfb29'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:15.601587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fd48b668454dfab0d7207527c42fb9', 'request_id': 'req-407b2775-c1e5-40c7-b096-ddde95dcfb29'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:15.620921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] The token cache is being invalidate because project 90fd48b668454dfab0d7207527c42fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:15.621213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:15.623507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-407b2775-c1e5-40c7-b096-ddde95dcfb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:15.627528 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 992/2010] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:15 2022] DELETE /identity/v3/projects/90fd48b668454dfab0d7207527c42fb9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:15.633241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcde9bf-9e75-4983-b54c-765f94390e28 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:15.633755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcde9bf-9e75-4983-b54c-765f94390e28 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:15.633755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcde9bf-9e75-4983-b54c-765f94390e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:15.692482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-adcde9bf-9e75-4983-b54c-765f94390e28 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:15.693701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-adcde9bf-9e75-4983-b54c-765f94390e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:15.827932 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1019/2011] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:15.836427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592eb8-94aa-42ae-8ffa-332ec86e5339 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:15.836991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592eb8-94aa-42ae-8ffa-332ec86e5339 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:15.837101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592eb8-94aa-42ae-8ffa-332ec86e5339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:15.877416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-32592eb8-94aa-42ae-8ffa-332ec86e5339 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:15.878797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-32592eb8-94aa-42ae-8ffa-332ec86e5339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:15.902415 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 993/2012] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:15.907232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcde9bf-9e75-4983-b54c-765f94390e28 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:15.921141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcde9bf-9e75-4983-b54c-765f94390e28 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:15.935314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:15.936002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:15.936280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:15.936553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:15.937285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:15.937591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:15.939253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:15.969017 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1020/2013] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:15.971200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592eb8-94aa-42ae-8ffa-332ec86e5339 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:16.012541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592eb8-94aa-42ae-8ffa-332ec86e5339 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:16.030723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:16.031649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.032850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.034760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.035871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:16.042293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:16.105824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:16.108679 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 994/2014] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:15 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:16.127936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6264c-c72d-4736-9459-74690e5d6101 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:16.279451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:16.280435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.281155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.282333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.283616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:16.291232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:16.340681 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1021/2015] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:16 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:16.345093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:16.356811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8d4b-4b68-4d29-a192-76b1ee5d44a1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:16.367717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00155c5-bdfa-489c-aaf7-736ec9ec53b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:16.368645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00155c5-bdfa-489c-aaf7-736ec9ec53b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.368940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00155c5-bdfa-489c-aaf7-736ec9ec53b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.369215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00155c5-bdfa-489c-aaf7-736ec9ec53b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.370309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00155c5-bdfa-489c-aaf7-736ec9ec53b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:16.372200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00155c5-bdfa-489c-aaf7-736ec9ec53b7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:16.413033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:16.418981 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 995/2016] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:16.435952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c496f-33c2-4003-8b90-d21836d9f253 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:16.457926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334af42-99da-4c01-bfb7-58028247eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:16.460396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334af42-99da-4c01-bfb7-58028247eec4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.462675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334af42-99da-4c01-bfb7-58028247eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.463428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334af42-99da-4c01-bfb7-58028247eec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.466194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334af42-99da-4c01-bfb7-58028247eec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:16.472503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334af42-99da-4c01-bfb7-58028247eec4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:16.497525 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1022/2017] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:16.503599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be633-da89-4de0-856f-8ea2fe573536 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.504116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be633-da89-4de0-856f-8ea2fe573536 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.504594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427be633-da89-4de0-856f-8ea2fe573536 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.507282 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 996/2018] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:46:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:16.508802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be633-da89-4de0-856f-8ea2fe573536 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:16.520445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84924735-13f4-4126-a7c9-cbfb25120fda None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.521713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84924735-13f4-4126-a7c9-cbfb25120fda None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.523426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84924735-13f4-4126-a7c9-cbfb25120fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.555839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427be633-da89-4de0-856f-8ea2fe573536 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:16.588940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbdefd3-d33a-4f2a-afbf-87baf4175af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:16.590297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdefd3-d33a-4f2a-afbf-87baf4175af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.592361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdefd3-d33a-4f2a-afbf-87baf4175af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.592889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbdefd3-d33a-4f2a-afbf-87baf4175af4 admin admin] PATH_INFO: `/v3/projects/01806714f13f49deb998d167e5951ba0/users/f5464d51209c4699a3b068fa5cf9aef5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.634417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdefd3-d33a-4f2a-afbf-87baf4175af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01806714f13f49deb998d167e5951ba0, user_id=f5464d51209c4699a3b068fa5cf9aef5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:16.637975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbdefd3-d33a-4f2a-afbf-87baf4175af4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:16.667553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 997/2019] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:16 2022] PUT /identity/v3/projects/01806714f13f49deb998d167e5951ba0/users/f5464d51209c4699a3b068fa5cf9aef5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:16.668873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-84924735-13f4-4126-a7c9-cbfb25120fda None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:16.679845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a29f3-e0b3-4269-81cb-f19e27e39730 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:16.680368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a29f3-e0b3-4269-81cb-f19e27e39730 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:16.680773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a29f3-e0b3-4269-81cb-f19e27e39730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:16.681188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-84924735-13f4-4126-a7c9-cbfb25120fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:16.755401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8f7a29f3-e0b3-4269-81cb-f19e27e39730 None None] MFA Rules not processed for user `f5464d51209c4699a3b068fa5cf9aef5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:16.765020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8f7a29f3-e0b3-4269-81cb-f19e27e39730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:16.827239 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1023/2020] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:46:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:16.992745 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 998/2021] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:16.996971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84924735-13f4-4126-a7c9-cbfb25120fda None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:17.119959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84924735-13f4-4126-a7c9-cbfb25120fda None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:17.126014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:17.135025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.135586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.136188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.137137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:17.142765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:17.182687 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1024/2022] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:16 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:17.186322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a29f3-e0b3-4269-81cb-f19e27e39730 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:17.197400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a29f3-e0b3-4269-81cb-f19e27e39730 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:17.280245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:17.282361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:17.356588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:17.359136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.360063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.360974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.363583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:17.365844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:17.408393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 999/2023] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:17 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:17.415572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:17.435287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e1a0e-8eb4-4ca5-9c54-f02d7beaeb00 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:17.443158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:17.446200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.446794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.447383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.449257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:17.451171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:17.458190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000295-5dea-4012-9937-865051d7c76c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:17.473247 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1000/2024] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:17.474427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:17.476314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:17.476987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.477277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.477554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.491848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:17.493616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:17.500622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a12fe-da97-4440-bcea-21bcb7d1b254 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:17.515367 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1025/2025] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:17.517571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:17.519191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.520096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.520505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] PATH_INFO: `/v3/projects/aceb15a9f06a4406b4a219552563d39a/users/864a462c2f1b4324a6318aed4cfdcd38/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.554513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] RBAC: Authorizing `identity:create_grant(project_id=aceb15a9f06a4406b4a219552563d39a, user_id=864a462c2f1b4324a6318aed4cfdcd38, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:17.557394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:17.599424 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1001/2026] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:17 2022] PUT /identity/v3/projects/aceb15a9f06a4406b4a219552563d39a/users/864a462c2f1b4324a6318aed4cfdcd38/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:17.603838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:17.618570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfce08-8acb-434a-b352-52efc24be347 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:17.719573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ccd2-4102-4480-8898-6a3c52e6f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:17.720446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ccd2-4102-4480-8898-6a3c52e6f407 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.720668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ccd2-4102-4480-8898-6a3c52e6f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.720949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ccd2-4102-4480-8898-6a3c52e6f407 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.722520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ccd2-4102-4480-8898-6a3c52e6f407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:17.724533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ccd2-4102-4480-8898-6a3c52e6f407 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:17.741637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:17.743015 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1026/2027] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:17.756294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31e1a-19af-43a9-bc6b-cf21170abead admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:17.765566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:17.766572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.767010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.767363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] PATH_INFO: `/v3/projects/aceb15a9f06a4406b4a219552563d39a/users/864a462c2f1b4324a6318aed4cfdcd38/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.770035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aceb15a9f06a4406b4a219552563d39a, user_id=864a462c2f1b4324a6318aed4cfdcd38, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:17.772901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:17.807433 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1002/2028] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:17 2022] PUT /identity/v3/projects/aceb15a9f06a4406b4a219552563d39a/users/864a462c2f1b4324a6318aed4cfdcd38/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:17.809837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cc3f-e64c-4d20-be93-63119b1529b1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:17.810141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cc3f-e64c-4d20-be93-63119b1529b1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:17.810418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078cc3f-e64c-4d20-be93-63119b1529b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:17.861583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1078cc3f-e64c-4d20-be93-63119b1529b1 None None] MFA Rules not processed for user `864a462c2f1b4324a6318aed4cfdcd38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:17.868606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1078cc3f-e64c-4d20-be93-63119b1529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:18.020996 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1027/2029] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:18.033352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:18.122373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969c85-2a7d-427f-a31f-f1145db2076e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:18.130206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0fe90-cb2a-4af6-9da5-84f0b3ab1ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:18.130899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fe90-cb2a-4af6-9da5-84f0b3ab1ad2 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:18.131187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fe90-cb2a-4af6-9da5-84f0b3ab1ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:18.131453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0fe90-cb2a-4af6-9da5-84f0b3ab1ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:18.140741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0fe90-cb2a-4af6-9da5-84f0b3ab1ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:18.142813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0fe90-cb2a-4af6-9da5-84f0b3ab1ad2 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:18.163319 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1003/2030] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:18.345303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078cc3f-e64c-4d20-be93-63119b1529b1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:18.426307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078cc3f-e64c-4d20-be93-63119b1529b1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:18.436743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:18.437644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:18.437923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:18.438196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] PATH_INFO: `/v3/users/f5464d51209c4699a3b068fa5cf9aef5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:18.439541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5464d51209c4699a3b068fa5cf9aef5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:18.442213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:18.504235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5464d51209c4699a3b068fa5cf9aef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:18.505520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5464d51209c4699a3b068fa5cf9aef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:18.513243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5464d51209c4699a3b068fa5cf9aef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:18.514085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5464d51209c4699a3b068fa5cf9aef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:18.523998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5464d51209c4699a3b068fa5cf9aef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:18.549189 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1028/2031] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:18 2022] DELETE /identity/v3/users/f5464d51209c4699a3b068fa5cf9aef5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:18.551476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:18.551787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:18.552066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:18.575452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:18.576686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:18.658654 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1004/2032] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:18.693929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:18.695470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:18.766414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81efbc-2afc-42ab-b263-9e3c1686291d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:18.774433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:18.777371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:18.777676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:18.777963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:18.801373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:18.802892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:18.825356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1029/2033] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:19.675998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:19.678352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:19.694999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff8ec6-66b3-4d7b-9edf-69f3e929fde5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:19.701278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:19.702517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:19.703067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:19.703505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] PATH_INFO: `/v3/projects/01806714f13f49deb998d167e5951ba0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:19.705318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01806714f13f49deb998d167e5951ba0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:19.708179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:19.803521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01806714f13f49deb998d167e5951ba0', 'request_id': 'req-a3780712-6a71-43ad-984a-e6583fe06624'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.810803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01806714f13f49deb998d167e5951ba0', 'request_id': 'req-a3780712-6a71-43ad-984a-e6583fe06624'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.823299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01806714f13f49deb998d167e5951ba0', 'request_id': 'req-a3780712-6a71-43ad-984a-e6583fe06624'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.835847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] The token cache is being invalidate because project 01806714f13f49deb998d167e5951ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:19.836052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.837494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3780712-6a71-43ad-984a-e6583fe06624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.842508 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1005/2034] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:19 2022] DELETE /identity/v3/projects/01806714f13f49deb998d167e5951ba0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:19.843807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:19.858187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4a15f-2a28-4e12-a349-9e169b13c648 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:19.915671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:19.916637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:19.917114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:19.917457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] PATH_INFO: `/v3/users/864a462c2f1b4324a6318aed4cfdcd38` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:19.918722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864a462c2f1b4324a6318aed4cfdcd38)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:19.920683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:19.967296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864a462c2f1b4324a6318aed4cfdcd38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.967953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864a462c2f1b4324a6318aed4cfdcd38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.975695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864a462c2f1b4324a6318aed4cfdcd38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.976355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864a462c2f1b4324a6318aed4cfdcd38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:19.986509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fef4aca8-b821-49c4-bbe9-d78040a3d516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864a462c2f1b4324a6318aed4cfdcd38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:20.005372 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1030/2035] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:19 2022] DELETE /identity/v3/users/864a462c2f1b4324a6318aed4cfdcd38 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:20.012936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:20.013297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:20.013497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:20.035918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] MFA Rules not processed for user `85eeaeaf9f1c464f8d45eff93bab41cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:20.036208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:20.111037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1006/2036] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:20.932475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:20.932987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:20.933091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:20.940147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:20.942669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:20.960509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:20.964635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:21.042371 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1031/2037] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:21.066119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.068225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:21.074759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaa375-dfea-43d8-ab54-1261d8d0d31f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.083037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.088280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.088686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.089038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] PATH_INFO: `/v3/projects/aceb15a9f06a4406b4a219552563d39a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.090749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aceb15a9f06a4406b4a219552563d39a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.092820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.103666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4232e-f421-42f9-bdca-f6c712841067 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.110965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a730b9-d5a1-4642-bddb-20a58e40e176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.112919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a730b9-d5a1-4642-bddb-20a58e40e176 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.113666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a730b9-d5a1-4642-bddb-20a58e40e176 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.114375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a730b9-d5a1-4642-bddb-20a58e40e176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.125837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a730b9-d5a1-4642-bddb-20a58e40e176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.128142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a730b9-d5a1-4642-bddb-20a58e40e176 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.138437 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1032/2038] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:21.158577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aceb15a9f06a4406b4a219552563d39a', 'request_id': 'req-33c48a5a-6642-41fc-8ffa-520c177150e6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:21.166843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aceb15a9f06a4406b4a219552563d39a', 'request_id': 'req-33c48a5a-6642-41fc-8ffa-520c177150e6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:21.176104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aceb15a9f06a4406b4a219552563d39a', 'request_id': 'req-33c48a5a-6642-41fc-8ffa-520c177150e6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:21.189331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] The token cache is being invalidate because project aceb15a9f06a4406b4a219552563d39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:21.189724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:21.190668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-33c48a5a-6642-41fc-8ffa-520c177150e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:21.192402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1007/2039] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:20 2022] DELETE /identity/v3/projects/aceb15a9f06a4406b4a219552563d39a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:21.204435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd5ddd-3803-4dd9-a424-a29efd9fd06f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.209660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd5ddd-3803-4dd9-a424-a29efd9fd06f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.210150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd5ddd-3803-4dd9-a424-a29efd9fd06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.234452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d4dd5ddd-3803-4dd9-a424-a29efd9fd06f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:21.236129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d4dd5ddd-3803-4dd9-a424-a29efd9fd06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:21.316815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1033/2040] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:21.327051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1b79e-edd9-4788-a803-883b11fab5ca None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.327559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1b79e-edd9-4788-a803-883b11fab5ca None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.327834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1b79e-edd9-4788-a803-883b11fab5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.347156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-34f1b79e-edd9-4788-a803-883b11fab5ca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:21.353805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-34f1b79e-edd9-4788-a803-883b11fab5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:21.361873 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1008/2041] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:21.365999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd5ddd-3803-4dd9-a424-a29efd9fd06f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.376119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd5ddd-3803-4dd9-a424-a29efd9fd06f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.385769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.386609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.387032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.387518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.388578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:21.388914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.391235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.419935 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1034/2042] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:21.421196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1b79e-edd9-4788-a803-883b11fab5ca None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.431603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1b79e-edd9-4788-a803-883b11fab5ca None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.437278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.438593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.439221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.439706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.440598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.442824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.497164 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1009/2043] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:21 2022] POST /identity/v3/projects => generated 395 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:21.498689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.520648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa5d58-5011-412a-8d65-8a9e2bb54869 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.607932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.608578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.608863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.609134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.609987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.612714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.649791 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1035/2044] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:21 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:21.651784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.680346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319ce72-0cc1-4a9e-b35b-ed9173c90281 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.687521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.689066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.689703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.690109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.691568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.694054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.714134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1010/2045] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:21.718607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.735173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46124d25-7897-48e3-ac77-8be4aefa1271 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.744194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86863b-04dd-421a-bedb-bbcf131dbeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.745889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86863b-04dd-421a-bedb-bbcf131dbeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.746371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86863b-04dd-421a-bedb-bbcf131dbeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.746897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86863b-04dd-421a-bedb-bbcf131dbeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.747981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86863b-04dd-421a-bedb-bbcf131dbeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.750003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86863b-04dd-421a-bedb-bbcf131dbeb6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.761974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1036/2046] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:21.766024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.781187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f965c-5f7f-4bf2-aa79-3a19927e8dd0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:21.787536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:21.789535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.789896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.790243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] PATH_INFO: `/v3/projects/ada8a5cee4dd4a8fb2b722d3aded1b0c/users/3ef5431cd2d34b1a846598c1ae459342/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.812219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada8a5cee4dd4a8fb2b722d3aded1b0c, user_id=3ef5431cd2d34b1a846598c1ae459342, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:21.815672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:21.843978 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1011/2047] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:21 2022] PUT /identity/v3/projects/ada8a5cee4dd4a8fb2b722d3aded1b0c/users/3ef5431cd2d34b1a846598c1ae459342/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:21.845661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d8c8-d9c5-4639-a4b5-9670a8e2b9e5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:21.846070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d8c8-d9c5-4639-a4b5-9670a8e2b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:21.846801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6d8c8-d9c5-4639-a4b5-9670a8e2b9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:21.895459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:21.897392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:21.920520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-22f6d8c8-d9c5-4639-a4b5-9670a8e2b9e5 None None] MFA Rules not processed for user `3ef5431cd2d34b1a846598c1ae459342`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:21.922100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-22f6d8c8-d9c5-4639-a4b5-9670a8e2b9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:21.995988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55731-8f93-4697-9726-3f44d67d72a1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.002259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.003496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.004113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.004591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] PATH_INFO: `/v3/users/5abf38af9d8b41dc9871b612a06dfb05` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.006051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abf38af9d8b41dc9871b612a06dfb05)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.008792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.104297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abf38af9d8b41dc9871b612a06dfb05'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:22.108007 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1037/2048] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:22.114501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d8c8-d9c5-4639-a4b5-9670a8e2b9e5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.122324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abf38af9d8b41dc9871b612a06dfb05'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:22.123424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abf38af9d8b41dc9871b612a06dfb05'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:22.124272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abf38af9d8b41dc9871b612a06dfb05'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:22.130114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6d8c8-d9c5-4639-a4b5-9670a8e2b9e5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.136581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.137379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.137773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.138155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.138990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.141261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.148461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b6185393-b07c-41b0-9635-6c2b2ecf3f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abf38af9d8b41dc9871b612a06dfb05'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:22.178373 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1012/2049] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:21 2022] DELETE /identity/v3/users/5abf38af9d8b41dc9871b612a06dfb05 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:22.189701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.190942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.191403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.211354 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1038/2050] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:22 2022] POST /identity/v3/projects => generated 395 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:22.215001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.219795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:22.256406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:22.257964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:22.353009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f88e1e-3676-46f7-9d6a-f946d72e33b4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.362613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.364084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.364378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.364653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.365352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.367956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.385659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1013/2051] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:22.401548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.403264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:22.415648 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1039/2052] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:22 2022] POST /identity/v3/users => generated 304 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:22.419651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.436580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c46b5-bda5-4c8b-a4e2-3a28512ea40a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.442882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.443746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.444097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.444730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.445662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.447899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.466160 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1040/2053] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:22.472788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.495611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b542-5338-4f5d-b85e-8722af93d9d4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.502614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.503258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc313e6b-9583-43b3-89c6-3052d61d1a03 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.503831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.504131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.504408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] PATH_INFO: `/v3/projects/cfeddb43c5ce431abfdfe46caa60a5e4/users/bb762dc3b827409c9fb5b44fcc6ce519/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.520881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.521558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.521841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.522113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.527911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeddb43c5ce431abfdfe46caa60a5e4, user_id=bb762dc3b827409c9fb5b44fcc6ce519, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.533162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.543282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.545122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.561037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1014/2054] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:22.564405 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1041/2055] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:22 2022] PUT /identity/v3/projects/cfeddb43c5ce431abfdfe46caa60a5e4/users/bb762dc3b827409c9fb5b44fcc6ce519/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:22.568412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.580359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a62df0-820a-44cd-90d2-e95fb2ed629b service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.674385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350ffad-a607-4f5d-aef3-57d8e5ca39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.677299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ffad-a607-4f5d-aef3-57d8e5ca39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.677694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ffad-a607-4f5d-aef3-57d8e5ca39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.677866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ffad-a607-4f5d-aef3-57d8e5ca39b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.678679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350ffad-a607-4f5d-aef3-57d8e5ca39b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.683813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350ffad-a607-4f5d-aef3-57d8e5ca39b5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.740797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.754363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1015/2056] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:22.757113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58278c2-1730-45e2-8fc3-14d9fb716cb2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:22.775944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:22.776913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.777206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.777519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] PATH_INFO: `/v3/projects/cfeddb43c5ce431abfdfe46caa60a5e4/users/bb762dc3b827409c9fb5b44fcc6ce519/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.781511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeddb43c5ce431abfdfe46caa60a5e4, user_id=bb762dc3b827409c9fb5b44fcc6ce519, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:22.785002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:22.827979 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1042/2057] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:22 2022] PUT /identity/v3/projects/cfeddb43c5ce431abfdfe46caa60a5e4/users/bb762dc3b827409c9fb5b44fcc6ce519/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:22.840105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:22.840397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:22.840677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:22.903699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] MFA Rules not processed for user `bb762dc3b827409c9fb5b44fcc6ce519`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:22.905934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:22.996851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:22.998742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:23.005608 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1016/2058] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:23.135889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe61a7b-c34f-4e5d-96b9-5e695bfbfc75 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:23.155297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:23.156124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:23.156405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:23.156680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] PATH_INFO: `/v3/projects/2224daefc94f40bb919f8052e55a8fe9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:23.162679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2224daefc94f40bb919f8052e55a8fe9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:23.164689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:23.246930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2224daefc94f40bb919f8052e55a8fe9', 'request_id': 'req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.257059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2224daefc94f40bb919f8052e55a8fe9', 'request_id': 'req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.271277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2224daefc94f40bb919f8052e55a8fe9', 'request_id': 'req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.285311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:23.287334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:23.292555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] The token cache is being invalidate because project 2224daefc94f40bb919f8052e55a8fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:23.292555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.293390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.295452 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1043/2059] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:22 2022] DELETE /identity/v3/projects/2224daefc94f40bb919f8052e55a8fe9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:23.299722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:23.301578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:23.387321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d21f2-f3a0-46e6-9f12-bc620d13a3a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:23.395598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:23.396843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:23.398706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:23.399127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] PATH_INFO: `/v3/users/dd7910f30f6d41eeabc3f17ef1b6cdde` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:23.399827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e665a-e85c-4181-8a9c-13cbfc1eb4b9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:23.402223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7910f30f6d41eeabc3f17ef1b6cdde)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:23.405882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:23.484575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7910f30f6d41eeabc3f17ef1b6cdde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.485291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7910f30f6d41eeabc3f17ef1b6cdde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.494797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7910f30f6d41eeabc3f17ef1b6cdde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.495625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7910f30f6d41eeabc3f17ef1b6cdde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.507174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7910f30f6d41eeabc3f17ef1b6cdde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:23.546548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1044/2060] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:23 2022] DELETE /identity/v3/users/dd7910f30f6d41eeabc3f17ef1b6cdde => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:23.556882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:23.557529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:23.557812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:23.558085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:23.562361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:23.685078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:23.687396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:23.712165 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1017/2061] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:23.991264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:23.991264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.122220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ad2b3-fbc0-45c2-857f-f8bff2b82ab0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:24.124223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.125712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.132192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:24.133153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.133506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.133847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] PATH_INFO: `/v3/projects/50678f73696e47c2869fc66ab77513b2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.137019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50678f73696e47c2869fc66ab77513b2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:24.139314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:24.152554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b503902-6781-4951-85ba-9f69f1a19356 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:24.254632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50678f73696e47c2869fc66ab77513b2', 'request_id': 'req-42c68293-28bc-49c5-9158-dcd933d44148'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.267331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50678f73696e47c2869fc66ab77513b2', 'request_id': 'req-42c68293-28bc-49c5-9158-dcd933d44148'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.279641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50678f73696e47c2869fc66ab77513b2', 'request_id': 'req-42c68293-28bc-49c5-9158-dcd933d44148'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.287209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:24.288026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.288377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.288759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.290805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.296830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] The token cache is being invalidate because project 50678f73696e47c2869fc66ab77513b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:24.298194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.299451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42c68293-28bc-49c5-9158-dcd933d44148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.305343 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1045/2062] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:23 2022] DELETE /identity/v3/projects/50678f73696e47c2869fc66ab77513b2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:24.309183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668f98-86cb-4315-8c5d-dda3f0284f89 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.309316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668f98-86cb-4315-8c5d-dda3f0284f89 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.309570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668f98-86cb-4315-8c5d-dda3f0284f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.332333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-21668f98-86cb-4315-8c5d-dda3f0284f89 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:24.333643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21668f98-86cb-4315-8c5d-dda3f0284f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.441867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:24.455285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:24.461873 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1046/2063] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:24.470572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cf280-43e5-4fbb-89b1-74cab8e8e5af None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.470890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cf280-43e5-4fbb-89b1-74cab8e8e5af None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.471707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cf280-43e5-4fbb-89b1-74cab8e8e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.490748 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1018/2064] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:24.525811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.526276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e2cf280-43e5-4fbb-89b1-74cab8e8e5af None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:24.527749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e2cf280-43e5-4fbb-89b1-74cab8e8e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.530601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.556377 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1047/2065] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:24.557055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b22a-2539-4f64-aff3-15d56070a47f service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:24.561187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cf280-43e5-4fbb-89b1-74cab8e8e5af None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.563785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:24.566377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.566377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.566377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] PATH_INFO: `/v3/users/3ef5431cd2d34b1a846598c1ae459342` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.567705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef5431cd2d34b1a846598c1ae459342)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:24.571103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:24.605563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cf280-43e5-4fbb-89b1-74cab8e8e5af None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:24.619713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:24.620868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.621245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.621627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.622475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:24.627141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:24.629611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:24.649397 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1048/2066] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:24.658681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.662923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef5431cd2d34b1a846598c1ae459342'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.675262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef5431cd2d34b1a846598c1ae459342'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.676003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef5431cd2d34b1a846598c1ae459342'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.676624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef5431cd2d34b1a846598c1ae459342'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.682458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea064-b92d-4b78-b49b-efa88ed4d929 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:24.688361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82936d9c-8031-4577-bcd1-e39c474645cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef5431cd2d34b1a846598c1ae459342'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:24.690897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:24.692418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.692648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.692923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.693624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:24.695828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:24.717789 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1019/2067] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:24 2022] DELETE /identity/v3/users/3ef5431cd2d34b1a846598c1ae459342 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:24.732654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849c15-7468-4d40-bc80-57ef7ab68cab None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.733048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849c15-7468-4d40-bc80-57ef7ab68cab None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.733335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3849c15-7468-4d40-bc80-57ef7ab68cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.744653 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1049/2068] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:24 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:24.749185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.757161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.788804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a3849c15-7468-4d40-bc80-57ef7ab68cab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:24.791048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a3849c15-7468-4d40-bc80-57ef7ab68cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.865705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cc7a3-d88a-44ff-a778-fa61b6a6341b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:24.874147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:24.875310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.875601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.875879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.876584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:24.878941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:24.917463 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1050/2069] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:24 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:24.918689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.944494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d123650-7362-483f-8956-b775010cbdad admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:24.952116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:24.952794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:24.953071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:24.953475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:24.955102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:24.958600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:24.980118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1020/2070] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:24.983302 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1051/2071] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:24.986990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849c15-7468-4d40-bc80-57ef7ab68cab None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.991240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:24.995864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:24.999678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3849c15-7468-4d40-bc80-57ef7ab68cab None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.005541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.006382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.006675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.006997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.007890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.009702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:25.023405 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1021/2072] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:25.031215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:25.051994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d632a8b-90f6-40e8-b30b-47dc97919f96 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.061348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ede52-5b51-40ef-967e-9940173f0f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.062380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ede52-5b51-40ef-967e-9940173f0f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.062670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ede52-5b51-40ef-967e-9940173f0f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.063485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ede52-5b51-40ef-967e-9940173f0f99 admin admin] PATH_INFO: `/v3/projects/3a25839617304e069e93d96029612c18/users/e9d562828c3241d0a5d0f2253205c12f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.104818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ede52-5b51-40ef-967e-9940173f0f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a25839617304e069e93d96029612c18, user_id=e9d562828c3241d0a5d0f2253205c12f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.110222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ede52-5b51-40ef-967e-9940173f0f99 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:25.142559 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1022/2073] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:25 2022] PUT /identity/v3/projects/3a25839617304e069e93d96029612c18/users/e9d562828c3241d0a5d0f2253205c12f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:25.165884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.166960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.170288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.185826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35bffa-0f84-490b-bc23-6396afeb4837 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.267778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] MFA Rules not processed for user `e9d562828c3241d0a5d0f2253205c12f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:25.269539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:25.299867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.300533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.300823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.301107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.434863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.436342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:25.470880 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1023/2074] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:25.472660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:25.473457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:25.503583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102ceee-bd04-4ede-a304-df03b625a09e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.507917 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1052/2075] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:25.511107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:25.516375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.517503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.519102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.520332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] PATH_INFO: `/v3/users/960370ae93bb47dfb3ec8ef5ac86e675` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.523338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=960370ae93bb47dfb3ec8ef5ac86e675)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.528109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:25.532930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0c5af-327b-4767-8914-35497d5535a5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.542878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.543840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.544343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.545546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.546354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.548455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:25.615059 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1053/2076] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:25 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:25.616248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:25.616764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960370ae93bb47dfb3ec8ef5ac86e675'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:25.630090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960370ae93bb47dfb3ec8ef5ac86e675'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:25.631397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960370ae93bb47dfb3ec8ef5ac86e675'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:25.632243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960370ae93bb47dfb3ec8ef5ac86e675'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:25.652996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b2e2545-93e3-413e-b96c-352b3b892519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960370ae93bb47dfb3ec8ef5ac86e675'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:25.710095 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1024/2077] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:25 2022] DELETE /identity/v3/users/960370ae93bb47dfb3ec8ef5ac86e675 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:25.714966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.715338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.716150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.739760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b79541-d5fa-4c06-8919-fea2cd0c2ac5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.750037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:25.758488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:25.819437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.820254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.820609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.821031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.822626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.825746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:25.864361 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1054/2078] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:25 2022] POST /identity/v3/users => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:25.866194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:25.868818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:25.892109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ff14f-3719-4106-a90f-af9a3b6ea14a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.898235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.899014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.899487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.899841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.900677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.902491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:25.915445 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1055/2079] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:25.920303 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1025/2080] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:25.925011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:25.937007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21408416-67c7-4c5c-943f-005f69e64f25 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:25.943761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:25.944807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:25.945086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:25.945357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] PATH_INFO: `/v3/projects/e7eae2a8d55f4b1d8be7b6828b835afc/users/741b5c98d4cf4293bc384ac581e3f809/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:25.969245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:25.970668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:25.978864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7eae2a8d55f4b1d8be7b6828b835afc, user_id=741b5c98d4cf4293bc384ac581e3f809, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:25.988720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:26.021575 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1056/2081] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:25 2022] PUT /identity/v3/projects/e7eae2a8d55f4b1d8be7b6828b835afc/users/741b5c98d4cf4293bc384ac581e3f809/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:26.025708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:26.128320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8059b67-9edd-4461-a563-3a26b7566cf1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:26.135145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:26.136037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.136337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.136631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.137740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:26.139569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:26.155088 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1057/2082] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:26.156362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:26.169945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef1c1-7276-4a97-8ac3-0f385e5824ab admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:26.177276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dad64-68cf-4bfd-b728-ce3edb5568ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:26.178262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dad64-68cf-4bfd-b728-ce3edb5568ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.178743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dad64-68cf-4bfd-b728-ce3edb5568ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.179044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dad64-68cf-4bfd-b728-ce3edb5568ad admin admin] PATH_INFO: `/v3/projects/e7eae2a8d55f4b1d8be7b6828b835afc/users/741b5c98d4cf4293bc384ac581e3f809/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.181991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dad64-68cf-4bfd-b728-ce3edb5568ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7eae2a8d55f4b1d8be7b6828b835afc, user_id=741b5c98d4cf4293bc384ac581e3f809, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:26.185477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dad64-68cf-4bfd-b728-ce3edb5568ad admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:26.201671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf17e2-6d6f-4cc6-b42f-18104b7d991b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:26.208561 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1058/2083] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:26 2022] PUT /identity/v3/projects/e7eae2a8d55f4b1d8be7b6828b835afc/users/741b5c98d4cf4293bc384ac581e3f809/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:26.219589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc8ce7-d309-4cbe-929d-7dcca6bf4a7d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.219891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc8ce7-d309-4cbe-929d-7dcca6bf4a7d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.220084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc8ce7-d309-4cbe-929d-7dcca6bf4a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.283009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b4bc8ce7-d309-4cbe-929d-7dcca6bf4a7d None None] MFA Rules not processed for user `741b5c98d4cf4293bc384ac581e3f809`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:26.284526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4bc8ce7-d309-4cbe-929d-7dcca6bf4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:26.303226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:26.303884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.304167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.304443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.378445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:26.380637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:26.392433 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1026/2084] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:26.394373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:26.395615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:26.421357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b621e-bfae-47fa-861a-8ebe6dc26022 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:26.424777 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1059/2085] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:26.426315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.426594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.426905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.441512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:26.442361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.442643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.443055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] PATH_INFO: `/v3/projects/ada8a5cee4dd4a8fb2b722d3aded1b0c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.448663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada8a5cee4dd4a8fb2b722d3aded1b0c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:26.451801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] MFA Rules not processed for user `e9d562828c3241d0a5d0f2253205c12f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:26.452111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:26.453581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:26.533213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada8a5cee4dd4a8fb2b722d3aded1b0c', 'request_id': 'req-19119bb2-864f-4902-80ee-d43612343609'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.557089 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1060/2086] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:26.568594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada8a5cee4dd4a8fb2b722d3aded1b0c', 'request_id': 'req-19119bb2-864f-4902-80ee-d43612343609'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.568754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:26.570126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:26.591503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada8a5cee4dd4a8fb2b722d3aded1b0c', 'request_id': 'req-19119bb2-864f-4902-80ee-d43612343609'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.608432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] The token cache is being invalidate because project ada8a5cee4dd4a8fb2b722d3aded1b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:26.609583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.610925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.614667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1027/2087] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:26 2022] DELETE /identity/v3/projects/ada8a5cee4dd4a8fb2b722d3aded1b0c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:26.619351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:26.622060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:26.761749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9b538-f3ca-4355-8cd5-9d88e9307b61 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:26.768388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19119bb2-864f-4902-80ee-d43612343609 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:26.784335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:26.785356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.785759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.786321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] PATH_INFO: `/v3/users/bb762dc3b827409c9fb5b44fcc6ce519` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.793866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb762dc3b827409c9fb5b44fcc6ce519)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:26.806008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:26.910568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:26.911426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:26.911834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:26.912042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:26.915089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:26.957098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb762dc3b827409c9fb5b44fcc6ce519'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.966147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb762dc3b827409c9fb5b44fcc6ce519'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.967245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb762dc3b827409c9fb5b44fcc6ce519'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.967994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb762dc3b827409c9fb5b44fcc6ce519'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:26.979959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb762dc3b827409c9fb5b44fcc6ce519'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.010290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1028/2088] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:26 2022] DELETE /identity/v3/users/bb762dc3b827409c9fb5b44fcc6ce519 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:27.044740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:27.046974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:27.074248 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1061/2089] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:27.101911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:27.104269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:27.187768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0555f16-d40b-49b4-bf48-77b7f19c19c7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:27.192565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:27.198800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:27.198800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:27.198800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] PATH_INFO: `/v3/projects/24373ce58ace40578f0a63f2bdff3118` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:27.200219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24373ce58ace40578f0a63f2bdff3118)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:27.202201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:27.264238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24373ce58ace40578f0a63f2bdff3118', 'request_id': 'req-7dc99753-acb7-478f-b802-6d5c855e4731'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.273151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24373ce58ace40578f0a63f2bdff3118', 'request_id': 'req-7dc99753-acb7-478f-b802-6d5c855e4731'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.282462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24373ce58ace40578f0a63f2bdff3118', 'request_id': 'req-7dc99753-acb7-478f-b802-6d5c855e4731'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.302788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] The token cache is being invalidate because project 24373ce58ace40578f0a63f2bdff3118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:27.303095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.307215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.313729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:27.315431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:27.324298 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1029/2090] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:27 2022] DELETE /identity/v3/projects/24373ce58ace40578f0a63f2bdff3118 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:27.332615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409e2f3-5c79-4774-84d2-bcb2587d4544 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:27.391195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:27.393640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:27.433471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:27.434649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:27.435165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:27.435598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] PATH_INFO: `/v3/users/76016fb9ad9448bf9bac9e25ecabf80a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:27.437173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=76016fb9ad9448bf9bac9e25ecabf80a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:27.439282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:27.511947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99753-acb7-478f-b802-6d5c855e4731 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:27.517830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76016fb9ad9448bf9bac9e25ecabf80a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.519091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76016fb9ad9448bf9bac9e25ecabf80a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.527099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76016fb9ad9448bf9bac9e25ecabf80a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.527715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb08b3-0c5e-4a59-bcab-513dcc569e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:27.528470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb08b3-0c5e-4a59-bcab-513dcc569e55 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:27.528797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76016fb9ad9448bf9bac9e25ecabf80a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.528924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb08b3-0c5e-4a59-bcab-513dcc569e55 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:27.529211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb08b3-0c5e-4a59-bcab-513dcc569e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:27.531479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1bcb08b3-0c5e-4a59-bcab-513dcc569e55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:27.541970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76016fb9ad9448bf9bac9e25ecabf80a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.571863 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1062/2091] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:27 2022] DELETE /identity/v3/users/76016fb9ad9448bf9bac9e25ecabf80a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:27.572890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:27.574240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:27.630525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb08b3-0c5e-4a59-bcab-513dcc569e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:27.632860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb08b3-0c5e-4a59-bcab-513dcc569e55 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:27.657955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c38289-ff43-43ae-b57b-2fdcbdd9d3fa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:27.664409 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1030/2092] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:27.681946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:27.683650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:27.683936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:27.684216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] PATH_INFO: `/v3/projects/cfeddb43c5ce431abfdfe46caa60a5e4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:27.685520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfeddb43c5ce431abfdfe46caa60a5e4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:27.688137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:27.781591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfeddb43c5ce431abfdfe46caa60a5e4', 'request_id': 'req-0a3f4b53-b52c-4f03-a381-60176937badd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.808072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfeddb43c5ce431abfdfe46caa60a5e4', 'request_id': 'req-0a3f4b53-b52c-4f03-a381-60176937badd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.823970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfeddb43c5ce431abfdfe46caa60a5e4', 'request_id': 'req-0a3f4b53-b52c-4f03-a381-60176937badd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.844242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] The token cache is being invalidate because project cfeddb43c5ce431abfdfe46caa60a5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:27.844786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.845679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a3f4b53-b52c-4f03-a381-60176937badd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:27.849287 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1063/2093] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:27 2022] DELETE /identity/v3/projects/cfeddb43c5ce431abfdfe46caa60a5e4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:27.856651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb931e4-6254-43c5-bf6e-73eb211ff80c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:27.856941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb931e4-6254-43c5-bf6e-73eb211ff80c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:27.857715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb931e4-6254-43c5-bf6e-73eb211ff80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:27.883725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fbb931e4-6254-43c5-bf6e-73eb211ff80c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:27.885260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fbb931e4-6254-43c5-bf6e-73eb211ff80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:27.981586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7f4b-4444-4d0b-b1d9-e09a6d1793c0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:27.981773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1031/2094] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:27.983048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7f4b-4444-4d0b-b1d9-e09a6d1793c0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:27.983736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e7f4b-4444-4d0b-b1d9-e09a6d1793c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.008532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2d3e7f4b-4444-4d0b-b1d9-e09a6d1793c0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:28.010019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2d3e7f4b-4444-4d0b-b1d9-e09a6d1793c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.019716 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1064/2095] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:28.024905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb931e4-6254-43c5-bf6e-73eb211ff80c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.040414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb931e4-6254-43c5-bf6e-73eb211ff80c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.048071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.048804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.050286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.050286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.050755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:28.051118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.053103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.091394 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1032/2096] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:28.095613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7f4b-4444-4d0b-b1d9-e09a6d1793c0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.108837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e7f4b-4444-4d0b-b1d9-e09a6d1793c0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.122099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.122099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.122099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.122512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.122986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.127997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.173221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.175941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.184904 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1065/2097] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:28 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:28.192141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.213382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5b632-d6be-47ac-9266-d8f11c8eca91 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.310754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0020b6-edd7-422a-a148-8e685d954ebe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.321502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.323377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.326996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.329802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.329802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.333961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.335899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.335899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.336130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] PATH_INFO: `/v3/projects/53d94c79ef1f4bcb910bf28e32ee0b26` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.338014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d94c79ef1f4bcb910bf28e32ee0b26)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.339294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.340081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.389891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1066/2098] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:28 2022] POST /identity/v3/users => generated 282 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:28.390752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.398970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.419316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d94c79ef1f4bcb910bf28e32ee0b26', 'request_id': 'req-7a526c9b-9f22-4937-81cf-006953ef0fe2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.426411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f70254-b220-44e8-b0d4-3e51017dd33a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.428953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d94c79ef1f4bcb910bf28e32ee0b26', 'request_id': 'req-7a526c9b-9f22-4937-81cf-006953ef0fe2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.442258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d94c79ef1f4bcb910bf28e32ee0b26', 'request_id': 'req-7a526c9b-9f22-4937-81cf-006953ef0fe2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.465961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] The token cache is being invalidate because project 53d94c79ef1f4bcb910bf28e32ee0b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:28.466354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.467137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.470835 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1033/2099] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:28 2022] DELETE /identity/v3/projects/53d94c79ef1f4bcb910bf28e32ee0b26 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:28.474610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.476876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.535761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.537466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.538053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.538491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] PATH_INFO: `/v3/users/e0e9f1939f084da58fc8a612ef31f6b2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.540154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e9f1939f084da58fc8a612ef31f6b2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.542933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.574496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a526c9b-9f22-4937-81cf-006953ef0fe2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.583610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af84afa-f816-4815-8023-063b985e6c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.584307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84afa-f816-4815-8023-063b985e6c95 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.585387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84afa-f816-4815-8023-063b985e6c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.586759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af84afa-f816-4815-8023-063b985e6c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.587661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af84afa-f816-4815-8023-063b985e6c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.590595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af84afa-f816-4815-8023-063b985e6c95 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.613674 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1034/2100] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:28.613893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e9f1939f084da58fc8a612ef31f6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.613893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e9f1939f084da58fc8a612ef31f6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.614617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.614936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.615225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.624922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e9f1939f084da58fc8a612ef31f6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.626804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e9f1939f084da58fc8a612ef31f6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.639221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b9c99d8-b8da-4b1c-ae9f-0afd6a4c40cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e9f1939f084da58fc8a612ef31f6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:28.644575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:28.645963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.660523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1035/2101] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:28.661362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.663985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.669262 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1067/2102] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:28 2022] DELETE /identity/v3/users/e0e9f1939f084da58fc8a612ef31f6b2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:28.671558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4201118-455d-4706-a3f1-8e1cdc562fe8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.671558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4201118-455d-4706-a3f1-8e1cdc562fe8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.671558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4201118-455d-4706-a3f1-8e1cdc562fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.677611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231b7b8-0c27-412d-8fd9-ce31671fdb6e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.689975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e4201118-455d-4706-a3f1-8e1cdc562fe8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:28.691328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4201118-455d-4706-a3f1-8e1cdc562fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.748779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035682-23da-46bb-a0e7-55a545ab36fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.748779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035682-23da-46bb-a0e7-55a545ab36fb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.748779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035682-23da-46bb-a0e7-55a545ab36fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.748779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035682-23da-46bb-a0e7-55a545ab36fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.749222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035682-23da-46bb-a0e7-55a545ab36fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.749222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035682-23da-46bb-a0e7-55a545ab36fb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.760835 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1036/2103] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:28.764071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d7fb6-b6c3-419e-9e0f-1dfa3e61fad8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.764364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d7fb6-b6c3-419e-9e0f-1dfa3e61fad8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.765335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d7fb6-b6c3-419e-9e0f-1dfa3e61fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.778704 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1068/2104] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:28.779824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4201118-455d-4706-a3f1-8e1cdc562fe8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.797084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4201118-455d-4706-a3f1-8e1cdc562fe8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.804085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.807184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.809538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.811286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] PATH_INFO: `/v3/projects/bd92ab7de4f3456e82ccaa60aa378562/users/c562e7dec6d34cd0a7fc7cea14fa5e74/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.833142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-849d7fb6-b6c3-419e-9e0f-1dfa3e61fad8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:28.834443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-849d7fb6-b6c3-419e-9e0f-1dfa3e61fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.848084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1037/2105] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:28.848863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d7fb6-b6c3-419e-9e0f-1dfa3e61fad8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.851767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd92ab7de4f3456e82ccaa60aa378562, user_id=c562e7dec6d34cd0a7fc7cea14fa5e74, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.855430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.860022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d7fb6-b6c3-419e-9e0f-1dfa3e61fad8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:28.866670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:28.867721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:28.868304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:28.868706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:28.869613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:28.870688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:28.871964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:28.888806 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1038/2106] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:28.889922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.895026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:28.937628 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1069/2107] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:28 2022] PUT /identity/v3/projects/bd92ab7de4f3456e82ccaa60aa378562/users/c562e7dec6d34cd0a7fc7cea14fa5e74/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:28.942591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:28.976041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2abc5-b414-4b29-aa56-f53663f858e3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.080848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c075f-64ff-4eec-b449-fabefc663275 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.081964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78e781-45a2-44b3-bf3f-46eb5974f7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.082631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78e781-45a2-44b3-bf3f-46eb5974f7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.082954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78e781-45a2-44b3-bf3f-46eb5974f7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.083918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78e781-45a2-44b3-bf3f-46eb5974f7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.086262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.086961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.087248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.087618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.088326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.101595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.109532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78e781-45a2-44b3-bf3f-46eb5974f7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.112735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78e781-45a2-44b3-bf3f-46eb5974f7d9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.138662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1039/2108] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:29.140150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa1d3-f0c0-4b0c-acf1-b844b91e848b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.140446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa1d3-f0c0-4b0c-acf1-b844b91e848b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.141236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94daa1d3-f0c0-4b0c-acf1-b844b91e848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.147462 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1070/2109] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:28 2022] POST /identity/v3/projects => generated 389 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:29.151197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:29.165074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-94daa1d3-f0c0-4b0c-acf1-b844b91e848b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:29.166375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-94daa1d3-f0c0-4b0c-acf1-b844b91e848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:29.272587 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1040/2110] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:29.282958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daa1d3-f0c0-4b0c-acf1-b844b91e848b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:29.333725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678fbbf-a54c-4c85-95d3-a15e45b79c79 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.349480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3951c6-2622-4fbb-9099-6130a1b42e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.350322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3951c6-2622-4fbb-9099-6130a1b42e2c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.350610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3951c6-2622-4fbb-9099-6130a1b42e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.351503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3951c6-2622-4fbb-9099-6130a1b42e2c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.351737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3951c6-2622-4fbb-9099-6130a1b42e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.353717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3951c6-2622-4fbb-9099-6130a1b42e2c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.396628 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1071/2111] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:29 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:29.399508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918f8d-981a-42bc-90e9-a899306e396e None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.400101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918f8d-981a-42bc-90e9-a899306e396e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.401310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27918f8d-981a-42bc-90e9-a899306e396e None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.402735 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1072/2112] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:29.405804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27918f8d-981a-42bc-90e9-a899306e396e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:29.413441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94daa1d3-f0c0-4b0c-acf1-b844b91e848b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.418109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebabe35-4c24-4385-a375-993f221a975e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.418794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebabe35-4c24-4385-a375-993f221a975e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.419118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebabe35-4c24-4385-a375-993f221a975e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.419401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebabe35-4c24-4385-a375-993f221a975e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.426551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27918f8d-981a-42bc-90e9-a899306e396e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.432930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.433700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.435006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.435225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.436073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.437598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebabe35-4c24-4385-a375-993f221a975e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.438910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.439477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebabe35-4c24-4385-a375-993f221a975e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.452462 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1041/2113] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:29.454012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.454463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.454883 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1073/2114] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:29.455092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.458368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:29.474565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414265d-1332-465c-b418-fc84cb6fb140 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.480445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.481408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.481924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.482406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.483490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.486396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.499351 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1074/2115] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:29.504084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:29.513439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:29.515837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:29.523027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6d8c-b776-4581-b674-42a098e2c469 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.530932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61b3d-0b45-4dbe-8f80-abb130f1c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.532450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61b3d-0b45-4dbe-8f80-abb130f1c445 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.534266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61b3d-0b45-4dbe-8f80-abb130f1c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.534858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61b3d-0b45-4dbe-8f80-abb130f1c445 admin admin] PATH_INFO: `/v3/projects/209bcaac9caa425f8f2149045d4ae170/users/29af2195a7f94f5a8762b462d22d778e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.555880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61b3d-0b45-4dbe-8f80-abb130f1c445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209bcaac9caa425f8f2149045d4ae170, user_id=29af2195a7f94f5a8762b462d22d778e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.560898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61b3d-0b45-4dbe-8f80-abb130f1c445 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.585270 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1075/2116] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:29 2022] PUT /identity/v3/projects/209bcaac9caa425f8f2149045d4ae170/users/29af2195a7f94f5a8762b462d22d778e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:29.599314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.600485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.602865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.670353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] MFA Rules not processed for user `29af2195a7f94f5a8762b462d22d778e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:29.672404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:29.689805 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1042/2117] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:29.691263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:29.693519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:29.722083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3d9b3-4278-49e7-bc80-f7648ba2f04f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:29.845618 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1076/2118] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:29.847462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:29.851312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:29.860884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:29.863463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:29.863914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:29.864595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] PATH_INFO: `/v3/projects/4a5c3e72c1f943bcb6256ddf95978995` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:29.865887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5c3e72c1f943bcb6256ddf95978995)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:29.868902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:29.942608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5c3e72c1f943bcb6256ddf95978995', 'request_id': 'req-2fae22b6-63e5-424a-8f89-0dd660357592'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:29.953176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5c3e72c1f943bcb6256ddf95978995', 'request_id': 'req-2fae22b6-63e5-424a-8f89-0dd660357592'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:29.970020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5c3e72c1f943bcb6256ddf95978995', 'request_id': 'req-2fae22b6-63e5-424a-8f89-0dd660357592'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:29.997884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] The token cache is being invalidate because project 4a5c3e72c1f943bcb6256ddf95978995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:29.998177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:29.999012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:30.003541 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1043/2119] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:29 2022] DELETE /identity/v3/projects/4a5c3e72c1f943bcb6256ddf95978995 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:30.005412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.008747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.018410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f069b89-487f-4a81-b339-f5878297b705 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.107979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae22b6-63e5-424a-8f89-0dd660357592 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.115566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.116420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.117078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.117207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.118014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.122625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.155676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54950cea-59e4-4c0b-9602-c538c947269e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.156413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54950cea-59e4-4c0b-9602-c538c947269e service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.156698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54950cea-59e4-4c0b-9602-c538c947269e service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.157053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54950cea-59e4-4c0b-9602-c538c947269e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.164088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54950cea-59e4-4c0b-9602-c538c947269e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.165507 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1044/2120] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:30 2022] POST /identity/v3/projects => generated 389 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:30.166607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.168551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.183485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54950cea-59e4-4c0b-9602-c538c947269e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.193184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54950cea-59e4-4c0b-9602-c538c947269e service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.208744 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1077/2121] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:30.210978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41773cba-44b1-4df7-96a5-3c9423753472 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.210978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41773cba-44b1-4df7-96a5-3c9423753472 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.210978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41773cba-44b1-4df7-96a5-3c9423753472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.231310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-41773cba-44b1-4df7-96a5-3c9423753472 None None] MFA Rules not processed for user `e1333f2166c947a4a37dd6865f532f24`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:30.232810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-41773cba-44b1-4df7-96a5-3c9423753472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.260344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae162118-ce48-42dc-81e6-3fe7e605354f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.267735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.269598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.269749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.270247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] PATH_INFO: `/v3/users/388aea58343b4c0c994dcf4f861a4250` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.272025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388aea58343b4c0c994dcf4f861a4250)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.274721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.348974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1078/2122] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:30.349851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41773cba-44b1-4df7-96a5-3c9423753472 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.368062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388aea58343b4c0c994dcf4f861a4250'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:30.375672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41773cba-44b1-4df7-96a5-3c9423753472 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.384287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388aea58343b4c0c994dcf4f861a4250'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:30.385489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388aea58343b4c0c994dcf4f861a4250'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:30.386941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388aea58343b4c0c994dcf4f861a4250'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:30.389077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.390030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.391594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.391890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.394815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.399730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388aea58343b4c0c994dcf4f861a4250'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:30.402549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.446395 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1045/2123] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:30 2022] DELETE /identity/v3/users/388aea58343b4c0c994dcf4f861a4250 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:30.449249 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1079/2124] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:30 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:30.453328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.458669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.615530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.617525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.670067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e41bdb-bd10-4660-978d-d4fb77800d80 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.687488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.688716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.689379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.689909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.690993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.693058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.708780 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1046/2125] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:30.710320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.725788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7340ebc-8526-4030-8698-afa0d5d51d73 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.725994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea66b0-4d61-43be-9348-93c1c2c0e3cd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.735518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.737962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.738516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.739190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] PATH_INFO: `/v3/projects/ac416d4e69b8403ab980cdf7ea4a4c8f/users/78cf2d4b833f4c7b9d1b01ffb3c156f4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.765910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac416d4e69b8403ab980cdf7ea4a4c8f, user_id=78cf2d4b833f4c7b9d1b01ffb3c156f4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.773984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.802293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.802992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.803434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.804937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.810252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.810719 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1047/2126] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:30 2022] PUT /identity/v3/projects/ac416d4e69b8403ab980cdf7ea4a4c8f/users/78cf2d4b833f4c7b9d1b01ffb3c156f4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:30.813578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.815548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:30.821956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.824714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.854582 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1080/2127] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:30.856646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.870070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5465b31-1fd2-4978-a89f-b455f36f8b59 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.943292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.944125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.944496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.944897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.945716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.948043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.963081 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1081/2128] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:30.965861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:30.967155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be82413-68e5-4ccc-a8cc-c584bb584162 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:30.975503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:30.977116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:30.977734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:30.978158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] PATH_INFO: `/v3/projects/f5b2b5193166455a8bb67322e81b3f67` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:30.980468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b2b5193166455a8bb67322e81b3f67)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:30.982730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:30.996409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2db86f-227b-46f8-8ae2-37e0d2bc7867 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:31.013084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1e7e5-2d08-41c1-93f6-3ec2f96e6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:31.015173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e7e5-2d08-41c1-93f6-3ec2f96e6144 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.017509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e7e5-2d08-41c1-93f6-3ec2f96e6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.020236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1e7e5-2d08-41c1-93f6-3ec2f96e6144 admin admin] PATH_INFO: `/v3/projects/ac416d4e69b8403ab980cdf7ea4a4c8f/users/78cf2d4b833f4c7b9d1b01ffb3c156f4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.026264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1e7e5-2d08-41c1-93f6-3ec2f96e6144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac416d4e69b8403ab980cdf7ea4a4c8f, user_id=78cf2d4b833f4c7b9d1b01ffb3c156f4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:31.036926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1e7e5-2d08-41c1-93f6-3ec2f96e6144 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:31.054523 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1082/2129] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:30 2022] PUT /identity/v3/projects/ac416d4e69b8403ab980cdf7ea4a4c8f/users/78cf2d4b833f4c7b9d1b01ffb3c156f4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:31.063488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b2b5193166455a8bb67322e81b3f67', 'request_id': 'req-d70cbe5c-66c0-4d2a-bcfd-040a98128324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:31.066099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5030-a53f-474a-b41d-223ee78b1d14 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.066722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5030-a53f-474a-b41d-223ee78b1d14 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.067190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b5030-a53f-474a-b41d-223ee78b1d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.076737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b2b5193166455a8bb67322e81b3f67', 'request_id': 'req-d70cbe5c-66c0-4d2a-bcfd-040a98128324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:31.105206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b2b5193166455a8bb67322e81b3f67', 'request_id': 'req-d70cbe5c-66c0-4d2a-bcfd-040a98128324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:31.117765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] The token cache is being invalidate because project f5b2b5193166455a8bb67322e81b3f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:31.118079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:31.118907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d70cbe5c-66c0-4d2a-bcfd-040a98128324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:31.121123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1048/2130] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:30 2022] DELETE /identity/v3/projects/f5b2b5193166455a8bb67322e81b3f67 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:31.131298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8465-542c-4c5e-b494-2e61d4ce1cce None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.131879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8465-542c-4c5e-b494-2e61d4ce1cce None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.135814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8465-542c-4c5e-b494-2e61d4ce1cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.140247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0c6b5030-a53f-474a-b41d-223ee78b1d14 None None] MFA Rules not processed for user `78cf2d4b833f4c7b9d1b01ffb3c156f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:31.142570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0c6b5030-a53f-474a-b41d-223ee78b1d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:31.183297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-400a8465-542c-4c5e-b494-2e61d4ce1cce None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:31.184528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-400a8465-542c-4c5e-b494-2e61d4ce1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:31.274340 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1049/2131] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:31.274541 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1083/2132] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:31.274658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d805e-d8d0-45fc-9e3d-2364716e2e6e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.274658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d805e-d8d0-45fc-9e3d-2364716e2e6e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.274658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d805e-d8d0-45fc-9e3d-2364716e2e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.276236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05afe2-ebc8-4fce-a9b2-b96070db6c94 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.276535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05afe2-ebc8-4fce-a9b2-b96070db6c94 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.276861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05afe2-ebc8-4fce-a9b2-b96070db6c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.301680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6b05afe2-ebc8-4fce-a9b2-b96070db6c94 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:31.303702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b05afe2-ebc8-4fce-a9b2-b96070db6c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:31.320458 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1084/2133] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:31.322899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05afe2-ebc8-4fce-a9b2-b96070db6c94 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:31.334839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05afe2-ebc8-4fce-a9b2-b96070db6c94 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:31.352707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:31.354334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.354624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.355917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.356688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:31.357753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:31.359134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1b2d805e-d8d0-45fc-9e3d-2364716e2e6e None None] MFA Rules not processed for user `c562e7dec6d34cd0a7fc7cea14fa5e74`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:31.360033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:31.362267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b2d805e-d8d0-45fc-9e3d-2364716e2e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:31.385930 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1085/2134] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:46:31.390385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:31.421406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53132b70-5553-4448-b214-ce71a5bf4271 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:31.431481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0cf01-7d0a-409d-9ebf-802d9badd1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:31.432156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cf01-7d0a-409d-9ebf-802d9badd1fc admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.432455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cf01-7d0a-409d-9ebf-802d9badd1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.432715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0cf01-7d0a-409d-9ebf-802d9badd1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.435576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0cf01-7d0a-409d-9ebf-802d9badd1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:31.438102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0cf01-7d0a-409d-9ebf-802d9badd1fc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:31.476941 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1050/2135] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:31.479196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd0244-4014-4e22-bcb2-657b5d769f38 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.479802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd0244-4014-4e22-bcb2-657b5d769f38 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.479802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd0244-4014-4e22-bcb2-657b5d769f38 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.481576 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1051/2136] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:31.482875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61436e61-2609-4ad8-8723-59c9bb114923 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.483248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61436e61-2609-4ad8-8723-59c9bb114923 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.483650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61436e61-2609-4ad8-8723-59c9bb114923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.494800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1086/2137] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:31.496106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.497648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.497952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.505115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-61436e61-2609-4ad8-8723-59c9bb114923 None None] MFA Rules not processed for user `c562e7dec6d34cd0a7fc7cea14fa5e74`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:31.507329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-61436e61-2609-4ad8-8723-59c9bb114923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:31.567159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:31.568764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:31.655290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1052/2138] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:31.656686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61436e61-2609-4ad8-8723-59c9bb114923 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:31.728250 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1087/2139] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:31.756910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:31.758612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:31.822960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61436e61-2609-4ad8-8723-59c9bb114923 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:31.835306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:31.836597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.836744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.837046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.840437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:31.845394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:31.891119 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1053/2140] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:31.893232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:31.899975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311ac82-efb0-46ca-b64f-b9eca5cb985b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:31.907128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87200620-b471-47e2-a030-28b03cd55f13 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:31.913364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:31.914169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.914549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.915001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.915529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:31.915948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:31.916537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.917068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.917493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.918264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:31.937656 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1054/2141] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:31.943266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:31.949115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:31.950080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:31.962497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21388d04-e59a-4036-b65d-cfe6887691d4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:31.969346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a131fa-8378-44c2-85d5-a3c75ca22ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:31.970337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a131fa-8378-44c2-85d5-a3c75ca22ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:31.970825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a131fa-8378-44c2-85d5-a3c75ca22ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:31.971194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a131fa-8378-44c2-85d5-a3c75ca22ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:31.971997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a131fa-8378-44c2-85d5-a3c75ca22ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:31.973716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a131fa-8378-44c2-85d5-a3c75ca22ab5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:31.976692 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1088/2142] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:31.987325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1055/2143] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:31.991555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.001551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948e6a7-9cbb-438f-94fa-2bb0f0a58f5c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.003026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948e6a7-9cbb-438f-94fa-2bb0f0a58f5c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.003510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948e6a7-9cbb-438f-94fa-2bb0f0a58f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.007538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c615c7d-a21f-4271-8d41-4c37a69c1884 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.023738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a5e7e-73d4-4fad-b8a6-a287b47435a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.024709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5e7e-73d4-4fad-b8a6-a287b47435a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.024995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5e7e-73d4-4fad-b8a6-a287b47435a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.025271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5e7e-73d4-4fad-b8a6-a287b47435a2 admin admin] PATH_INFO: `/v3/projects/c31a23c5613c406a93eec6dbc4afb7a5/users/1a3f358ff17049b28f4f678aa6938abe/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.025947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4948e6a7-9cbb-438f-94fa-2bb0f0a58f5c None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:32.027707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4948e6a7-9cbb-438f-94fa-2bb0f0a58f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:32.038072 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1056/2144] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:46:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:32.061455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5e7e-73d4-4fad-b8a6-a287b47435a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31a23c5613c406a93eec6dbc4afb7a5, user_id=1a3f358ff17049b28f4f678aa6938abe, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.064415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5e7e-73d4-4fad-b8a6-a287b47435a2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.094623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1089/2145] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:31 2022] PUT /identity/v3/projects/c31a23c5613c406a93eec6dbc4afb7a5/users/1a3f358ff17049b28f4f678aa6938abe/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:32.099770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948e6a7-9cbb-438f-94fa-2bb0f0a58f5c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.108875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341a85-a55a-4b82-93e3-64eca4326c0c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.109008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341a85-a55a-4b82-93e3-64eca4326c0c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.109287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341a85-a55a-4b82-93e3-64eca4326c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.115806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948e6a7-9cbb-438f-94fa-2bb0f0a58f5c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.164218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a5341a85-a55a-4b82-93e3-64eca4326c0c None None] MFA Rules not processed for user `1a3f358ff17049b28f4f678aa6938abe`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:32.165824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a5341a85-a55a-4b82-93e3-64eca4326c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:32.193298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.199798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.199798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.199798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.221003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.227203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.239327 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1057/2146] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:32.240706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.242487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:32.319765 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1090/2147] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:32.324661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5341a85-a55a-4b82-93e3-64eca4326c0c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.346256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6084d-655d-43fe-b132-2601b6cc30cb service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.364116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.365307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.365597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.365878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.434498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5341a85-a55a-4b82-93e3-64eca4326c0c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.439502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.440949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.441235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.441698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.442190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.444225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.475832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.477413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.491892 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1091/2148] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:32 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:32.492634 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1058/2149] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:32.496151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.579763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab88ccc-0b8c-4a10-a81c-281e94bf9905 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.586521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.588232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.589255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.589784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.591153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.593159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.618916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1092/2150] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:32 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:32.620130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.630994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b66b-e6c3-4c67-af46-990b82d351ce service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.636122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.637014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.637418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.637700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.638487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.640205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.655523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1059/2151] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:32.656755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.669653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f043-94bb-40d3-9f20-7683dcf2d793 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.681274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.682556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.683100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.683558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] PATH_INFO: `/v3/projects/83f4f84f7b8245c0bf6b58873a7c526c/users/6fb949e900ef4e6ea80cec9f42387424/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.708221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f4f84f7b8245c0bf6b58873a7c526c, user_id=6fb949e900ef4e6ea80cec9f42387424, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.711574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.731167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1093/2152] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:32 2022] PUT /identity/v3/projects/83f4f84f7b8245c0bf6b58873a7c526c/users/6fb949e900ef4e6ea80cec9f42387424/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:32.734965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.746468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de7db-8e46-4751-b79a-af9e08819504 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.786268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.833350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.834086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.834378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.834860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.836376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.839393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.857934 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1060/2153] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:32.858966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:32.872427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c13c00-99be-48d4-861d-eb28e8939cfc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.877596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b587a60-4bd6-4fef-944e-a4eef857b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.878472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587a60-4bd6-4fef-944e-a4eef857b424 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.878756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587a60-4bd6-4fef-944e-a4eef857b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.879118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b587a60-4bd6-4fef-944e-a4eef857b424 admin admin] PATH_INFO: `/v3/projects/83f4f84f7b8245c0bf6b58873a7c526c/users/6fb949e900ef4e6ea80cec9f42387424/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.881183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b587a60-4bd6-4fef-944e-a4eef857b424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f4f84f7b8245c0bf6b58873a7c526c, user_id=6fb949e900ef4e6ea80cec9f42387424, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:32.884187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8bf27-d134-4519-9b2c-aa7e6f7cc400 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:32.884326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b587a60-4bd6-4fef-944e-a4eef857b424 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:32.890577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:32.891606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.891959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.892412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.898598 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1061/2154] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:32 2022] PUT /identity/v3/projects/83f4f84f7b8245c0bf6b58873a7c526c/users/6fb949e900ef4e6ea80cec9f42387424/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:32.909212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359bcc-81c8-40c2-b9f1-13b0626110d4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:32.909452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359bcc-81c8-40c2-b9f1-13b0626110d4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:32.909960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359bcc-81c8-40c2-b9f1-13b0626110d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:32.940770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0f359bcc-81c8-40c2-b9f1-13b0626110d4 None None] MFA Rules not processed for user `6fb949e900ef4e6ea80cec9f42387424`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:32.942389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0f359bcc-81c8-40c2-b9f1-13b0626110d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:33.014036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:33.015865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:33.035874 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1094/2155] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:33.036830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:33.044888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:33.055946 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1062/2156] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:33.075994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b2cde-3c27-4e5e-8e4a-77b0e1fbbb61 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:33.153918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:33.154479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:33.154763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:33.155135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:33.156947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:33.215760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:33.218046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:33.228100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1095/2157] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:33.564213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359bcc-81c8-40c2-b9f1-13b0626110d4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:33.579014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359bcc-81c8-40c2-b9f1-13b0626110d4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:33.586762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:33.587828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:33.588290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:33.588748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:33.599301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:33.601568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:33.626596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1063/2158] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:34.343034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:34.354728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40cfcc-5432-4d6a-b1be-f6d982127ab7 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:34.367400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbdfca-7831-48b7-9f61-b99c6a415318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:34.368347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbdfca-7831-48b7-9f61-b99c6a415318 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:34.368646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbdfca-7831-48b7-9f61-b99c6a415318 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:34.368928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbdfca-7831-48b7-9f61-b99c6a415318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:34.531523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbdfca-7831-48b7-9f61-b99c6a415318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:34.533755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbdfca-7831-48b7-9f61-b99c6a415318 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:34.563685 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1096/2159] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:35.021741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:35.023429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:35.151146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7138ac-ccf5-4b31-b6ac-a244cb182e3b service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:35.157481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:35.159226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:35.159758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:35.160276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] PATH_INFO: `/v3/users/29af2195a7f94f5a8762b462d22d778e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:35.163017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29af2195a7f94f5a8762b462d22d778e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:35.165205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:35.246735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29af2195a7f94f5a8762b462d22d778e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.256441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29af2195a7f94f5a8762b462d22d778e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.257226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29af2195a7f94f5a8762b462d22d778e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.259215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29af2195a7f94f5a8762b462d22d778e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.268934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29af2195a7f94f5a8762b462d22d778e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.287464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1064/2160] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:35 2022] DELETE /identity/v3/users/29af2195a7f94f5a8762b462d22d778e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:35.292173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:35.292474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:35.293196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:35.315961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:35.317335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:35.384626 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1097/2161] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:35.398662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:35.400175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:35.477112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:35.479927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:35.499278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feee3f-92ec-4655-8c23-83a7975d79e0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:35.499802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26ee5a-c537-46d5-af84-57e345fb3d64 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:35.505106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:35.506467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:35.507101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:35.507588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] PATH_INFO: `/v3/users/1a3f358ff17049b28f4f678aa6938abe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:35.509157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3f358ff17049b28f4f678aa6938abe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:35.511996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:35.534973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c488ef-a4ee-423b-9070-52b145060fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:35.536083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c488ef-a4ee-423b-9070-52b145060fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:35.536498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c488ef-a4ee-423b-9070-52b145060fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:35.536655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c488ef-a4ee-423b-9070-52b145060fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:35.565580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c488ef-a4ee-423b-9070-52b145060fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:35.570487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c488ef-a4ee-423b-9070-52b145060fd9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:35.612486 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1065/2162] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:35.635521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3f358ff17049b28f4f678aa6938abe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.640047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3f358ff17049b28f4f678aa6938abe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.665933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3f358ff17049b28f4f678aa6938abe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.666695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3f358ff17049b28f4f678aa6938abe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.687016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3f358ff17049b28f4f678aa6938abe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:35.719146 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1098/2163] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:35 2022] DELETE /identity/v3/users/1a3f358ff17049b28f4f678aa6938abe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:35.725867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:35.725867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:35.725867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:35.776969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:35.780611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:35.933456 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1066/2164] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:35.953325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:35.956553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:36.139592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22283e20-cf29-45ef-80fc-bc7688651a38 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:36.160873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:36.161550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:36.161833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:36.162111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:36.177670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:36.179102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:36.196427 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1099/2165] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:36.576543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:36.578386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:36.591072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e356e-1551-41a0-8c39-b29b589de9ef None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:36.596700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:36.597749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:36.598208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:36.598631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] PATH_INFO: `/v3/projects/209bcaac9caa425f8f2149045d4ae170` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:36.600034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=209bcaac9caa425f8f2149045d4ae170)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:36.602341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:36.668931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209bcaac9caa425f8f2149045d4ae170', 'request_id': 'req-be52b93f-cef9-4215-a604-688f95dafccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.679531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209bcaac9caa425f8f2149045d4ae170', 'request_id': 'req-be52b93f-cef9-4215-a604-688f95dafccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.690450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209bcaac9caa425f8f2149045d4ae170', 'request_id': 'req-be52b93f-cef9-4215-a604-688f95dafccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.703208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] The token cache is being invalidate because project 209bcaac9caa425f8f2149045d4ae170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:36.703787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.704447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.706579 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1067/2166] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:36 2022] DELETE /identity/v3/projects/209bcaac9caa425f8f2149045d4ae170 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:36.710609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:36.720613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077cd5e-ad7c-40c2-a863-169e77700e77 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:36.783134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:36.785953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:36.786419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:36.786700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] PATH_INFO: `/v3/users/78cf2d4b833f4c7b9d1b01ffb3c156f4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:36.788925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78cf2d4b833f4c7b9d1b01ffb3c156f4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:36.790986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:36.851578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78cf2d4b833f4c7b9d1b01ffb3c156f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.852485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78cf2d4b833f4c7b9d1b01ffb3c156f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.860290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78cf2d4b833f4c7b9d1b01ffb3c156f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.861002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78cf2d4b833f4c7b9d1b01ffb3c156f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.871803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78cf2d4b833f4c7b9d1b01ffb3c156f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:36.896592 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1100/2167] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:36 2022] DELETE /identity/v3/users/78cf2d4b833f4c7b9d1b01ffb3c156f4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:37.558222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:37.560223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:37.577002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52b93f-cef9-4215-a604-688f95dafccd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:37.665065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:37.665960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:37.666265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:37.666547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] PATH_INFO: `/v3/projects/c31a23c5613c406a93eec6dbc4afb7a5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:37.667804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31a23c5613c406a93eec6dbc4afb7a5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:37.670362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:37.740386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31a23c5613c406a93eec6dbc4afb7a5', 'request_id': 'req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:37.749587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31a23c5613c406a93eec6dbc4afb7a5', 'request_id': 'req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:37.760260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31a23c5613c406a93eec6dbc4afb7a5', 'request_id': 'req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:37.778207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] The token cache is being invalidate because project c31a23c5613c406a93eec6dbc4afb7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:37.778845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:37.779940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:37.785260 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1068/2168] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:37 2022] DELETE /identity/v3/projects/c31a23c5613c406a93eec6dbc4afb7a5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:37.789302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:37.793277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:37.822640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64438f86-341a-4c33-8556-76f0ef240ee6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:37.936927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:37.938009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:37.938366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:37.938804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] PATH_INFO: `/v3/users/6fb949e900ef4e6ea80cec9f42387424` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:37.942296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb949e900ef4e6ea80cec9f42387424)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:37.949512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:37.963426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:37.965842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:38.010348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c1ee-e679-44b4-97cf-bf2fdbfd3f17 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:38.034499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:38.035306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.035592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.035868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] PATH_INFO: `/v3/projects/ac416d4e69b8403ab980cdf7ea4a4c8f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.060383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac416d4e69b8403ab980cdf7ea4a4c8f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:38.063875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:38.073405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb949e900ef4e6ea80cec9f42387424'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.074354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb949e900ef4e6ea80cec9f42387424'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.094868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb949e900ef4e6ea80cec9f42387424'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.096203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb949e900ef4e6ea80cec9f42387424'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.109317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a78369e9-6941-4110-9a22-21a9e021bc69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb949e900ef4e6ea80cec9f42387424'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.148577 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1101/2169] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:37 2022] DELETE /identity/v3/users/6fb949e900ef4e6ea80cec9f42387424 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:38.171132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac416d4e69b8403ab980cdf7ea4a4c8f', 'request_id': 'req-67f649f3-355e-45b9-a7f8-a02de147b2d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.178262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac416d4e69b8403ab980cdf7ea4a4c8f', 'request_id': 'req-67f649f3-355e-45b9-a7f8-a02de147b2d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.187051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac416d4e69b8403ab980cdf7ea4a4c8f', 'request_id': 'req-67f649f3-355e-45b9-a7f8-a02de147b2d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.214882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] The token cache is being invalidate because project ac416d4e69b8403ab980cdf7ea4a4c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:38.214882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.216685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-67f649f3-355e-45b9-a7f8-a02de147b2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:38.220315 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1069/2170] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:37 2022] DELETE /identity/v3/projects/ac416d4e69b8403ab980cdf7ea4a4c8f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:38.225171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1d2c-6101-448a-94e6-eac93c193aa5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.225461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1d2c-6101-448a-94e6-eac93c193aa5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.225789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf1d2c-6101-448a-94e6-eac93c193aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.253559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-addf1d2c-6101-448a-94e6-eac93c193aa5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:38.256868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-addf1d2c-6101-448a-94e6-eac93c193aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:38.344514 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1102/2171] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:38.353446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681575-5807-4dd7-b64f-152d578b8d21 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.353783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681575-5807-4dd7-b64f-152d578b8d21 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.354011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681575-5807-4dd7-b64f-152d578b8d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.373630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b6681575-5807-4dd7-b64f-152d578b8d21 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:38.374917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b6681575-5807-4dd7-b64f-152d578b8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:38.386944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1070/2172] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:38.388149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1d2c-6101-448a-94e6-eac93c193aa5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:38.403392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf1d2c-6101-448a-94e6-eac93c193aa5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:38.409746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:38.410440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.410724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.411044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.411789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:38.412096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:38.413753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:38.430905 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1103/2173] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:38.431784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6681575-5807-4dd7-b64f-152d578b8d21 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:38.443604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6681575-5807-4dd7-b64f-152d578b8d21 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:38.449230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:38.449910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.450194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.450710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.451569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:38.454349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:38.490828 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1071/2174] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:38 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:38.494619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:38.517221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0d381-68c4-4240-a29c-84d1c5cc99ef admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:38.655339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:38.656111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.657041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.657332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.658033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:38.661641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:38.715740 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1104/2175] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:38 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:38.716459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:38.738362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa91b61-360c-4a3b-840a-e022b4620007 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:38.756698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:38.757686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.757993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.758260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.761380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:38.766855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:38.784174 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1072/2176] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:38.788181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:38.804091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4a41-6f34-47b2-a513-7de8da70128c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:38.813561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec0398-5a11-432e-9b0a-5fe5f6ff4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:38.815197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec0398-5a11-432e-9b0a-5fe5f6ff4839 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.815829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec0398-5a11-432e-9b0a-5fe5f6ff4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.816309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec0398-5a11-432e-9b0a-5fe5f6ff4839 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.817416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec0398-5a11-432e-9b0a-5fe5f6ff4839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:38.819521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec0398-5a11-432e-9b0a-5fe5f6ff4839 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:38.831242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1105/2177] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:38.835155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:38.854608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afc99f-467d-4609-bf6a-819741e340cf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:38.862594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:38.864376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.864891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.865783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] PATH_INFO: `/v3/projects/7789855db11445de842c4df75bd05e10/users/3eb85bfb49aa4a519099c6f43ac77099/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:38.914448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7789855db11445de842c4df75bd05e10, user_id=3eb85bfb49aa4a519099c6f43ac77099, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:38.917344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:38.966547 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1073/2178] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:38 2022] PUT /identity/v3/projects/7789855db11445de842c4df75bd05e10/users/3eb85bfb49aa4a519099c6f43ac77099/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:38.983004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:38.983475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:38.983782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.027704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] MFA Rules not processed for user `3eb85bfb49aa4a519099c6f43ac77099`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:39.029300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:39.177709 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1106/2179] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:39.181849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.330483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.332315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:39.350585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581dd2-bcdd-49bd-870b-921572c19e5f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:39.355904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043a83e-d815-432a-a00d-15e04e0d962b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:39.363847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:39.365635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.365635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.365902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] PATH_INFO: `/v3/projects/83f4f84f7b8245c0bf6b58873a7c526c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.367502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f4f84f7b8245c0bf6b58873a7c526c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:39.369518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:39.370427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:39.371130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.371413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.371691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.372399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:39.374348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:39.416365 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1074/2180] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:39 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:39.417651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.444182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f4f84f7b8245c0bf6b58873a7c526c', 'request_id': 'req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:39.459491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f4f84f7b8245c0bf6b58873a7c526c', 'request_id': 'req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:39.476450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f4f84f7b8245c0bf6b58873a7c526c', 'request_id': 'req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:39.511435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] The token cache is being invalidate because project 83f4f84f7b8245c0bf6b58873a7c526c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:39.511435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:39.518596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d5fb841-2572-4aeb-9f3c-d73de807dcc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:39.533993 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1107/2181] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:39 2022] DELETE /identity/v3/projects/83f4f84f7b8245c0bf6b58873a7c526c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:39.535582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11949fa1-99d3-4dc8-8093-10c6c3f99657 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.535890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11949fa1-99d3-4dc8-8093-10c6c3f99657 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.536150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11949fa1-99d3-4dc8-8093-10c6c3f99657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.539152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f65ae6-e0c4-46dc-b755-4112318b711d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:39.623514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-11949fa1-99d3-4dc8-8093-10c6c3f99657 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:39.626110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-11949fa1-99d3-4dc8-8093-10c6c3f99657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:39.681094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:39.682158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.682605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.683061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.684087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:39.686202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:39.718590 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1075/2182] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:39 2022] POST /identity/v3/users => generated 294 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:39.723941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.727323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:39.745100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf634a-7dba-4602-9eca-e210375596a4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:39.752485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:39.753621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.754840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.755443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.756519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:39.760397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:39.776536 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1076/2183] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:39.779516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.790282 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1108/2184] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:46:39.792182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d1e92-6c07-48e9-8d1c-fb044277450f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.792476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d1e92-6c07-48e9-8d1c-fb044277450f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.792750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d1e92-6c07-48e9-8d1c-fb044277450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.803385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74c4f-f16c-49d2-aa66-710eb26ef2b9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:39.809140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:39.810292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.810829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.813198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] PATH_INFO: `/v3/projects/566d958787dd43a0be6c8221f003c8f4/users/a6edc155dc2646fbb81df7bb279aeee0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.827050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-968d1e92-6c07-48e9-8d1c-fb044277450f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:39.828402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-968d1e92-6c07-48e9-8d1c-fb044277450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:39.836938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=566d958787dd43a0be6c8221f003c8f4, user_id=a6edc155dc2646fbb81df7bb279aeee0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:39.840123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:39.850047 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1109/2185] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:39.854902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d1e92-6c07-48e9-8d1c-fb044277450f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.866687 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1077/2186] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:39 2022] PUT /identity/v3/projects/566d958787dd43a0be6c8221f003c8f4/users/a6edc155dc2646fbb81df7bb279aeee0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:39.868349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d1e92-6c07-48e9-8d1c-fb044277450f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:39.870190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.949007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:39.949924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:39.950540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:39.951071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:39.952236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:39.952711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:39.954782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:39.972171 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1110/2187] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:46:39.983098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:39.994666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d09c-d60c-49c5-8386-630e1875d90a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:39.999420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706152c-97eb-4feb-a5fa-b171f3f7c2eb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.001232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.002344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.003193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.003751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.004764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.007260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:40.017067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.017067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.017067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.019225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.020088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.022448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:40.051436 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1078/2188] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:40.052549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:40.073762 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1111/2189] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:39 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:40.074930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12725a8-fce1-4112-bc3a-9fe2e4556c0e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.075988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:40.164193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c175-2c22-4eb7-9996-af32b222cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.165196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c175-2c22-4eb7-9996-af32b222cad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.165549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c175-2c22-4eb7-9996-af32b222cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.165894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c175-2c22-4eb7-9996-af32b222cad7 admin admin] PATH_INFO: `/v3/projects/566d958787dd43a0be6c8221f003c8f4/users/a6edc155dc2646fbb81df7bb279aeee0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.172266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342c175-2c22-4eb7-9996-af32b222cad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566d958787dd43a0be6c8221f003c8f4, user_id=a6edc155dc2646fbb81df7bb279aeee0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.175517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342c175-2c22-4eb7-9996-af32b222cad7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:40.201570 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1079/2190] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:40 2022] PUT /identity/v3/projects/566d958787dd43a0be6c8221f003c8f4/users/a6edc155dc2646fbb81df7bb279aeee0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:40.222186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b16e03-6380-42d4-a6a6-8e2b9f2ccf43 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.223900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8b81-5a45-4a59-9806-cd258572d977 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.224375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8b81-5a45-4a59-9806-cd258572d977 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.224808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d8b81-5a45-4a59-9806-cd258572d977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.265759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5a9d8b81-5a45-4a59-9806-cd258572d977 None None] MFA Rules not processed for user `a6edc155dc2646fbb81df7bb279aeee0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:40.268689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5a9d8b81-5a45-4a59-9806-cd258572d977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:40.338100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.339136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.339565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.340027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.341204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.343443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:40.378859 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1112/2191] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:40 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:40.383015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:40.410635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600a29d-30e7-4ba8-85a7-b7c17fa31da2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.422829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efff6e-26ca-45a9-b433-d62804693a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.423518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efff6e-26ca-45a9-b433-d62804693a66 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.423840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efff6e-26ca-45a9-b433-d62804693a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.424111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efff6e-26ca-45a9-b433-d62804693a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.424844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efff6e-26ca-45a9-b433-d62804693a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.430855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efff6e-26ca-45a9-b433-d62804693a66 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:40.443398 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1080/2192] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:40.446937 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1113/2193] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:40.448212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8b81-5a45-4a59-9806-cd258572d977 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:40.455764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb880c-bcfa-4c7a-9837-26e5f1bfdf10 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.458204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb880c-bcfa-4c7a-9837-26e5f1bfdf10 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.458643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb880c-bcfa-4c7a-9837-26e5f1bfdf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.469810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d8b81-5a45-4a59-9806-cd258572d977 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.486995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.487987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.488366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.488782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.489627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.491981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:40.499409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dddb880c-bcfa-4c7a-9837-26e5f1bfdf10 None None] MFA Rules not processed for user `3eb85bfb49aa4a519099c6f43ac77099`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:40.505895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dddb880c-bcfa-4c7a-9837-26e5f1bfdf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:40.524455 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1081/2194] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:40.526277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:40.562550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2cc8c-28e9-4826-bc15-c69bb12ca592 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.594175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.595334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.595854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.606457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] PATH_INFO: `/v3/projects/ec8a926ed5984f0e87af39fccadbd1c5/users/64fb111aaf7c49478e62554b7739f20d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.637798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8a926ed5984f0e87af39fccadbd1c5, user_id=64fb111aaf7c49478e62554b7739f20d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.647984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:40.648570 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1114/2195] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:40.683256 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1082/2196] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:40 2022] PUT /identity/v3/projects/ec8a926ed5984f0e87af39fccadbd1c5/users/64fb111aaf7c49478e62554b7739f20d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:40.695054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf377-1a15-4adf-88dc-84616706a9bf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.695394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf377-1a15-4adf-88dc-84616706a9bf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.695676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bf377-1a15-4adf-88dc-84616706a9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.769997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d33bf377-1a15-4adf-88dc-84616706a9bf None None] MFA Rules not processed for user `64fb111aaf7c49478e62554b7739f20d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:40.771441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d33bf377-1a15-4adf-88dc-84616706a9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:40.801585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:40.803486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:40.870172 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1115/2197] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:40.871155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf377-1a15-4adf-88dc-84616706a9bf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:40.915492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85f431-b6a9-4f2d-9891-09463dc1242b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.922058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.922716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.923031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.923307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.928731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:40.951803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bf377-1a15-4adf-88dc-84616706a9bf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:40.958493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:40.959300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:40.960827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:40.961122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:40.961831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:40.963968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.004408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.006871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.009878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1116/2198] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:40 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:41.013531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:41.021148 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1083/2199] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:41.103115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69b15e-0e89-4d82-bf57-182896078652 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:41.109850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:41.112008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.112303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.112575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.113326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.115415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.142409 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1117/2200] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:41 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:41.143673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:41.155733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea16285-726c-4547-a1a1-a4dc8e118edd service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:41.163848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:41.164831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.165274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.165655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.169047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.170390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.188206 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1084/2201] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:41.189665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:41.201955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013eb81-013c-4463-86e3-919baf921104 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:41.208842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:41.215027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.215027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.215027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] PATH_INFO: `/v3/projects/000901a4bef84ea1bbea5d1a8a276c5f/users/0c906fe3e42e497f902a506a5b2b2143/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.233904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=000901a4bef84ea1bbea5d1a8a276c5f, user_id=0c906fe3e42e497f902a506a5b2b2143, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.238150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.267384 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1118/2202] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:41 2022] PUT /identity/v3/projects/000901a4bef84ea1bbea5d1a8a276c5f/users/0c906fe3e42e497f902a506a5b2b2143/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:41.268714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:41.282804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8812122-c0d4-45e8-90ed-2178e404c611 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:41.367992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69403aa8-5502-46af-a533-ce62d50ef6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:41.368896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69403aa8-5502-46af-a533-ce62d50ef6ea admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.369231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69403aa8-5502-46af-a533-ce62d50ef6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.369603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69403aa8-5502-46af-a533-ce62d50ef6ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.370507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69403aa8-5502-46af-a533-ce62d50ef6ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.372412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69403aa8-5502-46af-a533-ce62d50ef6ea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.385774 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1085/2203] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:41.386761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:41.397122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90005d-e427-4461-bb7d-0e011045b86e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:41.402274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:41.403442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.403724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.403989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] PATH_INFO: `/v3/projects/000901a4bef84ea1bbea5d1a8a276c5f/users/0c906fe3e42e497f902a506a5b2b2143/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.406000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=000901a4bef84ea1bbea5d1a8a276c5f, user_id=0c906fe3e42e497f902a506a5b2b2143, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.409471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.421244 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1119/2204] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:41 2022] PUT /identity/v3/projects/000901a4bef84ea1bbea5d1a8a276c5f/users/0c906fe3e42e497f902a506a5b2b2143/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:41.432125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745887-4665-48a3-a4d2-84229e157704 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.432419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745887-4665-48a3-a4d2-84229e157704 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.432701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33745887-4665-48a3-a4d2-84229e157704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.471799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-33745887-4665-48a3-a4d2-84229e157704 None None] MFA Rules not processed for user `0c906fe3e42e497f902a506a5b2b2143`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:41.473184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-33745887-4665-48a3-a4d2-84229e157704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:41.546676 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1086/2205] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:41.557348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:41.640284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c29f-37b2-4e37-974a-6ae50ca14617 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:41.650446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:41.652168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.652613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.653100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.665800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.668013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:41.679072 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1120/2206] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:41.818211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33745887-4665-48a3-a4d2-84229e157704 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:41.820437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-33745887-4665-48a3-a4d2-84229e157704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:41.840131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33745887-4665-48a3-a4d2-84229e157704 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:41.847089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:41.847888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:41.848060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:41.848334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:41.989167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:41.994921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:42.029765 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1087/2207] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:42.073445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:42.096363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030dd9e-213f-4d73-89ca-03dfa1787342 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:42.104257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc608caf-79a4-4017-b89b-517849466242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:42.104935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc608caf-79a4-4017-b89b-517849466242 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:42.105217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc608caf-79a4-4017-b89b-517849466242 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:42.105501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc608caf-79a4-4017-b89b-517849466242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:42.108064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cc608caf-79a4-4017-b89b-517849466242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:42.188253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc608caf-79a4-4017-b89b-517849466242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:42.190574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc608caf-79a4-4017-b89b-517849466242 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:42.217833 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1121/2208] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:42.750968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:42.824453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5302422-a143-4f07-9ba7-d286a1ed63ad service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:42.829303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:42.830782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:42.831081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:42.831354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] PATH_INFO: `/v3/users/64fb111aaf7c49478e62554b7739f20d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:42.832711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fb111aaf7c49478e62554b7739f20d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:42.834652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:42.879721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fb111aaf7c49478e62554b7739f20d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:42.886408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fb111aaf7c49478e62554b7739f20d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:42.887095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fb111aaf7c49478e62554b7739f20d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:42.887705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fb111aaf7c49478e62554b7739f20d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:42.896089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fb111aaf7c49478e62554b7739f20d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:42.913562 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1088/2209] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:42 2022] DELETE /identity/v3/users/64fb111aaf7c49478e62554b7739f20d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:42.918174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:42.918457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:42.918732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:42.935594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:42.936805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:42.997056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1122/2210] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:43.008327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:43.009754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:43.063767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df5d67-3910-4d3f-83b5-00360424e0fa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:43.068076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:43.068713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:43.069000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:43.069276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:43.078254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:43.079713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:43.088847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1089/2211] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:43.372337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:43.373878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:43.386222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640dd7c-6aba-49bf-9e7a-daf8d3bd80ae None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:43.391925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:43.392902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:43.393168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:43.393542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] PATH_INFO: `/v3/projects/ec8a926ed5984f0e87af39fccadbd1c5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:43.394890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8a926ed5984f0e87af39fccadbd1c5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:43.396939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:43.442893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8a926ed5984f0e87af39fccadbd1c5', 'request_id': 'req-9f3e4315-8059-4498-9ba5-05020c016790'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.448995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8a926ed5984f0e87af39fccadbd1c5', 'request_id': 'req-9f3e4315-8059-4498-9ba5-05020c016790'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.456333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8a926ed5984f0e87af39fccadbd1c5', 'request_id': 'req-9f3e4315-8059-4498-9ba5-05020c016790'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.466945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] The token cache is being invalidate because project ec8a926ed5984f0e87af39fccadbd1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:43.467235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.467883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.469392 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1123/2212] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:43 2022] DELETE /identity/v3/projects/ec8a926ed5984f0e87af39fccadbd1c5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:46:43.474088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:43.483445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fda827-8158-44b8-b91a-fa41d01789f5 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:43.538732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:43.539541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:43.539822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:43.540097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] PATH_INFO: `/v3/users/0c906fe3e42e497f902a506a5b2b2143` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:43.541297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c906fe3e42e497f902a506a5b2b2143)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:43.543282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:43.588880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c906fe3e42e497f902a506a5b2b2143'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.596546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c906fe3e42e497f902a506a5b2b2143'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.597239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c906fe3e42e497f902a506a5b2b2143'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.597839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c906fe3e42e497f902a506a5b2b2143'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.608569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e1e162-19b2-44b5-a38d-ae44cce9460c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c906fe3e42e497f902a506a5b2b2143'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:43.631752 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1090/2213] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:46:43 2022] DELETE /identity/v3/users/0c906fe3e42e497f902a506a5b2b2143 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:44.225356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:44.239442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:44.284422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e4315-8059-4498-9ba5-05020c016790 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:44.437599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:44.438479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:44.438803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:44.439075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] PATH_INFO: `/v3/projects/000901a4bef84ea1bbea5d1a8a276c5f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:44.441417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000901a4bef84ea1bbea5d1a8a276c5f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:44.443706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:44.505824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000901a4bef84ea1bbea5d1a8a276c5f', 'request_id': 'req-810e9aa9-33f8-4205-82fa-f06441199286'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:44.512451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000901a4bef84ea1bbea5d1a8a276c5f', 'request_id': 'req-810e9aa9-33f8-4205-82fa-f06441199286'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:44.521933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000901a4bef84ea1bbea5d1a8a276c5f', 'request_id': 'req-810e9aa9-33f8-4205-82fa-f06441199286'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:44.538874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] The token cache is being invalidate because project 000901a4bef84ea1bbea5d1a8a276c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:46:44.539909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:44.540642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-810e9aa9-33f8-4205-82fa-f06441199286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:46:44.542623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1124/2214] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:46:44 2022] DELETE /identity/v3/projects/000901a4bef84ea1bbea5d1a8a276c5f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:44.547372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18574c4-943c-4341-b3a7-6d5dc873a7f4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:44.547843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18574c4-943c-4341-b3a7-6d5dc873a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:44.548041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18574c4-943c-4341-b3a7-6d5dc873a7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:44.568037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f18574c4-943c-4341-b3a7-6d5dc873a7f4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:44.569267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f18574c4-943c-4341-b3a7-6d5dc873a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:44.671606 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1091/2215] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:44.680660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b711f2-c5d9-4ab0-8609-ad1bdc7be81a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:44.681290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b711f2-c5d9-4ab0-8609-ad1bdc7be81a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:44.681725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b711f2-c5d9-4ab0-8609-ad1bdc7be81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:44.714874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b3b711f2-c5d9-4ab0-8609-ad1bdc7be81a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:44.716476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3b711f2-c5d9-4ab0-8609-ad1bdc7be81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:44.735441 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1125/2216] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:44.737661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18574c4-943c-4341-b3a7-6d5dc873a7f4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:44.755274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18574c4-943c-4341-b3a7-6d5dc873a7f4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:44.772145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:44.772884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:44.773176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:44.773598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:44.774355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:46:44.774687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:44.776372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:44.795573 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1092/2217] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:46:44.800286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b711f2-c5d9-4ab0-8609-ad1bdc7be81a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:44.816316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b711f2-c5d9-4ab0-8609-ad1bdc7be81a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:44.823960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:44.824642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:44.824931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:44.825204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:44.829330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:44.831446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:44.869294 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1126/2218] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:44 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:44.873406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:44.885790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720032e1-73d0-4e2e-a520-04cba74fde94 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:44.968431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:44.977810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:44.978310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:44.978799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:44.980423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:44.983096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:45.027152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1093/2219] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:44 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:45.031161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:45.046070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc5dcd-7f9c-4f05-a31f-f2cbb2751b01 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:45.056150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:45.056947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:45.057328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:45.057725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:45.058543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:45.060310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:45.080441 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1127/2220] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:46:45.082058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:45.103021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b125be5-9c51-457a-8dda-305a2d642d32 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:45.139939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:45.154536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:45.156659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:45.159265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:45.160054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:45.161695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:45.169941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:45.171941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:45.219059 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1094/2221] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:45.222723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:45.264593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb3064-7ddb-4d8f-b23f-b0be99db6e55 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:45.280519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf632d9-1229-43d3-986b-6f23d7179dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:45.281432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf632d9-1229-43d3-986b-6f23d7179dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:45.281726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf632d9-1229-43d3-986b-6f23d7179dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:45.281990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf632d9-1229-43d3-986b-6f23d7179dd1 admin admin] PATH_INFO: `/v3/projects/1bcaffad5d3447b98f0216d3481045e5/users/7dd9c30816a7410f94b10294234c1dc2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:45.310145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf632d9-1229-43d3-986b-6f23d7179dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcaffad5d3447b98f0216d3481045e5, user_id=7dd9c30816a7410f94b10294234c1dc2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:45.313435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf632d9-1229-43d3-986b-6f23d7179dd1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:45.337224 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1095/2222] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:45 2022] PUT /identity/v3/projects/1bcaffad5d3447b98f0216d3481045e5/users/7dd9c30816a7410f94b10294234c1dc2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:45.342392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:45.344436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:45.345428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:45.358760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2ec8a-137b-45af-ac68-bd1151816857 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:45.379004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:45.380500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:45.449702 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1096/2223] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:45.464808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:45.467330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:45.473568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f32e44-7984-49db-a344-574ce7630f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:45.474665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32e44-7984-49db-a344-574ce7630f21 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:45.475341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32e44-7984-49db-a344-574ce7630f21 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:45.475341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f32e44-7984-49db-a344-574ce7630f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:45.478554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-05f32e44-7984-49db-a344-574ce7630f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:45.535232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8d7e-31a2-42a2-b466-5fdb7fd728c8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:45.542546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c352b4-43ce-4ae5-9632-f0835de773e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:45.543644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c352b4-43ce-4ae5-9632-f0835de773e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:45.543936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c352b4-43ce-4ae5-9632-f0835de773e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:45.544214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c352b4-43ce-4ae5-9632-f0835de773e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:45.557216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c352b4-43ce-4ae5-9632-f0835de773e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:45.558882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c352b4-43ce-4ae5-9632-f0835de773e2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:45.559913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f32e44-7984-49db-a344-574ce7630f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:45.561615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f32e44-7984-49db-a344-574ce7630f21 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:45.570080 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1097/2224] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:45.574833 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1128/2225] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:46:46.434895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2da9e-27df-4fdd-8ea9-13d250ec62b3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:46.435186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2da9e-27df-4fdd-8ea9-13d250ec62b3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:46.435704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2da9e-27df-4fdd-8ea9-13d250ec62b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:46.459824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-46b2da9e-27df-4fdd-8ea9-13d250ec62b3 None None] MFA Rules not processed for user `e9d562828c3241d0a5d0f2253205c12f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:46.476823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-46b2da9e-27df-4fdd-8ea9-13d250ec62b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:46.601953 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1098/2226] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:47.264367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4316-dddb-4e63-bdd3-9265cc7c5c73 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:47.264949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4316-dddb-4e63-bdd3-9265cc7c5c73 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:47.264949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f4316-dddb-4e63-bdd3-9265cc7c5c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:47.332284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-500f4316-dddb-4e63-bdd3-9265cc7c5c73 None None] MFA Rules not processed for user `7dd9c30816a7410f94b10294234c1dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:47.334085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-500f4316-dddb-4e63-bdd3-9265cc7c5c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:47.499756 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1129/2227] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:47.505155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2da9e-27df-4fdd-8ea9-13d250ec62b3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:47.524130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2da9e-27df-4fdd-8ea9-13d250ec62b3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:47.534428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:47.535221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:47.535588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:47.535776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:47.536878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:47.539265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:47.587927 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1099/2228] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:46:47 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:46:47.591816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4316-dddb-4e63-bdd3-9265cc7c5c73 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:47.612193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f4316-dddb-4e63-bdd3-9265cc7c5c73 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:47.774653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:47.775675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:47.776069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:47.776810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:47.777580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:47.779919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:47.836184 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1130/2229] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:46:47 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:46:47.836530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:47.851784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c81dd-815a-42ab-9c23-5ce6889fe495 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:47.857256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:47.858055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:47.858455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:47.858832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:47.859723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:47.862068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:47.874695 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1100/2230] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:47.879931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:47.892235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cec36b-f870-4d52-903f-9b7ead628bfb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:47.897732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:47.898837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:47.899132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:47.899413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] PATH_INFO: `/v3/projects/d5f84194328949aeb7dedf97875a70c5/users/0f5b7dfeac7e4adb8b1edb35cc8c5044/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:47.932781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f84194328949aeb7dedf97875a70c5, user_id=0f5b7dfeac7e4adb8b1edb35cc8c5044, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:47.936708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:47.952686 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1131/2231] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:47 2022] PUT /identity/v3/projects/d5f84194328949aeb7dedf97875a70c5/users/0f5b7dfeac7e4adb8b1edb35cc8c5044/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:47.957230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:47.967927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f365b-42bd-4c85-93ec-80d469def832 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:48.041465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898a586-8d51-4302-9291-f5008afa749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:48.042241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a586-8d51-4302-9291-f5008afa749b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:48.042602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a586-8d51-4302-9291-f5008afa749b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:48.042979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898a586-8d51-4302-9291-f5008afa749b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:48.044695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898a586-8d51-4302-9291-f5008afa749b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:48.046723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898a586-8d51-4302-9291-f5008afa749b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:48.060415 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1101/2232] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:46:48.063014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:48.074150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97d03-cbc8-45ec-a622-376ee658424c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:48.079587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be102e02-738a-4b73-b6b8-e71277df62e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:48.080782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102e02-738a-4b73-b6b8-e71277df62e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:48.081138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102e02-738a-4b73-b6b8-e71277df62e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:48.081490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be102e02-738a-4b73-b6b8-e71277df62e4 admin admin] PATH_INFO: `/v3/projects/d5f84194328949aeb7dedf97875a70c5/users/0f5b7dfeac7e4adb8b1edb35cc8c5044/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:48.083784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be102e02-738a-4b73-b6b8-e71277df62e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f84194328949aeb7dedf97875a70c5, user_id=0f5b7dfeac7e4adb8b1edb35cc8c5044, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:48.087001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be102e02-738a-4b73-b6b8-e71277df62e4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:48.103043 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1132/2233] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:46:48 2022] PUT /identity/v3/projects/d5f84194328949aeb7dedf97875a70c5/users/0f5b7dfeac7e4adb8b1edb35cc8c5044/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:46:49.005897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:49.008431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:49.009032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:49.047417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] MFA Rules not processed for user `0f5b7dfeac7e4adb8b1edb35cc8c5044`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:49.049135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:49.232525 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1102/2234] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:49.249211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52a13-47da-4ab8-99ee-5b7304ad9da6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:49.250320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52a13-47da-4ab8-99ee-5b7304ad9da6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:49.250848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52a13-47da-4ab8-99ee-5b7304ad9da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:49.273550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f8c52a13-47da-4ab8-99ee-5b7304ad9da6 None None] MFA Rules not processed for user `7dd9c30816a7410f94b10294234c1dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:49.275338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f8c52a13-47da-4ab8-99ee-5b7304ad9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:49.370687 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1133/2235] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:49.536664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:49.538148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:49.675259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d505e-3001-47b4-827c-df735d7e10c3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:49.699687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6f8e-23b8-493b-a575-ac521d574788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:49.700533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6f8e-23b8-493b-a575-ac521d574788 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:49.701036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6f8e-23b8-493b-a575-ac521d574788 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:49.701574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6f8e-23b8-493b-a575-ac521d574788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:49.716614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b6f8e-23b8-493b-a575-ac521d574788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:49.719661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b6f8e-23b8-493b-a575-ac521d574788 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:49.731412 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1103/2236] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:49.848352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52a13-47da-4ab8-99ee-5b7304ad9da6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:49.866747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52a13-47da-4ab8-99ee-5b7304ad9da6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:49.874075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7cc42-4f61-45f6-af7d-c70e586f1f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:49.874748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7cc42-4f61-45f6-af7d-c70e586f1f04 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:49.875065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7cc42-4f61-45f6-af7d-c70e586f1f04 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:49.875345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7cc42-4f61-45f6-af7d-c70e586f1f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:49.878121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-15b7cc42-4f61-45f6-af7d-c70e586f1f04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:49.957153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7cc42-4f61-45f6-af7d-c70e586f1f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:49.958834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7cc42-4f61-45f6-af7d-c70e586f1f04 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:49.968598 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1134/2237] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:52.455387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:52.456291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:52.456978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:52.482505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] MFA Rules not processed for user `99e9b91d4fb949f18cc61bf2bbd63ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:52.485655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:52.604582 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1104/2238] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:46:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:55.621809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128911e9-c0c3-4636-916c-f5e4e8ace637 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:55.622351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128911e9-c0c3-4636-916c-f5e4e8ace637 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:55.622351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128911e9-c0c3-4636-916c-f5e4e8ace637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:55.673735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-128911e9-c0c3-4636-916c-f5e4e8ace637 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:55.675008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-128911e9-c0c3-4636-916c-f5e4e8ace637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:55.786878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1135/2239] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:46:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:55.832948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:55.835075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:55.951098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f038-b55e-4429-860c-2906aa3d9bd1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:55.958004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed3657-f5e4-4da9-838e-0fd788d0b654 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:55.958963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3657-f5e4-4da9-838e-0fd788d0b654 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:55.959785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3657-f5e4-4da9-838e-0fd788d0b654 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:55.960214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3657-f5e4-4da9-838e-0fd788d0b654 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:55.971207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3657-f5e4-4da9-838e-0fd788d0b654 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:55.973089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3657-f5e4-4da9-838e-0fd788d0b654 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:56.010750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1105/2240] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:46:57.737204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128911e9-c0c3-4636-916c-f5e4e8ace637 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:57.760961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128911e9-c0c3-4636-916c-f5e4e8ace637 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:57.775506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6eafb-3961-4a5c-9e09-8bae0b01dcae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:57.779045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6eafb-3961-4a5c-9e09-8bae0b01dcae service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:57.779444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6eafb-3961-4a5c-9e09-8bae0b01dcae service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:57.779845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6eafb-3961-4a5c-9e09-8bae0b01dcae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:57.785984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33e6eafb-3961-4a5c-9e09-8bae0b01dcae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:57.879442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6eafb-3961-4a5c-9e09-8bae0b01dcae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:57.881235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6eafb-3961-4a5c-9e09-8bae0b01dcae service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:57.908425 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1136/2241] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:58.676666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1eab7-f44b-4738-bb73-103a63509b42 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:58.677950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1eab7-f44b-4738-bb73-103a63509b42 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:58.678226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1eab7-f44b-4738-bb73-103a63509b42 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:58.680082 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1106/2242] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:58.685631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a16da-9640-486f-97aa-2953f359b1a5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:58.686491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a16da-9640-486f-97aa-2953f359b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:58.688394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a16da-9640-486f-97aa-2953f359b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:58.716433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6c4a16da-9640-486f-97aa-2953f359b1a5 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:58.719806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6c4a16da-9640-486f-97aa-2953f359b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:58.840276 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1137/2243] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:46:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:58.869484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1eab7-f44b-4738-bb73-103a63509b42 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:58.872193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-22a1eab7-f44b-4738-bb73-103a63509b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:58.915392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1eab7-f44b-4738-bb73-103a63509b42 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:58.924397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528905dd-62cc-4b2f-8ed1-e45b20381d16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:58.925418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528905dd-62cc-4b2f-8ed1-e45b20381d16 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:58.925834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528905dd-62cc-4b2f-8ed1-e45b20381d16 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:58.926134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528905dd-62cc-4b2f-8ed1-e45b20381d16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:58.937594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528905dd-62cc-4b2f-8ed1-e45b20381d16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:58.939616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528905dd-62cc-4b2f-8ed1-e45b20381d16 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:58.951721 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1107/2244] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:46:59.612606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25514de0-7e48-4056-ba35-df5d2cc7a174 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:59.612872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25514de0-7e48-4056-ba35-df5d2cc7a174 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:59.613204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25514de0-7e48-4056-ba35-df5d2cc7a174 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:59.615180 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1138/2245] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:46:59.622013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfa3aa-da58-4550-9ce8-bf6bf8cd067e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:59.622361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfa3aa-da58-4550-9ce8-bf6bf8cd067e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:59.623657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfa3aa-da58-4550-9ce8-bf6bf8cd067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:59.655795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f5dfa3aa-da58-4550-9ce8-bf6bf8cd067e None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:46:59.657134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f5dfa3aa-da58-4550-9ce8-bf6bf8cd067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:59.767798 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1108/2246] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:46:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:46:59.809468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25514de0-7e48-4056-ba35-df5d2cc7a174 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:46:59.811889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25514de0-7e48-4056-ba35-df5d2cc7a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:46:59.840377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25514de0-7e48-4056-ba35-df5d2cc7a174 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:46:59.849457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9fe7-4afe-42f9-8047-fbc384c3b0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:46:59.850114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9fe7-4afe-42f9-8047-fbc384c3b0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:46:59.850402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9fe7-4afe-42f9-8047-fbc384c3b0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:46:59.850676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9fe7-4afe-42f9-8047-fbc384c3b0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:46:59.862427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff9fe7-4afe-42f9-8047-fbc384c3b0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:46:59.863911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff9fe7-4afe-42f9-8047-fbc384c3b0a8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:46:59.894290 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1139/2247] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:46:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:00.136884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4aca3-108a-46dc-bb20-9f87d9205def None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:00.137393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4aca3-108a-46dc-bb20-9f87d9205def None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:00.142886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4aca3-108a-46dc-bb20-9f87d9205def None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:00.144832 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1109/2248] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:47:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:00.150111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b2e62-7378-4b27-9315-95ae694b67de None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:00.150353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b2e62-7378-4b27-9315-95ae694b67de None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:00.150643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b2e62-7378-4b27-9315-95ae694b67de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:00.184907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f43b2e62-7378-4b27-9315-95ae694b67de None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:00.188141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f43b2e62-7378-4b27-9315-95ae694b67de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:00.224676 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1140/2249] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:47:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:00.259357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4aca3-108a-46dc-bb20-9f87d9205def None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:00.277205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4aca3-108a-46dc-bb20-9f87d9205def None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:00.283021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f66ef0-cb43-435e-86e6-97a3d1426e55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:00.283858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f66ef0-cb43-435e-86e6-97a3d1426e55 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:00.284299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f66ef0-cb43-435e-86e6-97a3d1426e55 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:00.284726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f66ef0-cb43-435e-86e6-97a3d1426e55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:00.296484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f66ef0-cb43-435e-86e6-97a3d1426e55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:00.301648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f66ef0-cb43-435e-86e6-97a3d1426e55 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:00.311375 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1110/2250] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:00.553476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc119b6-0e8b-463a-877a-8221c92807e8 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:00.553754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc119b6-0e8b-463a-877a-8221c92807e8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:00.554218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc119b6-0e8b-463a-877a-8221c92807e8 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:00.555769 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1141/2251] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:00.567574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ecc4d-dd21-44c6-becd-4dfec53cc313 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:00.568131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ecc4d-dd21-44c6-becd-4dfec53cc313 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:00.568407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ecc4d-dd21-44c6-becd-4dfec53cc313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:00.601893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-692ecc4d-dd21-44c6-becd-4dfec53cc313 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:00.601893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-692ecc4d-dd21-44c6-becd-4dfec53cc313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:00.634738 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1111/2252] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:47:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:00.656367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc119b6-0e8b-463a-877a-8221c92807e8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:00.671761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc119b6-0e8b-463a-877a-8221c92807e8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:00.677287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:00.678164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:00.678601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:00.679092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:00.692201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:00.694961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:00.732393 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1142/2253] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:07.270677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ecc4d-dd21-44c6-becd-4dfec53cc313 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:07.282647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ecc4d-dd21-44c6-becd-4dfec53cc313 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:07.288982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ccfc4-56e2-4d55-954f-2308cb7e3ec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:07.289743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ccfc4-56e2-4d55-954f-2308cb7e3ec6 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:07.290097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ccfc4-56e2-4d55-954f-2308cb7e3ec6 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:07.290442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ccfc4-56e2-4d55-954f-2308cb7e3ec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:07.300746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ccfc4-56e2-4d55-954f-2308cb7e3ec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:07.303316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ccfc4-56e2-4d55-954f-2308cb7e3ec6 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:07.315044 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1112/2254] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:07.602091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:07.603835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:07.688116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f88ed-405f-466b-8e6f-9b675de9ccdb service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:07.699547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:07.707975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:07.708604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:07.709205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] PATH_INFO: `/v3/users/e9d562828c3241d0a5d0f2253205c12f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:07.713597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d562828c3241d0a5d0f2253205c12f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:07.715650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:07.808511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d562828c3241d0a5d0f2253205c12f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:07.809342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d562828c3241d0a5d0f2253205c12f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:07.821289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d562828c3241d0a5d0f2253205c12f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:07.829775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d562828c3241d0a5d0f2253205c12f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:07.841573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d562828c3241d0a5d0f2253205c12f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:07.867109 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1143/2255] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:07 2022] DELETE /identity/v3/users/e9d562828c3241d0a5d0f2253205c12f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:07.871651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f837d-d6bd-4d7e-b6db-14568e841b44 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:07.872139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f837d-d6bd-4d7e-b6db-14568e841b44 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:07.872564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f837d-d6bd-4d7e-b6db-14568e841b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:07.915759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c31f837d-d6bd-4d7e-b6db-14568e841b44 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:07.917265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c31f837d-d6bd-4d7e-b6db-14568e841b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:08.055001 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1113/2256] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:08.064771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:08.067115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:08.123483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ec12-62a9-4eb0-8b52-5f54be0bd2ff None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:08.124067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ec12-62a9-4eb0-8b52-5f54be0bd2ff None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:08.124709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ec12-62a9-4eb0-8b52-5f54be0bd2ff None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:08.128499 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1114/2257] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:47:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:08.135442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:08.136043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:08.136657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:08.166700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:08.169615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca59cf-4382-4f13-80a5-537ed6054d1b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:08.171301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:08.180556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:08.181720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:08.182244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:08.184477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:08.212949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:08.215049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:08.231624 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1144/2258] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:08.281357 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1115/2259] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:08.302293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:08.304227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:08.321924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ea6b-d3ce-4cdf-9f91-f6d721522791 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:08.327753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:08.328826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:08.329717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:08.330010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:08.340069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:08.341813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:08.356485 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1145/2260] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:08.486317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:08.488159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:08.510930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe47d0-a06e-4db0-ab29-34d032d3c02e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:08.526599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:08.528881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:08.529894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:08.530533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] PATH_INFO: `/v3/projects/3a25839617304e069e93d96029612c18` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:08.533064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a25839617304e069e93d96029612c18)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:08.535249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:08.610059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a25839617304e069e93d96029612c18', 'request_id': 'req-a7b526c9-829d-42d8-986a-6ea9fa9532d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.618218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a25839617304e069e93d96029612c18', 'request_id': 'req-a7b526c9-829d-42d8-986a-6ea9fa9532d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.637770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a25839617304e069e93d96029612c18', 'request_id': 'req-a7b526c9-829d-42d8-986a-6ea9fa9532d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.656483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] The token cache is being invalidate because project 3a25839617304e069e93d96029612c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:08.656779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.657470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.659099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1116/2261] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:08 2022] DELETE /identity/v3/projects/3a25839617304e069e93d96029612c18 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:08.662997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:08.675942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250494a5-2308-4906-9828-9c1407bed30a service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:08.768050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:08.768936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:08.769197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:08.771040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] PATH_INFO: `/v3/users/741b5c98d4cf4293bc384ac581e3f809` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:08.771762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] RBAC: Authorizing `identity:delete_user(user_id=741b5c98d4cf4293bc384ac581e3f809)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:08.773817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:08.827822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741b5c98d4cf4293bc384ac581e3f809'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.828695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741b5c98d4cf4293bc384ac581e3f809'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.836918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741b5c98d4cf4293bc384ac581e3f809'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.837700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741b5c98d4cf4293bc384ac581e3f809'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.847329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89ac8b21-b72e-4a8e-918e-b4521b5c915d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741b5c98d4cf4293bc384ac581e3f809'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:08.873895 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1146/2262] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:08 2022] DELETE /identity/v3/users/741b5c98d4cf4293bc384ac581e3f809 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:09.271475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:09.272983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:09.296048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b526c9-829d-42d8-986a-6ea9fa9532d9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:09.374333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:09.375238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.375522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.375951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] PATH_INFO: `/v3/projects/e7eae2a8d55f4b1d8be7b6828b835afc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.377137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7eae2a8d55f4b1d8be7b6828b835afc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:09.379094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:09.427908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7eae2a8d55f4b1d8be7b6828b835afc', 'request_id': 'req-e1cdcea3-1279-4051-aadb-489f796c4ef6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:09.435082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7eae2a8d55f4b1d8be7b6828b835afc', 'request_id': 'req-e1cdcea3-1279-4051-aadb-489f796c4ef6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:09.442319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7eae2a8d55f4b1d8be7b6828b835afc', 'request_id': 'req-e1cdcea3-1279-4051-aadb-489f796c4ef6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:09.453747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] The token cache is being invalidate because project e7eae2a8d55f4b1d8be7b6828b835afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:09.454715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:09.455459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e1cdcea3-1279-4051-aadb-489f796c4ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:09.457441 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1117/2263] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:09 2022] DELETE /identity/v3/projects/e7eae2a8d55f4b1d8be7b6828b835afc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:09.462110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f1ee1-dcac-4844-a8d3-48815da2d6f0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.462527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f1ee1-dcac-4844-a8d3-48815da2d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.462914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f1ee1-dcac-4844-a8d3-48815da2d6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.482708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c58f1ee1-dcac-4844-a8d3-48815da2d6f0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:09.484013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c58f1ee1-dcac-4844-a8d3-48815da2d6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:09.576190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1147/2264] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:09.580486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa119-31df-4c1a-81bc-160801c61a3b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.583179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa119-31df-4c1a-81bc-160801c61a3b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.584146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afa119-31df-4c1a-81bc-160801c61a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.614270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-39afa119-31df-4c1a-81bc-160801c61a3b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:09.615825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39afa119-31df-4c1a-81bc-160801c61a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:09.629584 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1118/2265] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:09.634008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f1ee1-dcac-4844-a8d3-48815da2d6f0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:09.644683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f1ee1-dcac-4844-a8d3-48815da2d6f0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:09.651314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:09.652003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.653024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.653451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.654239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:09.654551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:09.656226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:09.669277 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1148/2266] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:09.679546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afa119-31df-4c1a-81bc-160801c61a3b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:09.689007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afa119-31df-4c1a-81bc-160801c61a3b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:09.696214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:09.697145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.697428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.697700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.698389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:09.700350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:09.727394 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1119/2267] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:09 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:09.732466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:09.745220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad7e27-3632-4f28-91c4-7613b8e279bb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:09.852508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674973e-ab57-4b22-99e1-683ad64eeeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:09.853392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674973e-ab57-4b22-99e1-683ad64eeeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.853768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674973e-ab57-4b22-99e1-683ad64eeeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.854161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674973e-ab57-4b22-99e1-683ad64eeeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.855112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674973e-ab57-4b22-99e1-683ad64eeeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:09.857700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674973e-ab57-4b22-99e1-683ad64eeeb8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:09.889606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1149/2268] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:09 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:09.891027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:09.903148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a4131-ab6b-41b9-ac8d-702222a3efe6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:09.924637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:09.925521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.925863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.926329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.927326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:09.933505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:09.934031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:09.934332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:09.954907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:09.977941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:09.978281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:09.979667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1120/2269] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:09.983772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:09.997573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5dc1f-bc8b-4dff-b9b9-a8a65a24fb15 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.005407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.006431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.006715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.007011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.007729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.009902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.024158 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1121/2270] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:10.028410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.039514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb459a8-b618-4f40-97e4-98079a128a1d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.044723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec08b-67f1-4c37-a4c9-f12b0ff62da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.045593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec08b-67f1-4c37-a4c9-f12b0ff62da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.045878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec08b-67f1-4c37-a4c9-f12b0ff62da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.046252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec08b-67f1-4c37-a4c9-f12b0ff62da6 admin admin] PATH_INFO: `/v3/projects/14f007f587fe489d826051ba7906b98e/users/6bb542cbe0864187845470e877c56bbc/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.050866 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1150/2271] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:47:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:10.068497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec08b-67f1-4c37-a4c9-f12b0ff62da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f007f587fe489d826051ba7906b98e, user_id=6bb542cbe0864187845470e877c56bbc, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.069701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.071102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec08b-67f1-4c37-a4c9-f12b0ff62da6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.071212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:10.086825 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1122/2272] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:10 2022] PUT /identity/v3/projects/14f007f587fe489d826051ba7906b98e/users/6bb542cbe0864187845470e877c56bbc/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:10.097584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594304dc-be2e-44c9-918f-72d298bfd890 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.099178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594304dc-be2e-44c9-918f-72d298bfd890 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.099481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594304dc-be2e-44c9-918f-72d298bfd890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.130131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-594304dc-be2e-44c9-918f-72d298bfd890 None None] MFA Rules not processed for user `6bb542cbe0864187845470e877c56bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:10.131546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-594304dc-be2e-44c9-918f-72d298bfd890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:10.172488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d9790-0ac8-4ad9-b6f7-874a621a06c4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.217535 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1123/2273] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:10.222620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594304dc-be2e-44c9-918f-72d298bfd890 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.268259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.269039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.269321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.269594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.294800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594304dc-be2e-44c9-918f-72d298bfd890 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.299350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.300055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.300340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.300615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.301297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.303362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.334172 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1124/2274] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:10 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:10.337468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.338101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.339151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.348154 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1151/2275] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:47:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:47:10.405521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865867f-c7f1-4fc4-8622-9b161c6cc8ce admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.411134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.413333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.413774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.414330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.415373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.417622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.441210 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1125/2276] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:10 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:10.445264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.461884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6a38b-6938-468f-8da2-72ec6af311fe service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.466985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.467658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.467974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.468242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.468972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.472686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.494428 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1152/2277] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:10.495206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.507178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc920-46c4-46dd-bf29-c76905ac705c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.516211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.518060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.518342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.523409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] PATH_INFO: `/v3/projects/2d7b0588895b43eb9b8d3deb573c2fdf/users/8a07e4d0d54d4dec8053297f46cca2c6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.548780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7b0588895b43eb9b8d3deb573c2fdf, user_id=8a07e4d0d54d4dec8053297f46cca2c6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.552178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.570723 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1126/2278] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:10 2022] PUT /identity/v3/projects/2d7b0588895b43eb9b8d3deb573c2fdf/users/8a07e4d0d54d4dec8053297f46cca2c6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:10.578279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.592638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b2c28-48d2-4336-bc09-e2659e13566e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.661638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e745c-c20a-430d-b6b0-1639a0c3c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.662309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e745c-c20a-430d-b6b0-1639a0c3c73e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.662701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e745c-c20a-430d-b6b0-1639a0c3c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.662907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e745c-c20a-430d-b6b0-1639a0c3c73e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.663662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e745c-c20a-430d-b6b0-1639a0c3c73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.665334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e745c-c20a-430d-b6b0-1639a0c3c73e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.676952 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1153/2279] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:10.681737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:10.693639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf16eb5-cee0-4a5b-bad3-28ae6e6c0166 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:10.699062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:10.699949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.700232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.700507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] PATH_INFO: `/v3/projects/2d7b0588895b43eb9b8d3deb573c2fdf/users/8a07e4d0d54d4dec8053297f46cca2c6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.702644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7b0588895b43eb9b8d3deb573c2fdf, user_id=8a07e4d0d54d4dec8053297f46cca2c6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:10.706431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:10.717124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1127/2280] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:10 2022] PUT /identity/v3/projects/2d7b0588895b43eb9b8d3deb573c2fdf/users/8a07e4d0d54d4dec8053297f46cca2c6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:10.729969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b20c-5b76-49be-8c2c-85ca271fb1b2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:10.730509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b20c-5b76-49be-8c2c-85ca271fb1b2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:10.730976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2b20c-5b76-49be-8c2c-85ca271fb1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:10.781284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fba2b20c-5b76-49be-8c2c-85ca271fb1b2 None None] MFA Rules not processed for user `8a07e4d0d54d4dec8053297f46cca2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:10.782790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fba2b20c-5b76-49be-8c2c-85ca271fb1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:10.869121 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1154/2281] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:11.021548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:11.022634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce21e15-e40a-4b70-b20a-ba46d4e60a74 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:11.022963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce21e15-e40a-4b70-b20a-ba46d4e60a74 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:11.023240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce21e15-e40a-4b70-b20a-ba46d4e60a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:11.054492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8ce21e15-e40a-4b70-b20a-ba46d4e60a74 None None] MFA Rules not processed for user `c562e7dec6d34cd0a7fc7cea14fa5e74`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:11.057042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8ce21e15-e40a-4b70-b20a-ba46d4e60a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:11.132517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81756ec3-0f33-4510-9fd5-aeea2db37b38 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:11.140463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:11.140643 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1155/2282] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:11.144280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:11.144568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:11.144891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] PATH_INFO: `/v3/users/6bb542cbe0864187845470e877c56bbc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:11.146193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb542cbe0864187845470e877c56bbc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:11.148804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:11.227350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb542cbe0864187845470e877c56bbc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.235153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb542cbe0864187845470e877c56bbc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.236377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb542cbe0864187845470e877c56bbc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.236977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb542cbe0864187845470e877c56bbc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.247726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb542cbe0864187845470e877c56bbc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.265894 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1128/2283] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:11 2022] DELETE /identity/v3/users/6bb542cbe0864187845470e877c56bbc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:11.270595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:11.270595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:11.270876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:11.288436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:11.290255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:11.378541 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1156/2284] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:11.398030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:11.399516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:11.462743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1287a6-bf47-4088-bf51-6692aa901dc2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:11.466536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:11.467230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:11.467652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:11.467930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:11.478886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:11.480344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:11.492446 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1129/2285] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:11.791873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:11.793494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:11.816547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580b75-578f-4d41-be6d-1c4e760a1351 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:11.829973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:11.831365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:11.831650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:11.831921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] PATH_INFO: `/v3/projects/14f007f587fe489d826051ba7906b98e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:11.833634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f007f587fe489d826051ba7906b98e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:11.835997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:11.892340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f007f587fe489d826051ba7906b98e', 'request_id': 'req-cced3123-d1c0-4719-9a46-cfa0145aa67e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.899823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f007f587fe489d826051ba7906b98e', 'request_id': 'req-cced3123-d1c0-4719-9a46-cfa0145aa67e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.916908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f007f587fe489d826051ba7906b98e', 'request_id': 'req-cced3123-d1c0-4719-9a46-cfa0145aa67e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.932717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] The token cache is being invalidate because project 14f007f587fe489d826051ba7906b98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:11.933243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.934141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cced3123-d1c0-4719-9a46-cfa0145aa67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:11.939263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1157/2286] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:11 2022] DELETE /identity/v3/projects/14f007f587fe489d826051ba7906b98e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:11.940470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:11.952508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d76159-7055-40c4-91f2-7b748b303abd service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:12.022671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:12.023742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:12.024027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:12.024305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] PATH_INFO: `/v3/users/8a07e4d0d54d4dec8053297f46cca2c6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:12.025614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a07e4d0d54d4dec8053297f46cca2c6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:12.027819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:12.115647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a07e4d0d54d4dec8053297f46cca2c6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.133454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a07e4d0d54d4dec8053297f46cca2c6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.134128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a07e4d0d54d4dec8053297f46cca2c6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.134857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a07e4d0d54d4dec8053297f46cca2c6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.149449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a07e4d0d54d4dec8053297f46cca2c6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.165012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bddec-efd1-43a9-8590-38bc366f8a81 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:12.165301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bddec-efd1-43a9-8590-38bc366f8a81 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:12.165571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bddec-efd1-43a9-8590-38bc366f8a81 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:12.167318 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1158/2287] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:47:12.170980 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1130/2288] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:11 2022] DELETE /identity/v3/users/8a07e4d0d54d4dec8053297f46cca2c6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:12.185045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:12.185409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:12.185761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:12.219646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:12.220998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:12.366728 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1159/2289] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:12.394624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:12.396606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:12.418301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57db5aa-4cef-4377-811a-d9911e2335e8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:12.424394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104cb64-6771-40bc-a2b0-ab9fd6268dd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:12.425219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104cb64-6771-40bc-a2b0-ab9fd6268dd4 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:12.425514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104cb64-6771-40bc-a2b0-ab9fd6268dd4 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:12.425781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104cb64-6771-40bc-a2b0-ab9fd6268dd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:12.436116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104cb64-6771-40bc-a2b0-ab9fd6268dd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:12.438065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104cb64-6771-40bc-a2b0-ab9fd6268dd4 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:12.449022 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1131/2290] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:12.659246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:12.661102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:12.783069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e50bc-3e0f-4493-bf81-93cbe4a2a4d9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:12.787664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:12.789086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:12.789288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:12.789548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] PATH_INFO: `/v3/projects/2d7b0588895b43eb9b8d3deb573c2fdf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:12.790856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7b0588895b43eb9b8d3deb573c2fdf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:12.792930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:12.848253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7b0588895b43eb9b8d3deb573c2fdf', 'request_id': 'req-e08537bc-1b29-496b-bb5f-a2895fd38505'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.854348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7b0588895b43eb9b8d3deb573c2fdf', 'request_id': 'req-e08537bc-1b29-496b-bb5f-a2895fd38505'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.863003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7b0588895b43eb9b8d3deb573c2fdf', 'request_id': 'req-e08537bc-1b29-496b-bb5f-a2895fd38505'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.873041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] The token cache is being invalidate because project 2d7b0588895b43eb9b8d3deb573c2fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:12.873325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.873940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e08537bc-1b29-496b-bb5f-a2895fd38505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:12.875554 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1160/2291] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:12 2022] DELETE /identity/v3/projects/2d7b0588895b43eb9b8d3deb573c2fdf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:12.880948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba1d8b-8120-4cae-a161-2445fa8e6686 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:12.881233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba1d8b-8120-4cae-a161-2445fa8e6686 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:12.881505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba1d8b-8120-4cae-a161-2445fa8e6686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:12.898688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6bba1d8b-8120-4cae-a161-2445fa8e6686 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:12.899980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6bba1d8b-8120-4cae-a161-2445fa8e6686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:12.959183 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1132/2292] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:12.966940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8418-b9cf-47a5-baf5-82d985d80522 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:12.967226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8418-b9cf-47a5-baf5-82d985d80522 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:12.967499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8418-b9cf-47a5-baf5-82d985d80522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:12.985965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0eaf8418-b9cf-47a5-baf5-82d985d80522 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:12.987196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0eaf8418-b9cf-47a5-baf5-82d985d80522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:12.998734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1161/2293] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:13.000036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba1d8b-8120-4cae-a161-2445fa8e6686 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.014362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba1d8b-8120-4cae-a161-2445fa8e6686 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.019752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.020407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.020686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.020957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.021735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:13.022037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.023658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.035518 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1133/2294] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:13.039980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8418-b9cf-47a5-baf5-82d985d80522 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.049204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8418-b9cf-47a5-baf5-82d985d80522 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.054017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.054762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.055084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.055379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.056059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.057969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.083718 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1162/2295] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:13 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:13.087892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.098577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21ac5-4bcf-4fa0-a33d-26457adbb81f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.155706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.156409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.156692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.157695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.158392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.160363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.180472 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1134/2296] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:13 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:13.184615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.197490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6df86-b2e5-416f-9981-ed6f86210011 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.200551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.200756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.201046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.201320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.202188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.204759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.216634 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1163/2297] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:13.221903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.235076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73b485-b504-4dc8-943a-334673437107 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.240496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a3fd2-4f38-4fae-bfdd-4aa5692b5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.241190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a3fd2-4f38-4fae-bfdd-4aa5692b5d0d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.241477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a3fd2-4f38-4fae-bfdd-4aa5692b5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.241749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a3fd2-4f38-4fae-bfdd-4aa5692b5d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.242524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a3fd2-4f38-4fae-bfdd-4aa5692b5d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.244450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a3fd2-4f38-4fae-bfdd-4aa5692b5d0d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.254701 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1135/2298] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:13.258879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.270090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb42e4-e5bd-4939-b2c0-cb21111fcbd8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.274917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.276063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.276352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.276626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] PATH_INFO: `/v3/projects/268f4ddc7fd04214ad6c9decbd9ecb9f/users/8c5074f95f6c4bf6b58c6a30ae2483b9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.297268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=268f4ddc7fd04214ad6c9decbd9ecb9f, user_id=8c5074f95f6c4bf6b58c6a30ae2483b9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.300623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.329573 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1164/2299] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:13 2022] PUT /identity/v3/projects/268f4ddc7fd04214ad6c9decbd9ecb9f/users/8c5074f95f6c4bf6b58c6a30ae2483b9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:13.334253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905bd38-3589-4efc-8e21-0de20fd23528 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.334653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905bd38-3589-4efc-8e21-0de20fd23528 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.335023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905bd38-3589-4efc-8e21-0de20fd23528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.361580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2905bd38-3589-4efc-8e21-0de20fd23528 None None] MFA Rules not processed for user `8c5074f95f6c4bf6b58c6a30ae2483b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:13.362922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2905bd38-3589-4efc-8e21-0de20fd23528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:13.441121 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1136/2300] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:13.445357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.521570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54f0eb-d2a7-44f6-9fb1-53190ce8ce2a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.526435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.527208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.527488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.527753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.528432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.530342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.556155 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1165/2301] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:13 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:13.560310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905bd38-3589-4efc-8e21-0de20fd23528 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.572023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905bd38-3589-4efc-8e21-0de20fd23528 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.632931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.633609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.633892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.634165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.634898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.636887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.659759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1137/2302] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:13 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:13.660960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.671623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeee2ff-7e8b-43a6-8506-a02af4aa2656 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.676577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.677796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.678283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.678783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.679627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.681484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.693348 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1166/2303] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:13.697811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.708273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2b8c-9462-46d5-b4c9-7bf52824dcb0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.712979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.713846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.714126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.714396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] PATH_INFO: `/v3/projects/a797e16ee5be40b1b5406504fb730b14/users/8682f696e068486896b48a3bef1a8b0e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.731476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a797e16ee5be40b1b5406504fb730b14, user_id=8682f696e068486896b48a3bef1a8b0e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.734261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.747533 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1138/2304] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:13 2022] PUT /identity/v3/projects/a797e16ee5be40b1b5406504fb730b14/users/8682f696e068486896b48a3bef1a8b0e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:13.764325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.777488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e40dd-44ae-4fcd-bd2c-c56bdb22664c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.869430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cff35c-3c4c-4aa7-821b-7a7fbda05192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.870173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cff35c-3c4c-4aa7-821b-7a7fbda05192 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.870480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cff35c-3c4c-4aa7-821b-7a7fbda05192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.870727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cff35c-3c4c-4aa7-821b-7a7fbda05192 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.871891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cff35c-3c4c-4aa7-821b-7a7fbda05192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.873574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cff35c-3c4c-4aa7-821b-7a7fbda05192 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.898062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1167/2305] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:13.902056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:13.914013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a36b6-2167-4797-b3ee-4ee5c2b81ab5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:13.919845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:13.920741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.921021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.921291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] PATH_INFO: `/v3/projects/a797e16ee5be40b1b5406504fb730b14/users/8682f696e068486896b48a3bef1a8b0e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.924309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a797e16ee5be40b1b5406504fb730b14, user_id=8682f696e068486896b48a3bef1a8b0e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:13.927796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:13.951810 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1139/2306] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:13 2022] PUT /identity/v3/projects/a797e16ee5be40b1b5406504fb730b14/users/8682f696e068486896b48a3bef1a8b0e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:13.953983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b314-540c-4cdb-a4c9-4f4f1fdf249e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:13.954276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b314-540c-4cdb-a4c9-4f4f1fdf249e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:13.954552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8b314-540c-4cdb-a4c9-4f4f1fdf249e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:13.997539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-99b8b314-540c-4cdb-a4c9-4f4f1fdf249e None None] MFA Rules not processed for user `8682f696e068486896b48a3bef1a8b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:13.999184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-99b8b314-540c-4cdb-a4c9-4f4f1fdf249e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:14.117869 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1168/2307] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:14.290362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:14.292147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:14.371493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f64ae-bdca-4cde-8674-24a122221eb4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:14.386243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366bd66-934a-48bf-8f1c-8a30daebdb31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:14.388309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bd66-934a-48bf-8f1c-8a30daebdb31 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:14.388808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bd66-934a-48bf-8f1c-8a30daebdb31 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:14.389351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bd66-934a-48bf-8f1c-8a30daebdb31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:14.420298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366bd66-934a-48bf-8f1c-8a30daebdb31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:14.421929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366bd66-934a-48bf-8f1c-8a30daebdb31 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:14.444266 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1140/2308] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:14.570569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b314-540c-4cdb-a4c9-4f4f1fdf249e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:14.644292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8b314-540c-4cdb-a4c9-4f4f1fdf249e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:14.649019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:14.649933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:14.650288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:14.650652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] PATH_INFO: `/v3/users/8c5074f95f6c4bf6b58c6a30ae2483b9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:14.652210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5074f95f6c4bf6b58c6a30ae2483b9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:14.654361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:14.711405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5074f95f6c4bf6b58c6a30ae2483b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:14.712115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5074f95f6c4bf6b58c6a30ae2483b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:14.720487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5074f95f6c4bf6b58c6a30ae2483b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:14.721251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5074f95f6c4bf6b58c6a30ae2483b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:14.731672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5074f95f6c4bf6b58c6a30ae2483b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:14.762233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1169/2309] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:14 2022] DELETE /identity/v3/users/8c5074f95f6c4bf6b58c6a30ae2483b9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:14.767668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:14.767958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:14.768236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:14.787960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:14.789171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:14.863721 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1141/2310] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:14.876444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:14.879413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:14.941739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dbf8f-c371-4f54-9cc5-3ae628cf44e3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:14.944296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:14.945026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:14.945309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:14.945585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:14.956819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:14.958273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:14.968653 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1170/2311] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:15.525910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:15.528071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:15.551709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc1e0-7075-4bd6-ac2f-14fafe24d33b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:15.560150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:15.561266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:15.561678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:15.562018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] PATH_INFO: `/v3/projects/268f4ddc7fd04214ad6c9decbd9ecb9f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:15.564359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] RBAC: Authorizing `identity:delete_project(project_id=268f4ddc7fd04214ad6c9decbd9ecb9f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:15.566633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:15.629192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '268f4ddc7fd04214ad6c9decbd9ecb9f', 'request_id': 'req-6e7c2d8d-121b-418b-adf0-19634b38819c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.636735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '268f4ddc7fd04214ad6c9decbd9ecb9f', 'request_id': 'req-6e7c2d8d-121b-418b-adf0-19634b38819c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.645661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '268f4ddc7fd04214ad6c9decbd9ecb9f', 'request_id': 'req-6e7c2d8d-121b-418b-adf0-19634b38819c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.657522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] The token cache is being invalidate because project 268f4ddc7fd04214ad6c9decbd9ecb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:15.657816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.658469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.660279 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1142/2312] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:15 2022] DELETE /identity/v3/projects/268f4ddc7fd04214ad6c9decbd9ecb9f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:15.665070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:15.681934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d09f8-c93c-4d3f-aec0-df7f378e75c3 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:15.741503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:15.742372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:15.742652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:15.742962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] PATH_INFO: `/v3/users/8682f696e068486896b48a3bef1a8b0e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:15.744149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8682f696e068486896b48a3bef1a8b0e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:15.746085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:15.792344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8682f696e068486896b48a3bef1a8b0e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.793652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8682f696e068486896b48a3bef1a8b0e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.803592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8682f696e068486896b48a3bef1a8b0e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.804573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8682f696e068486896b48a3bef1a8b0e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.813855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ac8c6d1-6ccb-4024-b935-c09e13795a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8682f696e068486896b48a3bef1a8b0e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:15.837790 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1171/2313] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:15 2022] DELETE /identity/v3/users/8682f696e068486896b48a3bef1a8b0e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:16.622400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:16.624659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:16.664914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c2d8d-121b-418b-adf0-19634b38819c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:16.762307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:16.763262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:16.763612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:16.763948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] PATH_INFO: `/v3/projects/a797e16ee5be40b1b5406504fb730b14` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:16.766004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a797e16ee5be40b1b5406504fb730b14)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:16.768307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:16.823879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a797e16ee5be40b1b5406504fb730b14', 'request_id': 'req-20143426-0a5c-45ff-ac27-1798b3d43db5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:16.831813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a797e16ee5be40b1b5406504fb730b14', 'request_id': 'req-20143426-0a5c-45ff-ac27-1798b3d43db5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:16.840469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a797e16ee5be40b1b5406504fb730b14', 'request_id': 'req-20143426-0a5c-45ff-ac27-1798b3d43db5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:16.853914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] The token cache is being invalidate because project a797e16ee5be40b1b5406504fb730b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:16.854274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:16.855052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-20143426-0a5c-45ff-ac27-1798b3d43db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:16.856982 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1143/2314] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:16 2022] DELETE /identity/v3/projects/a797e16ee5be40b1b5406504fb730b14 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:16.862352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4342d6-2e3d-4afe-a38c-e0d16848e460 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:16.862902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4342d6-2e3d-4afe-a38c-e0d16848e460 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:16.863029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4342d6-2e3d-4afe-a38c-e0d16848e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:16.883013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0f4342d6-2e3d-4afe-a38c-e0d16848e460 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:16.884166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0f4342d6-2e3d-4afe-a38c-e0d16848e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:16.962421 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1172/2315] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:16.970626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf16c-9dd0-4eee-ab93-83d49c5f5df4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:16.970948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf16c-9dd0-4eee-ab93-83d49c5f5df4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:16.971256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf16c-9dd0-4eee-ab93-83d49c5f5df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:16.990216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-85fdf16c-9dd0-4eee-ab93-83d49c5f5df4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:16.991655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-85fdf16c-9dd0-4eee-ab93-83d49c5f5df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:17.002534 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1144/2316] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:17.007752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4342d6-2e3d-4afe-a38c-e0d16848e460 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.024233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4342d6-2e3d-4afe-a38c-e0d16848e460 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.033539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.034357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.034748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.035170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.036078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:17.036479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.038752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.055437 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1173/2317] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:17.056559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf16c-9dd0-4eee-ab93-83d49c5f5df4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.067945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdf16c-9dd0-4eee-ab93-83d49c5f5df4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.078814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.080582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.081052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.081591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.082811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.084990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.137377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1145/2318] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:17 2022] POST /identity/v3/projects => generated 399 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:17.138130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.151879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d72f1b-b3cb-401d-8fe2-6fb4c18a9784 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.213814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.214415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.214727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.214990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.216345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.218530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.242482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1174/2319] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:17 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:17.247123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.257365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bfd14-2bb3-4463-8d37-de79531bac49 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.262892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.263552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.263835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.264106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.264822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.266709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.278307 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1146/2320] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:17.282966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.295462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26602f59-5226-4258-a03d-dcd6bbb5908d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.302189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21c0f7-71ce-4d5f-b700-d6f9fb7ec721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.303268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c0f7-71ce-4d5f-b700-d6f9fb7ec721 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.303613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c0f7-71ce-4d5f-b700-d6f9fb7ec721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.303893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21c0f7-71ce-4d5f-b700-d6f9fb7ec721 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.304629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21c0f7-71ce-4d5f-b700-d6f9fb7ec721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.306504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21c0f7-71ce-4d5f-b700-d6f9fb7ec721 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.318303 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1175/2321] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:17.323552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.337977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62b409-e14a-46a6-a98d-85d4261869ed admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.346268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.356358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.356358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.356358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] PATH_INFO: `/v3/projects/b5d023c7f4a049c2b0369dff8942e141/users/53b47423fc234f879da69fd46934687f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.366261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d023c7f4a049c2b0369dff8942e141, user_id=53b47423fc234f879da69fd46934687f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.369080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.383766 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1147/2322] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:17 2022] PUT /identity/v3/projects/b5d023c7f4a049c2b0369dff8942e141/users/53b47423fc234f879da69fd46934687f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:17.394987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25c6f-4e22-4295-b45f-0607942b0ed4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.395282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25c6f-4e22-4295-b45f-0607942b0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.395560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f25c6f-4e22-4295-b45f-0607942b0ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.425884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e7f25c6f-4e22-4295-b45f-0607942b0ed4 None None] MFA Rules not processed for user `53b47423fc234f879da69fd46934687f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:17.427221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e7f25c6f-4e22-4295-b45f-0607942b0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:17.489472 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1176/2323] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:17.494038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.556688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d64ae-01be-41a7-bae3-14ccfc43a08c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.563340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.564012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.564296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.564575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.565277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.567240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.596026 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1148/2324] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:17 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:17.600115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25c6f-4e22-4295-b45f-0607942b0ed4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.612094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f25c6f-4e22-4295-b45f-0607942b0ed4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.690717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.691418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.691701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.691974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.692693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.694643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.717007 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1177/2325] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:17 2022] POST /identity/v3/users => generated 306 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:17.721546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.732471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7977a9b-a38e-49c2-84ae-ad3d7d0b1564 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.737440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.738238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.738523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.738832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.739837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.742244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.752355 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1149/2326] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:17.756413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.767175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e72aa-0da5-4494-a084-8ed6ee82d1f6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.771859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.772737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.773021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.773297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] PATH_INFO: `/v3/projects/5ca04ac90b1a422fb2f841373067cb40/users/8712cf95092648e39e8873f9e9caec8c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.789394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca04ac90b1a422fb2f841373067cb40, user_id=8712cf95092648e39e8873f9e9caec8c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.792184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.806147 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1178/2327] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:17 2022] PUT /identity/v3/projects/5ca04ac90b1a422fb2f841373067cb40/users/8712cf95092648e39e8873f9e9caec8c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:17.809862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.821930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310fd0-c3fc-4d24-8ebe-ca9016b00cbd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.889438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e4521-2958-4486-b80c-c4699ea4ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.890228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4521-2958-4486-b80c-c4699ea4ebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.890615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4521-2958-4486-b80c-c4699ea4ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.891021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e4521-2958-4486-b80c-c4699ea4ebc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.893151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4521-2958-4486-b80c-c4699ea4ebc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.895372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e4521-2958-4486-b80c-c4699ea4ebc5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.905382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1150/2328] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:17.909500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:17.922714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a16f82-f536-4235-aef8-19ab57748964 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:17.927705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:17.928750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.929123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.929463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] PATH_INFO: `/v3/projects/5ca04ac90b1a422fb2f841373067cb40/users/8712cf95092648e39e8873f9e9caec8c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.931631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca04ac90b1a422fb2f841373067cb40, user_id=8712cf95092648e39e8873f9e9caec8c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:17.934619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:17.945625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1179/2329] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:17 2022] PUT /identity/v3/projects/5ca04ac90b1a422fb2f841373067cb40/users/8712cf95092648e39e8873f9e9caec8c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:17.956929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4c85-52a1-4b28-ab51-d06480efd27a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:17.957220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4c85-52a1-4b28-ab51-d06480efd27a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:17.957500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da4c85-52a1-4b28-ab51-d06480efd27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:17.989636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a1da4c85-52a1-4b28-ab51-d06480efd27a None None] MFA Rules not processed for user `8712cf95092648e39e8873f9e9caec8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:17.991155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a1da4c85-52a1-4b28-ab51-d06480efd27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:18.073010 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1151/2330] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:18.084068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:18.085954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:18.159521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee5927-86cc-4a34-97ee-e1a7aae67f0a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:18.167698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:18.168359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:18.168642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:18.168920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:18.227960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:18.229561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:18.238901 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1180/2331] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:18.291512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4c85-52a1-4b28-ab51-d06480efd27a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:18.308826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da4c85-52a1-4b28-ab51-d06480efd27a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:18.314895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c598bb-a663-427c-b6d2-2c0334a17cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:18.315536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c598bb-a663-427c-b6d2-2c0334a17cd2 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:18.315820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c598bb-a663-427c-b6d2-2c0334a17cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:18.316095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c598bb-a663-427c-b6d2-2c0334a17cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:18.324511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c598bb-a663-427c-b6d2-2c0334a17cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:18.326100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c598bb-a663-427c-b6d2-2c0334a17cd2 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:18.335457 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1152/2332] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:18.472623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:18.533489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e62f6b-54c6-4310-b983-905a45292dfd service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:18.540363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:18.542100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:18.542382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:18.542660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] PATH_INFO: `/v3/users/53b47423fc234f879da69fd46934687f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:18.543919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b47423fc234f879da69fd46934687f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:18.545852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:18.595904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b47423fc234f879da69fd46934687f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:18.596556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b47423fc234f879da69fd46934687f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:18.603464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b47423fc234f879da69fd46934687f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:18.604093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b47423fc234f879da69fd46934687f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:18.614564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b47423fc234f879da69fd46934687f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:18.631626 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1181/2333] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:18 2022] DELETE /identity/v3/users/53b47423fc234f879da69fd46934687f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:18.636322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817d0b-6850-444b-bd0c-3ce7314a05d1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:18.636615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817d0b-6850-444b-bd0c-3ce7314a05d1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:18.636895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817d0b-6850-444b-bd0c-3ce7314a05d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:18.654849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9c817d0b-6850-444b-bd0c-3ce7314a05d1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:18.656046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9c817d0b-6850-444b-bd0c-3ce7314a05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:18.715570 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1153/2334] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:18.725931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:18.727693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:18.784498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460724f-dafc-4ba0-b6ae-c02c3265a102 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:18.785474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460724f-dafc-4ba0-b6ae-c02c3265a102 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:18.786186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460724f-dafc-4ba0-b6ae-c02c3265a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:18.807115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb54b6-99a6-4de5-bd7a-b08038082186 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:18.811793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:18.812316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d460724f-dafc-4ba0-b6ae-c02c3265a102 None None] MFA Rules not processed for user `85eeaeaf9f1c464f8d45eff93bab41cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:18.812997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:18.813489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:18.813856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d460724f-dafc-4ba0-b6ae-c02c3265a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:18.814658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:18.829379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:18.830911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:18.855114 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1182/2335] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:47:18.907227 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1154/2336] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:19.268079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:19.271513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:19.314016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df51e0-113c-43c7-8a8f-12f41df21aeb service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:19.319493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:19.321895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:19.322833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:19.323273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] PATH_INFO: `/v3/projects/b5d023c7f4a049c2b0369dff8942e141` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:19.324740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d023c7f4a049c2b0369dff8942e141)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:19.326899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:19.398633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d023c7f4a049c2b0369dff8942e141', 'request_id': 'req-c70af8ff-1109-43ae-a350-68122958cca9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.409381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d023c7f4a049c2b0369dff8942e141', 'request_id': 'req-c70af8ff-1109-43ae-a350-68122958cca9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.417657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d023c7f4a049c2b0369dff8942e141', 'request_id': 'req-c70af8ff-1109-43ae-a350-68122958cca9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.429045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] The token cache is being invalidate because project b5d023c7f4a049c2b0369dff8942e141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:19.429335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.430175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.431994 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1183/2337] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:19 2022] DELETE /identity/v3/projects/b5d023c7f4a049c2b0369dff8942e141 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:19.436624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460724f-dafc-4ba0-b6ae-c02c3265a102 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:19.448642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460724f-dafc-4ba0-b6ae-c02c3265a102 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:19.518910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:19.520066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:19.520517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:19.521025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] PATH_INFO: `/v3/users/8712cf95092648e39e8873f9e9caec8c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:19.522373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8712cf95092648e39e8873f9e9caec8c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:19.524779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:19.596221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8712cf95092648e39e8873f9e9caec8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.605895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8712cf95092648e39e8873f9e9caec8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.608979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8712cf95092648e39e8873f9e9caec8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.609625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8712cf95092648e39e8873f9e9caec8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.618629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4424887b-a5bd-4728-af32-63709f576d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8712cf95092648e39e8873f9e9caec8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:19.642850 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1155/2338] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:19 2022] DELETE /identity/v3/users/8712cf95092648e39e8873f9e9caec8c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:20.032651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:20.034518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:20.049671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70af8ff-1109-43ae-a350-68122958cca9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:20.109176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:20.110591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.110967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.111248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] PATH_INFO: `/v3/projects/5ca04ac90b1a422fb2f841373067cb40` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.112474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca04ac90b1a422fb2f841373067cb40)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:20.114493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:20.165430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca04ac90b1a422fb2f841373067cb40', 'request_id': 'req-c1f33b70-5d68-4b0f-90b0-c3798e28824c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:20.172942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca04ac90b1a422fb2f841373067cb40', 'request_id': 'req-c1f33b70-5d68-4b0f-90b0-c3798e28824c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:20.181379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca04ac90b1a422fb2f841373067cb40', 'request_id': 'req-c1f33b70-5d68-4b0f-90b0-c3798e28824c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:20.193304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] The token cache is being invalidate because project 5ca04ac90b1a422fb2f841373067cb40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:20.193777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:20.194540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1f33b70-5d68-4b0f-90b0-c3798e28824c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:20.200565 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1184/2339] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:20 2022] DELETE /identity/v3/projects/5ca04ac90b1a422fb2f841373067cb40 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:20.214866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30b39-8ef9-4f00-83fc-ca16281d227c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.214866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30b39-8ef9-4f00-83fc-ca16281d227c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.214866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f30b39-8ef9-4f00-83fc-ca16281d227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.232967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-01f30b39-8ef9-4f00-83fc-ca16281d227c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:20.234554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-01f30b39-8ef9-4f00-83fc-ca16281d227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:20.299352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1156/2340] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:20.308042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd6b4-fb39-4fdc-98cf-dee36888c6e2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.308577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd6b4-fb39-4fdc-98cf-dee36888c6e2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.308693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd6b4-fb39-4fdc-98cf-dee36888c6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.335610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-445bd6b4-fb39-4fdc-98cf-dee36888c6e2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:20.336829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-445bd6b4-fb39-4fdc-98cf-dee36888c6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:20.348089 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1185/2341] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:20.352513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f30b39-8ef9-4f00-83fc-ca16281d227c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:20.367681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f30b39-8ef9-4f00-83fc-ca16281d227c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:20.374041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:20.375082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.375961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.376453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.378051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:20.379143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:20.382115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:20.395654 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1157/2342] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:20.400325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd6b4-fb39-4fdc-98cf-dee36888c6e2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:20.411732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd6b4-fb39-4fdc-98cf-dee36888c6e2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:20.420212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:20.421212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.423036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.425352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.426104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:20.428091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:20.467479 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1186/2343] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:20 2022] POST /identity/v3/projects => generated 409 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:20.468273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:20.479948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c9a0-80c5-41f4-9e9e-def63eb9f189 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:20.560625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:20.561476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.561846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.562341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.563351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:20.565574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:20.588773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1158/2344] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:20 2022] POST /identity/v3/users => generated 305 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:20.593021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:20.605694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdfe4f-e264-4268-9011-b895843248f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:20.610567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:20.611502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.611959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.612559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.613448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:20.615587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:20.627104 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1187/2345] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:20.632257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:20.649347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5119715-9d11-4425-afc3-83cacdfaa21c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:20.655299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ef6d0-18a9-4f47-b1d4-78a72b6a1ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:20.656261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef6d0-18a9-4f47-b1d4-78a72b6a1ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.656261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef6d0-18a9-4f47-b1d4-78a72b6a1ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.656534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef6d0-18a9-4f47-b1d4-78a72b6a1ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.658215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ef6d0-18a9-4f47-b1d4-78a72b6a1ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:20.660359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ef6d0-18a9-4f47-b1d4-78a72b6a1ba8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:20.676483 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1159/2346] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:20.685966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:20.698441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93862f-f1c8-4f20-b6f8-93eb8755ccba admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:20.706888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:20.708215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.708662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.709100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] PATH_INFO: `/v3/projects/1c5a6610ec304bcd8a796cf709fb33b7/users/6ae1efbac3a54474af8b01eb9371abba/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.732735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5a6610ec304bcd8a796cf709fb33b7, user_id=6ae1efbac3a54474af8b01eb9371abba, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:20.738226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:20.771642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1188/2347] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:20 2022] PUT /identity/v3/projects/1c5a6610ec304bcd8a796cf709fb33b7/users/6ae1efbac3a54474af8b01eb9371abba/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:20.787491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befe97-875c-45a6-a4a8-43ef8d8b4b85 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:20.787837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befe97-875c-45a6-a4a8-43ef8d8b4b85 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:20.788122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befe97-875c-45a6-a4a8-43ef8d8b4b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:20.837321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-51befe97-875c-45a6-a4a8-43ef8d8b4b85 None None] MFA Rules not processed for user `6ae1efbac3a54474af8b01eb9371abba`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:20.838557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51befe97-875c-45a6-a4a8-43ef8d8b4b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:20.977927 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1160/2348] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:20 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:20.982642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:21.070921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230de5f1-bab0-4efd-bf6a-df57b20878d6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:21.078182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:21.079856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.080967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.081491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.082458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:21.085023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:21.139743 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1189/2349] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:20 2022] POST /identity/v3/projects => generated 409 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:21.145188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51befe97-875c-45a6-a4a8-43ef8d8b4b85 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:21.156815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51befe97-875c-45a6-a4a8-43ef8d8b4b85 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:21.248600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:21.251161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.253171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.253515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.254293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:21.256408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:21.287319 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1161/2350] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:21 2022] POST /identity/v3/users => generated 311 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:21.288530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:21.301836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e6324-7a86-442d-8caa-784a6ad803ef admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:21.306989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:21.307608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.307913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.308209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.308933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:21.310562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:21.325664 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1190/2351] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:21.327090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:21.339057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a60e-d126-4316-89f4-d823a0b95afb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:21.344300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:21.345195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.345466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.345901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] PATH_INFO: `/v3/projects/6842f422a4934bbab0b6f658af875b3f/users/27ce2084c27c4bc083e39bbef32a0b68/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.366288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6842f422a4934bbab0b6f658af875b3f, user_id=27ce2084c27c4bc083e39bbef32a0b68, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:21.369036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:21.387285 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1162/2352] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:21 2022] PUT /identity/v3/projects/6842f422a4934bbab0b6f658af875b3f/users/27ce2084c27c4bc083e39bbef32a0b68/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:21.391424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:21.402155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a49a0e-8a07-4fac-a654-e6d279092764 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:21.473344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a9ebd-7a9f-4c52-818e-c14d3c9e8ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:21.474404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9ebd-7a9f-4c52-818e-c14d3c9e8ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.475024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9ebd-7a9f-4c52-818e-c14d3c9e8ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.475483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a9ebd-7a9f-4c52-818e-c14d3c9e8ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.476311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a9ebd-7a9f-4c52-818e-c14d3c9e8ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:21.478063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a9ebd-7a9f-4c52-818e-c14d3c9e8ff1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:21.498859 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1191/2353] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:21.499206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:21.512528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a35e37-cde4-40c1-b9d4-96d491a2e947 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:21.519038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:21.520243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.520689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.521125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] PATH_INFO: `/v3/projects/6842f422a4934bbab0b6f658af875b3f/users/27ce2084c27c4bc083e39bbef32a0b68/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.523380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6842f422a4934bbab0b6f658af875b3f, user_id=27ce2084c27c4bc083e39bbef32a0b68, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:21.526400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:21.537613 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1163/2354] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:21 2022] PUT /identity/v3/projects/6842f422a4934bbab0b6f658af875b3f/users/27ce2084c27c4bc083e39bbef32a0b68/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:21.549653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a5e6e-7b11-4aa3-84cc-9da3486f26ce None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.550172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a5e6e-7b11-4aa3-84cc-9da3486f26ce None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.550609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a5e6e-7b11-4aa3-84cc-9da3486f26ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.581362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4a8a5e6e-7b11-4aa3-84cc-9da3486f26ce None None] MFA Rules not processed for user `27ce2084c27c4bc083e39bbef32a0b68`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:21.582722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a8a5e6e-7b11-4aa3-84cc-9da3486f26ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:21.684018 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1192/2355] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:21.753090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:21.754854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:21.846058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e19e4-0e68-4bfc-a717-420928a50b0d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:21.873728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:21.874409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:21.874697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:21.875011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:21.911304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:21.917757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:21.943930 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1164/2356] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:22.061734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a5e6e-7b11-4aa3-84cc-9da3486f26ce None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:22.081606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a5e6e-7b11-4aa3-84cc-9da3486f26ce None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:22.095267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f718f3e-20bd-473c-9522-dd99656118bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:22.096244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718f3e-20bd-473c-9522-dd99656118bf service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:22.097956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718f3e-20bd-473c-9522-dd99656118bf service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:22.098414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f718f3e-20bd-473c-9522-dd99656118bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:22.254241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f718f3e-20bd-473c-9522-dd99656118bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:22.256270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f718f3e-20bd-473c-9522-dd99656118bf service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:22.267134 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1193/2357] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:24.054812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:24.122886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62834466-f5b5-4ce4-8dc6-ae51f72534bc service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:24.128519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:24.129564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:24.129840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:24.130119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] PATH_INFO: `/v3/users/6ae1efbac3a54474af8b01eb9371abba` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:24.131380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae1efbac3a54474af8b01eb9371abba)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:24.133330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:24.275797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae1efbac3a54474af8b01eb9371abba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:24.289458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae1efbac3a54474af8b01eb9371abba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:24.290355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae1efbac3a54474af8b01eb9371abba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:24.291638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae1efbac3a54474af8b01eb9371abba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:24.302831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae1efbac3a54474af8b01eb9371abba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:24.370036 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1165/2358] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:24 2022] DELETE /identity/v3/users/6ae1efbac3a54474af8b01eb9371abba => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:24.372272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:24.372750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:24.372891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:24.427119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:24.428484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:24.552891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1194/2359] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:24.663440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:24.665056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:24.789943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c0e3b-e914-4911-98dc-c5a129e2a118 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:24.800520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:24.801289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:24.801672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:24.802054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:24.814020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:24.823068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:24.837631 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1166/2360] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:25.698226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:25.699693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:25.724617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f23d-6439-45d4-b81e-152938d7bdb7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:25.736097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:25.737243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:25.737675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:25.738100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] PATH_INFO: `/v3/projects/1c5a6610ec304bcd8a796cf709fb33b7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:25.740540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5a6610ec304bcd8a796cf709fb33b7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:25.742808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:25.817775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5a6610ec304bcd8a796cf709fb33b7', 'request_id': 'req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:25.826480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5a6610ec304bcd8a796cf709fb33b7', 'request_id': 'req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:25.845480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5a6610ec304bcd8a796cf709fb33b7', 'request_id': 'req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:25.863703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] The token cache is being invalidate because project 1c5a6610ec304bcd8a796cf709fb33b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:25.863703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:25.867116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e269e4cb-734a-45e0-b7cb-4b5d423a9de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:25.870096 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1195/2361] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:25 2022] DELETE /identity/v3/projects/1c5a6610ec304bcd8a796cf709fb33b7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:25.873811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:25.891365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e56431-7a56-4891-a068-fa7dc96634dd service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:26.045068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:26.046094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:26.046548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:26.047683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] PATH_INFO: `/v3/users/27ce2084c27c4bc083e39bbef32a0b68` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:26.049002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ce2084c27c4bc083e39bbef32a0b68)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:26.051284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:26.130799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ce2084c27c4bc083e39bbef32a0b68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:26.139775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ce2084c27c4bc083e39bbef32a0b68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:26.141025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ce2084c27c4bc083e39bbef32a0b68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:26.141804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ce2084c27c4bc083e39bbef32a0b68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:26.154809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ce2084c27c4bc083e39bbef32a0b68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:26.181888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1167/2362] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:25 2022] DELETE /identity/v3/users/27ce2084c27c4bc083e39bbef32a0b68 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:27.121016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96acc-6ede-4479-9d5c-9b16094840a7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:27.121475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96acc-6ede-4479-9d5c-9b16094840a7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:27.121744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a96acc-6ede-4479-9d5c-9b16094840a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:27.166739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-88a96acc-6ede-4479-9d5c-9b16094840a7 None None] MFA Rules not processed for user `7dd9c30816a7410f94b10294234c1dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:27.170109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88a96acc-6ede-4479-9d5c-9b16094840a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:27.311147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:27.312648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:27.365305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1196/2363] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:27.458859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed016dae-4d41-49f4-b014-649389dd5de9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:27.470575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:27.471426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:27.471944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:27.478816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] PATH_INFO: `/v3/projects/6842f422a4934bbab0b6f658af875b3f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:27.482124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6842f422a4934bbab0b6f658af875b3f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:27.484232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:27.574603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6842f422a4934bbab0b6f658af875b3f', 'request_id': 'req-751627ff-dff6-44fd-9adb-6ea7f17b56c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:27.581054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6842f422a4934bbab0b6f658af875b3f', 'request_id': 'req-751627ff-dff6-44fd-9adb-6ea7f17b56c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:27.589895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6842f422a4934bbab0b6f658af875b3f', 'request_id': 'req-751627ff-dff6-44fd-9adb-6ea7f17b56c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:27.603200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] The token cache is being invalidate because project 6842f422a4934bbab0b6f658af875b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:27.603492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:27.604348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-751627ff-dff6-44fd-9adb-6ea7f17b56c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:27.605932 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1168/2364] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:27 2022] DELETE /identity/v3/projects/6842f422a4934bbab0b6f658af875b3f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:27.611995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851c4d-c329-49f0-ac23-579fe9b955b9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:27.612288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851c4d-c329-49f0-ac23-579fe9b955b9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:27.613953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a851c4d-c329-49f0-ac23-579fe9b955b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:27.633276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5a851c4d-c329-49f0-ac23-579fe9b955b9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:27.635048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5a851c4d-c329-49f0-ac23-579fe9b955b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:27.717116 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1197/2365] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:27.720397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17f508-94ba-4aa5-9081-1d7a721f22da None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:27.720684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17f508-94ba-4aa5-9081-1d7a721f22da None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:27.721010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17f508-94ba-4aa5-9081-1d7a721f22da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:27.749331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3a17f508-94ba-4aa5-9081-1d7a721f22da None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:27.750557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3a17f508-94ba-4aa5-9081-1d7a721f22da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:27.770122 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1169/2366] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:27.771065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851c4d-c329-49f0-ac23-579fe9b955b9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:27.780945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a851c4d-c329-49f0-ac23-579fe9b955b9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:27.786987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:27.787651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:27.787926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:27.788201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:27.788923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:27.789225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:27.790847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:27.803185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1198/2367] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:27.807563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17f508-94ba-4aa5-9081-1d7a721f22da None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:27.833606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17f508-94ba-4aa5-9081-1d7a721f22da None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:27.838920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:27.840028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:27.840321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:27.840597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:27.841318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:27.843305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:27.877298 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1170/2368] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:27 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:27.881480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:27.892367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632a83c-8957-4796-abcd-fdab8bad5d0d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:28.023646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:28.024326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:28.024808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:28.025173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:28.025846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:28.027834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:28.051683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1199/2369] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:27 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:28.057529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:28.079779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7cbb-1765-481e-b937-39a1f3d3979f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:28.105815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:28.106518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:28.107350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:28.107350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:28.107858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:28.116318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:28.132763 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1171/2370] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:28.137367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:28.161220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeed78-7fbc-41f9-812e-a3ace5074f0e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:28.166895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b62ae-d525-42ba-9693-9ea107022591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:28.168214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b62ae-d525-42ba-9693-9ea107022591 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:28.168613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b62ae-d525-42ba-9693-9ea107022591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:28.169025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b62ae-d525-42ba-9693-9ea107022591 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:28.169991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b62ae-d525-42ba-9693-9ea107022591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:28.172801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b62ae-d525-42ba-9693-9ea107022591 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:28.189858 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1200/2371] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:28.191059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:28.217736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c142294-60f8-4bfe-b5b0-127f9f115247 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:28.226204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:28.227483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:28.227483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:28.227685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] PATH_INFO: `/v3/projects/023784247b6441e9b281d0a62620a0bf/users/364e54f0018e49f48a329bf8c002bb04/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:28.296305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023784247b6441e9b281d0a62620a0bf, user_id=364e54f0018e49f48a329bf8c002bb04, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:28.301167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:28.362428 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1172/2372] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:28 2022] PUT /identity/v3/projects/023784247b6441e9b281d0a62620a0bf/users/364e54f0018e49f48a329bf8c002bb04/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:28.364227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3136d-53b8-444e-8fc2-cdae2fa5e5c5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:28.364921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3136d-53b8-444e-8fc2-cdae2fa5e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:28.369439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3136d-53b8-444e-8fc2-cdae2fa5e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:28.396948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5ae3136d-53b8-444e-8fc2-cdae2fa5e5c5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:28.400312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ae3136d-53b8-444e-8fc2-cdae2fa5e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:28.512853 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1201/2373] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:28.523801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:28.525693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:28.599927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e7c90-af95-4b47-ae59-a40a14df44f1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:28.606141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc58c3-0c88-4105-b0c1-672b9b07aed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:28.607441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc58c3-0c88-4105-b0c1-672b9b07aed9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:28.607955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc58c3-0c88-4105-b0c1-672b9b07aed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:28.608530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc58c3-0c88-4105-b0c1-672b9b07aed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:28.624534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc58c3-0c88-4105-b0c1-672b9b07aed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:28.626709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc58c3-0c88-4105-b0c1-672b9b07aed9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:28.637590 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1173/2374] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:29.089571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b5e19-40d0-4fe9-b74e-d5dce49a80d2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:29.090291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b5e19-40d0-4fe9-b74e-d5dce49a80d2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:29.091116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b5e19-40d0-4fe9-b74e-d5dce49a80d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:29.113176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-779b5e19-40d0-4fe9-b74e-d5dce49a80d2 None None] MFA Rules not processed for user `99e9b91d4fb949f18cc61bf2bbd63ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:29.115676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-779b5e19-40d0-4fe9-b74e-d5dce49a80d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:29.207036 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1202/2375] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:29.608627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1995c-b8fa-4f7a-9e08-0ba632ee7cf7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:29.609715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1995c-b8fa-4f7a-9e08-0ba632ee7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:29.610253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1995c-b8fa-4f7a-9e08-0ba632ee7cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:29.646464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b5b1995c-b8fa-4f7a-9e08-0ba632ee7cf7 None None] MFA Rules not processed for user `364e54f0018e49f48a329bf8c002bb04`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:29.648056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b5b1995c-b8fa-4f7a-9e08-0ba632ee7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:29.768393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1174/2376] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:29.772798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b5e19-40d0-4fe9-b74e-d5dce49a80d2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:29.788036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b5e19-40d0-4fe9-b74e-d5dce49a80d2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:29.793769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:29.794871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:29.795324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:29.795836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:29.796747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:29.799181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:29.853878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1203/2377] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:29 2022] POST /identity/v3/projects => generated 399 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:29.855600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1995c-b8fa-4f7a-9e08-0ba632ee7cf7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:29.870715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1995c-b8fa-4f7a-9e08-0ba632ee7cf7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:29.975602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:29.976618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:29.977060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:29.977342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:29.978146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:29.980360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:30.013441 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1175/2378] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:29 2022] POST /identity/v3/users => generated 306 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:30.018835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:30.032989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ff2a-05b2-4dfc-bdc9-cc4531a9bc35 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:30.040122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:30.041073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:30.041605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:30.042047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:30.043264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:30.045209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:30.060605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1204/2379] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:30.061510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:30.079087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa998cb3-7a8d-4479-b8d4-8ff68a39ac8f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:30.108042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:30.108968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:30.109258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:30.109574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] PATH_INFO: `/v3/projects/128780b076564b77b99449d2e31ce8b7/users/8ac2d4b82600490ba6aa7f97724c237e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:30.125894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:30.128912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:30.153908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368391b-dffb-4b9f-86aa-f95814fc52fe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:30.168498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128780b076564b77b99449d2e31ce8b7, user_id=8ac2d4b82600490ba6aa7f97724c237e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:30.169600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:30.170704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:30.171018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:30.171293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] PATH_INFO: `/v3/users/f7c66dcdb16748bd900fb2a0501d7d72` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:30.171428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:30.181422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c66dcdb16748bd900fb2a0501d7d72)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:30.186619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:30.204064 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1176/2380] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:30 2022] PUT /identity/v3/projects/128780b076564b77b99449d2e31ce8b7/users/8ac2d4b82600490ba6aa7f97724c237e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:30.208703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:30.262152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c66dcdb16748bd900fb2a0501d7d72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:30.263680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c66dcdb16748bd900fb2a0501d7d72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:30.275028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c66dcdb16748bd900fb2a0501d7d72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:30.276234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c66dcdb16748bd900fb2a0501d7d72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:30.290505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8dd6c869-c05e-4174-aad2-c5c81ac12856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c66dcdb16748bd900fb2a0501d7d72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:30.304628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798080-96d5-496e-ae0b-a2dcf0486ac5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:30.311971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:30.313741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:30.314186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:30.314665 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1205/2381] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:30 2022] DELETE /identity/v3/users/f7c66dcdb16748bd900fb2a0501d7d72 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:30.314857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:30.315657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:30.317637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:30.320540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:30.320883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:30.321438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:30.330872 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1177/2382] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:30.334435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:30.336558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:30.350722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:30.352913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:30.355864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bc870-bff2-4f52-b914-4b7f5424fa03 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:30.431001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1206/2383] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:30.458471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:30.460112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:30.509446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:30.511199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:30.511491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:30.511960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] PATH_INFO: `/v3/projects/128780b076564b77b99449d2e31ce8b7/users/8ac2d4b82600490ba6aa7f97724c237e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:30.515916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128780b076564b77b99449d2e31ce8b7, user_id=8ac2d4b82600490ba6aa7f97724c237e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:30.524192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:30.527673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8a028-186a-48c7-bca8-1e839ff49bbe None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:30.533902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:30.549815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:30.550334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:30.551914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:30.554704 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1178/2384] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:30 2022] PUT /identity/v3/projects/128780b076564b77b99449d2e31ce8b7/users/8ac2d4b82600490ba6aa7f97724c237e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:30.570749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:30.573233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:30.587573 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1207/2385] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:47:31.823056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:31.825793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:32.020597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c872-d6b2-4563-9b72-4de87b1afdb9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:32.029363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:32.030386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:32.030805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:32.031665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] PATH_INFO: `/v3/projects/e319fb6c72864e1997a9f30a5f09f36c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:32.033449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e319fb6c72864e1997a9f30a5f09f36c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:32.035661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:32.123955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e319fb6c72864e1997a9f30a5f09f36c', 'request_id': 'req-74bf2159-cd19-467d-924e-eb5db52f16a8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.138492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e319fb6c72864e1997a9f30a5f09f36c', 'request_id': 'req-74bf2159-cd19-467d-924e-eb5db52f16a8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.163860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e319fb6c72864e1997a9f30a5f09f36c', 'request_id': 'req-74bf2159-cd19-467d-924e-eb5db52f16a8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.186013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] The token cache is being invalidate because project e319fb6c72864e1997a9f30a5f09f36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:32.187114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.188233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74bf2159-cd19-467d-924e-eb5db52f16a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.191683 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1179/2386] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:31 2022] DELETE /identity/v3/projects/e319fb6c72864e1997a9f30a5f09f36c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:32.195653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:32.209382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cef48b-bcd5-435e-9824-3d9b1e2b4af0 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:32.316128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:32.323724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:32.324065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:32.324293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] PATH_INFO: `/v3/users/34d0670ceea34106bee3718cff0a6bb6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:32.326102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34d0670ceea34106bee3718cff0a6bb6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:32.331555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:32.425920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34d0670ceea34106bee3718cff0a6bb6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.426919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34d0670ceea34106bee3718cff0a6bb6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.428753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0290a56-ab57-43b3-8db9-e8b68683afa3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:32.429042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0290a56-ab57-43b3-8db9-e8b68683afa3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:32.429319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0290a56-ab57-43b3-8db9-e8b68683afa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:32.440375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34d0670ceea34106bee3718cff0a6bb6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.441333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34d0670ceea34106bee3718cff0a6bb6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.454887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34d0670ceea34106bee3718cff0a6bb6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:32.483046 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1208/2387] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:32 2022] DELETE /identity/v3/users/34d0670ceea34106bee3718cff0a6bb6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:32.487039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f0290a56-ab57-43b3-8db9-e8b68683afa3 None None] MFA Rules not processed for user `8ac2d4b82600490ba6aa7f97724c237e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:32.488279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f0290a56-ab57-43b3-8db9-e8b68683afa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:32.615778 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1180/2388] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:33.978451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:33.984225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:34.090948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504afd9d-d65c-4874-a7bf-a88b50278709 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:34.098854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:34.100057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.100690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.101212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] PATH_INFO: `/v3/projects/9a6e01ee83e641049cd363a84b35804e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.102959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6e01ee83e641049cd363a84b35804e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:34.107032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:34.192855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6e01ee83e641049cd363a84b35804e', 'request_id': 'req-00c18701-6cbd-444d-a630-62df82e7a40a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:34.204620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6e01ee83e641049cd363a84b35804e', 'request_id': 'req-00c18701-6cbd-444d-a630-62df82e7a40a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:34.210391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6e01ee83e641049cd363a84b35804e', 'request_id': 'req-00c18701-6cbd-444d-a630-62df82e7a40a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:34.226166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] The token cache is being invalidate because project 9a6e01ee83e641049cd363a84b35804e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:34.226459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:34.227257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00c18701-6cbd-444d-a630-62df82e7a40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:34.229067 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1209/2389] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:33 2022] DELETE /identity/v3/projects/9a6e01ee83e641049cd363a84b35804e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:34.233938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a015-2aee-40f0-b64b-72ff3519814d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.234456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a015-2aee-40f0-b64b-72ff3519814d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.234560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447a015-2aee-40f0-b64b-72ff3519814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.260652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0447a015-2aee-40f0-b64b-72ff3519814d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:34.262043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0447a015-2aee-40f0-b64b-72ff3519814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:34.333910 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1181/2390] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:34.341336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ced085-038d-41e0-97d6-3b1953901786 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.341621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ced085-038d-41e0-97d6-3b1953901786 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.341900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ced085-038d-41e0-97d6-3b1953901786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.364051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-11ced085-038d-41e0-97d6-3b1953901786 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:34.365471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-11ced085-038d-41e0-97d6-3b1953901786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:34.379105 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1210/2391] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:34.379582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447a015-2aee-40f0-b64b-72ff3519814d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:34.392816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447a015-2aee-40f0-b64b-72ff3519814d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:34.397674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:34.398596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.399688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.400126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.401188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:34.401665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:34.403999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:34.420998 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1182/2392] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:34.425476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ced085-038d-41e0-97d6-3b1953901786 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:34.445068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ced085-038d-41e0-97d6-3b1953901786 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:34.450953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:34.451631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.451913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.452272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.453708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:34.456041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:34.504955 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1211/2393] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:34 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:34.508915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:34.528018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e2dcf-9a25-46d2-a737-05ba7b765201 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:34.614669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:34.615479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.618446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.618933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.619813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:34.622130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:34.654163 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1183/2394] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:34 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:34.659347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:34.673185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f18de-45da-4358-a144-9561239974f1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:34.680265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:34.682033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.682240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.685060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.685060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:34.687988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:34.702389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1212/2395] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:34.705571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:34.716113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733818b4-4cce-4f02-803f-21bb69c24a14 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:34.721358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8cd31-fa78-4aad-8f5a-985426d3a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:34.722303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8cd31-fa78-4aad-8f5a-985426d3a866 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.722589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8cd31-fa78-4aad-8f5a-985426d3a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.722897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8cd31-fa78-4aad-8f5a-985426d3a866 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.723816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8cd31-fa78-4aad-8f5a-985426d3a866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:34.725473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8cd31-fa78-4aad-8f5a-985426d3a866 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:34.736032 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1184/2396] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:34.740153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:34.751488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeed9e-3745-4b1f-b68f-45cf408256b2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:34.758686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:34.760026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.760026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.760271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] PATH_INFO: `/v3/projects/fcb0bde79e814e00a5ac9fcaff43bec3/users/145633f5689447bb9c5ad6e31760d688/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.779025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb0bde79e814e00a5ac9fcaff43bec3, user_id=145633f5689447bb9c5ad6e31760d688, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:34.784888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:34.811353 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1213/2397] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:34 2022] PUT /identity/v3/projects/fcb0bde79e814e00a5ac9fcaff43bec3/users/145633f5689447bb9c5ad6e31760d688/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:34.815986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14398e3-ed82-4451-8581-8d1ec553c507 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:34.816471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14398e3-ed82-4451-8581-8d1ec553c507 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:34.816925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14398e3-ed82-4451-8581-8d1ec553c507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:34.861094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d14398e3-ed82-4451-8581-8d1ec553c507 None None] MFA Rules not processed for user `145633f5689447bb9c5ad6e31760d688`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:34.862999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d14398e3-ed82-4451-8581-8d1ec553c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:34.970041 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1185/2398] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:34.977814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:34.980644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:35.075561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d2ed5-5eb4-49f8-a9a8-75b393e1806c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:35.079633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:35.080511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:35.080894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:35.081910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:35.091520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:35.093335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:35.109122 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1214/2399] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:47:35.244377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b426-55ca-4865-95cc-263f41226346 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:35.244855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b426-55ca-4865-95cc-263f41226346 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:35.245153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144b426-55ca-4865-95cc-263f41226346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:35.275301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f144b426-55ca-4865-95cc-263f41226346 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:35.277223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f144b426-55ca-4865-95cc-263f41226346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:35.353729 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1186/2400] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:47:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:35.365939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:35.367672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:35.441535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b2695-bd27-496a-9d98-d3cbe88d642c service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:35.448575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:35.449240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:35.449515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:35.449785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:35.459265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:35.460960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:35.469533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1215/2401] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:47:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:47:35.999281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144b426-55ca-4865-95cc-263f41226346 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:36.002136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f144b426-55ca-4865-95cc-263f41226346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:36.105904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144b426-55ca-4865-95cc-263f41226346 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:36.112523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:36.113416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:36.113703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:36.113980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] PATH_INFO: `/v3/users/364e54f0018e49f48a329bf8c002bb04` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:36.115449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=364e54f0018e49f48a329bf8c002bb04)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:36.119145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:36.204516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364e54f0018e49f48a329bf8c002bb04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.222110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364e54f0018e49f48a329bf8c002bb04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.222943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364e54f0018e49f48a329bf8c002bb04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.224195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364e54f0018e49f48a329bf8c002bb04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.234763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364e54f0018e49f48a329bf8c002bb04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.269998 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1187/2402] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:35 2022] DELETE /identity/v3/users/364e54f0018e49f48a329bf8c002bb04 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:36.575213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:36.633155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee59329-6dce-453c-89d1-4533c59b069f service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:36.757794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:36.758814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:36.759158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:36.759441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] PATH_INFO: `/v3/projects/023784247b6441e9b281d0a62620a0bf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:36.761314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=023784247b6441e9b281d0a62620a0bf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:36.763345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:36.872999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023784247b6441e9b281d0a62620a0bf', 'request_id': 'req-e1b22da4-00ae-4169-b6c4-86591c325fec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.890523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023784247b6441e9b281d0a62620a0bf', 'request_id': 'req-e1b22da4-00ae-4169-b6c4-86591c325fec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.917913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023784247b6441e9b281d0a62620a0bf', 'request_id': 'req-e1b22da4-00ae-4169-b6c4-86591c325fec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.933490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] The token cache is being invalidate because project 023784247b6441e9b281d0a62620a0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:36.933934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.935335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:36.939247 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1216/2403] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:36 2022] DELETE /identity/v3/projects/023784247b6441e9b281d0a62620a0bf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:36.943077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:36.944604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:36.966221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae217-c690-44ae-8f28-ff8d4a5cb9aa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:37.087110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:37.088582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:37.089139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:37.090378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] PATH_INFO: `/v3/users/8ac2d4b82600490ba6aa7f97724c237e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:37.091704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac2d4b82600490ba6aa7f97724c237e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:37.094273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:37.163110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac2d4b82600490ba6aa7f97724c237e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.172475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac2d4b82600490ba6aa7f97724c237e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.173869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac2d4b82600490ba6aa7f97724c237e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.174709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac2d4b82600490ba6aa7f97724c237e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.191213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-17803f8a-7ae8-402c-9b93-b86f0b350259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac2d4b82600490ba6aa7f97724c237e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.225968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1188/2404] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:36 2022] DELETE /identity/v3/users/8ac2d4b82600490ba6aa7f97724c237e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:37.678859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:37.682053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:37.721159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b22da4-00ae-4169-b6c4-86591c325fec admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:37.800267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:37.801169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:37.801452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:37.801729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] PATH_INFO: `/v3/projects/128780b076564b77b99449d2e31ce8b7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:37.802982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128780b076564b77b99449d2e31ce8b7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:37.804946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:37.896720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128780b076564b77b99449d2e31ce8b7', 'request_id': 'req-6f742d78-17da-4848-9b0a-0083cd6caac8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.903770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128780b076564b77b99449d2e31ce8b7', 'request_id': 'req-6f742d78-17da-4848-9b0a-0083cd6caac8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.915664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128780b076564b77b99449d2e31ce8b7', 'request_id': 'req-6f742d78-17da-4848-9b0a-0083cd6caac8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.931619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] The token cache is being invalidate because project 128780b076564b77b99449d2e31ce8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:37.931920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.932683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f742d78-17da-4848-9b0a-0083cd6caac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:37.934456 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1217/2405] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:37 2022] DELETE /identity/v3/projects/128780b076564b77b99449d2e31ce8b7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:37.939172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085281-7835-4f9b-b160-eb0c1156d629 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:37.939639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085281-7835-4f9b-b160-eb0c1156d629 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:37.939719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86085281-7835-4f9b-b160-eb0c1156d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:37.960782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-86085281-7835-4f9b-b160-eb0c1156d629 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:37.962007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-86085281-7835-4f9b-b160-eb0c1156d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:38.049648 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1189/2406] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:38.057693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017b26-7239-4b98-9e1a-a3ff1d48e2a5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.058289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017b26-7239-4b98-9e1a-a3ff1d48e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.059415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017b26-7239-4b98-9e1a-a3ff1d48e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.080771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6b017b26-7239-4b98-9e1a-a3ff1d48e2a5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:38.082479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b017b26-7239-4b98-9e1a-a3ff1d48e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:38.091169 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1218/2407] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:38.095995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085281-7835-4f9b-b160-eb0c1156d629 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:38.119183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86085281-7835-4f9b-b160-eb0c1156d629 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:38.125303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:38.126066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.126473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.126921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.127726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:38.128096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:38.130275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:38.150723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017b26-7239-4b98-9e1a-a3ff1d48e2a5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:38.151163 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1190/2408] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:38.162748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017b26-7239-4b98-9e1a-a3ff1d48e2a5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:38.179237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:38.181854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.182356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.183099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.183978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:38.186562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:38.221151 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1219/2409] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:38 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:38.225560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:38.237224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d208-2b8c-4af6-8a4b-cc043859a75c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:38.325913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:38.326945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.327284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.327666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.328719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:38.331114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:38.361881 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1191/2410] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:38 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:38.366190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:38.378510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ac976-23dc-4a80-a9f5-5e8439acd280 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:38.384287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:38.385157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.385624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.386106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.387776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:38.391011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:38.404758 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1220/2411] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:38.409339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:38.439885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b626e25-ac90-42be-b99e-eb66128b4bb2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:38.448687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aadae4-a417-4892-a1b6-e3cb5f813249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:38.449376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aadae4-a417-4892-a1b6-e3cb5f813249 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.449661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aadae4-a417-4892-a1b6-e3cb5f813249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.449939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aadae4-a417-4892-a1b6-e3cb5f813249 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.450672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aadae4-a417-4892-a1b6-e3cb5f813249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:38.452364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aadae4-a417-4892-a1b6-e3cb5f813249 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:38.473101 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1192/2412] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:38.477288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:38.489441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952d53-1a09-4d28-bd3a-72b6e8082c29 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:38.497201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:38.498106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.498678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.499015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] PATH_INFO: `/v3/projects/4b2e6a4e38634967bf1c5631d890654d/users/970029489a3a42b7858dea8a0ae46c97/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.529240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2e6a4e38634967bf1c5631d890654d, user_id=970029489a3a42b7858dea8a0ae46c97, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:38.533334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:38.567182 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1221/2413] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:38 2022] PUT /identity/v3/projects/4b2e6a4e38634967bf1c5631d890654d/users/970029489a3a42b7858dea8a0ae46c97/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:38.581015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c183a-872e-4c49-84be-2fd1e6cd37cd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.581634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c183a-872e-4c49-84be-2fd1e6cd37cd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.582173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c183a-872e-4c49-84be-2fd1e6cd37cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.643562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4b0c183a-872e-4c49-84be-2fd1e6cd37cd None None] MFA Rules not processed for user `970029489a3a42b7858dea8a0ae46c97`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:38.654509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4b0c183a-872e-4c49-84be-2fd1e6cd37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:38.835991 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1193/2414] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:38.837247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:38.975374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ea96e-d2e9-4aa5-bbbc-d073b58cbc73 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:38.982676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:38.983816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:38.984816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:38.985301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:38.986994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:38.990702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.037414 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1222/2415] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:38 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:39.041566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c183a-872e-4c49-84be-2fd1e6cd37cd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.053332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c183a-872e-4c49-84be-2fd1e6cd37cd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.135397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.136347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.136903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.137357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.138221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.141686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.168937 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1194/2416] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:39 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:39.173020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.186590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de95f5-0dcb-4511-b2c4-8500eee4245e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.193267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.194001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.194381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.194711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.195477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.197372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.216072 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1223/2417] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:39.216605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.226532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397b2f6-9fe8-4aef-bc27-918f040135eb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.231555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.232413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.232691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.233230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] PATH_INFO: `/v3/projects/88f88909c6e74b6bb959c5f95c283b33/users/59d6739ab4e747ddaed34c901ffc6add/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.253122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f88909c6e74b6bb959c5f95c283b33, user_id=59d6739ab4e747ddaed34c901ffc6add, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.256612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.287084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1195/2418] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:39 2022] PUT /identity/v3/projects/88f88909c6e74b6bb959c5f95c283b33/users/59d6739ab4e747ddaed34c901ffc6add/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:39.291053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.305286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63834c-aee2-4a96-bc41-b7d712c7e1dc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.445660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783c36a-edfa-4fe6-8053-17a21a202c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.446601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c36a-edfa-4fe6-8053-17a21a202c34 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.446920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c36a-edfa-4fe6-8053-17a21a202c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.447197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783c36a-edfa-4fe6-8053-17a21a202c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.447929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783c36a-edfa-4fe6-8053-17a21a202c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.449682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783c36a-edfa-4fe6-8053-17a21a202c34 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.480424 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1224/2419] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:39.485137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.501368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf9cb0-f7da-4656-94f8-bd2f0b0eddb2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.506562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.507774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.508199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.508926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] PATH_INFO: `/v3/projects/88f88909c6e74b6bb959c5f95c283b33/users/59d6739ab4e747ddaed34c901ffc6add/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.512090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f88909c6e74b6bb959c5f95c283b33, user_id=59d6739ab4e747ddaed34c901ffc6add, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.517588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.543913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ffdd-50b2-4cc5-a92f-0a1cea00b5d5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.544248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ffdd-50b2-4cc5-a92f-0a1cea00b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.544486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ffdd-50b2-4cc5-a92f-0a1cea00b5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.544716 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1196/2420] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:39 2022] PUT /identity/v3/projects/88f88909c6e74b6bb959c5f95c283b33/users/59d6739ab4e747ddaed34c901ffc6add/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:39.576651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4ef2ffdd-50b2-4cc5-a92f-0a1cea00b5d5 None None] MFA Rules not processed for user `59d6739ab4e747ddaed34c901ffc6add`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:39.578749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4ef2ffdd-50b2-4cc5-a92f-0a1cea00b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:39.671618 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1225/2421] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:39.677918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.690430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5a6b3-dc25-44c7-942f-1b522b7169a4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.696362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.697169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.697502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.697781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.698503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:39.699413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.701145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.722487 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1197/2422] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:39.727007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ffdd-50b2-4cc5-a92f-0a1cea00b5d5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.736853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ffdd-50b2-4cc5-a92f-0a1cea00b5d5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.743674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.744688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.745200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.745728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.746614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.749388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.794306 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1226/2423] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:39 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:39.798662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:39.810081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca5665-cd30-438c-aff7-58e466e107ff tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:39.928584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0abd7-3edc-4fe1-a403-30d5754a3982 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:39.929992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0abd7-3edc-4fe1-a403-30d5754a3982 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:39.930533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0abd7-3edc-4fe1-a403-30d5754a3982 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:39.931327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0abd7-3edc-4fe1-a403-30d5754a3982 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:39.932286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0abd7-3edc-4fe1-a403-30d5754a3982 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:39.933126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0abd7-3edc-4fe1-a403-30d5754a3982 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:39.935861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0abd7-3edc-4fe1-a403-30d5754a3982 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:39.957753 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1198/2424] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:40.216783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:40.221175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:40.348261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff76f52-15d9-4e6a-822c-76edd6d4366a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:40.358195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278320d-0078-44db-80fb-0962034b765b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:40.358946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278320d-0078-44db-80fb-0962034b765b service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:40.359818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278320d-0078-44db-80fb-0962034b765b service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:40.360095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278320d-0078-44db-80fb-0962034b765b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:40.371856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278320d-0078-44db-80fb-0962034b765b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:40.374190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278320d-0078-44db-80fb-0962034b765b service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:40.386568 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1227/2425] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:40.408932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0506d-2b1c-47b6-9fbb-9035309462bd None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:40.409471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0506d-2b1c-47b6-9fbb-9035309462bd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:40.409565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0506d-2b1c-47b6-9fbb-9035309462bd None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:40.411515 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1199/2426] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:40.416139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278320d-0078-44db-80fb-0962034b765b service nova] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:40.436541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278320d-0078-44db-80fb-0962034b765b service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:40.446653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278320d-0078-44db-80fb-0962034b765b service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:40.452716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:40.454060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:40.454348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:40.454680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/fb511fe759a84587b534f98cfc9e8748` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:40.456410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=fb511fe759a84587b534f98cfc9e8748)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:40.459385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:40.461666 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1228/2427] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:40 2022] GET /identity/v3/projects/fb511fe759a84587b534f98cfc9e8748 => generated 371 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:41.152623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6282-d478-404f-af34-0b7c6e44af87 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.152915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6282-d478-404f-af34-0b7c6e44af87 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.153198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc6282-d478-404f-af34-0b7c6e44af87 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.155151 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1200/2428] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:47:41.162027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:41.197108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:41.218504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2fdcd-4b57-46a8-8db9-b45a37d4d194 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:41.223597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:41.224513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.224806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.225230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/fb511fe759a84587b534f98cfc9e8748` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.226557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=fb511fe759a84587b534f98cfc9e8748)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:41.228736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:41.231058 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1229/2429] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:41 2022] GET /identity/v3/projects/fb511fe759a84587b534f98cfc9e8748 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:41.535591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55ee49-478d-4f62-9e6e-8814bddccf72 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.536052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55ee49-478d-4f62-9e6e-8814bddccf72 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.536526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55ee49-478d-4f62-9e6e-8814bddccf72 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.538020 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1201/2430] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:41.542815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:41.544750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:41.561376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:41.570614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c4a9b-4c7e-48cf-b86a-3b2e876e566a tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:41.575905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba84f92-c248-45af-b9e4-5da96c7c1676 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:41.576774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84f92-c248-45af-b9e4-5da96c7c1676 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.577058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84f92-c248-45af-b9e4-5da96c7c1676 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.577347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba84f92-c248-45af-b9e4-5da96c7c1676 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/fb511fe759a84587b534f98cfc9e8748` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.578554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba84f92-c248-45af-b9e4-5da96c7c1676 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=fb511fe759a84587b534f98cfc9e8748)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:41.580679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba84f92-c248-45af-b9e4-5da96c7c1676 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:41.582982 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1230/2431] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:41 2022] GET /identity/v3/projects/fb511fe759a84587b534f98cfc9e8748 => generated 371 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:41.604860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55ee49-478d-4f62-9e6e-8814bddccf72 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:41.620240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55ee49-478d-4f62-9e6e-8814bddccf72 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:41.628080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:41.629220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.629507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.629776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/fb511fe759a84587b534f98cfc9e8748` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.631158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fb511fe759a84587b534f98cfc9e8748)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:41.633251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:41.683564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb511fe759a84587b534f98cfc9e8748', 'request_id': 'req-f89ade45-e472-4bdf-b824-0fcd783d2b47'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:41.690737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb511fe759a84587b534f98cfc9e8748', 'request_id': 'req-f89ade45-e472-4bdf-b824-0fcd783d2b47'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:41.699182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb511fe759a84587b534f98cfc9e8748', 'request_id': 'req-f89ade45-e472-4bdf-b824-0fcd783d2b47'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:41.709946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] The token cache is being invalidate because project fb511fe759a84587b534f98cfc9e8748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:41.710239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:41.710940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:41.712510 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1202/2432] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:41 2022] DELETE /identity/v3/projects/fb511fe759a84587b534f98cfc9e8748 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:41.742541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d352e-4b9e-42b3-8c16-acb1601b1c93 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.743032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d352e-4b9e-42b3-8c16-acb1601b1c93 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.743417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d352e-4b9e-42b3-8c16-acb1601b1c93 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.745180 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1231/2433] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:41.751041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:41.753187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:41.843304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:41.845169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:41.909459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ade45-e472-4bdf-b824-0fcd783d2b47 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:41.914386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:41.915264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.915545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.915823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/4b2e6a4e38634967bf1c5631d890654d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.916988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b2e6a4e38634967bf1c5631d890654d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:41.919118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:41.920915 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1203/2434] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:41 2022] GET /identity/v3/projects/4b2e6a4e38634967bf1c5631d890654d => generated 373 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:41.937445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d352e-4b9e-42b3-8c16-acb1601b1c93 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:41.950997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d352e-4b9e-42b3-8c16-acb1601b1c93 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:41.962103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:41.972426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:41.972731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:41.973071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:41.973822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:41.974173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:41.975790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:41.998551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1232/2435] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:41.999876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:42.019529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97125f-9837-4c22-bcba-bf1d739b0348 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:42.028279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729b74c-eab4-441f-9ab8-e93e84118286 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:42.029353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b74c-eab4-441f-9ab8-e93e84118286 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:42.030097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b74c-eab4-441f-9ab8-e93e84118286 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:42.030456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b74c-eab4-441f-9ab8-e93e84118286 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:42.032009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729b74c-eab4-441f-9ab8-e93e84118286 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:42.034856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729b74c-eab4-441f-9ab8-e93e84118286 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:42.095653 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1204/2436] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:41 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:42.099491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:42.111835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0816083-d755-4269-b85b-f94d6f9613d4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:42.223052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:42.223873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:42.224162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:42.224447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:42.225180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:42.226529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:42.228670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:42.246651 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1233/2437] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:42.538466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007b391-90e8-4127-9b61-3c8186524231 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:42.539072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007b391-90e8-4127-9b61-3c8186524231 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:42.539072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007b391-90e8-4127-9b61-3c8186524231 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:42.540420 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1205/2438] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:42.545254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:42.547091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:42.638657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:42.652954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa25c05-ff98-4b11-90c1-e98094481b15 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:42.659685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:42.661096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:42.661598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:42.662281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:42.663868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=65630e5fa2a1482ab04cffe6eaddec5b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:42.671708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:42.673826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1234/2439] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:42 2022] GET /identity/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b => generated 371 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:42.947295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c981-4b60-49e9-be3c-99b44be50094 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:42.947579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c981-4b60-49e9-be3c-99b44be50094 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:42.947852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16c981-4b60-49e9-be3c-99b44be50094 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:42.949196 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1206/2440] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:42.954422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:42.967306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:42.976103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182eb73-4408-42eb-81a3-aed54381c0a1 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:42.980730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:42.981584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:42.981867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:42.982247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:42.983452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=65630e5fa2a1482ab04cffe6eaddec5b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:42.986066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:42.987973 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1235/2441] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:42 2022] GET /identity/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:43.028808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c981-4b60-49e9-be3c-99b44be50094 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:43.049264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16c981-4b60-49e9-be3c-99b44be50094 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:43.054280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:43.055197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.055557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.055906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.056740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:43.057253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:43.058949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:43.073867 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1207/2442] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:43.078024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:43.089015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d739-d79d-4d0a-905f-60389afcb607 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:43.094230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab78c5-2ae3-4375-837f-7225351f612b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:43.095085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab78c5-2ae3-4375-837f-7225351f612b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.095469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab78c5-2ae3-4375-837f-7225351f612b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.095850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab78c5-2ae3-4375-837f-7225351f612b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.096633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab78c5-2ae3-4375-837f-7225351f612b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:43.098667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab78c5-2ae3-4375-837f-7225351f612b tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:43.122811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1236/2443] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:43 2022] POST /identity/v3/users => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:43.127883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:43.140182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ed96d-909d-4406-b083-830989a5ec40 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:43.145482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:43.146266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.146587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.146971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.147777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:43.148084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:43.149717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:43.167525 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1208/2444] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:43.214875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9096e7-8f2b-4fdb-9876-35e6c9b6265e None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.215171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9096e7-8f2b-4fdb-9876-35e6c9b6265e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.215458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9096e7-8f2b-4fdb-9876-35e6c9b6265e None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.217235 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1237/2445] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:43.224033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:43.238252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:43.247088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bae26-ac16-4067-897e-43b400060a0c tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:43.252430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:43.253418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.253741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.254132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.255559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=65630e5fa2a1482ab04cffe6eaddec5b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:43.257742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:43.262838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1209/2446] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:43 2022] GET /identity/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b => generated 371 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:43.622680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc924-ccf0-411c-8351-27179dfc4c36 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.623590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc924-ccf0-411c-8351-27179dfc4c36 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.624060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bc924-ccf0-411c-8351-27179dfc4c36 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.626183 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1238/2447] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:43.631247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:43.644132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:43.653436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cc5ca-08d7-4b54-91d4-1b9dbdfc0d78 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:43.658940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49b0f9-9ad8-4d3a-af89-5b75353f6ccc tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:43.660017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49b0f9-9ad8-4d3a-af89-5b75353f6ccc tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.660483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49b0f9-9ad8-4d3a-af89-5b75353f6ccc tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.660938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49b0f9-9ad8-4d3a-af89-5b75353f6ccc tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.662310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49b0f9-9ad8-4d3a-af89-5b75353f6ccc tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=65630e5fa2a1482ab04cffe6eaddec5b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:43.664589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49b0f9-9ad8-4d3a-af89-5b75353f6ccc tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:43.679749 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1210/2448] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:43 2022] GET /identity/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b => generated 371 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:43.698192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bc924-ccf0-411c-8351-27179dfc4c36 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:43.712492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bc924-ccf0-411c-8351-27179dfc4c36 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:43.717253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:43.723127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.723681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.724075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/users/599a218bd3b846ec8338f095eae1dadf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.734987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.735210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.735493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.742029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:delete_user(user_id=599a218bd3b846ec8338f095eae1dadf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:43.744637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:43.755655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] MFA Rules not processed for user `3eb85bfb49aa4a519099c6f43ac77099`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:43.757333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:43.803606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599a218bd3b846ec8338f095eae1dadf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:43.804547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599a218bd3b846ec8338f095eae1dadf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:43.812480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599a218bd3b846ec8338f095eae1dadf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:43.813304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599a218bd3b846ec8338f095eae1dadf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:43.824248 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1211/2449] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:43.826473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7adfa1b2-f8a5-4ea2-9a1c-e67f62568c9d tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599a218bd3b846ec8338f095eae1dadf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:43.869444 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1239/2450] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:43 2022] DELETE /identity/v3/users/599a218bd3b846ec8338f095eae1dadf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:43.874193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:43.875809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:43.892977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417f6d5-41b6-4e64-ab57-534d8f68c380 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:43.977060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:43.978425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:43.978425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:43.978598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:43.979727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:delete_project(project_id=65630e5fa2a1482ab04cffe6eaddec5b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:43.981838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:44.064555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65630e5fa2a1482ab04cffe6eaddec5b', 'request_id': 'req-9d237572-8147-4c73-9e04-a89eff754c23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.072102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a08de-327a-4b3f-a5bc-c5c66f124e7d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.072768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a08de-327a-4b3f-a5bc-c5c66f124e7d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.073232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a08de-327a-4b3f-a5bc-c5c66f124e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.076236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65630e5fa2a1482ab04cffe6eaddec5b', 'request_id': 'req-9d237572-8147-4c73-9e04-a89eff754c23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.086627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65630e5fa2a1482ab04cffe6eaddec5b', 'request_id': 'req-9d237572-8147-4c73-9e04-a89eff754c23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.098245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] The token cache is being invalidate because project 65630e5fa2a1482ab04cffe6eaddec5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:44.098624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.099341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.101114 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1212/2451] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:43 2022] DELETE /identity/v3/projects/65630e5fa2a1482ab04cffe6eaddec5b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:44.102709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f84a08de-327a-4b3f-a5bc-c5c66f124e7d None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:44.103986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f84a08de-327a-4b3f-a5bc-c5c66f124e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.169233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1240/2452] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:44.184891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:44.188785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.274587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d237572-8147-4c73-9e04-a89eff754c23 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:44.281249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d8e1f-08f3-4808-9aa6-e7918e231ac0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:44.282079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8e1f-08f3-4808-9aa6-e7918e231ac0 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.282424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8e1f-08f3-4808-9aa6-e7918e231ac0 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.282751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d8e1f-08f3-4808-9aa6-e7918e231ac0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.292063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d8e1f-08f3-4808-9aa6-e7918e231ac0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:44.293905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d8e1f-08f3-4808-9aa6-e7918e231ac0 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:44.303735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1213/2453] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:47:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:47:44.373864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5e781-08a4-4767-b0a4-d926d2e6ebdd None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.373864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5e781-08a4-4767-b0a4-d926d2e6ebdd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.374173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5e781-08a4-4767-b0a4-d926d2e6ebdd None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.376418 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1241/2454] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:44.382076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.382367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.382673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.407310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:44.408314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.439372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5e781-08a4-4767-b0a4-d926d2e6ebdd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:44.441360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-11e5e781-08a4-4767-b0a4-d926d2e6ebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.481914 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1214/2455] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:44.507686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:44.509317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.523028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87c24d-3e18-4e8a-b270-1be892349987 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:44.528827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80d0e4-453e-409b-8b77-77217f286e30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:44.529436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d0e4-453e-409b-8b77-77217f286e30 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.529720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d0e4-453e-409b-8b77-77217f286e30 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.529999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80d0e4-453e-409b-8b77-77217f286e30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.531438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5e781-08a4-4767-b0a4-d926d2e6ebdd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:44.536664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:44.537756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.538528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.539136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] PATH_INFO: `/v3/users/145633f5689447bb9c5ad6e31760d688` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.539534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80d0e4-453e-409b-8b77-77217f286e30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:44.540493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] RBAC: Authorizing `identity:delete_user(user_id=145633f5689447bb9c5ad6e31760d688)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:44.541128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80d0e4-453e-409b-8b77-77217f286e30 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:44.542575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:44.552011 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1215/2456] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:44.553391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.553675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.553957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.555400 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1216/2457] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:44.560986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:44.563430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.624110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145633f5689447bb9c5ad6e31760d688'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.625585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145633f5689447bb9c5ad6e31760d688'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.641796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145633f5689447bb9c5ad6e31760d688'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.642674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145633f5689447bb9c5ad6e31760d688'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.651979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e7af13b9-ff3d-4868-a515-48591e1c768f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145633f5689447bb9c5ad6e31760d688'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:44.657111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:44.658670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.672571 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1242/2458] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:44 2022] DELETE /identity/v3/users/145633f5689447bb9c5ad6e31760d688 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:44.677873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.678217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.679281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.705593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:44.708944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.732267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4dd10-36fc-4721-8c6d-a4d223bfe096 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:44.796144 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1243/2459] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:44.803395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:44.804910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:44.815283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94936479-6602-458e-a08c-6d9234b7ccd4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:44.816143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936479-6602-458e-a08c-6d9234b7ccd4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.816428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936479-6602-458e-a08c-6d9234b7ccd4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.816699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94936479-6602-458e-a08c-6d9234b7ccd4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/4b2e6a4e38634967bf1c5631d890654d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.817995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94936479-6602-458e-a08c-6d9234b7ccd4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b2e6a4e38634967bf1c5631d890654d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:44.820312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94936479-6602-458e-a08c-6d9234b7ccd4 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:44.822439 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1217/2460] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:44 2022] GET /identity/v3/projects/4b2e6a4e38634967bf1c5631d890654d => generated 373 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:44.903972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05217b-36c1-43d8-9cb2-04550766e36a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:44.909199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919422a-bb0c-4497-a346-28f864f19a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:44.910014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919422a-bb0c-4497-a346-28f864f19a82 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:44.910368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919422a-bb0c-4497-a346-28f864f19a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:44.910891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919422a-bb0c-4497-a346-28f864f19a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:44.920946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919422a-bb0c-4497-a346-28f864f19a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:44.923303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919422a-bb0c-4497-a346-28f864f19a82 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:44.938151 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1244/2461] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:45.204736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f3c8-8220-482e-98c4-0f836ff96405 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.205099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f3c8-8220-482e-98c4-0f836ff96405 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.205452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072f3c8-8220-482e-98c4-0f836ff96405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.239965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f072f3c8-8220-482e-98c4-0f836ff96405 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:45.241178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f072f3c8-8220-482e-98c4-0f836ff96405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:45.285575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.286116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.286445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.288584 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1245/2462] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:45.296378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:45.299016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:45.329828 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1218/2463] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:47:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:45.340828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072f3c8-8220-482e-98c4-0f836ff96405 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.353276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072f3c8-8220-482e-98c4-0f836ff96405 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.357117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.357829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.358295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.358627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.370223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.371774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.383607 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1219/2464] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:45.384440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.385871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:45.399528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a78a8-3b1d-49c6-967e-e568220f16bf service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.401081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.402345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:45.405574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.407159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.407440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.407711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] PATH_INFO: `/v3/projects/fcb0bde79e814e00a5ac9fcaff43bec3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.409067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb0bde79e814e00a5ac9fcaff43bec3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.411027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.417292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614412e-a1ab-4e32-b59b-7c3782ac4cff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.422370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22d69b-6a6e-45bc-8075-bb4015e69247 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.423306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d69b-6a6e-45bc-8075-bb4015e69247 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.423590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d69b-6a6e-45bc-8075-bb4015e69247 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.423865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22d69b-6a6e-45bc-8075-bb4015e69247 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/4b2e6a4e38634967bf1c5631d890654d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.425049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22d69b-6a6e-45bc-8075-bb4015e69247 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b2e6a4e38634967bf1c5631d890654d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.427160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22d69b-6a6e-45bc-8075-bb4015e69247 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.429066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1246/2465] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:45 2022] GET /identity/v3/projects/4b2e6a4e38634967bf1c5631d890654d => generated 373 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:45.464846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb0bde79e814e00a5ac9fcaff43bec3', 'request_id': 'req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:45.472008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb0bde79e814e00a5ac9fcaff43bec3', 'request_id': 'req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:45.481346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb0bde79e814e00a5ac9fcaff43bec3', 'request_id': 'req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:45.492503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] The token cache is being invalidate because project fcb0bde79e814e00a5ac9fcaff43bec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:45.493651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:45.493651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3a7e1fe-5299-4423-b5d1-fa62492b61e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:45.495393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1220/2466] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:45 2022] DELETE /identity/v3/projects/fcb0bde79e814e00a5ac9fcaff43bec3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:45.500211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925ebd-8b9d-4333-868e-fa11f232a41f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.500502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925ebd-8b9d-4333-868e-fa11f232a41f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.500784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a925ebd-8b9d-4333-868e-fa11f232a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.522185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2a925ebd-8b9d-4333-868e-fa11f232a41f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:45.523757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a925ebd-8b9d-4333-868e-fa11f232a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:45.602637 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1247/2467] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:45.610212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebdb8-b3a3-4ffe-abd9-6a079daeba0e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.610553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebdb8-b3a3-4ffe-abd9-6a079daeba0e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.610913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebdb8-b3a3-4ffe-abd9-6a079daeba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.633647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-836ebdb8-b3a3-4ffe-abd9-6a079daeba0e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:45.635379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-836ebdb8-b3a3-4ffe-abd9-6a079daeba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:45.648343 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1221/2468] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:45.652565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a925ebd-8b9d-4333-868e-fa11f232a41f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.666996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a925ebd-8b9d-4333-868e-fa11f232a41f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.672760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.673696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.674166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.674650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.675711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:45.676463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.678653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.696925 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1248/2469] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:45.701092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebdb8-b3a3-4ffe-abd9-6a079daeba0e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.714948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebdb8-b3a3-4ffe-abd9-6a079daeba0e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.723027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.723828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.724112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.724449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.726901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.729379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.761369 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1222/2470] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:45 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:45.765179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.783432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7da18-15ba-4699-b0d3-176e0db6321f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.866184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.866980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.867208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.867652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.868760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.870943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.893886 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1249/2471] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:45 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:45.899025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.912002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a7a45-aadc-4288-9bf4-e39802b1fd3c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.917547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.918509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.919010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.919494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.920464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.922458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.938206 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1223/2472] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:45.942838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.957307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c488ff-29ce-468d-9b51-1a7db82d0c6b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:45.962978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5606ca-b03c-4347-95f1-dc993de69e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:45.963858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5606ca-b03c-4347-95f1-dc993de69e04 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:45.964322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5606ca-b03c-4347-95f1-dc993de69e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:45.964783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5606ca-b03c-4347-95f1-dc993de69e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:45.965731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5606ca-b03c-4347-95f1-dc993de69e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:45.967503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5606ca-b03c-4347-95f1-dc993de69e04 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:45.981988 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1250/2473] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:45.983330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:45.997545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c493f-a7ad-4922-9f8f-848b03eeaa0f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:46.004638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc5844-4d9d-41e5-ad8e-0049141272e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:46.005910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5844-4d9d-41e5-ad8e-0049141272e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:46.006254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5844-4d9d-41e5-ad8e-0049141272e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:46.007385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5844-4d9d-41e5-ad8e-0049141272e7 admin admin] PATH_INFO: `/v3/projects/cc9da8a3554242008d73cbc700b8d1b5/users/6ff1737cc7634a59934174d614e16d1d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:46.039332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc5844-4d9d-41e5-ad8e-0049141272e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9da8a3554242008d73cbc700b8d1b5, user_id=6ff1737cc7634a59934174d614e16d1d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:46.044412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc5844-4d9d-41e5-ad8e-0049141272e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:46.063369 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1224/2474] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:45 2022] PUT /identity/v3/projects/cc9da8a3554242008d73cbc700b8d1b5/users/6ff1737cc7634a59934174d614e16d1d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:46.075077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:46.075430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:46.075638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:46.099578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:46.100163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:46.101571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:46.104193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1225/2475] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:47:46.110455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] MFA Rules not processed for user `6ff1737cc7634a59934174d614e16d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:46.111933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:46.113281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:46.118277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:46.221409 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1251/2476] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:46.240400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:46.241784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:46.320610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472d206-fa0b-4a49-9b0e-adc28aa81099 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:46.331663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59d6739ab4e747ddaed34c901ffc6add', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88f88909c6e74b6bb959c5f95c283b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:46.333296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:46.333791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:46.334085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] PATH_INFO: `/v3/projects/4b2e6a4e38634967bf1c5631d890654d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:46.335540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorizing `identity:get_project(project_id=4b2e6a4e38634967bf1c5631d890654d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:46.338242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:46.343158 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1226/2477] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:46 2022] GET /identity/v3/projects/4b2e6a4e38634967bf1c5631d890654d => generated 373 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:46.658346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:46.661209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:46.696682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f819f-5e61-43b8-bfed-6b95945f583a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:46.720201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:46.720909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:46.721302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:46.721464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:46.740791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:46.747925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:46.763305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1252/2478] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:47:46.785618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:46.787601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:46.913501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d0593-d8a1-429e-a0ff-719dfc3acc61 tempest-QuotasAdminTestJSON-1365990475 tempest-QuotasAdminTestJSON-1365990475-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:46.920251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:46.922377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:46.923143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:46.923776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] PATH_INFO: `/v3/users/970029489a3a42b7858dea8a0ae46c97` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:46.926157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=970029489a3a42b7858dea8a0ae46c97)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:46.930403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:47.037365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970029489a3a42b7858dea8a0ae46c97'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.055320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:47.062734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970029489a3a42b7858dea8a0ae46c97'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.068059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970029489a3a42b7858dea8a0ae46c97'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.069072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970029489a3a42b7858dea8a0ae46c97'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.092630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-82430a5d-0c23-45cd-9975-1ed5e3500d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970029489a3a42b7858dea8a0ae46c97'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.093529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab59858-4da6-4893-951d-e6763e6866a3 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:47.101124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:47.102274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:47.102561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:47.102909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] PATH_INFO: `/v3/users/6ff1737cc7634a59934174d614e16d1d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:47.104448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ff1737cc7634a59934174d614e16d1d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:47.111947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:47.131456 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1227/2479] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:46 2022] DELETE /identity/v3/users/970029489a3a42b7858dea8a0ae46c97 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:47.135784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:47.136089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:47.136364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:47.173748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:47.175095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:47.231455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ff1737cc7634a59934174d614e16d1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.233593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ff1737cc7634a59934174d614e16d1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.248275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ff1737cc7634a59934174d614e16d1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.253817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ff1737cc7634a59934174d614e16d1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.268186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-720d4ce5-a70a-4713-a400-e4d89569b87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ff1737cc7634a59934174d614e16d1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:47.310052 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1253/2480] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:47 2022] DELETE /identity/v3/users/6ff1737cc7634a59934174d614e16d1d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:47.310243 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1228/2481] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:47.314075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bfa99-d218-4df4-b81e-cc99961da966 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:47.314369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bfa99-d218-4df4-b81e-cc99961da966 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:47.314812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615bfa99-d218-4df4-b81e-cc99961da966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:47.323493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:47.325114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:47.346225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-615bfa99-d218-4df4-b81e-cc99961da966 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:47.347491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-615bfa99-d218-4df4-b81e-cc99961da966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:47.409783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d0a3d-465f-4380-a2cf-5d333a4547c9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:47.481614 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1254/2482] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:47.489143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bfa99-d218-4df4-b81e-cc99961da966 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:47.528652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:47.529511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:47.529803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:47.530084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:47.545269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:47.547744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:47.571095 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1229/2483] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:47:47.615699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615bfa99-d218-4df4-b81e-cc99961da966 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:47.623110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:47.623692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:47.626318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:47.626318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:47.637937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:47.639944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:47.657436 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1255/2484] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:48.316299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:48.317991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:48.333297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ad98-ee63-497f-a4a7-b6a25601daa9 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:48.353368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:48.354506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:48.355125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:48.355685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] PATH_INFO: `/v3/projects/4b2e6a4e38634967bf1c5631d890654d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:48.357202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2e6a4e38634967bf1c5631d890654d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:48.360744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:48.371341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:48.372779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:48.395392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4f0e-9cc1-477a-b77f-2b7e4682ed7a service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:48.408940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:48.409867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:48.410372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:48.411638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] PATH_INFO: `/v3/projects/cc9da8a3554242008d73cbc700b8d1b5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:48.414659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9da8a3554242008d73cbc700b8d1b5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:48.421861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:48.479878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2e6a4e38634967bf1c5631d890654d', 'request_id': 'req-3bb525c4-e4d9-4f74-9cce-25d27933806e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.489805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2e6a4e38634967bf1c5631d890654d', 'request_id': 'req-3bb525c4-e4d9-4f74-9cce-25d27933806e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.506684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9da8a3554242008d73cbc700b8d1b5', 'request_id': 'req-5a6d5b6d-444d-4864-bc64-6fe19e58960e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.511997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2e6a4e38634967bf1c5631d890654d', 'request_id': 'req-3bb525c4-e4d9-4f74-9cce-25d27933806e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.513617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9da8a3554242008d73cbc700b8d1b5', 'request_id': 'req-5a6d5b6d-444d-4864-bc64-6fe19e58960e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.523396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9da8a3554242008d73cbc700b8d1b5', 'request_id': 'req-5a6d5b6d-444d-4864-bc64-6fe19e58960e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.533253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] The token cache is being invalidate because project 4b2e6a4e38634967bf1c5631d890654d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:48.533602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.536230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.538749 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1230/2485] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:48 2022] DELETE /identity/v3/projects/4b2e6a4e38634967bf1c5631d890654d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:48.541947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:48.545409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:48.549307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] The token cache is being invalidate because project cc9da8a3554242008d73cbc700b8d1b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:48.549607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.554729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5a6d5b6d-444d-4864-bc64-6fe19e58960e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.558873 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1256/2486] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:48 2022] DELETE /identity/v3/projects/cc9da8a3554242008d73cbc700b8d1b5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:48.573607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de536-60cf-4a4d-b8d6-8c4ae5bc207d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:48.573607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de536-60cf-4a4d-b8d6-8c4ae5bc207d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:48.573607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776de536-60cf-4a4d-b8d6-8c4ae5bc207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:48.599467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-776de536-60cf-4a4d-b8d6-8c4ae5bc207d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:48.600970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-776de536-60cf-4a4d-b8d6-8c4ae5bc207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:48.636530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb525c4-e4d9-4f74-9cce-25d27933806e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:48.726031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:48.727332 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1257/2487] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:48.734893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:48.735366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:48.736138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] PATH_INFO: `/v3/users/59d6739ab4e747ddaed34c901ffc6add` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:48.737443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d6739ab4e747ddaed34c901ffc6add)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:48.739956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:48.751218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40e4cc-239f-458e-96dc-e3c8f7bdb204 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:48.751742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40e4cc-239f-458e-96dc-e3c8f7bdb204 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:48.752179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40e4cc-239f-458e-96dc-e3c8f7bdb204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:48.795458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8a40e4cc-239f-458e-96dc-e3c8f7bdb204 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:48.797797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a40e4cc-239f-458e-96dc-e3c8f7bdb204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:48.811728 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1258/2488] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:48.817760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40e4cc-239f-458e-96dc-e3c8f7bdb204 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:48.833312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40e4cc-239f-458e-96dc-e3c8f7bdb204 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:48.840702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:48.841485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:48.841779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:48.842107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:48.843724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:48.844086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:48.846532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:48.866442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1259/2489] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:48.867498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:48.881138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d61365-e57f-4911-abbe-7e7cf9345142 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:48.895469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d6739ab4e747ddaed34c901ffc6add'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.901370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:48.903941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:48.904262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:48.904686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:48.906106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d6739ab4e747ddaed34c901ffc6add'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.907033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:48.907360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d6739ab4e747ddaed34c901ffc6add'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.908155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d6739ab4e747ddaed34c901ffc6add'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.909010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:48.918640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d6739ab4e747ddaed34c901ffc6add'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:48.950576 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1260/2490] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:48 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:48.978687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:48.982598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:48.986488 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1231/2491] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:48 2022] DELETE /identity/v3/users/59d6739ab4e747ddaed34c901ffc6add => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:47:49.089622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb231681-d3f4-47d6-992d-2cf3ba9411e2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:49.219657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:49.221739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:49.222095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:49.222441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:49.225099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:49.228430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:49.277354 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1261/2492] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:48 2022] POST /identity/v3/users => generated 290 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:47:49.281265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:49.305542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a06f71-fc12-451b-95da-7cc0590a0045 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:49.314540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:49.315890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:49.316189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:49.316473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:49.317304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:49.319954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:49.334604 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1232/2493] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:49.345555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:49.356513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce156e-3498-4d7d-bfde-e1d8c4c95736 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:49.372722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cc55a-b4c9-4ed1-a174-f99bfc2a1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:49.373548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cc55a-b4c9-4ed1-a174-f99bfc2a1a9e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:49.373840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cc55a-b4c9-4ed1-a174-f99bfc2a1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:49.374120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cc55a-b4c9-4ed1-a174-f99bfc2a1a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:49.375537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cc55a-b4c9-4ed1-a174-f99bfc2a1a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:49.377190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cc55a-b4c9-4ed1-a174-f99bfc2a1a9e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:49.416880 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1262/2494] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:49.421314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:49.443909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed82a7-ee85-4668-949c-72e362f34d1f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:49.463608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef6ec6-85e6-4e23-ae09-52c22afe002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:49.464647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef6ec6-85e6-4e23-ae09-52c22afe002f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:49.464816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef6ec6-85e6-4e23-ae09-52c22afe002f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:49.465062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef6ec6-85e6-4e23-ae09-52c22afe002f admin admin] PATH_INFO: `/v3/projects/59b4f20214214616967d9d414375248a/users/af32f4f4abc2444fb869076ed80b3a8d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:49.500693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef6ec6-85e6-4e23-ae09-52c22afe002f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b4f20214214616967d9d414375248a, user_id=af32f4f4abc2444fb869076ed80b3a8d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:49.503464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef6ec6-85e6-4e23-ae09-52c22afe002f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:49.524482 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1233/2495] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:49 2022] PUT /identity/v3/projects/59b4f20214214616967d9d414375248a/users/af32f4f4abc2444fb869076ed80b3a8d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:49.537074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:49.537445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:49.537732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:49.585700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] MFA Rules not processed for user `af32f4f4abc2444fb869076ed80b3a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:49.586882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:49.702242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1263/2496] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:49.712268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:49.712563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:49.712836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:49.736522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] MFA Rules not processed for user `af32f4f4abc2444fb869076ed80b3a8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:49.738301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:49.746117 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1234/2497] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:49.758122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:49.759797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:49.853705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:49.857845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:49.911053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564668c-1fa6-41ed-b8fe-2e85c81caa87 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:49.925584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c35e9-93a9-41cc-9c06-f0b66367b1c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:49.926259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c35e9-93a9-41cc-9c06-f0b66367b1c5 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:49.926538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c35e9-93a9-41cc-9c06-f0b66367b1c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:49.926843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c35e9-93a9-41cc-9c06-f0b66367b1c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:49.959241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c35e9-93a9-41cc-9c06-f0b66367b1c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:49.961664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c35e9-93a9-41cc-9c06-f0b66367b1c5 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:49.997069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509e642-0a72-40f8-b7cc-1fbb573f09aa None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:50.013389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:50.014955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.015460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.016402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] PATH_INFO: `/v3/projects/88f88909c6e74b6bb959c5f95c283b33` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.018712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f88909c6e74b6bb959c5f95c283b33)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:50.025893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:50.030330 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1264/2498] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:50.165314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f88909c6e74b6bb959c5f95c283b33', 'request_id': 'req-f2906a03-e582-44aa-8dcd-33206a09ca3d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:50.174808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f88909c6e74b6bb959c5f95c283b33', 'request_id': 'req-f2906a03-e582-44aa-8dcd-33206a09ca3d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:50.189015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f88909c6e74b6bb959c5f95c283b33', 'request_id': 'req-f2906a03-e582-44aa-8dcd-33206a09ca3d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:50.225636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] The token cache is being invalidate because project 88f88909c6e74b6bb959c5f95c283b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:50.226302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:50.227511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f2906a03-e582-44aa-8dcd-33206a09ca3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:50.230875 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1235/2499] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:49 2022] DELETE /identity/v3/projects/88f88909c6e74b6bb959c5f95c283b33 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:50.237352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db9cd-eba2-47a5-bb4e-aa3ffc7a9c9b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.240359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db9cd-eba2-47a5-bb4e-aa3ffc7a9c9b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.241210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db9cd-eba2-47a5-bb4e-aa3ffc7a9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.262052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9e1db9cd-eba2-47a5-bb4e-aa3ffc7a9c9b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:50.263920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9e1db9cd-eba2-47a5-bb4e-aa3ffc7a9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:50.334918 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1265/2500] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:50.402384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b42a-c962-4e2a-a336-99d31c640588 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.402897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b42a-c962-4e2a-a336-99d31c640588 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.403007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743b42a-c962-4e2a-a336-99d31c640588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.422483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b743b42a-c962-4e2a-a336-99d31c640588 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:50.423722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b743b42a-c962-4e2a-a336-99d31c640588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:50.434317 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1236/2501] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:50.439061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1db9cd-eba2-47a5-bb4e-aa3ffc7a9c9b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:50.452349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1db9cd-eba2-47a5-bb4e-aa3ffc7a9c9b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:50.460238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:50.461569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.461870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.462155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.462990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:50.463375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:50.465079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:50.483281 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1266/2502] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:50.484976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b42a-c962-4e2a-a336-99d31c640588 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:50.496482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743b42a-c962-4e2a-a336-99d31c640588 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:50.504947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:50.506029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.506389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.506868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.508214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:50.509717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:50.549773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1237/2503] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:50 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:50.553628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:50.566044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3df9b-1b20-4ff7-a68d-6be78c6310ca admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:50.645924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:50.646646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.646967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.647250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.648018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:50.649964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:50.676664 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1267/2504] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:50 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:50.677851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:50.692835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e864b4-4c60-43bc-aa75-504b59e4c31b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:50.698987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:50.699808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.700148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.700368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.701089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:50.702736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:50.718818 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1238/2505] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:50.723537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:50.738246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b69d1-c9a6-4c34-a056-f32b5f998824 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:50.750652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249b8c5-5c4c-4241-85ad-2e0dae4a608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:50.751372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249b8c5-5c4c-4241-85ad-2e0dae4a608f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.751655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249b8c5-5c4c-4241-85ad-2e0dae4a608f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.751927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249b8c5-5c4c-4241-85ad-2e0dae4a608f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.752665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249b8c5-5c4c-4241-85ad-2e0dae4a608f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:50.754286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249b8c5-5c4c-4241-85ad-2e0dae4a608f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:50.770837 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1268/2506] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:50.773164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:50.785759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78802a0-2339-4c78-817f-5f0264afb7bd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:50.801058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:50.803805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.806008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.806555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083/users/6921f3bc90ae43e4b644e20c0cde1bfd/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.833423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c335f668e1934df38eaeaaf86af96083, user_id=6921f3bc90ae43e4b644e20c0cde1bfd, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:50.840145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:50.857603 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1239/2507] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:50 2022] PUT /identity/v3/projects/c335f668e1934df38eaeaaf86af96083/users/6921f3bc90ae43e4b644e20c0cde1bfd/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:50.868906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36e8e2-ca25-41be-9ff2-631580882604 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:50.869199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36e8e2-ca25-41be-9ff2-631580882604 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:50.869474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36e8e2-ca25-41be-9ff2-631580882604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:50.931531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-be36e8e2-ca25-41be-9ff2-631580882604 None None] MFA Rules not processed for user `6921f3bc90ae43e4b644e20c0cde1bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:50.933150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-be36e8e2-ca25-41be-9ff2-631580882604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:51.043158 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1269/2508] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:51.045074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.143274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727839de-9a25-48fa-b861-9a60088968a9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.150456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.151464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.152071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.152722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.153657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.159141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.204332 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1240/2509] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:51 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:51.208341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36e8e2-ca25-41be-9ff2-631580882604 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.221658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36e8e2-ca25-41be-9ff2-631580882604 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.300735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.301342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.301631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.301912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.302612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.305342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.333430 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1270/2510] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:51 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:51.338284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.349481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b220d01-3b60-4a16-8438-5c8c823ee772 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.355929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.357091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.357384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.357725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.358851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.360534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.375679 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1241/2511] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:51.379893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.396705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf957-7814-4712-a1b3-45822da98cbf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.401747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.402950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.403241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.403520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] PATH_INFO: `/v3/projects/23af23cd0357473b9aa411e924c96a5b/users/45ded100e379444f8ad9c30516375cf0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.423931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23af23cd0357473b9aa411e924c96a5b, user_id=45ded100e379444f8ad9c30516375cf0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.426621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.440599 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1271/2512] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:51 2022] PUT /identity/v3/projects/23af23cd0357473b9aa411e924c96a5b/users/45ded100e379444f8ad9c30516375cf0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:51.444674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.456890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747872e-6fd7-49f1-8339-4e0ba8c774ef admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.537090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfe651-f2be-4631-9c1c-ce8abeff3ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.537899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe651-f2be-4631-9c1c-ce8abeff3ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.538186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe651-f2be-4631-9c1c-ce8abeff3ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.538948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfe651-f2be-4631-9c1c-ce8abeff3ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.540512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe651-f2be-4631-9c1c-ce8abeff3ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.543001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfe651-f2be-4631-9c1c-ce8abeff3ff5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.555736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1242/2513] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:51.559996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.572806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399fc90-9ce7-42ac-b280-dedaca2e5373 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.580280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.581192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.581467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.581736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] PATH_INFO: `/v3/projects/23af23cd0357473b9aa411e924c96a5b/users/45ded100e379444f8ad9c30516375cf0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.583738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23af23cd0357473b9aa411e924c96a5b, user_id=45ded100e379444f8ad9c30516375cf0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.587386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.600436 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1272/2514] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:51 2022] PUT /identity/v3/projects/23af23cd0357473b9aa411e924c96a5b/users/45ded100e379444f8ad9c30516375cf0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:51.610824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9ed16-3dbc-4ffb-9822-a02d2d35cda2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.611057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9ed16-3dbc-4ffb-9822-a02d2d35cda2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.611336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9ed16-3dbc-4ffb-9822-a02d2d35cda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.638186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-39a9ed16-3dbc-4ffb-9822-a02d2d35cda2 None None] MFA Rules not processed for user `45ded100e379444f8ad9c30516375cf0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:51.639424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39a9ed16-3dbc-4ffb-9822-a02d2d35cda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:51.725175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1243/2515] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:51.782418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.784177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:51.876344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f677e-cf90-4c3f-bc4c-e81f4c4c19b2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.882044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.882687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.883018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.883296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.893201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.895017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.904579 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1273/2516] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:51.918548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fabf-0c68-4c06-8786-5d579f51c08c None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.918995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fabf-0c68-4c06-8786-5d579f51c08c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.919306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850fabf-0c68-4c06-8786-5d579f51c08c None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.920679 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1244/2517] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:47:51.925990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:51.937533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:51.949821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0334d3-93d9-4ac3-ab09-7a413c040d39 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:51.955091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:51.955943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:51.956225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:51.956681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:51.958005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:51.960256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:51.961959 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1274/2518] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:51 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:52.119827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e09b6-0365-43c2-a2ff-176d89c3ae4c None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:52.120114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e09b6-0365-43c2-a2ff-176d89c3ae4c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:52.120395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e09b6-0365-43c2-a2ff-176d89c3ae4c None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:52.121837 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1245/2519] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:52.141612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:52.144434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:52.181913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:52.198586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b5cd4-0f5e-4b41-8e67-87dae2afa6ef tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:52.206352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:52.207272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:52.207560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:52.207912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:52.209137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:52.211402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:52.214211 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1275/2520] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:52 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:52.306070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4627-32ed-4699-a02a-35156f54901c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:52.306070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4627-32ed-4699-a02a-35156f54901c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:52.306070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4627-32ed-4699-a02a-35156f54901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:52.326055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d1ec4627-32ed-4699-a02a-35156f54901c None None] MFA Rules not processed for user `6921f3bc90ae43e4b644e20c0cde1bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:52.327310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d1ec4627-32ed-4699-a02a-35156f54901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:52.384099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1246/2521] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:52.440325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:52.453868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906a3ae-903b-434c-8704-a4c2c18f0e48 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:52.459502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:52.460143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:52.460425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:52.460703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:52.469656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:52.471616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:52.481438 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1276/2522] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:52.979367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57a6a-7fc9-4f5f-9bdb-7e5defad3c2c None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:52.979857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57a6a-7fc9-4f5f-9bdb-7e5defad3c2c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:52.979954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a57a6a-7fc9-4f5f-9bdb-7e5defad3c2c None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:52.981287 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1247/2523] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:52.986174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:52.997483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:53.008199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700e46d-d36e-4b52-869b-bb9b7991f084 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:53.012948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:53.013908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.014263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.014679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.016546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:53.019294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:53.021080 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1277/2524] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:52 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:53.109469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff5a0-b5af-494a-b9cf-6c72c8aeadd7 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.109838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff5a0-b5af-494a-b9cf-6c72c8aeadd7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.110195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fff5a0-b5af-494a-b9cf-6c72c8aeadd7 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.112023 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1248/2525] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:53.116530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:53.135095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:53.146327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ffcfa-c7a5-4b6c-8747-3bc12b99a9d1 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:53.151527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:53.152647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.153110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.153392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.154618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:53.156723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:53.158449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1278/2526] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:53 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:53.200107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899ce5-c48e-4823-b003-43bb2b2f530a None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.200399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899ce5-c48e-4823-b003-43bb2b2f530a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.200678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61899ce5-c48e-4823-b003-43bb2b2f530a None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.202046 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1249/2527] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:53.208529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:53.224991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:53.235177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f71778-a1a9-4d2b-a906-e3cf48d1f8e9 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:53.240611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d15b1e-30b0-4477-b8f1-2c151f6925e8 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:53.241126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15b1e-30b0-4477-b8f1-2c151f6925e8 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.241408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15b1e-30b0-4477-b8f1-2c151f6925e8 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.242290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d15b1e-30b0-4477-b8f1-2c151f6925e8 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.242972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d15b1e-30b0-4477-b8f1-2c151f6925e8 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:53.245540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d15b1e-30b0-4477-b8f1-2c151f6925e8 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:53.248173 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1279/2528] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:53 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:47:53.359203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.359489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.359768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.379610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] MFA Rules not processed for user `6921f3bc90ae43e4b644e20c0cde1bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:53.380816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:53.387662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1250/2529] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:53.755700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410851a2-fa69-49f9-ab72-b5eb756e7351 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.756238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410851a2-fa69-49f9-ab72-b5eb756e7351 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.756379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410851a2-fa69-49f9-ab72-b5eb756e7351 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.757650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1280/2530] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:53.762541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:53.778408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:53.788102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdd6bb-50ed-4659-9dbb-cbf34c90b3b1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:53.792602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:53.793506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.793792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.794070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.799526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:53.803223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:53.806038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1251/2531] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:53 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:53.913936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd362-4706-4eee-b260-b7ca862e9e8b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.914533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd362-4706-4eee-b260-b7ca862e9e8b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.914959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd362-4706-4eee-b260-b7ca862e9e8b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.916666 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1281/2532] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:53.922107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:53.939051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:53.950712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f888f-077f-4db9-8ac4-74952eb1c72e tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:53.958927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:53.960012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:53.960448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:53.960892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:53.962234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:53.964469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:53.966895 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1252/2533] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:53 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:54.426047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e61b-fc72-4ae9-a152-0aabb86f6f8f None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:54.426341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e61b-fc72-4ae9-a152-0aabb86f6f8f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:54.426621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384e61b-fc72-4ae9-a152-0aabb86f6f8f None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:54.428001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1282/2534] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:54.435925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:54.455796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:54.465480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88f9b8-0563-4520-84c3-e71b4c99b183 tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:54.473815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce2e2a-5cb8-450a-a957-590c932a0d2a tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:54.475192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce2e2a-5cb8-450a-a957-590c932a0d2a tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:54.475670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce2e2a-5cb8-450a-a957-590c932a0d2a tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:54.476141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce2e2a-5cb8-450a-a957-590c932a0d2a tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:54.480163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce2e2a-5cb8-450a-a957-590c932a0d2a tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:54.484686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce2e2a-5cb8-450a-a957-590c932a0d2a tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:54.498863 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1253/2535] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:54 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:54.587807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:54.588107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:54.588390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:54.606642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] MFA Rules not processed for user `6921f3bc90ae43e4b644e20c0cde1bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:54.607921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:54.615424 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1283/2536] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:55.426626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747a81-d80a-44e4-863b-c772cc49d287 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:55.427270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747a81-d80a-44e4-863b-c772cc49d287 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:55.427764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747a81-d80a-44e4-863b-c772cc49d287 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:55.432534 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1254/2537] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:47:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:47:55.458158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:47:55.481627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:55.502095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82a06d-eb46-4cdb-aa35-fb79685567ba None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:55.507860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab896ec-8d53-4a91-9421-46adfaa0630b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45ded100e379444f8ad9c30516375cf0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23af23cd0357473b9aa411e924c96a5b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:55.509224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab896ec-8d53-4a91-9421-46adfaa0630b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:55.510296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab896ec-8d53-4a91-9421-46adfaa0630b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:55.510789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab896ec-8d53-4a91-9421-46adfaa0630b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:55.512261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab896ec-8d53-4a91-9421-46adfaa0630b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorizing `identity:get_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:55.514840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab896ec-8d53-4a91-9421-46adfaa0630b tempest-QuotasAdminNegativeTest-657342398 tempest-QuotasAdminNegativeTest-657342398-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:55.517040 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1284/2538] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:47:55 2022] GET /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 383 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:55.733584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3747a81-d80a-44e4-863b-c772cc49d287 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:55.824920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3747a81-d80a-44e4-863b-c772cc49d287 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:55.830302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:55.831211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:55.831492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:55.831767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] PATH_INFO: `/v3/users/6921f3bc90ae43e4b644e20c0cde1bfd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:55.832990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6921f3bc90ae43e4b644e20c0cde1bfd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:55.834986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:55.880329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6921f3bc90ae43e4b644e20c0cde1bfd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:55.886973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6921f3bc90ae43e4b644e20c0cde1bfd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:55.887667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6921f3bc90ae43e4b644e20c0cde1bfd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:55.888302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6921f3bc90ae43e4b644e20c0cde1bfd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:55.896423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6921f3bc90ae43e4b644e20c0cde1bfd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:55.914280 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1255/2539] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:55 2022] DELETE /identity/v3/users/6921f3bc90ae43e4b644e20c0cde1bfd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:55.918941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:55.919237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:55.919519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:55.936431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:55.937752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:55.996266 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1285/2540] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:56.006351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:56.008077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:56.065555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e51dd0-5474-42f2-87f5-78e2d5caf0ad admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:56.069169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:56.069804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:56.070086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:56.070360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:56.079901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:56.081333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:56.090393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1256/2541] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:56.439219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:56.440796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:56.465000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a7587-bcda-4dc2-bf3a-117d1e768aa9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:56.474088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:56.475063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:56.475349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:56.475631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] PATH_INFO: `/v3/projects/c335f668e1934df38eaeaaf86af96083` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:56.476906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c335f668e1934df38eaeaaf86af96083)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:56.479063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:56.527010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c335f668e1934df38eaeaaf86af96083', 'request_id': 'req-a293492a-141f-4496-9a1e-8e0adfa9c189'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.534520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c335f668e1934df38eaeaaf86af96083', 'request_id': 'req-a293492a-141f-4496-9a1e-8e0adfa9c189'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.542739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c335f668e1934df38eaeaaf86af96083', 'request_id': 'req-a293492a-141f-4496-9a1e-8e0adfa9c189'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.553695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] The token cache is being invalidate because project c335f668e1934df38eaeaaf86af96083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:56.554237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.555049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.556734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1286/2542] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:56 2022] DELETE /identity/v3/projects/c335f668e1934df38eaeaaf86af96083 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:56.560650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:56.571190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209767d-a3da-4958-99bd-dc01998637fc service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:56.632900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:56.633889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:56.634286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:56.634581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] PATH_INFO: `/v3/users/45ded100e379444f8ad9c30516375cf0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:56.635793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ded100e379444f8ad9c30516375cf0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:56.637726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:56.684620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ded100e379444f8ad9c30516375cf0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.691278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ded100e379444f8ad9c30516375cf0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.691933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ded100e379444f8ad9c30516375cf0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.692528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ded100e379444f8ad9c30516375cf0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.700194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f286cd79-ec3a-4f17-b010-8a6b98516480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ded100e379444f8ad9c30516375cf0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:56.717852 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1257/2543] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:56 2022] DELETE /identity/v3/users/45ded100e379444f8ad9c30516375cf0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:57.135330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:57.137251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:57.157473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293492a-141f-4496-9a1e-8e0adfa9c189 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:57.288218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:57.289347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.289634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.289913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] PATH_INFO: `/v3/projects/23af23cd0357473b9aa411e924c96a5b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.291148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23af23cd0357473b9aa411e924c96a5b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:57.293081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:57.348686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23af23cd0357473b9aa411e924c96a5b', 'request_id': 'req-0ed45df5-9ef2-4413-9721-8bc1e78da408'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:57.357488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23af23cd0357473b9aa411e924c96a5b', 'request_id': 'req-0ed45df5-9ef2-4413-9721-8bc1e78da408'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:57.368501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23af23cd0357473b9aa411e924c96a5b', 'request_id': 'req-0ed45df5-9ef2-4413-9721-8bc1e78da408'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:57.379897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] The token cache is being invalidate because project 23af23cd0357473b9aa411e924c96a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:57.380413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:57.381149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ed45df5-9ef2-4413-9721-8bc1e78da408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:57.382817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1287/2544] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:57 2022] DELETE /identity/v3/projects/23af23cd0357473b9aa411e924c96a5b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:57.388924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a764d-13e9-4b27-bd68-64f0541d01d8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.389823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a764d-13e9-4b27-bd68-64f0541d01d8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.390111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a764d-13e9-4b27-bd68-64f0541d01d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.409069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-947a764d-13e9-4b27-bd68-64f0541d01d8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:57.410512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-947a764d-13e9-4b27-bd68-64f0541d01d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:57.473858 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1258/2545] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:57.482689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ec56-3801-4320-a3f5-0356389d041f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.484150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ec56-3801-4320-a3f5-0356389d041f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.484601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ec56-3801-4320-a3f5-0356389d041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.504267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9220ec56-3801-4320-a3f5-0356389d041f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:57.505385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9220ec56-3801-4320-a3f5-0356389d041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:57.513261 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1288/2546] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:57.517537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a764d-13e9-4b27-bd68-64f0541d01d8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:57.527863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a764d-13e9-4b27-bd68-64f0541d01d8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:57.536651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:57.537494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.538003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.538500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.539454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:47:57.539763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:57.541879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:57.559716 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1259/2547] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:47:57.565684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220ec56-3801-4320-a3f5-0356389d041f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:57.579101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220ec56-3801-4320-a3f5-0356389d041f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:57.584675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:57.585618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.586075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.586358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.587120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:57.589097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:57.633761 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1289/2548] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:57 2022] POST /identity/v3/projects => generated 409 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:57.635346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:57.647875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7e249-69be-48d1-b2a8-c6957e25710c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:57.717167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:57.718724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.719260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.719714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.720736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:57.723518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:57.751312 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1260/2549] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:57 2022] POST /identity/v3/users => generated 305 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:57.751734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:57.765580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10e5e-adfa-4422-a595-2c29e597bb61 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:57.772378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:57.773317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.773760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.774220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.775156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:57.777047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:57.796642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:57.796857 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1290/2550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:57.810962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edcd89-04df-4aae-8b3c-18836b1a292e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:57.819051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f7b12-1d9b-4d53-9b7a-8924fdf1e3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:57.820026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7b12-1d9b-4d53-9b7a-8924fdf1e3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.820465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7b12-1d9b-4d53-9b7a-8924fdf1e3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.821823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7b12-1d9b-4d53-9b7a-8924fdf1e3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.822943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f7b12-1d9b-4d53-9b7a-8924fdf1e3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:57.824733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f7b12-1d9b-4d53-9b7a-8924fdf1e3a3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:57.839051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1261/2551] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:57.839994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:57.869488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b7b4d-2077-4c0f-ad5c-a5cc3bf947b9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:57.874968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:57.876562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.876851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.877126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] PATH_INFO: `/v3/projects/879aa8e5a8b844c48260a9c488de929f/users/9e3489f2bb7e48ebb0dcbb8d5e6b29dc/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.896704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=879aa8e5a8b844c48260a9c488de929f, user_id=9e3489f2bb7e48ebb0dcbb8d5e6b29dc, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:57.899489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:57.918818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1291/2552] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:57 2022] PUT /identity/v3/projects/879aa8e5a8b844c48260a9c488de929f/users/9e3489f2bb7e48ebb0dcbb8d5e6b29dc/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:57.929998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50b599-4ea9-43cb-8a68-78555d0073f7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:57.930884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50b599-4ea9-43cb-8a68-78555d0073f7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:57.930884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50b599-4ea9-43cb-8a68-78555d0073f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:57.958900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7d50b599-4ea9-43cb-8a68-78555d0073f7 None None] MFA Rules not processed for user `9e3489f2bb7e48ebb0dcbb8d5e6b29dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:57.960225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7d50b599-4ea9-43cb-8a68-78555d0073f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:58.075245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1262/2553] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:58.079916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.165329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603af4c5-f9e9-4c7a-ae1b-b35bda1d10ee admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:58.173217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:58.173890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.174177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.174453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.175195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:58.178357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:58.226288 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1292/2554] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:47:58 2022] POST /identity/v3/projects => generated 407 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:58.230715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50b599-4ea9-43cb-8a68-78555d0073f7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.243880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50b599-4ea9-43cb-8a68-78555d0073f7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:58.321238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:58.322326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.322678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.323083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.323852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:58.326240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:58.350429 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1263/2555] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:47:58 2022] POST /identity/v3/users => generated 310 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:47:58.354538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.365144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaa15b-5b76-47a4-9cb4-2dad2502dedd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:58.371224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:58.371905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.372191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.372469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.373228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:58.375437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:58.387642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1293/2556] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:47:58.393292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.403330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c1da2-9207-4b0b-bf5d-509abff45ce2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:58.409314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:58.410410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.410761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.411135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] PATH_INFO: `/v3/projects/1f7cd8aadc01403ba1fae2c9d4b1af55/users/cd3d5c403ca54aa591eadb9306e4c721/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.429236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7cd8aadc01403ba1fae2c9d4b1af55, user_id=cd3d5c403ca54aa591eadb9306e4c721, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:58.432490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:58.452224 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1264/2557] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:58 2022] PUT /identity/v3/projects/1f7cd8aadc01403ba1fae2c9d4b1af55/users/cd3d5c403ca54aa591eadb9306e4c721/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:58.456872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.478115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a489ccc-34c5-4bd4-b8c3-abee4e2798e9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:58.540488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013ea45-44f8-435c-bee6-b47ae10780ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:58.541201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ea45-44f8-435c-bee6-b47ae10780ac admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.541763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ea45-44f8-435c-bee6-b47ae10780ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.542039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013ea45-44f8-435c-bee6-b47ae10780ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.542971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013ea45-44f8-435c-bee6-b47ae10780ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:58.544800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013ea45-44f8-435c-bee6-b47ae10780ac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:58.555764 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1294/2558] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:47:58.559959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.572326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a6c30-42b6-4218-86e8-6c8b1c153b7b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:58.578618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ff4d7-6036-453a-af31-613bcba0e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:58.579596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff4d7-6036-453a-af31-613bcba0e4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.579876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff4d7-6036-453a-af31-613bcba0e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.580154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ff4d7-6036-453a-af31-613bcba0e4fc admin admin] PATH_INFO: `/v3/projects/1f7cd8aadc01403ba1fae2c9d4b1af55/users/cd3d5c403ca54aa591eadb9306e4c721/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.582347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ff4d7-6036-453a-af31-613bcba0e4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7cd8aadc01403ba1fae2c9d4b1af55, user_id=cd3d5c403ca54aa591eadb9306e4c721, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:58.585617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ff4d7-6036-453a-af31-613bcba0e4fc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:58.598393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1265/2559] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:47:58 2022] PUT /identity/v3/projects/1f7cd8aadc01403ba1fae2c9d4b1af55/users/cd3d5c403ca54aa591eadb9306e4c721/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:58.610962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c70e9-ed26-4831-803e-292e353e7dc4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.611255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c70e9-ed26-4831-803e-292e353e7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.611539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c70e9-ed26-4831-803e-292e353e7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.645900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-429c70e9-ed26-4831-803e-292e353e7dc4 None None] MFA Rules not processed for user `cd3d5c403ca54aa591eadb9306e4c721`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:58.647455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-429c70e9-ed26-4831-803e-292e353e7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:58.687632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7b18-3f81-4327-90f7-e62396df87a3 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.687931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7b18-3f81-4327-90f7-e62396df87a3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.688213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b7b18-3f81-4327-90f7-e62396df87a3 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.689715 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1266/2560] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:47:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:47:58.696294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.696578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.696856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.729197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:58.730440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:58.761190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1295/2561] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:58 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:58.769139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c70e9-ed26-4831-803e-292e353e7dc4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.878429 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1267/2562] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:47:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:47:58.879613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c70e9-ed26-4831-803e-292e353e7dc4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:58.888015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:58.888920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:58.889202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:58.890419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] PATH_INFO: `/v3/users/9e3489f2bb7e48ebb0dcbb8d5e6b29dc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:58.891777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3489f2bb7e48ebb0dcbb8d5e6b29dc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:58.893741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:58.948327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:58.953423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:58.992212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691c284-1a8e-40ac-a8ec-25b8bc304ab6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:59.007530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1f397-ecf1-405f-a139-874b27d97a37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:59.008206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1f397-ecf1-405f-a139-874b27d97a37 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:59.008486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1f397-ecf1-405f-a139-874b27d97a37 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:59.008833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1f397-ecf1-405f-a139-874b27d97a37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:59.023161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1f397-ecf1-405f-a139-874b27d97a37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:59.024787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1f397-ecf1-405f-a139-874b27d97a37 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:59.034981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3489f2bb7e48ebb0dcbb8d5e6b29dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.035717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3489f2bb7e48ebb0dcbb8d5e6b29dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.045812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3489f2bb7e48ebb0dcbb8d5e6b29dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.047003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3489f2bb7e48ebb0dcbb8d5e6b29dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.057023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3489f2bb7e48ebb0dcbb8d5e6b29dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.063809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1268/2563] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:59.081881 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1296/2564] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:58 2022] DELETE /identity/v3/users/9e3489f2bb7e48ebb0dcbb8d5e6b29dc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:59.086466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:59.086759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:59.087060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:59.122719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:47:59.124591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:59.221109 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1269/2565] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:47:59.232038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:59.233561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:59.368449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a20f8-64d5-46e8-92f4-87c1aba5b75d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:59.378111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:59.379150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:59.379588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:59.380168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:59.397756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:59.399280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:59.410554 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1297/2566] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:47:59.753921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:59.755372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:47:59.769562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0aa87-8130-4f28-92cd-17c512538505 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:59.774843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:59.775976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:59.776249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:59.776790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] PATH_INFO: `/v3/projects/879aa8e5a8b844c48260a9c488de929f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:59.777992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879aa8e5a8b844c48260a9c488de929f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:59.780374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:47:59.845697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879aa8e5a8b844c48260a9c488de929f', 'request_id': 'req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.851852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879aa8e5a8b844c48260a9c488de929f', 'request_id': 'req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.861328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879aa8e5a8b844c48260a9c488de929f', 'request_id': 'req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.871708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] The token cache is being invalidate because project 879aa8e5a8b844c48260a9c488de929f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:47:59.872004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.872624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd88cc68-6319-48a4-8f3c-8c5e1b2b1f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:47:59.874294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1270/2567] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:47:59 2022] DELETE /identity/v3/projects/879aa8e5a8b844c48260a9c488de929f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:47:59.878361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:47:59.887875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2643a7-fe05-4929-9081-6c37218ffde8 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:47:59.946141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:47:59.947040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:47:59.947353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:47:59.947631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] PATH_INFO: `/v3/users/cd3d5c403ca54aa591eadb9306e4c721` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:47:59.949082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3d5c403ca54aa591eadb9306e4c721)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:47:59.951414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:00.005258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3d5c403ca54aa591eadb9306e4c721'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.006004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3d5c403ca54aa591eadb9306e4c721'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.013149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3d5c403ca54aa591eadb9306e4c721'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.013940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3d5c403ca54aa591eadb9306e4c721'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.023363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf09b539-c316-4cd2-a034-35060a037e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3d5c403ca54aa591eadb9306e4c721'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.041590 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1298/2568] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:47:59 2022] DELETE /identity/v3/users/cd3d5c403ca54aa591eadb9306e4c721 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:48:00.322669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b36e-ab6e-41fb-81cd-8f4791a5b5b4 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.323238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b36e-ab6e-41fb-81cd-8f4791a5b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.323692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46b36e-ab6e-41fb-81cd-8f4791a5b5b4 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.325525 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1271/2569] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:48:00.345777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.346366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.347340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.373266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:00.375747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:00.448977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46b36e-ab6e-41fb-81cd-8f4791a5b5b4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:00.451529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5c46b36e-ab6e-41fb-81cd-8f4791a5b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:00.514004 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1299/2570] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:48:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:00.571272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:00.572827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:00.575613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46b36e-ab6e-41fb-81cd-8f4791a5b5b4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:00.583466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:00.584866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.584866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.584866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] PATH_INFO: `/v3/projects/1f7cd8aadc01403ba1fae2c9d4b1af55` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.586431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7cd8aadc01403ba1fae2c9d4b1af55)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:00.588489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:00.589624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669ac2-d58f-490b-acd2-b8d48121f6dc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:00.594842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341449d7-fb13-4b5d-b1b3-8815d320bc8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:00.595512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341449d7-fb13-4b5d-b1b3-8815d320bc8d service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.596402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341449d7-fb13-4b5d-b1b3-8815d320bc8d service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.596692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341449d7-fb13-4b5d-b1b3-8815d320bc8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.605624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341449d7-fb13-4b5d-b1b3-8815d320bc8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:00.607433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341449d7-fb13-4b5d-b1b3-8815d320bc8d service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:00.617576 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1300/2571] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:48:00.642739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7cd8aadc01403ba1fae2c9d4b1af55', 'request_id': 'req-c8be9bb0-7086-4fd7-8a58-131d65994d0a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.650060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7cd8aadc01403ba1fae2c9d4b1af55', 'request_id': 'req-c8be9bb0-7086-4fd7-8a58-131d65994d0a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.666865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7cd8aadc01403ba1fae2c9d4b1af55', 'request_id': 'req-c8be9bb0-7086-4fd7-8a58-131d65994d0a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.696828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] The token cache is being invalidate because project 1f7cd8aadc01403ba1fae2c9d4b1af55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:48:00.697187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.697920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8be9bb0-7086-4fd7-8a58-131d65994d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:00.719698 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1272/2572] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:00 2022] DELETE /identity/v3/projects/1f7cd8aadc01403ba1fae2c9d4b1af55 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:00.725749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00150c62-7834-48e9-b5c2-efe12f5378f0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.726113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00150c62-7834-48e9-b5c2-efe12f5378f0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.726321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00150c62-7834-48e9-b5c2-efe12f5378f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.753165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-00150c62-7834-48e9-b5c2-efe12f5378f0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:00.754450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00150c62-7834-48e9-b5c2-efe12f5378f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:00.833152 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1301/2573] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:00.844769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff356-6029-46c3-a8c0-252cd51cde2d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.845366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff356-6029-46c3-a8c0-252cd51cde2d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.845542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff356-6029-46c3-a8c0-252cd51cde2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.869921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9cfff356-6029-46c3-a8c0-252cd51cde2d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:00.873240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e43fd-ea37-4a3b-b130-e18791e1ec6b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.873738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e43fd-ea37-4a3b-b130-e18791e1ec6b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.874707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e43fd-ea37-4a3b-b130-e18791e1ec6b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.876702 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1302/2574] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:48:00.877524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9cfff356-6029-46c3-a8c0-252cd51cde2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:00.882977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b891-a079-499d-87e7-6dbbfdbd93af None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.883931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b891-a079-499d-87e7-6dbbfdbd93af None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.884332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1b891-a079-499d-87e7-6dbbfdbd93af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.897218 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1273/2575] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:00.900005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff356-6029-46c3-a8c0-252cd51cde2d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:00.910058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bdd1b891-a079-499d-87e7-6dbbfdbd93af None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:00.912022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bdd1b891-a079-499d-87e7-6dbbfdbd93af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:00.915295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff356-6029-46c3-a8c0-252cd51cde2d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:00.922367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:00.924971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:00.925305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:00.925592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:00.926378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:48:00.927148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:00.929285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:00.962137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1274/2576] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:48:00.968496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.017951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcbba-2133-4af2-bf7b-2a2e2b44b129 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.018276 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1303/2577] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:48:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:48:01.026646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5db847-9c3d-4715-91a0-182b6623a29a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.027149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5db847-9c3d-4715-91a0-182b6623a29a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.027672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5db847-9c3d-4715-91a0-182b6623a29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.037085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.042227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.042652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.043029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.043820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.045881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.054386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7b5db847-9c3d-4715-91a0-182b6623a29a None None] MFA Rules not processed for user `7dd9c30816a7410f94b10294234c1dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:01.056343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b5db847-9c3d-4715-91a0-182b6623a29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:01.087684 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1275/2578] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:48:00 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:01.088757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.091952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:01.155164 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1304/2579] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:01.156690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5db847-9c3d-4715-91a0-182b6623a29a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.170273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5db847-9c3d-4715-91a0-182b6623a29a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.183910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656be2c8-2df7-4945-b25e-615535920fee admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.197196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.198099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.198570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.199049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.242357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.247845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.248219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.248570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.250134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.252292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.302296 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1305/2580] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:48:01 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:01.308048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.323826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457117fd-3363-473b-a4ac-001b03b28c95 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.325746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.328376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.331654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.332330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.332755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.333098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.333902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.338310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.350591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1276/2581] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:01.354625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1306/2582] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:48:01.355640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.366547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89f559-9274-4c62-b790-bd12ca0941ea service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.375516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f5026-bd07-4e08-a692-f665c78365e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.376321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5026-bd07-4e08-a692-f665c78365e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.376680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5026-bd07-4e08-a692-f665c78365e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.377034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f5026-bd07-4e08-a692-f665c78365e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.378089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f5026-bd07-4e08-a692-f665c78365e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.382284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f5026-bd07-4e08-a692-f665c78365e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.396112 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1277/2583] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:01.401918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.418211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941cf7a-8e9d-46a0-a930-bc4faaf9d724 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.423919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.424964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.425433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.425716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] PATH_INFO: `/v3/projects/db9bfb87028d4c069dba18e42c7bdf13/users/bb6270f2f93f4f94b70d316baa2fd745/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.456528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9bfb87028d4c069dba18e42c7bdf13, user_id=bb6270f2f93f4f94b70d316baa2fd745, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.460152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.500139 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1307/2584] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:48:01 2022] PUT /identity/v3/projects/db9bfb87028d4c069dba18e42c7bdf13/users/bb6270f2f93f4f94b70d316baa2fd745/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:01.515452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a272-2e55-481f-b2b2-a73520fb79e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.515973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a272-2e55-481f-b2b2-a73520fb79e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.516258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a272-2e55-481f-b2b2-a73520fb79e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.549803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3aa9a272-2e55-481f-b2b2-a73520fb79e6 None None] MFA Rules not processed for user `bb6270f2f93f4f94b70d316baa2fd745`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:01.551378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3aa9a272-2e55-481f-b2b2-a73520fb79e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:01.642827 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1278/2585] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:01.647667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.750088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccdabd-72ca-4ca7-a693-2c123aae0595 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.756232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.756910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.757280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.757564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.758260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.760234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.789986 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1308/2586] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:48:01 2022] POST /identity/v3/projects => generated 393 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:01.794032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9a272-2e55-481f-b2b2-a73520fb79e6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.805964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9a272-2e55-481f-b2b2-a73520fb79e6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.881794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.881794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.881794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.881794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.882628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.882628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.905892 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1279/2587] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:48:01 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:01.907082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.919265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56c9a-18db-4e26-884a-c824f96e4f05 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.924560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700052-ee30-4682-a488-2667756862ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.925236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700052-ee30-4682-a488-2667756862ad admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.925518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700052-ee30-4682-a488-2667756862ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.925792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700052-ee30-4682-a488-2667756862ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.926521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700052-ee30-4682-a488-2667756862ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.928203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700052-ee30-4682-a488-2667756862ad admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:01.944864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1309/2588] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:01.946108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:01.957250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f9bd1-79ca-431d-a0d6-191f067ba162 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:01.964423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:01.965844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:01.966129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:01.966410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] PATH_INFO: `/v3/projects/635884e93f9149bebcedb5ca43a06113/users/99bfa651d09e48f1ae2f591f98244898/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:01.982267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635884e93f9149bebcedb5ca43a06113, user_id=99bfa651d09e48f1ae2f591f98244898, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:01.985770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:02.000605 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1280/2589] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:48:01 2022] PUT /identity/v3/projects/635884e93f9149bebcedb5ca43a06113/users/99bfa651d09e48f1ae2f591f98244898/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:02.005022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700052-ee30-4682-a488-2667756862ad admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:02.015455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700052-ee30-4682-a488-2667756862ad admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:02.077268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eacb1a-047d-44a8-9ce4-f738b2c0badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:02.078269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacb1a-047d-44a8-9ce4-f738b2c0badf admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:02.078269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacb1a-047d-44a8-9ce4-f738b2c0badf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:02.078490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacb1a-047d-44a8-9ce4-f738b2c0badf admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:02.079288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eacb1a-047d-44a8-9ce4-f738b2c0badf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:02.081032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eacb1a-047d-44a8-9ce4-f738b2c0badf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:02.093372 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1310/2590] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:02.097735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:02.110500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb62dc-6fec-4059-8973-354dea6c9675 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:02.120426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:02.121701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:02.122137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:02.122460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] PATH_INFO: `/v3/projects/635884e93f9149bebcedb5ca43a06113/users/99bfa651d09e48f1ae2f591f98244898/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:02.129501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635884e93f9149bebcedb5ca43a06113, user_id=99bfa651d09e48f1ae2f591f98244898, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:02.133360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:02.148363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1281/2591] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:48:02 2022] PUT /identity/v3/projects/635884e93f9149bebcedb5ca43a06113/users/99bfa651d09e48f1ae2f591f98244898/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:02.161496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:02.161801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:02.162090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:02.191496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] MFA Rules not processed for user `99bfa651d09e48f1ae2f591f98244898`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:02.192825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:02.287651 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1311/2592] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:02.300624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:02.302514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:02.419511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f21741-ce54-4edb-941a-0fa96a2c2a11 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:02.430749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:02.431479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:02.432037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:02.432528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:02.450993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:02.454018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:02.466840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1282/2593] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:02.535300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:02.537472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:02.565147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b817920-83e8-485d-bf7e-44ab7d8ba5dc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:02.578409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3defb-53fe-473e-aa8c-c56ad0d7d393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:02.579175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3defb-53fe-473e-aa8c-c56ad0d7d393 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:02.579470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3defb-53fe-473e-aa8c-c56ad0d7d393 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:02.580008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3defb-53fe-473e-aa8c-c56ad0d7d393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:02.658345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3defb-53fe-473e-aa8c-c56ad0d7d393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:02.662161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3defb-53fe-473e-aa8c-c56ad0d7d393 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:02.675540 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1312/2594] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:02.710982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:02.925095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0226fc-7579-4b60-b572-a6fa38742a2b service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:02.948563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:02.949238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:02.949528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:02.949805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] PATH_INFO: `/v3/users/bb6270f2f93f4f94b70d316baa2fd745` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:02.963903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6270f2f93f4f94b70d316baa2fd745)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:02.965882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:03.094372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6270f2f93f4f94b70d316baa2fd745'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:03.109989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6270f2f93f4f94b70d316baa2fd745'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:03.115166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6270f2f93f4f94b70d316baa2fd745'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:03.116356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6270f2f93f4f94b70d316baa2fd745'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:03.129924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6270f2f93f4f94b70d316baa2fd745'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:03.171664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1283/2595] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:48:02 2022] DELETE /identity/v3/users/bb6270f2f93f4f94b70d316baa2fd745 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:03.175810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0563b-5271-4208-baa9-f99d8fa468b5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:03.176678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0563b-5271-4208-baa9-f99d8fa468b5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:03.177172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0563b-5271-4208-baa9-f99d8fa468b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:03.216619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1eb0563b-5271-4208-baa9-f99d8fa468b5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:03.217903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1eb0563b-5271-4208-baa9-f99d8fa468b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:03.327820 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1313/2596] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:03.347087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:03.348981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:03.431743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2ff2-d182-482c-b60b-737ee9242248 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:03.436412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:03.437417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:03.437943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:03.438224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:03.459456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:03.461614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:03.473684 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1284/2597] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:03.903642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:03.904290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:03.905588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:03.939269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:03.943816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:04.070306 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1314/2598] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 07 21:48:04.098529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:04.104658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:04.239208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56683d5-46d5-43bf-9c1e-acb09e8c23c9 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:04.245622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:04.246366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:04.246648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:04.246960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:04.256261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:04.257880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:04.267398 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1285/2599] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:48:04.541375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:04.542831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:04.609667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f88ed-9f8c-476e-a3ad-a5fe318455b7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:04.638164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:04.641847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:04.648951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:04.649494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] PATH_INFO: `/v3/projects/db9bfb87028d4c069dba18e42c7bdf13` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:04.654007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9bfb87028d4c069dba18e42c7bdf13)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:04.664330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:04.805558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9bfb87028d4c069dba18e42c7bdf13', 'request_id': 'req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:04.819931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9bfb87028d4c069dba18e42c7bdf13', 'request_id': 'req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:04.840351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9bfb87028d4c069dba18e42c7bdf13', 'request_id': 'req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:04.858094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] The token cache is being invalidate because project db9bfb87028d4c069dba18e42c7bdf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:48:04.859551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:04.861004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:04.864274 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1315/2600] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:04 2022] DELETE /identity/v3/projects/db9bfb87028d4c069dba18e42c7bdf13 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:04.868807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:04.884087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be9376-25c5-4464-87e1-dd65b60ac0ac service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:05.095710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:05.096619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:05.096911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:05.097199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] PATH_INFO: `/v3/users/99bfa651d09e48f1ae2f591f98244898` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:05.103769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bfa651d09e48f1ae2f591f98244898)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:05.116435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:05.183720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bfa651d09e48f1ae2f591f98244898'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:05.192898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bfa651d09e48f1ae2f591f98244898'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:05.194260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bfa651d09e48f1ae2f591f98244898'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:05.195305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bfa651d09e48f1ae2f591f98244898'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:05.212027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bfa651d09e48f1ae2f591f98244898'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:05.239633 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1286/2601] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:48:04 2022] DELETE /identity/v3/users/99bfa651d09e48f1ae2f591f98244898 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:05.617926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:05.620111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:05.643738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18f66-7076-4cfc-af7f-37f52ce0b2a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:05.851130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:05.853070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:05.855493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:05.857346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:05.857802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:05.858436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] PATH_INFO: `/v3/users/e1333f2166c947a4a37dd6865f532f24` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:05.860006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1333f2166c947a4a37dd6865f532f24)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:05.862220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:05.887199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd536ef-d685-47d9-8335-8d51570e6e88 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:05.901405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:05.902483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:05.903364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:05.904138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] PATH_INFO: `/v3/projects/635884e93f9149bebcedb5ca43a06113` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:05.905829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635884e93f9149bebcedb5ca43a06113)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:05.907990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.000940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1333f2166c947a4a37dd6865f532f24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.001505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1333f2166c947a4a37dd6865f532f24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.002505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635884e93f9149bebcedb5ca43a06113', 'request_id': 'req-39f660a5-303b-4bec-bb72-19dec2df3fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.012886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1333f2166c947a4a37dd6865f532f24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.014103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1333f2166c947a4a37dd6865f532f24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.015635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635884e93f9149bebcedb5ca43a06113', 'request_id': 'req-39f660a5-303b-4bec-bb72-19dec2df3fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.041083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635884e93f9149bebcedb5ca43a06113', 'request_id': 'req-39f660a5-303b-4bec-bb72-19dec2df3fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.047826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-01a40ffb-8408-44f0-9406-67be37c23e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1333f2166c947a4a37dd6865f532f24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.064014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] The token cache is being invalidate because project 635884e93f9149bebcedb5ca43a06113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:48:06.064313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.066465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39f660a5-303b-4bec-bb72-19dec2df3fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:06.072037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1287/2602] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:05 2022] DELETE /identity/v3/projects/635884e93f9149bebcedb5ca43a06113 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:48:06.079051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b12323-200d-4117-af4e-3e31bc4c96ee None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.079744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b12323-200d-4117-af4e-3e31bc4c96ee None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.080305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b12323-200d-4117-af4e-3e31bc4c96ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.089770 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1316/2603] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:48:05 2022] DELETE /identity/v3/users/e1333f2166c947a4a37dd6865f532f24 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:06.094425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.094912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.095344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.122467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b9b12323-200d-4117-af4e-3e31bc4c96ee None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:06.125421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b9b12323-200d-4117-af4e-3e31bc4c96ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:06.139318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:06.142035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:06.288385 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1288/2604] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:06.297337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e17cc-a07a-4a03-94e3-5fd3cc3a7222 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.297852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e17cc-a07a-4a03-94e3-5fd3cc3a7222 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.299091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e17cc-a07a-4a03-94e3-5fd3cc3a7222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.311078 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1317/2605] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:06.325624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.327773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:06.359550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f79e17cc-a07a-4a03-94e3-5fd3cc3a7222 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:06.365310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f79e17cc-a07a-4a03-94e3-5fd3cc3a7222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:06.397947 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1289/2606] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:48:06.401719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e17cc-a07a-4a03-94e3-5fd3cc3a7222 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.423547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e17cc-a07a-4a03-94e3-5fd3cc3a7222 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.430060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.430842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.431138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.431415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.433403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:48:06.433701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:06.435996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.456057 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1290/2607] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:48:06.456394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.470930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742b844-3b3c-40db-9fcb-f15c77ba8f77 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.477101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.477372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.477666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.477942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.478630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:06.480673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.508229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e89328-44b2-4573-a521-f5497a4f6b9e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.517189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.517889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.518177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.518460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.536458 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1291/2608] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:48:06 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:48:06.537982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.543832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:06.546291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.568573 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1318/2609] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:06.660874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91cfe8-79fb-4625-bffe-eab609664c35 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.666332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.667055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.667343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.667621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.668329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:06.670352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.709662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1292/2610] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:48:06 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:06.714815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.730404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5973fc-7834-461f-bb58-637160b8a4cf service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.744631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.745830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.753232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.753819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.754866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:06.759885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.810129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1319/2611] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:06.816514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.832722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe05ad-1f2f-4911-8fab-9e502a20b2d8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.862542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.863820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.864357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.865342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.865784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:06.869009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.888014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.891262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:06.912045 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1293/2612] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:06.917229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:06.925619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aa527-35d3-4f90-9777-34a8a12a6fed admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.963558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.966851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd54f64-ea05-4d30-8a46-ad0e7c063aa4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:06.967300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.969235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.969632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] PATH_INFO: `/v3/projects/95946c2e9a5c4a72905d75010a9bb7a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:06.972772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95946c2e9a5c4a72905d75010a9bb7a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:06.976516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:06.987955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c58b8-b106-4b2a-bb10-d20d2426a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:06.989274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c58b8-b106-4b2a-bb10-d20d2426a45d admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:06.989788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c58b8-b106-4b2a-bb10-d20d2426a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:06.995095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c58b8-b106-4b2a-bb10-d20d2426a45d admin admin] PATH_INFO: `/v3/projects/b54c87608b4742e7bb720e7cd095a5ed/users/b520cb8b70634a5fbe8c7a17ebfa8982/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:07.026492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c58b8-b106-4b2a-bb10-d20d2426a45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54c87608b4742e7bb720e7cd095a5ed, user_id=b520cb8b70634a5fbe8c7a17ebfa8982, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:07.043293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c58b8-b106-4b2a-bb10-d20d2426a45d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:07.103512 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1294/2613] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:48:06 2022] PUT /identity/v3/projects/b54c87608b4742e7bb720e7cd095a5ed/users/b520cb8b70634a5fbe8c7a17ebfa8982/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:07.108684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:07.109523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:07.111760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:07.118291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95946c2e9a5c4a72905d75010a9bb7a5', 'request_id': 'req-baac44b2-b134-4389-9c35-43760b592134'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.136471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95946c2e9a5c4a72905d75010a9bb7a5', 'request_id': 'req-baac44b2-b134-4389-9c35-43760b592134'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.147603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:07.150054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:07.158332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95946c2e9a5c4a72905d75010a9bb7a5', 'request_id': 'req-baac44b2-b134-4389-9c35-43760b592134'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.198970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] The token cache is being invalidate because project 95946c2e9a5c4a72905d75010a9bb7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:48:07.200599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.205834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.213214 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1320/2614] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:06 2022] DELETE /identity/v3/projects/95946c2e9a5c4a72905d75010a9bb7a5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:48:07.218499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:07.223442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:07.343438 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1295/2615] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:07.353358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:07.356130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:07.390757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac44b2-b134-4389-9c35-43760b592134 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:07.405981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:07.406917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:07.407202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:07.407476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] PATH_INFO: `/v3/users/2cc85c70e1094bff978c7ef711f2bed3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:07.408755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc85c70e1094bff978c7ef711f2bed3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:07.410927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:07.516018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc85c70e1094bff978c7ef711f2bed3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.517115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc85c70e1094bff978c7ef711f2bed3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.521804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81173c40-dc3f-415c-90b8-797152081be6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:07.527424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:07.528402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:07.528694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:07.528970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:07.534620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:07.537623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc85c70e1094bff978c7ef711f2bed3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.538722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc85c70e1094bff978c7ef711f2bed3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.554559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e2d792d3-e30c-4ea9-a439-353ee32172c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc85c70e1094bff978c7ef711f2bed3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:07.556666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:07.567744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:07.590696 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1296/2616] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:48:07.605257 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1321/2617] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:48:07 2022] DELETE /identity/v3/users/2cc85c70e1094bff978c7ef711f2bed3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:08.074034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:08.075498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:08.109174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed98ae-6ba7-4e14-b232-111fde384613 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:08.238671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:08.240983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:08.241476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:08.242362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] PATH_INFO: `/v3/projects/3f76a01201d14762b196350691f865bf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:08.244434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f76a01201d14762b196350691f865bf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:08.247073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:08.321017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f76a01201d14762b196350691f865bf', 'request_id': 'req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:08.332562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f76a01201d14762b196350691f865bf', 'request_id': 'req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:08.346439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f76a01201d14762b196350691f865bf', 'request_id': 'req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:08.384585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] The token cache is being invalidate because project 3f76a01201d14762b196350691f865bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:48:08.384945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:08.385628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4b1c8b2c-95b1-4dd1-80a2-02cf8fe06d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:08.392413 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1297/2618] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:08 2022] DELETE /identity/v3/projects/3f76a01201d14762b196350691f865bf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:08.394174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890eac-2e49-4b9f-b292-daa2b84cf5ae None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:08.394683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890eac-2e49-4b9f-b292-daa2b84cf5ae None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:08.394800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890eac-2e49-4b9f-b292-daa2b84cf5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:08.417767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-45890eac-2e49-4b9f-b292-daa2b84cf5ae None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:08.429183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45890eac-2e49-4b9f-b292-daa2b84cf5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:08.526211 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1322/2619] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:48:08.542913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518b29e-c169-487e-ac2c-ce61237f4dcf None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:08.542913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518b29e-c169-487e-ac2c-ce61237f4dcf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:08.542913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518b29e-c169-487e-ac2c-ce61237f4dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:08.567609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4518b29e-c169-487e-ac2c-ce61237f4dcf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:08.569640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4518b29e-c169-487e-ac2c-ce61237f4dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:08.588680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45890eac-2e49-4b9f-b292-daa2b84cf5ae None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:08.589020 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1298/2620] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:08.603999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45890eac-2e49-4b9f-b292-daa2b84cf5ae None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:08.613613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:08.615339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:08.615882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:08.616773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:08.619307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:48:08.620071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:08.622923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:08.643981 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1323/2621] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:48:08.644847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518b29e-c169-487e-ac2c-ce61237f4dcf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:08.668256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518b29e-c169-487e-ac2c-ce61237f4dcf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:08.681685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:08.683670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:08.684038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:08.686722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:08.688451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:08.690857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:08.752122 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1299/2622] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:48:08 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:08.756772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:08.776559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ebc59-3fe4-4f13-a2b4-7ee65bc42421 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:08.967692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:08.968415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:08.968704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:08.968979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:08.971143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:08.976624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:09.021770 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1324/2623] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:48:08 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:09.023014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:09.041519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0c3b-504a-471b-bbb6-0b8911f146d9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:09.050560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:09.051281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:09.051559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:09.051841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:09.052573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:09.054187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:09.074425 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1300/2624] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:09.078661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:09.109028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630cea48-a5a3-4897-8b89-a8a644754df2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:09.117582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8f943-0bfc-4a52-97e2-3aa88f76e5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:09.118271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8f943-0bfc-4a52-97e2-3aa88f76e5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:09.118554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8f943-0bfc-4a52-97e2-3aa88f76e5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:09.118866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8f943-0bfc-4a52-97e2-3aa88f76e5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:09.119610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8f943-0bfc-4a52-97e2-3aa88f76e5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:09.121412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8f943-0bfc-4a52-97e2-3aa88f76e5e6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:09.136460 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1325/2625] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:09.142608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:09.165831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319af72b-1f13-4628-b2a5-e8abe9500e9c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:09.185479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:09.187577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:09.188583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:09.189087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] PATH_INFO: `/v3/projects/6bff84c55662404f85da55f6d1c111b4/users/54fdb97b210a4f38a0fb6a100d9d72ab/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:09.218614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bff84c55662404f85da55f6d1c111b4, user_id=54fdb97b210a4f38a0fb6a100d9d72ab, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:09.223185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:09.248436 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1301/2626] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:48:09 2022] PUT /identity/v3/projects/6bff84c55662404f85da55f6d1c111b4/users/54fdb97b210a4f38a0fb6a100d9d72ab/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:09.254060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07514-2a85-48fe-adf3-8836c04a9a92 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:09.254351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07514-2a85-48fe-adf3-8836c04a9a92 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:09.254627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f07514-2a85-48fe-adf3-8836c04a9a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:09.290103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-27f07514-2a85-48fe-adf3-8836c04a9a92 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:09.291413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-27f07514-2a85-48fe-adf3-8836c04a9a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:09.401364 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1326/2627] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:09.402953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:09.404749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:09.496090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141511-a515-4912-84a5-cb489f2c0aa9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:09.501505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:09.503056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:09.503575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:09.504059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:09.517974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:09.524085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:09.551570 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1302/2628] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:48:14.913173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f508-f368-4364-a086-9f342b8b100b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:14.913753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f508-f368-4364-a086-9f342b8b100b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:14.913753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96f508-f368-4364-a086-9f342b8b100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:14.957915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2c96f508-f368-4364-a086-9f342b8b100b None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:14.959236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2c96f508-f368-4364-a086-9f342b8b100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:15.135973 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1327/2629] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:48:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:15.182208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:15.184873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:15.333380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2a61f-3f74-4b54-bd69-c8a8afe5b9b5 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:15.346276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ac17d-7abb-4eab-851a-3d11025faae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:15.347510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ac17d-7abb-4eab-851a-3d11025faae1 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:15.349914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ac17d-7abb-4eab-851a-3d11025faae1 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:15.350439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ac17d-7abb-4eab-851a-3d11025faae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:15.368804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ac17d-7abb-4eab-851a-3d11025faae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:15.370846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ac17d-7abb-4eab-851a-3d11025faae1 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:15.397260 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1303/2630] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:48:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:48:21.425320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:21.426397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:21.427054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:21.460760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] MFA Rules not processed for user `b520cb8b70634a5fbe8c7a17ebfa8982`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:21.462670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:21.651474 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1328/2631] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:22.161267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:22.161267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:22.161267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:22.233064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] MFA Rules not processed for user `54fdb97b210a4f38a0fb6a100d9d72ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:22.237159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:22.426492 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1304/2632] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:48:25.384265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:25.385813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:25.497977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b3c2-a6d2-44ac-9982-b57a7c8cb0f9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:25.507613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f823aa-f5b7-46f9-aa76-7b70fa83af35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:25.508240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f823aa-f5b7-46f9-aa76-7b70fa83af35 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:25.508612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f823aa-f5b7-46f9-aa76-7b70fa83af35 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:25.508969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f823aa-f5b7-46f9-aa76-7b70fa83af35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:25.520362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f823aa-f5b7-46f9-aa76-7b70fa83af35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:25.522366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f823aa-f5b7-46f9-aa76-7b70fa83af35 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:25.552046 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1329/2633] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:25.569491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:25.571471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:25.595798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2e398-898d-4984-a69c-cff29077c36e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:25.602952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:25.603903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:25.604358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:25.604800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:25.630295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:25.641318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:25.672972 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1305/2634] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:26.649862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:26.650677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:26.651996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:26.688204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:26.690683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:26.708708 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1330/2635] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:48:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:26.716415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:26.740192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb80bb-b316-423b-8c84-c2510504d1c2 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:26.757663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474ccbb-0067-4ec1-92a3-f751658a9e1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:26.759416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474ccbb-0067-4ec1-92a3-f751658a9e1b service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:26.760527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474ccbb-0067-4ec1-92a3-f751658a9e1b service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:26.776428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474ccbb-0067-4ec1-92a3-f751658a9e1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:26.797810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474ccbb-0067-4ec1-92a3-f751658a9e1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:26.799830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474ccbb-0067-4ec1-92a3-f751658a9e1b service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:26.821803 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1306/2636] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:48:27.295156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:27.296946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:27.535441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b7f5d-bd98-4afc-bf14-2d262411ac5a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:27.552350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:27.553040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:27.553330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:27.553607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:27.564615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:27.588247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:27.591603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:27.622458 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1331/2637] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:30.293098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:30.293560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:30.293644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:30.314345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] MFA Rules not processed for user `c562e7dec6d34cd0a7fc7cea14fa5e74`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:30.316056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:30.408086 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1307/2638] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:35.709107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:35.726521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169688f4-9540-44c0-86f5-6840cc85ca24 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:35.753315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f6438-7c4d-4cbc-9b52-6946da739293 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:35.755486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6438-7c4d-4cbc-9b52-6946da739293 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:35.757410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6438-7c4d-4cbc-9b52-6946da739293 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:35.763050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f6438-7c4d-4cbc-9b52-6946da739293 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:35.774387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-883f6438-7c4d-4cbc-9b52-6946da739293 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:35.832881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f6438-7c4d-4cbc-9b52-6946da739293 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:35.843248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f6438-7c4d-4cbc-9b52-6946da739293 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:35.878870 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1332/2639] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:38.733492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:38.735868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:38.760243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0b779-fc06-4217-9927-6f0ba9d36100 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:38.782274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:38.783380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:38.783818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:38.784330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] PATH_INFO: `/v3/users/b520cb8b70634a5fbe8c7a17ebfa8982` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:38.785818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b520cb8b70634a5fbe8c7a17ebfa8982)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:38.787981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:38.844722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b520cb8b70634a5fbe8c7a17ebfa8982'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:38.859925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b520cb8b70634a5fbe8c7a17ebfa8982'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:38.861187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b520cb8b70634a5fbe8c7a17ebfa8982'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:38.861973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b520cb8b70634a5fbe8c7a17ebfa8982'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:38.876147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b520cb8b70634a5fbe8c7a17ebfa8982'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:38.906564 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1308/2640] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:48:38 2022] DELETE /identity/v3/users/b520cb8b70634a5fbe8c7a17ebfa8982 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:39.100473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:39.100948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:39.100948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:39.121864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:39.123611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:39.191129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1333/2641] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:39.218215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:39.220227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:39.306569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b346985-fdc2-48d4-96cd-9f946068275c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:39.313159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b595e1-3632-4d40-ac42-39470e8bd8d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:39.314127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b595e1-3632-4d40-ac42-39470e8bd8d3 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:39.314740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b595e1-3632-4d40-ac42-39470e8bd8d3 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:39.316218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b595e1-3632-4d40-ac42-39470e8bd8d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:39.329178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b595e1-3632-4d40-ac42-39470e8bd8d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:39.331083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b595e1-3632-4d40-ac42-39470e8bd8d3 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:39.341408 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1309/2642] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:48:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:48:39.502539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:39.504294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:39.605666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c46b8-09e2-4b11-97e3-6a2f36fe1bd0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:39.611543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:39.612772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:39.613448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:39.613905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] PATH_INFO: `/v3/projects/b54c87608b4742e7bb720e7cd095a5ed` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:39.616354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54c87608b4742e7bb720e7cd095a5ed)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:39.618720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:39.684186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54c87608b4742e7bb720e7cd095a5ed', 'request_id': 'req-ecb2f800-47aa-4301-aea2-3f69053208f8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:39.691961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54c87608b4742e7bb720e7cd095a5ed', 'request_id': 'req-ecb2f800-47aa-4301-aea2-3f69053208f8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:39.708107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54c87608b4742e7bb720e7cd095a5ed', 'request_id': 'req-ecb2f800-47aa-4301-aea2-3f69053208f8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:39.723868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] The token cache is being invalidate because project b54c87608b4742e7bb720e7cd095a5ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:48:39.724562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:39.725331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecb2f800-47aa-4301-aea2-3f69053208f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:48:39.727606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1334/2643] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:48:39 2022] DELETE /identity/v3/projects/b54c87608b4742e7bb720e7cd095a5ed => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:39.737481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d17e-2f25-4bfe-9f46-324e07436c2c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:39.738019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d17e-2f25-4bfe-9f46-324e07436c2c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:39.738103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d17e-2f25-4bfe-9f46-324e07436c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:39.769356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8121d17e-2f25-4bfe-9f46-324e07436c2c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:39.770570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8121d17e-2f25-4bfe-9f46-324e07436c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:39.868975 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1310/2644] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:39.877651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99c2f-4554-479a-92de-77711eaaf128 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:39.878312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99c2f-4554-479a-92de-77711eaaf128 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:39.879164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f99c2f-4554-479a-92de-77711eaaf128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:39.904322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-50f99c2f-4554-479a-92de-77711eaaf128 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:39.905800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-50f99c2f-4554-479a-92de-77711eaaf128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:39.930106 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1335/2645] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:39.934442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121d17e-2f25-4bfe-9f46-324e07436c2c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:39.944545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121d17e-2f25-4bfe-9f46-324e07436c2c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:39.950125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:39.951369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:39.951654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:39.951937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:39.952797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:48:39.953108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:39.954732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:39.973647 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1311/2646] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:48:39.978202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f99c2f-4554-479a-92de-77711eaaf128 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:39.989034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f99c2f-4554-479a-92de-77711eaaf128 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:39.994466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9f931-befa-4406-87c9-630856607bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:39.995179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f931-befa-4406-87c9-630856607bcf admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:39.995461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f931-befa-4406-87c9-630856607bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:39.995735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f931-befa-4406-87c9-630856607bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:39.996419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9f931-befa-4406-87c9-630856607bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:39.998732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9f931-befa-4406-87c9-630856607bcf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:40.060493 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1336/2647] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:48:39 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:40.064717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:40.075188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944cf33-ef5d-40e7-8d88-432e2d73ec8f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:40.169468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bb3b3-d141-4167-8f1a-a6eb6eb6fccb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:40.170387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bb3b3-d141-4167-8f1a-a6eb6eb6fccb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:40.170679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bb3b3-d141-4167-8f1a-a6eb6eb6fccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:40.189489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-884bb3b3-d141-4167-8f1a-a6eb6eb6fccb None None] MFA Rules not processed for user `99e9b91d4fb949f18cc61bf2bbd63ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:40.190720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-884bb3b3-d141-4167-8f1a-a6eb6eb6fccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:40.206173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:40.207384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:40.208033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:40.208479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:40.209327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:40.211664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:40.245041 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1312/2648] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:48:40 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:48:40.248867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:40.263667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17eaeb7-c96a-4aec-9309-229e79a4dd52 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:40.271924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:40.273625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:40.274545 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1337/2649] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:40.274905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:40.275431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:40.276461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:40.278229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:40.296838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1313/2650] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:48:40.299996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bb3b3-d141-4167-8f1a-a6eb6eb6fccb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:40.326970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bb3b3-d141-4167-8f1a-a6eb6eb6fccb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:40.339284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac9d02-8723-4526-bc9e-8e5832bdd66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:40.340049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac9d02-8723-4526-bc9e-8e5832bdd66b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:40.340428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac9d02-8723-4526-bc9e-8e5832bdd66b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:40.340777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac9d02-8723-4526-bc9e-8e5832bdd66b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:40.341829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac9d02-8723-4526-bc9e-8e5832bdd66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:40.347878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac9d02-8723-4526-bc9e-8e5832bdd66b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:40.373561 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1338/2651] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:48:40.377740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:40.400009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957457a-fa0a-44cc-a759-d074303525de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:40.418823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3721ba3c-10de-4423-9769-104db20d79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:40.419757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ba3c-10de-4423-9769-104db20d79e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:40.424462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ba3c-10de-4423-9769-104db20d79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:40.424926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3721ba3c-10de-4423-9769-104db20d79e3 admin admin] PATH_INFO: `/v3/projects/b32f89ced1064b42a865fa6c8f48a92b/users/e1d56d3935a4454e867bfe3bbf95da2f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:40.457658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721ba3c-10de-4423-9769-104db20d79e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32f89ced1064b42a865fa6c8f48a92b, user_id=e1d56d3935a4454e867bfe3bbf95da2f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:40.485143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3721ba3c-10de-4423-9769-104db20d79e3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:40.516708 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1314/2652] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:48:40 2022] PUT /identity/v3/projects/b32f89ced1064b42a865fa6c8f48a92b/users/e1d56d3935a4454e867bfe3bbf95da2f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:48:40.527653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5e6a-a009-41b2-8a30-15a641c0b3d7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:40.528838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5e6a-a009-41b2-8a30-15a641c0b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:40.529426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5e6a-a009-41b2-8a30-15a641c0b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:40.601863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-712a5e6a-a009-41b2-8a30-15a641c0b3d7 None None] MFA Rules not processed for user `e1d56d3935a4454e867bfe3bbf95da2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:40.603503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-712a5e6a-a009-41b2-8a30-15a641c0b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:40.688805 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1339/2653] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:40.699554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af93c1-3870-4b48-9710-93c1c05bf386 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:40.701378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af93c1-3870-4b48-9710-93c1c05bf386 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:40.702030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af93c1-3870-4b48-9710-93c1c05bf386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:40.727283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-11af93c1-3870-4b48-9710-93c1c05bf386 None None] MFA Rules not processed for user `e1d56d3935a4454e867bfe3bbf95da2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:40.728698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-11af93c1-3870-4b48-9710-93c1c05bf386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:40.741713 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1315/2654] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:41.125622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3267-f771-42d7-88b5-2066c02b4bff None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:41.125977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3267-f771-42d7-88b5-2066c02b4bff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:41.126179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3267-f771-42d7-88b5-2066c02b4bff None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:41.127788 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1340/2655] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:48:41.137550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:41.137817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:41.138368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:41.168481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:41.170532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:41.323237 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1316/2656] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:48:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:41.358816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c3267-f771-42d7-88b5-2066c02b4bff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:41.361203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0d9c3267-f771-42d7-88b5-2066c02b4bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:41.387471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c3267-f771-42d7-88b5-2066c02b4bff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:41.394393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87d607-27c6-4326-8164-ac6bfcf22a4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:41.395351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d607-27c6-4326-8164-ac6bfcf22a4a service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:41.395792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d607-27c6-4326-8164-ac6bfcf22a4a service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:41.396246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87d607-27c6-4326-8164-ac6bfcf22a4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:41.406875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87d607-27c6-4326-8164-ac6bfcf22a4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:41.410700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87d607-27c6-4326-8164-ac6bfcf22a4a service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:41.426590 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1341/2657] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:42.506229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:42.507797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:42.625919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5065ea-0b52-44d6-b173-6ea55d2f8a20 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:42.632828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c67bc-7776-4aec-9cd9-4a1ae6153966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:42.633577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c67bc-7776-4aec-9cd9-4a1ae6153966 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:42.636935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c67bc-7776-4aec-9cd9-4a1ae6153966 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:42.636935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c67bc-7776-4aec-9cd9-4a1ae6153966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:42.646575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c67bc-7776-4aec-9cd9-4a1ae6153966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:42.648651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c67bc-7776-4aec-9cd9-4a1ae6153966 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:42.666737 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1317/2658] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:48:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:48:44.281683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:44.282921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:44.283414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:44.324958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] MFA Rules not processed for user `3eb85bfb49aa4a519099c6f43ac77099`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:44.326718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:44.442432 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1342/2659] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:45.141599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:45.143112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:45.143363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:45.230889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:48:45.233443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:45.318429 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1318/2660] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:48:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:48:45.332467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:48:45.334039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:48:45.526913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9abfb6b-7bc4-4c0f-998f-ea29882ad6ff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:48:45.538568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:48:45.540124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:48:45.540412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:48:45.540691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:48:45.555459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:48:45.557125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:48:45.585276 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1343/2661] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:48:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 21:49:03.186209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:03.188620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:03.405132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1f3f1-d7ab-4cd6-9aa0-3d7b948f0439 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:03.432151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:03.433427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:03.435246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:03.436176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] PATH_INFO: `/v3/users/85eeaeaf9f1c464f8d45eff93bab41cb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:03.440804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85eeaeaf9f1c464f8d45eff93bab41cb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:03.460583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:03.580867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85eeaeaf9f1c464f8d45eff93bab41cb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:03.597292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85eeaeaf9f1c464f8d45eff93bab41cb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:03.598343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85eeaeaf9f1c464f8d45eff93bab41cb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:03.600112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85eeaeaf9f1c464f8d45eff93bab41cb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:03.637543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85eeaeaf9f1c464f8d45eff93bab41cb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:03.687658 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1319/2662] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:03 2022] DELETE /identity/v3/users/85eeaeaf9f1c464f8d45eff93bab41cb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:04.048652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:04.063596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b721-4405-49c2-9c05-46ed19412444 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:04.219636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:04.221683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:04.222236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:04.222723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] PATH_INFO: `/v3/projects/d7a25055f3544e5c95bacd3a07611e1d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:04.226631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a25055f3544e5c95bacd3a07611e1d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:04.229478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:04.331612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a25055f3544e5c95bacd3a07611e1d', 'request_id': 'req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.347507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a25055f3544e5c95bacd3a07611e1d', 'request_id': 'req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.379789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a25055f3544e5c95bacd3a07611e1d', 'request_id': 'req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.406597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] The token cache is being invalidate because project d7a25055f3544e5c95bacd3a07611e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:04.407047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.407899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.410926 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1344/2663] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:04 2022] DELETE /identity/v3/projects/d7a25055f3544e5c95bacd3a07611e1d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:04.415674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:04.419617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:04.435248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8eb29-3508-471c-a4d7-961da6bd7610 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:04.545312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:04.546726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:04.547398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:04.548115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] PATH_INFO: `/v3/users/bc43b06076df4cfaae8e4a5a4328b60c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:04.549662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc43b06076df4cfaae8e4a5a4328b60c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:04.552919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:04.669940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc43b06076df4cfaae8e4a5a4328b60c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.683690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc43b06076df4cfaae8e4a5a4328b60c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.683690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc43b06076df4cfaae8e4a5a4328b60c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.683690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc43b06076df4cfaae8e4a5a4328b60c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.705978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a80a0d0a-1f0a-415b-a200-cd64b681649c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc43b06076df4cfaae8e4a5a4328b60c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:04.729443 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1320/2664] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:04 2022] DELETE /identity/v3/users/bc43b06076df4cfaae8e4a5a4328b60c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:05.102440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:05.104032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:05.125608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f60fe-1184-44df-b7b2-d23b7e6bac71 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:05.254378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:05.256157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:05.256639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:05.257223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] PATH_INFO: `/v3/projects/12dbc8ee204548bba46b92b913aeed3a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:05.258657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12dbc8ee204548bba46b92b913aeed3a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:05.261306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:05.372311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12dbc8ee204548bba46b92b913aeed3a', 'request_id': 'req-fa3008cc-5787-4883-8f05-a23da7d2119e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:05.381583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12dbc8ee204548bba46b92b913aeed3a', 'request_id': 'req-fa3008cc-5787-4883-8f05-a23da7d2119e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:05.416375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12dbc8ee204548bba46b92b913aeed3a', 'request_id': 'req-fa3008cc-5787-4883-8f05-a23da7d2119e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:05.447044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] The token cache is being invalidate because project 12dbc8ee204548bba46b92b913aeed3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:05.448219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:05.449527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa3008cc-5787-4883-8f05-a23da7d2119e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:05.456629 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1345/2665] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:05 2022] DELETE /identity/v3/projects/12dbc8ee204548bba46b92b913aeed3a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:05.459059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca9c7-a578-45f3-9089-07f02b75cc3b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:05.459523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca9c7-a578-45f3-9089-07f02b75cc3b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:05.459666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca9c7-a578-45f3-9089-07f02b75cc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:05.531392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8bdca9c7-a578-45f3-9089-07f02b75cc3b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:05.532587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8bdca9c7-a578-45f3-9089-07f02b75cc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:05.635458 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1321/2666] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:05.644842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de79b4-a618-42f4-b2d9-c4b1cc6d1665 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:05.645602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de79b4-a618-42f4-b2d9-c4b1cc6d1665 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:05.645602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de79b4-a618-42f4-b2d9-c4b1cc6d1665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:05.670373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-43de79b4-a618-42f4-b2d9-c4b1cc6d1665 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:05.671641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-43de79b4-a618-42f4-b2d9-c4b1cc6d1665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:05.692773 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1346/2667] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:05.698753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca9c7-a578-45f3-9089-07f02b75cc3b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:05.715132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca9c7-a578-45f3-9089-07f02b75cc3b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:05.720629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:05.722500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:05.722897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:05.723931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:05.724763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:05.725146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:05.727501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:05.751038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1322/2668] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:05.756493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de79b4-a618-42f4-b2d9-c4b1cc6d1665 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:05.766259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de79b4-a618-42f4-b2d9-c4b1cc6d1665 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:05.781722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:05.782438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:05.782724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:05.783803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:05.784752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:05.788230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:05.834480 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1347/2669] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:05 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:05.835074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:05.845585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9d044-1601-44c4-a124-c28f36ff1d4a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:05.923879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:05.924657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:05.925170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:05.925521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:05.926295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:05.929144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:05.950671 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1323/2670] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:05 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:05.954522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:05.968332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e816b-9904-45f2-b3f3-cd05a8cfe1dc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:05.973130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:05.973801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:05.974085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:05.974487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:05.979608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:05.983131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:06.001050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1348/2671] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:06.007142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:06.019963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c2fd-2549-4318-86e7-a0b0362f5592 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:06.033802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab26a53-5e6e-4ced-899f-4c19dde118a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:06.034564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26a53-5e6e-4ced-899f-4c19dde118a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.034797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26a53-5e6e-4ced-899f-4c19dde118a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.035096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab26a53-5e6e-4ced-899f-4c19dde118a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.035824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26a53-5e6e-4ced-899f-4c19dde118a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:06.037501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab26a53-5e6e-4ced-899f-4c19dde118a4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:06.053149 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1324/2672] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:06.056904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:06.067427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84aa627-31d5-4509-ae18-fb819de5c4fb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:06.080997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:06.082053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.082405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.083043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] PATH_INFO: `/v3/projects/91912089ae704097827a93cfcf570d69/users/710da3b10f67402a8bcd1eb5ab2be949/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.102565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91912089ae704097827a93cfcf570d69, user_id=710da3b10f67402a8bcd1eb5ab2be949, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:06.107063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:06.137330 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1349/2673] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:06 2022] PUT /identity/v3/projects/91912089ae704097827a93cfcf570d69/users/710da3b10f67402a8bcd1eb5ab2be949/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:49:06.151822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442e68-52d7-4683-8e9f-9b1bcb558251 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.152384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442e68-52d7-4683-8e9f-9b1bcb558251 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.153350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442e68-52d7-4683-8e9f-9b1bcb558251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.186805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5d442e68-52d7-4683-8e9f-9b1bcb558251 None None] MFA Rules not processed for user `710da3b10f67402a8bcd1eb5ab2be949`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:06.188228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5d442e68-52d7-4683-8e9f-9b1bcb558251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:06.280651 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1325/2674] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:06.285432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:06.431125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93cf67-61b6-4b8e-b546-15d459c85538 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:06.439703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:06.440784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.441160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.441775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.442910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:06.445473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:06.481479 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1350/2675] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:06 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:06.482303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442e68-52d7-4683-8e9f-9b1bcb558251 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:06.494062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442e68-52d7-4683-8e9f-9b1bcb558251 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:06.569469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:06.570317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.570694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.571091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.571979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:06.575788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:06.620717 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1326/2676] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:06 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:06.625931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:06.641719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510d62-33fb-46b6-ac5c-b4b8222236f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:06.649033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:06.649826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.650199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.650698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.651727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:06.654142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:06.671615 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1351/2677] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:06.672028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:06.684686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c4ac3-5294-40ef-916d-453c1459d8c2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:06.693652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:06.694846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.695137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.695415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] PATH_INFO: `/v3/projects/a376ed4e06184e4d84ac35b0ac27a140/users/9c0188de3f174cf0bd2af8222aadd628/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.727770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a376ed4e06184e4d84ac35b0ac27a140, user_id=9c0188de3f174cf0bd2af8222aadd628, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:06.736578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:06.764278 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1327/2678] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:06 2022] PUT /identity/v3/projects/a376ed4e06184e4d84ac35b0ac27a140/users/9c0188de3f174cf0bd2af8222aadd628/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:49:06.768097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:06.781519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe696953-f6f7-48c4-ba6c-7aabf8f1dabd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:06.958199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d821159-4f38-4045-9b3a-36c74e64eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:06.959027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d821159-4f38-4045-9b3a-36c74e64eaea admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:06.959314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d821159-4f38-4045-9b3a-36c74e64eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:06.959588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d821159-4f38-4045-9b3a-36c74e64eaea admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:06.960321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d821159-4f38-4045-9b3a-36c74e64eaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:06.962130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d821159-4f38-4045-9b3a-36c74e64eaea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:07.008408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:07.017386 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1352/2679] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:07.025171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ba586-1a4e-4656-a4b1-dcef397064a0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:07.039746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:07.041224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:07.041670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:07.042240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] PATH_INFO: `/v3/projects/a376ed4e06184e4d84ac35b0ac27a140/users/9c0188de3f174cf0bd2af8222aadd628/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:07.050394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a376ed4e06184e4d84ac35b0ac27a140, user_id=9c0188de3f174cf0bd2af8222aadd628, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:07.059910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:07.073156 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1328/2680] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:07 2022] PUT /identity/v3/projects/a376ed4e06184e4d84ac35b0ac27a140/users/9c0188de3f174cf0bd2af8222aadd628/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:07.087036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e84029-614f-48a7-bd37-fc1fec7501c7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:07.087260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e84029-614f-48a7-bd37-fc1fec7501c7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:07.087537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e84029-614f-48a7-bd37-fc1fec7501c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:07.214367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-76e84029-614f-48a7-bd37-fc1fec7501c7 None None] MFA Rules not processed for user `9c0188de3f174cf0bd2af8222aadd628`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:07.222121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-76e84029-614f-48a7-bd37-fc1fec7501c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:07.373088 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1353/2681] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:07.635846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:07.638321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:07.739304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c9793-2a3d-4020-be5f-4e3e6f612ca1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:07.739587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c9793-2a3d-4020-be5f-4e3e6f612ca1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:07.739891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c9793-2a3d-4020-be5f-4e3e6f612ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:07.791543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-486c9793-2a3d-4020-be5f-4e3e6f612ca1 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:07.792930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07885-b4f8-4027-b23b-2f2ff31d6fbf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:07.799633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-486c9793-2a3d-4020-be5f-4e3e6f612ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:07.811403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:07.811884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:07.812805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:07.813089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:07.837653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:07.840035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:07.879626 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1329/2682] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:07.923676 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1354/2683] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:49:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:07.938294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:07.940629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:08.055688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a4a39-8e3c-46e6-bbb8-8bfa7d914c65 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:08.067570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6b900-4aa3-4eda-8580-30445c9945d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:08.068241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b900-4aa3-4eda-8580-30445c9945d4 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:08.068526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b900-4aa3-4eda-8580-30445c9945d4 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:08.074053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6b900-4aa3-4eda-8580-30445c9945d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:08.097214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5262-b21a-467d-8255-8c7ecb4bb535 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:08.098014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5262-b21a-467d-8255-8c7ecb4bb535 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:08.098471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5262-b21a-467d-8255-8c7ecb4bb535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:08.117590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6b900-4aa3-4eda-8580-30445c9945d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:08.120010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6b900-4aa3-4eda-8580-30445c9945d4 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:08.132032 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1330/2684] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:49:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:49:08.145678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e49b5262-b21a-467d-8255-8c7ecb4bb535 None None] MFA Rules not processed for user `7dd9c30816a7410f94b10294234c1dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:08.147116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e49b5262-b21a-467d-8255-8c7ecb4bb535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:08.426492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1355/2685] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:08.902059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:08.902646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:08.903308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:08.941909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:08.943189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:08.959731 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1331/2686] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:49:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:09.017309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b5262-b21a-467d-8255-8c7ecb4bb535 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:09.054470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b5262-b21a-467d-8255-8c7ecb4bb535 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:09.085203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1f782-471d-4e14-9628-ddf69778d9d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:09.088777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1f782-471d-4e14-9628-ddf69778d9d3 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:09.089328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1f782-471d-4e14-9628-ddf69778d9d3 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:09.094534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1f782-471d-4e14-9628-ddf69778d9d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:09.141659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1f782-471d-4e14-9628-ddf69778d9d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:09.146973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1f782-471d-4e14-9628-ddf69778d9d3 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:09.232338 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1356/2687] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:49:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:49:10.895575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:10.897012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:11.232089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f45729-0874-425c-a38e-f13c0dcf9102 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:11.232739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f45729-0874-425c-a38e-f13c0dcf9102 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:11.232862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f45729-0874-425c-a38e-f13c0dcf9102 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:11.234681 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1357/2688] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:49:11.245070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:11.245767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:11.246156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:11.325281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:11.339019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:11.369072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6f206-54fc-476c-9b10-30457bec1d3b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:11.431947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:11.439036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:11.439328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:11.439613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] PATH_INFO: `/v3/users/e1d56d3935a4454e867bfe3bbf95da2f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:11.451321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d56d3935a4454e867bfe3bbf95da2f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:11.459783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:11.596238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d56d3935a4454e867bfe3bbf95da2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:11.598130 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1358/2689] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:49:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 07 21:49:11.609318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d56d3935a4454e867bfe3bbf95da2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:11.610083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d56d3935a4454e867bfe3bbf95da2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:11.610687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d56d3935a4454e867bfe3bbf95da2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:11.618237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:11.629684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:11.636882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d56d3935a4454e867bfe3bbf95da2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:11.673597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffed65-92d9-4e0f-a529-16b7d5176834 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:11.704209 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1332/2690] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:10 2022] DELETE /identity/v3/users/e1d56d3935a4454e867bfe3bbf95da2f => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:11.705347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:11.706937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:11.708296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be7b2-8130-41c2-8ec2-29468ca3d50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:11.709439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be7b2-8130-41c2-8ec2-29468ca3d50a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:11.711729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be7b2-8130-41c2-8ec2-29468ca3d50a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:11.720991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be7b2-8130-41c2-8ec2-29468ca3d50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:11.746162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9b8be7b2-8130-41c2-8ec2-29468ca3d50a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:11.925065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77ce9-c195-4ee6-8161-3cc3f0cfa3fe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:11.951464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be7b2-8130-41c2-8ec2-29468ca3d50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:11.953117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be7b2-8130-41c2-8ec2-29468ca3d50a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:11.957530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:11.958226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:11.958512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:11.958809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:11.964177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:11.977897 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1359/2691] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:11.998996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:11.999644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:12.000086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:12.009391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:12.011088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:12.031300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:12.034188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:12.051202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1333/2692] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:12.204434 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1360/2693] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:12.227698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:12.229477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:12.273346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:12.276802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:12.301299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb934-fec6-4c55-b9af-9c0170dd60d1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:12.328338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:12.329748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:12.330198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:12.330628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] PATH_INFO: `/v3/users/54fdb97b210a4f38a0fb6a100d9d72ab` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:12.333030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fdb97b210a4f38a0fb6a100d9d72ab)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:12.338135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:12.412620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73cba-4b87-4a46-9246-6e0fae3cf22f service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:12.427572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:12.429363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:12.430097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:12.432776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:12.458371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:12.461391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fdb97b210a4f38a0fb6a100d9d72ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:12.463275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fdb97b210a4f38a0fb6a100d9d72ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:12.494760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:12.496024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fdb97b210a4f38a0fb6a100d9d72ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:12.497419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fdb97b210a4f38a0fb6a100d9d72ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:12.514447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b00f989-6c71-48a7-8c05-5fa570ef0a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fdb97b210a4f38a0fb6a100d9d72ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:12.518536 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1334/2694] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:12.545051 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1361/2695] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:12 2022] DELETE /identity/v3/users/54fdb97b210a4f38a0fb6a100d9d72ab => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:49:13.080127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:13.081587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:13.106877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4df63-e267-4503-8d05-a97783b8430a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:13.271508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:13.272860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:13.275290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:13.276104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] PATH_INFO: `/v3/projects/b32f89ced1064b42a865fa6c8f48a92b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:13.277379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32f89ced1064b42a865fa6c8f48a92b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:13.289147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:13.425184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32f89ced1064b42a865fa6c8f48a92b', 'request_id': 'req-1a58b389-ae7a-4037-8374-c1053066c42e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:13.436524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32f89ced1064b42a865fa6c8f48a92b', 'request_id': 'req-1a58b389-ae7a-4037-8374-c1053066c42e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:13.468178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32f89ced1064b42a865fa6c8f48a92b', 'request_id': 'req-1a58b389-ae7a-4037-8374-c1053066c42e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:13.486149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] The token cache is being invalidate because project b32f89ced1064b42a865fa6c8f48a92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:13.486750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:13.487673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:13.493799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1335/2696] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:13 2022] DELETE /identity/v3/projects/b32f89ced1064b42a865fa6c8f48a92b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:13.495245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00369a-f3cd-4b5b-9f11-795ac94801c3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:13.496063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00369a-f3cd-4b5b-9f11-795ac94801c3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:13.497051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00369a-f3cd-4b5b-9f11-795ac94801c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:13.591147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cd00369a-f3cd-4b5b-9f11-795ac94801c3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:13.592494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cd00369a-f3cd-4b5b-9f11-795ac94801c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:13.703141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:13.708076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:13.803217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1362/2697] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:13.820571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c319d35-a676-4f72-a935-4a7e6af1180a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:13.822425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c319d35-a676-4f72-a935-4a7e6af1180a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:13.822962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c319d35-a676-4f72-a935-4a7e6af1180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:13.892756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7c319d35-a676-4f72-a935-4a7e6af1180a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:13.897958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7c319d35-a676-4f72-a935-4a7e6af1180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:13.959951 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1363/2698] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:13.966153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c319d35-a676-4f72-a935-4a7e6af1180a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.004164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58b389-ae7a-4037-8374-c1053066c42e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.037701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c319d35-a676-4f72-a935-4a7e6af1180a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.039996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.047929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.048226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.048508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] PATH_INFO: `/v3/projects/6bff84c55662404f85da55f6d1c111b4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.055851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bff84c55662404f85da55f6d1c111b4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.057545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.058241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.059819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.060939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.063070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:14.063930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.065599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.068723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.108281 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1364/2699] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:14.116567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.147186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58b2ed-616f-4d5b-88b0-50a380fc960f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.156273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.157401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.157695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.157976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.159253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.162487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.218375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1365/2700] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:14 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:14.232351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bff84c55662404f85da55f6d1c111b4', 'request_id': 'req-3b716f86-d250-4ec8-a344-80476bc95e6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.241195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bff84c55662404f85da55f6d1c111b4', 'request_id': 'req-3b716f86-d250-4ec8-a344-80476bc95e6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.241427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.273105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bff84c55662404f85da55f6d1c111b4', 'request_id': 'req-3b716f86-d250-4ec8-a344-80476bc95e6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.295025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] The token cache is being invalidate because project 6bff84c55662404f85da55f6d1c111b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:14.295745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.297137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b716f86-d250-4ec8-a344-80476bc95e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.300040 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1336/2701] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:13 2022] DELETE /identity/v3/projects/6bff84c55662404f85da55f6d1c111b4 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:14.305023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c7de-c5b2-4fc5-9b4b-8eb5da02fe9d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.313431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c7de-c5b2-4fc5-9b4b-8eb5da02fe9d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.313827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c7de-c5b2-4fc5-9b4b-8eb5da02fe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.394203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1c45c7de-c5b2-4fc5-9b4b-8eb5da02fe9d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:14.400141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1c45c7de-c5b2-4fc5-9b4b-8eb5da02fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:14.444690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7bcd2-9a54-45c2-b3f0-178a43e5ae1f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.457784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.458578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.459116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.459602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.460521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.462136 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1337/2702] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:14.464609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.470433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.471798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.472376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.498530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:14.505687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:14.509177 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1366/2703] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:14 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:14.513341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.526810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:14.541455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0cf56-5e5c-4ed4-a9f7-cd32836d866e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.546875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.547847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.548343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.548839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.549757 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1338/2704] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:14.550135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.552026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.552228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.554073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:14.563772 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1367/2705] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:49:14.565002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.578246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e7a1-f468-477b-aa07-4a90e1a41e81 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.586930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.587664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612eab5-14cc-49c2-a3f1-7b3da28849b2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.588128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.588661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.589125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.591766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:14.592275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.594095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.594473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.595514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.595937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.596274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] PATH_INFO: `/v3/users/710da3b10f67402a8bcd1eb5ab2be949` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.597737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710da3b10f67402a8bcd1eb5ab2be949)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.603201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.610425 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1368/2706] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:14.611762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.623221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bafaa-f9e5-4ca1-8ab2-80936ed1ed28 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.629611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.630516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.631029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.631469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.632412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.634185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.647870 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1369/2707] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:14.649610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.662755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f19359-dc48-4c66-a8af-3197862ccdb8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:14.670259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:14.671322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:14.671759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:14.672184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:14.673205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:14.676936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:14.719142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1370/2708] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:14 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:14.720418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.743342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710da3b10f67402a8bcd1eb5ab2be949'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.760627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710da3b10f67402a8bcd1eb5ab2be949'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.763368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710da3b10f67402a8bcd1eb5ab2be949'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.766078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710da3b10f67402a8bcd1eb5ab2be949'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.782151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710da3b10f67402a8bcd1eb5ab2be949'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:14.837702 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1339/2709] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:14 2022] DELETE /identity/v3/users/710da3b10f67402a8bcd1eb5ab2be949 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:14.843485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:14.845360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:14.886375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc7013-ce1a-41c0-b34b-c41f8836b5d9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.041206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960250f9-4cc3-48c2-945f-d10d634fed99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.042241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960250f9-4cc3-48c2-945f-d10d634fed99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.042619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960250f9-4cc3-48c2-945f-d10d634fed99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.043076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960250f9-4cc3-48c2-945f-d10d634fed99 admin admin] PATH_INFO: `/v3/projects/397d3af89ad74a74b7f950ddfef16aee/users/e37a0b792dac44beb1580b3995f1883f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.061773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d79d0-b2ce-4fca-9042-47a05e2147c7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.077584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.079174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.079661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.080111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.080981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.084786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.126444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960250f9-4cc3-48c2-945f-d10d634fed99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397d3af89ad74a74b7f950ddfef16aee, user_id=e37a0b792dac44beb1580b3995f1883f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.131889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960250f9-4cc3-48c2-945f-d10d634fed99 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.188848 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1340/2710] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:14 2022] POST /identity/v3/users => generated 296 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:15.200989 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1371/2711] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:14 2022] PUT /identity/v3/projects/397d3af89ad74a74b7f950ddfef16aee/users/e37a0b792dac44beb1580b3995f1883f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:15.201805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453103c0-974b-4a14-aa54-000ff6d64822 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.204317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453103c0-974b-4a14-aa54-000ff6d64822 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.204717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453103c0-974b-4a14-aa54-000ff6d64822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.205866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:15.221049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.240833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-453103c0-974b-4a14-aa54-000ff6d64822 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:15.242592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-453103c0-974b-4a14-aa54-000ff6d64822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.252700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25762d87-161d-4936-9469-11d27835fc4f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.352957 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1372/2712] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:15.354841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453103c0-974b-4a14-aa54-000ff6d64822 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:15.383929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453103c0-974b-4a14-aa54-000ff6d64822 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.389634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.392051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.392051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.392751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] PATH_INFO: `/v3/users/af32f4f4abc2444fb869076ed80b3a8d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.395587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af32f4f4abc2444fb869076ed80b3a8d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.397735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c1164-5500-40ac-8b8b-f90117f88380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.398466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c1164-5500-40ac-8b8b-f90117f88380 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.398750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c1164-5500-40ac-8b8b-f90117f88380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.399104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c1164-5500-40ac-8b8b-f90117f88380 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.400230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c1164-5500-40ac-8b8b-f90117f88380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.401110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.402076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c1164-5500-40ac-8b8b-f90117f88380 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.419994 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1373/2713] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:15.419994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.419994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.420376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.446917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:15.448514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.472912 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1374/2714] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:15.479218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:15.482753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.500499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af32f4f4abc2444fb869076ed80b3a8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:15.514205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af32f4f4abc2444fb869076ed80b3a8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:15.516221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af32f4f4abc2444fb869076ed80b3a8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:15.517247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af32f4f4abc2444fb869076ed80b3a8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:15.529578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af32f4f4abc2444fb869076ed80b3a8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:15.561326 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1341/2715] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:15 2022] DELETE /identity/v3/users/af32f4f4abc2444fb869076ed80b3a8d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:15.562573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:15.568723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.594631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116fe26-0752-4dcd-9a74-67fa6dc289f5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.670273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.670994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.671396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.671685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.673718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.692222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe2dc2-fa9c-4bd3-b80e-59c6034ee60b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.692717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.695222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.705051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d6c9f-ac5b-443b-9293-51c6d52d983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.707461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6c9f-ac5b-443b-9293-51c6d52d983a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.707872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6c9f-ac5b-443b-9293-51c6d52d983a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.708209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d6c9f-ac5b-443b-9293-51c6d52d983a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.708961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d6c9f-ac5b-443b-9293-51c6d52d983a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.709272 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1375/2716] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:15.711954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d6c9f-ac5b-443b-9293-51c6d52d983a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.721240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:15.724628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.731522 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1342/2717] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:15.733172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc0ca-04e0-4a7f-bf0a-fcd86e7f77f5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.733850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc0ca-04e0-4a7f-bf0a-fcd86e7f77f5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.734324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc0ca-04e0-4a7f-bf0a-fcd86e7f77f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.750243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa38cd-9db1-4c1e-8318-afcfeb85e883 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.758097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.758792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.759076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.759354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.764798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.778560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a5adc0ca-04e0-4a7f-bf0a-fcd86e7f77f5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:15.781574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a5adc0ca-04e0-4a7f-bf0a-fcd86e7f77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.791233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.794729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.800190 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1343/2718] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:15.801277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adc0ca-04e0-4a7f-bf0a-fcd86e7f77f5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:15.821048 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1376/2719] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:15.823014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:15.829294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adc0ca-04e0-4a7f-bf0a-fcd86e7f77f5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.830308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:15.843482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.848596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.848860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.849214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] PATH_INFO: `/v3/projects/765d4ae9756147578d64d04613c3a294/users/10d27e677e614503a0b12c5cdda162f7/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.858815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35670932-5fea-4d0d-87d0-ad9ca712ceb0 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:15.865744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c430e-1baf-4bec-b1ff-cd0066a7c4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:15.866796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c430e-1baf-4bec-b1ff-cd0066a7c4ff service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.867274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c430e-1baf-4bec-b1ff-cd0066a7c4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.868578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c430e-1baf-4bec-b1ff-cd0066a7c4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:15.873204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765d4ae9756147578d64d04613c3a294, user_id=10d27e677e614503a0b12c5cdda162f7, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.890225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.895836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c430e-1baf-4bec-b1ff-cd0066a7c4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:15.897848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c430e-1baf-4bec-b1ff-cd0066a7c4ff service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:15.914206 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1377/2720] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:15.936010 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1344/2721] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:15 2022] PUT /identity/v3/projects/765d4ae9756147578d64d04613c3a294/users/10d27e677e614503a0b12c5cdda162f7/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:15.938669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:15.939922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:15.940454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:16.016028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] MFA Rules not processed for user `10d27e677e614503a0b12c5cdda162f7`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:16.017524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:16.150193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1378/2722] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:16.158559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:16.160532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:16.352969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:16.354765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:16.445737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060e14e-2275-489c-bd1d-e32bea91f879 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:16.473015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:16.473693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:16.473979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:16.474300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:16.495630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:16.497815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:16.545597 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1345/2723] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:16.554575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:16.559948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:16.567343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed44f2e-1a53-4a03-b0c5-f33b4c295116 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:16.598351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:16.604428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd4cd8-3043-4e66-a9bd-ed8ecf29663b service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:16.605358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:16.607718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:16.608475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] PATH_INFO: `/v3/projects/91912089ae704097827a93cfcf570d69` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:16.611984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91912089ae704097827a93cfcf570d69)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:16.614251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:16.621003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:16.661509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:16.661716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:16.662636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] PATH_INFO: `/v3/projects/59b4f20214214616967d9d414375248a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:16.679256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b4f20214214616967d9d414375248a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:16.681581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:16.805550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91912089ae704097827a93cfcf570d69', 'request_id': 'req-2cb31592-1525-42c7-8150-34d1e73b4a12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.828513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91912089ae704097827a93cfcf570d69', 'request_id': 'req-2cb31592-1525-42c7-8150-34d1e73b4a12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.857184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91912089ae704097827a93cfcf570d69', 'request_id': 'req-2cb31592-1525-42c7-8150-34d1e73b4a12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.875857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] The token cache is being invalidate because project 91912089ae704097827a93cfcf570d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:16.876101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.878251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b4f20214214616967d9d414375248a', 'request_id': 'req-839aa2e6-bfb8-453e-8e46-eba8ad716207'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.879928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.898911 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1379/2724] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:16 2022] DELETE /identity/v3/projects/91912089ae704097827a93cfcf570d69 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:49:16.905511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:16.907395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:16.909008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b4f20214214616967d9d414375248a', 'request_id': 'req-839aa2e6-bfb8-453e-8e46-eba8ad716207'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.941604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b4f20214214616967d9d414375248a', 'request_id': 'req-839aa2e6-bfb8-453e-8e46-eba8ad716207'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.988274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] The token cache is being invalidate because project 59b4f20214214616967d9d414375248a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:16.989948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.989948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-839aa2e6-bfb8-453e-8e46-eba8ad716207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:16.991706 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1346/2725] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:16 2022] DELETE /identity/v3/projects/59b4f20214214616967d9d414375248a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:16.997055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:16.997624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:16.998106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.034979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:17.036601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:17.148498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb31592-1525-42c7-8150-34d1e73b4a12 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:17.177960 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1347/2726] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:17.179653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:17.181041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:17.197543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd405b3d-e5bd-4d6f-87c7-c6036f7c38a9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:17.206365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:17.209687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:17.211963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:17.212687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] PATH_INFO: `/v3/users/10d27e677e614503a0b12c5cdda162f7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.226178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d27e677e614503a0b12c5cdda162f7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:17.229797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:17.279459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:17.280471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:17.280745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:17.281102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] PATH_INFO: `/v3/users/9c0188de3f174cf0bd2af8222aadd628` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.282430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0188de3f174cf0bd2af8222aadd628)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:17.284646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:17.360044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d27e677e614503a0b12c5cdda162f7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.373133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d27e677e614503a0b12c5cdda162f7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.374321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d27e677e614503a0b12c5cdda162f7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.375215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d27e677e614503a0b12c5cdda162f7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.392193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2257104-8237-448f-a56c-b2cbd4a6b35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d27e677e614503a0b12c5cdda162f7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.419843 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1348/2727] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:17 2022] DELETE /identity/v3/users/10d27e677e614503a0b12c5cdda162f7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:17.421370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c9da-2b6d-4e14-9511-830226f65edb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:17.421815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c9da-2b6d-4e14-9511-830226f65edb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:17.422267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790c9da-2b6d-4e14-9511-830226f65edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.432030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0188de3f174cf0bd2af8222aadd628'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.433167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0188de3f174cf0bd2af8222aadd628'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.461856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f790c9da-2b6d-4e14-9511-830226f65edb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:17.467067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f790c9da-2b6d-4e14-9511-830226f65edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:17.471574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0188de3f174cf0bd2af8222aadd628'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.473568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0188de3f174cf0bd2af8222aadd628'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.493070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c50e495c-49d4-4245-8d01-b332dc6e2aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0188de3f174cf0bd2af8222aadd628'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:17.528555 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1380/2728] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:16 2022] DELETE /identity/v3/users/9c0188de3f174cf0bd2af8222aadd628 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:17.532921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:17.533390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:17.538091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.571779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:17.573872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:17.604013 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1349/2729] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:17.624814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790c9da-2b6d-4e14-9511-830226f65edb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:17.637515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790c9da-2b6d-4e14-9511-830226f65edb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:17.725911 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1381/2730] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:17.746900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:17.748747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:17.840420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:17.841510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:17.842529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:17.843401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.846194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:17.849151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:17.857112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:17.903300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadcdf0-c02a-4f84-a304-b53a926f3c05 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:17.928702 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1350/2731] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:17.928702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:17.937421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb5afd-d476-41a1-88f5-ac005f6d843b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:17.938706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5afd-d476-41a1-88f5-ac005f6d843b service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:17.938706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5afd-d476-41a1-88f5-ac005f6d843b service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:17.939353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb5afd-d476-41a1-88f5-ac005f6d843b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.964271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9e10-ef57-4ba0-ad07-659ce4f0a690 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:17.975745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb5afd-d476-41a1-88f5-ac005f6d843b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:17.978359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb5afd-d476-41a1-88f5-ac005f6d843b service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:17.987365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:17.987365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:17.987365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:17.990357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:17.990357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:18.001438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:18.033832 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1382/2732] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:18.036324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:18.036872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:18.044785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:18.112468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1351/2733] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:17 2022] POST /identity/v3/projects => generated 399 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:18.117631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:18.145694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] MFA Rules not processed for user `e37a0b792dac44beb1580b3995f1883f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:18.149970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:18.300428 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1383/2734] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:18.322830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:18.326515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:18.346441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abec180-75bd-42b9-856b-56f74722a5f9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:18.369352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:18.370437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:18.371058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:18.372163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:18.373208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:18.375546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:18.466120 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1352/2735] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:18 2022] POST /identity/v3/users => generated 300 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:49:18.470223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:18.475639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:18.536871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3c378-4f3e-4672-9313-b4ac99277a13 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:18.552119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:18.553003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:18.556056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:18.556389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] PATH_INFO: `/v3/projects/a376ed4e06184e4d84ac35b0ac27a140` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:18.558881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a376ed4e06184e4d84ac35b0ac27a140)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:18.564659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:18.589352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33ae2a-027e-43bb-8be9-776080beb02f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:18.615494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:18.616468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:18.616966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:18.617514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:18.633491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:18.635164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:18.650642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1384/2736] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:49:18.651702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:18.665320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb929-42a4-45b9-a176-417884727ebf service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:18.707912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a376ed4e06184e4d84ac35b0ac27a140', 'request_id': 'req-b355f928-ef18-442d-bcde-0dd2a3df2e5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:18.729450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a376ed4e06184e4d84ac35b0ac27a140', 'request_id': 'req-b355f928-ef18-442d-bcde-0dd2a3df2e5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:18.745058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a376ed4e06184e4d84ac35b0ac27a140', 'request_id': 'req-b355f928-ef18-442d-bcde-0dd2a3df2e5c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:18.776885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] The token cache is being invalidate because project a376ed4e06184e4d84ac35b0ac27a140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:18.777255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:18.778670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b355f928-ef18-442d-bcde-0dd2a3df2e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:18.780768 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1353/2737] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:18 2022] DELETE /identity/v3/projects/a376ed4e06184e4d84ac35b0ac27a140 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:18.788673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5279e-3384-483c-9c3f-28cffff59662 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:18.789059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5279e-3384-483c-9c3f-28cffff59662 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:18.789429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5279e-3384-483c-9c3f-28cffff59662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:18.827372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-aae5279e-3384-483c-9c3f-28cffff59662 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:18.828864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aae5279e-3384-483c-9c3f-28cffff59662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:18.829051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:18.829895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:18.832082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:18.832364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:18.833403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:18.839075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:18.849352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1354/2738] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:18.852191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b930cc-c59d-41de-bac2-c7f79a65f1cf None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:18.853463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b930cc-c59d-41de-bac2-c7f79a65f1cf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:18.854029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b930cc-c59d-41de-bac2-c7f79a65f1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:18.897483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-19b930cc-c59d-41de-bac2-c7f79a65f1cf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:18.899570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19b930cc-c59d-41de-bac2-c7f79a65f1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:18.914244 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1385/2739] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:18.916565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:18.919590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:18.923972 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1355/2740] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:18.925071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b930cc-c59d-41de-bac2-c7f79a65f1cf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:18.960181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b930cc-c59d-41de-bac2-c7f79a65f1cf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:18.970128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631099a4-8b03-4a74-8393-07cd6bae6afc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:19.004145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.005876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.008697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.009498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.010030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.011516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.012372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:19.012852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.015513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.015513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.015785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.021544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.021761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.044631 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1356/2741] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:19.045972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:19.048272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:19.050950 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1386/2742] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:19.067996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:19.078494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bafce-a163-4291-ae99-b340c97dc084 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:19.089874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.091382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.091594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fe24c-8538-4fdc-8f3f-640e7026109c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:19.091728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.091933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] PATH_INFO: `/v3/projects/765d4ae9756147578d64d04613c3a294` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.099141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.099946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.100331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.100698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.100915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765d4ae9756147578d64d04613c3a294)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.101573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.104411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.109593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.179195 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1387/2743] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:19 2022] POST /identity/v3/projects => generated 395 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:19.180258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:19.242451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765d4ae9756147578d64d04613c3a294', 'request_id': 'req-d5886a1a-9b71-456c-a3e7-92e152abb845'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:19.252221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765d4ae9756147578d64d04613c3a294', 'request_id': 'req-d5886a1a-9b71-456c-a3e7-92e152abb845'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:19.268452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765d4ae9756147578d64d04613c3a294', 'request_id': 'req-d5886a1a-9b71-456c-a3e7-92e152abb845'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:19.302013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] The token cache is being invalidate because project 765d4ae9756147578d64d04613c3a294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:19.311212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:19.313100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:19.315822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1357/2744] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:19 2022] DELETE /identity/v3/projects/765d4ae9756147578d64d04613c3a294 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:19.321697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:19.323361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:19.390507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce692e5-3389-4299-8dd3-e7baa984808b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:19.549687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.550607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.550978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.551200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] PATH_INFO: `/v3/projects/dc265111632a4aab932a3582370e459a/users/6831b3c5867845d08e56f96ae1b47ec3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.552671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5886a1a-9b71-456c-a3e7-92e152abb845 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:19.560388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9148d8-4ca8-4cd5-8b1c-779d8c19905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.561176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9148d8-4ca8-4cd5-8b1c-779d8c19905e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.561473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9148d8-4ca8-4cd5-8b1c-779d8c19905e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.561748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9148d8-4ca8-4cd5-8b1c-779d8c19905e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.562454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9148d8-4ca8-4cd5-8b1c-779d8c19905e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.564912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9148d8-4ca8-4cd5-8b1c-779d8c19905e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.599380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc265111632a4aab932a3582370e459a, user_id=6831b3c5867845d08e56f96ae1b47ec3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.613589 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1358/2745] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:19 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:19.613589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799dc2-ec34-4c79-9a7d-93ada84b2860 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.613589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799dc2-ec34-4c79-9a7d-93ada84b2860 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.613589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799dc2-ec34-4c79-9a7d-93ada84b2860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.615431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.637866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c9799dc2-ec34-4c79-9a7d-93ada84b2860 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:19.639474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c9799dc2-ec34-4c79-9a7d-93ada84b2860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:19.656275 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1388/2746] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:19 2022] PUT /identity/v3/projects/dc265111632a4aab932a3582370e459a/users/6831b3c5867845d08e56f96ae1b47ec3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:19.657214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:19.802475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a96ca1-088a-48ff-a998-b16aa8ed1aac admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:19.830498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c446e-783d-45f6-9bd2-d53334bb26ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.831419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c446e-783d-45f6-9bd2-d53334bb26ae admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.831531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c446e-783d-45f6-9bd2-d53334bb26ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.831772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c446e-783d-45f6-9bd2-d53334bb26ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.832550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c446e-783d-45f6-9bd2-d53334bb26ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.834237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c446e-783d-45f6-9bd2-d53334bb26ae admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.861002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1389/2747] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:19.872235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6e8a-283a-418d-975d-3ff8a30b447f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.872389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6e8a-283a-418d-975d-3ff8a30b447f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.872683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa6e8a-283a-418d-975d-3ff8a30b447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.890440 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1359/2748] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:19.894201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799dc2-ec34-4c79-9a7d-93ada84b2860 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:19.917690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799dc2-ec34-4c79-9a7d-93ada84b2860 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:19.929843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15506992-e207-49ac-bb11-c11c91ecfb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:19.931185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506992-e207-49ac-bb11-c11c91ecfb36 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.931712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506992-e207-49ac-bb11-c11c91ecfb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.932436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15506992-e207-49ac-bb11-c11c91ecfb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.933460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15506992-e207-49ac-bb11-c11c91ecfb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:19.935945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15506992-e207-49ac-bb11-c11c91ecfb36 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:19.947144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-28aa6e8a-283a-418d-975d-3ff8a30b447f None None] MFA Rules not processed for user `6831b3c5867845d08e56f96ae1b47ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:19.948414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-28aa6e8a-283a-418d-975d-3ff8a30b447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:19.967681 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1360/2749] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:19.968932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b27510-4650-4804-86fa-2047ddb5bf5d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:19.969276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b27510-4650-4804-86fa-2047ddb5bf5d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:19.969551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b27510-4650-4804-86fa-2047ddb5bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:19.998660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-71b27510-4650-4804-86fa-2047ddb5bf5d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:20.000895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-71b27510-4650-4804-86fa-2047ddb5bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:20.017190 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1361/2750] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:20.017190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b27510-4650-4804-86fa-2047ddb5bf5d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:20.032040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b27510-4650-4804-86fa-2047ddb5bf5d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:20.041653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:20.042609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:20.043006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:20.043738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] PATH_INFO: `/v3/projects/9e8e0d71ab744caca68c43441b435233/users/989bb6e140994164aa31fd17d2023f46/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:20.070953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8e0d71ab744caca68c43441b435233, user_id=989bb6e140994164aa31fd17d2023f46, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:20.080424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:20.101974 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1362/2751] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:20 2022] PUT /identity/v3/projects/9e8e0d71ab744caca68c43441b435233/users/989bb6e140994164aa31fd17d2023f46/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:20.113668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:20.124816 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1390/2752] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:20.127655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c5c30-8e13-4fdd-813e-ce7a8760645b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:20.127655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c5c30-8e13-4fdd-813e-ce7a8760645b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:20.127655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c5c30-8e13-4fdd-813e-ce7a8760645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:20.197335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1b8c5c30-8e13-4fdd-813e-ce7a8760645b None None] MFA Rules not processed for user `989bb6e140994164aa31fd17d2023f46`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:20.201845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1b8c5c30-8e13-4fdd-813e-ce7a8760645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:20.272172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6020-5393-43d1-b784-7d00c36b6edc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:20.283036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:20.285475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:20.286099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:20.287883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:20.288722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:20.289506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:20.291732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:20.323644 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1363/2753] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:20.331311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:20.333613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:20.444380 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1391/2754] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:20.444380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c5c30-8e13-4fdd-813e-ce7a8760645b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:20.475498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c5c30-8e13-4fdd-813e-ce7a8760645b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:20.493773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:20.495481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:20.496621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:20.497689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:20.498579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:20.503921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:20.509745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46599-fa34-4dd8-8363-2741c2f67e3e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:20.532942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:20.533873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:20.534348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:20.534723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:20.552398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1392/2755] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:20 2022] POST /identity/v3/projects => generated 397 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:20.554502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:20.695845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfe5a2-7918-40f6-af5c-3498f32ee8cf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:20.714270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:20.717573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:20.717880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:20.719402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:20.720097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:20.724398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:20.756456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:20.762880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:20.801791 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1364/2756] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:20.815843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:20.820422 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1393/2757] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:20 2022] POST /identity/v3/projects => generated 393 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:20.821429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:20.847692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435aacf-c755-4681-9b60-70815c3588ad service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:20.988975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd053a21-15da-4434-9e33-b48a6739c688 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:20.996816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:20.998999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:20.999672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:20.999950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.001448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.004392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.005795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.006868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.007365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.008936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.010152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.012828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.060038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1365/2758] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:20 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:21.062466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.065281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:21.074068 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1394/2759] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:20 2022] POST /identity/v3/users => generated 303 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:21.074068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.080403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00b6c-8fb1-480a-ad01-0bdfc2474309 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.091197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.092584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.093102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.093385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] PATH_INFO: `/v3/users/6831b3c5867845d08e56f96ae1b47ec3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.094874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6831b3c5867845d08e56f96ae1b47ec3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.097525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.100237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262cbc8-114a-447d-9a71-d5278c4510db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.119468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.120443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.120900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.121360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.122413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.126073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.153563 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1395/2760] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:21.156720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.184126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6cbb4-1da7-4a84-a966-0051060a33e1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.216427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.231920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.231920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.232192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.232973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.234895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.264658 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1396/2761] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:21.265834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.295683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98629e28-5799-423e-868b-ce9956a33005 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.303639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.304472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.304882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.305266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.306116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.308882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.317763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6831b3c5867845d08e56f96ae1b47ec3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.336742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6831b3c5867845d08e56f96ae1b47ec3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.337613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1397/2762] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:21.338927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.341600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:21.341771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6831b3c5867845d08e56f96ae1b47ec3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.342697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6831b3c5867845d08e56f96ae1b47ec3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.359509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6831b3c5867845d08e56f96ae1b47ec3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.382556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92981ae-e007-4aa6-b048-dd9de4c7598e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.386070 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1366/2763] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:21 2022] DELETE /identity/v3/users/6831b3c5867845d08e56f96ae1b47ec3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:21.387811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.388722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.389680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:21.390024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.390538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.391128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] PATH_INFO: `/v3/users/e37a0b792dac44beb1580b3995f1883f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.393603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37a0b792dac44beb1580b3995f1883f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.396596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.515161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47dd9-04eb-4687-b01e-26e27e096098 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.522470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.523389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.523729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.524053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] PATH_INFO: `/v3/projects/b19fec8d47f6473ead67ca78de83c496/users/60018920b1df4dc286f4a91307fffc33/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.533290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37a0b792dac44beb1580b3995f1883f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.536402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37a0b792dac44beb1580b3995f1883f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.560444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37a0b792dac44beb1580b3995f1883f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.561255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37a0b792dac44beb1580b3995f1883f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.565178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19fec8d47f6473ead67ca78de83c496, user_id=60018920b1df4dc286f4a91307fffc33, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.569987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.580757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-616a8c9b-2565-4f83-98e1-292760ae72d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37a0b792dac44beb1580b3995f1883f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:21.602227 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1367/2764] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:21 2022] PUT /identity/v3/projects/b19fec8d47f6473ead67ca78de83c496/users/60018920b1df4dc286f4a91307fffc33/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:21.606920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.608922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:21.640496 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1398/2765] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:21 2022] DELETE /identity/v3/users/e37a0b792dac44beb1580b3995f1883f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:21.642102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.642519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.657966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.707864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:21.713354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:21.729555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a2486-ca20-430b-a1b0-64ac26e3da1f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.867002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1399/2766] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:21.868103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.872852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:21.881887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:21.883325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:21.883688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:21.883985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] PATH_INFO: `/v3/projects/273e6b1d35a44caaafcda83f27d0a744/users/e3d508ca036e4ac5aae50cc67eb63bbf/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:21.904596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273e6b1d35a44caaafcda83f27d0a744, user_id=e3d508ca036e4ac5aae50cc67eb63bbf, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:21.908707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:21.926892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b9709-e8a3-4954-a7af-5a2bb6291115 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:21.936731 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1368/2767] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:21 2022] PUT /identity/v3/projects/273e6b1d35a44caaafcda83f27d0a744/users/e3d508ca036e4ac5aae50cc67eb63bbf/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:21.939473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:21.948954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:22.082171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc906ef4-8a2a-4990-a27d-f26264b67349 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:22.088033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:22.088839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.089126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.089418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.133936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb5762-7a77-462a-b851-7ed0dde5a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:22.136023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5762-7a77-462a-b851-7ed0dde5a5ec admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.136569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5762-7a77-462a-b851-7ed0dde5a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.137304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb5762-7a77-462a-b851-7ed0dde5a5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.138844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb5762-7a77-462a-b851-7ed0dde5a5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:22.142088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb5762-7a77-462a-b851-7ed0dde5a5ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:22.205499 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1400/2768] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:22.208728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb35676-e8fd-4b72-853a-63cb6736b4e7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.212383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb35676-e8fd-4b72-853a-63cb6736b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.215516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb35676-e8fd-4b72-853a-63cb6736b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.252873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:22.254967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:22.266843 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1369/2769] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:22.272519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1fb35676-e8fd-4b72-853a-63cb6736b4e7 None None] MFA Rules not processed for user `e3d508ca036e4ac5aae50cc67eb63bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:22.276387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:22.276603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1fb35676-e8fd-4b72-853a-63cb6736b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:22.282389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:22.314686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bea9f2-c7e2-453d-9be9-9f0f16d8ab6a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:22.330557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:22.331822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.332736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.334645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] PATH_INFO: `/v3/projects/397d3af89ad74a74b7f950ddfef16aee` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.337925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397d3af89ad74a74b7f950ddfef16aee)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:22.342443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:22.502389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1401/2770] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:22.502389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb35676-e8fd-4b72-853a-63cb6736b4e7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:22.508291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397d3af89ad74a74b7f950ddfef16aee', 'request_id': 'req-5e63a428-ac87-4ab8-971d-b321c6efc8f3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:22.524725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397d3af89ad74a74b7f950ddfef16aee', 'request_id': 'req-5e63a428-ac87-4ab8-971d-b321c6efc8f3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:22.532327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb35676-e8fd-4b72-853a-63cb6736b4e7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:22.558376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397d3af89ad74a74b7f950ddfef16aee', 'request_id': 'req-5e63a428-ac87-4ab8-971d-b321c6efc8f3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:22.612369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] The token cache is being invalidate because project 397d3af89ad74a74b7f950ddfef16aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:22.613045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:22.613933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:22.623623 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1370/2771] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:22 2022] DELETE /identity/v3/projects/397d3af89ad74a74b7f950ddfef16aee => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:22.625005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:22.627178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:22.714519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f467a-a1df-4362-8dd5-9024f0bd96c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:22.716203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f467a-a1df-4362-8dd5-9024f0bd96c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.716487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f467a-a1df-4362-8dd5-9024f0bd96c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.716762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f467a-a1df-4362-8dd5-9024f0bd96c1 admin admin] PATH_INFO: `/v3/projects/b19fec8d47f6473ead67ca78de83c496/users/60018920b1df4dc286f4a91307fffc33/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.721346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f467a-a1df-4362-8dd5-9024f0bd96c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19fec8d47f6473ead67ca78de83c496, user_id=60018920b1df4dc286f4a91307fffc33, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:22.724054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f467a-a1df-4362-8dd5-9024f0bd96c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:22.742309 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1402/2772] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:22 2022] PUT /identity/v3/projects/b19fec8d47f6473ead67ca78de83c496/users/60018920b1df4dc286f4a91307fffc33/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:22.747558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502fafd-05a3-4cae-9227-888e1123c5bc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.747558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502fafd-05a3-4cae-9227-888e1123c5bc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.747558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502fafd-05a3-4cae-9227-888e1123c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.772789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c502fafd-05a3-4cae-9227-888e1123c5bc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:22.774082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c502fafd-05a3-4cae-9227-888e1123c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:22.829549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63a428-ac87-4ab8-971d-b321c6efc8f3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:22.891543 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1403/2773] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:22.893159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e902-230c-4299-9d38-205b08fcad27 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.894068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e902-230c-4299-9d38-205b08fcad27 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.894559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e902-230c-4299-9d38-205b08fcad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.966588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-96c8e902-230c-4299-9d38-205b08fcad27 None None] MFA Rules not processed for user `60018920b1df4dc286f4a91307fffc33`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:22.968078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-96c8e902-230c-4299-9d38-205b08fcad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:22.972213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:22.973122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:22.973819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:22.974589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:22.977022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.064574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.066237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.083512 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1371/2774] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:23.096688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.097850 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1404/2775] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:23.099381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.099669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.099946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.101137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.123593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59030c8f-5f07-47cd-9e82-a605ff87e88d service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.135500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.139282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.140020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.140599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] PATH_INFO: `/v3/projects/dc265111632a4aab932a3582370e459a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.144023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc265111632a4aab932a3582370e459a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.144515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:23.145911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.147513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.169896 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1405/2776] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:23.170875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.175223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.201160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0624bf-563d-4a1e-a3a3-b2234bd76af9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.207732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd40ea-453e-49d5-a2ad-9d5344b82c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.208155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd40ea-453e-49d5-a2ad-9d5344b82c4d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.208624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd40ea-453e-49d5-a2ad-9d5344b82c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.208973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd40ea-453e-49d5-a2ad-9d5344b82c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.209759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd40ea-453e-49d5-a2ad-9d5344b82c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.211923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd40ea-453e-49d5-a2ad-9d5344b82c4d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.251673 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1406/2777] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/projects => generated 395 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:23.255166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc265111632a4aab932a3582370e459a', 'request_id': 'req-5564b748-327c-446a-91cb-09b3d81fb47e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:23.256009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.256307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.256735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.263404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc265111632a4aab932a3582370e459a', 'request_id': 'req-5564b748-327c-446a-91cb-09b3d81fb47e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:23.275025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc265111632a4aab932a3582370e459a', 'request_id': 'req-5564b748-327c-446a-91cb-09b3d81fb47e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:23.285267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] MFA Rules not processed for user `e3d508ca036e4ac5aae50cc67eb63bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:23.287655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.298748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] The token cache is being invalidate because project dc265111632a4aab932a3582370e459a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:23.299119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:23.299816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:23.302352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1372/2778] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:23 2022] DELETE /identity/v3/projects/dc265111632a4aab932a3582370e459a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:23.303813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.307661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.383375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1407/2779] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:23.383375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.383375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.401740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564b748-327c-446a-91cb-09b3d81fb47e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.504816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a51d8-f3a6-4ce0-8838-78886a0dbbb3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.512937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.513796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.514085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.514361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.515205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.522926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2680-19f0-4e4d-863e-011f8186b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.523215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.523556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2680-19f0-4e4d-863e-011f8186b902 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.523835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2680-19f0-4e4d-863e-011f8186b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.524257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2680-19f0-4e4d-863e-011f8186b902 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.525146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2680-19f0-4e4d-863e-011f8186b902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:23.525450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2680-19f0-4e4d-863e-011f8186b902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.528779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2680-19f0-4e4d-863e-011f8186b902 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.546011 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1373/2780] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:23.547560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cd5e-84b5-4fd8-9d67-e8eb89c3ec1d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.547852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cd5e-84b5-4fd8-9d67-e8eb89c3ec1d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.548340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cd5e-84b5-4fd8-9d67-e8eb89c3ec1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.566141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1408/2781] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:23.570127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.592808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2587cd5e-84b5-4fd8-9d67-e8eb89c3ec1d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:23.593996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a77086-e8d4-4443-b7ef-675e99cbecde admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.594289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2587cd5e-84b5-4fd8-9d67-e8eb89c3ec1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.613552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3d8b6-1f6e-418b-8ab7-3df4c7f7d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.613552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d8b6-1f6e-418b-8ab7-3df4c7f7d0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.613879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d8b6-1f6e-418b-8ab7-3df4c7f7d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.614146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d8b6-1f6e-418b-8ab7-3df4c7f7d0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.614971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3d8b6-1f6e-418b-8ab7-3df4c7f7d0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.618067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3d8b6-1f6e-418b-8ab7-3df4c7f7d0a2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.619966 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1374/2782] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:23.620827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587cd5e-84b5-4fd8-9d67-e8eb89c3ec1d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.641889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587cd5e-84b5-4fd8-9d67-e8eb89c3ec1d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.653770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.654563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.654936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.655178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.655942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.657881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.674196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1409/2783] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:23.677503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b953e-c85a-4182-b6b3-8bd13387d08f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.678265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b953e-c85a-4182-b6b3-8bd13387d08f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.681563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b953e-c85a-4182-b6b3-8bd13387d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.687725 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1375/2784] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:23.688648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.708964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c15142-37d9-4a00-8203-145bc28a0a0c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.728427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9c6b953e-c85a-4182-b6b3-8bd13387d08f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:23.732681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9c6b953e-c85a-4182-b6b3-8bd13387d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:23.811261 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1410/2785] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:23.812242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b953e-c85a-4182-b6b3-8bd13387d08f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.835136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b953e-c85a-4182-b6b3-8bd13387d08f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.849074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.849074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.849484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.854150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.855054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.858041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.879970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.880729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.881018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.881309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.881983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.888582 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1411/2786] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:23.889738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.895244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.905921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022882ca-25af-4d81-ba10-ecb920fecbe3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.914205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.915438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.915972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.916516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.917570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:23.918676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.921314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:23.944605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1412/2787] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:23.944605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.966169 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1376/2788] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:23.966169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:23.983708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d68d5-c19b-4841-bfc5-5803d62a8bce admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.993631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:23.994530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:23.995121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:23.996279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:23.997381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:23.999131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa1962-e9a1-44b5-82c2-2bdf8a0660ef admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:23.999886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.005826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.007140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.008391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.008904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] PATH_INFO: `/v3/projects/de583b1aaef54fd483197444d6f601a6/users/500330010d7b4e29912158a27ac095e4/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.039055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de583b1aaef54fd483197444d6f601a6, user_id=500330010d7b4e29912158a27ac095e4, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.042524 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1377/2789] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:23 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:24.042524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.043813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.066634 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1413/2790] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:23 2022] PUT /identity/v3/projects/de583b1aaef54fd483197444d6f601a6/users/500330010d7b4e29912158a27ac095e4/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:24.068669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.071468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.121105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3a45-144d-43c3-9dd4-6eeae4c174eb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.163837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8da94-75df-4f99-a0ac-196b9771fbe5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.169821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.170941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.171292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.171764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] PATH_INFO: `/v3/users/e3d508ca036e4ac5aae50cc67eb63bbf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.173057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d508ca036e4ac5aae50cc67eb63bbf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.175467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.204929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.205740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.206100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.208108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.208108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.209039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.229515 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1378/2791] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:24.230745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.244791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0914e7a-62eb-4e49-aef2-f7708b9e0cbb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.253253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7356-0b22-4661-8e15-ce52ade39048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.255410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7356-0b22-4661-8e15-ce52ade39048 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.256724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7356-0b22-4661-8e15-ce52ade39048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.257048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7356-0b22-4661-8e15-ce52ade39048 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.257814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7356-0b22-4661-8e15-ce52ade39048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.262380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7356-0b22-4661-8e15-ce52ade39048 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.280880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d508ca036e4ac5aae50cc67eb63bbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:24.282008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d508ca036e4ac5aae50cc67eb63bbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:24.286980 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1379/2792] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:24 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:24.288591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.288984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.289332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.295289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d508ca036e4ac5aae50cc67eb63bbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:24.296350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d508ca036e4ac5aae50cc67eb63bbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:24.312120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d508ca036e4ac5aae50cc67eb63bbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:24.333308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] MFA Rules not processed for user `500330010d7b4e29912158a27ac095e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:24.334839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.369008 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1414/2793] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:24 2022] DELETE /identity/v3/users/e3d508ca036e4ac5aae50cc67eb63bbf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:24.370313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.378203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.410438 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1380/2794] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:24.414933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.423319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.452062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dbcd6-224c-414e-a2c0-606f1ebfeb24 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.525912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b23dd-90f9-414e-a372-8a96649a424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.526607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b23dd-90f9-414e-a372-8a96649a424e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.526929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b23dd-90f9-414e-a372-8a96649a424e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.527787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b23dd-90f9-414e-a372-8a96649a424e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.528811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b23dd-90f9-414e-a372-8a96649a424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.530497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b23dd-90f9-414e-a372-8a96649a424e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.539572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bd462-36de-43b4-add0-ab950569ff67 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.548785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.549836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.550281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.550716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.551678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.552132 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1381/2795] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:24.553604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5910-a745-4153-8c6f-808086db7c26 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.553887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5910-a745-4153-8c6f-808086db7c26 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.554164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d5910-a745-4153-8c6f-808086db7c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.554321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.568490 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1415/2796] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:24.570541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.575740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.579505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d85d5910-a745-4153-8c6f-808086db7c26 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:24.580848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d85d5910-a745-4153-8c6f-808086db7c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.609980 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1382/2797] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:24.613657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d5910-a745-4153-8c6f-808086db7c26 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.636356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d5910-a745-4153-8c6f-808086db7c26 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.649792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.650812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.650812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.651044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.651760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.653434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.669825 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1383/2798] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:24.670699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.686352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e3152-5cd8-4824-90b6-c35c14f47a34 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.691972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.692870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.693155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.693437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] PATH_INFO: `/v3/projects/281216301a5449cdb4c66e9f35e6e582/users/1e3abb274c044cc4b88d57193b5c62d2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.718080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=281216301a5449cdb4c66e9f35e6e582, user_id=1e3abb274c044cc4b88d57193b5c62d2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.722576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.730044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd09198-edb5-4217-9839-157f1c1d59ca admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.741521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.742259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.742642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.742888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.744952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.749464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1384/2799] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:24 2022] PUT /identity/v3/projects/281216301a5449cdb4c66e9f35e6e582/users/1e3abb274c044cc4b88d57193b5c62d2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:24.751785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.753792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:24.835840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38280da-39d0-4494-983f-c43772d3a4f1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.849441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68a6ce-a7c0-4184-af16-641925ae62db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.851585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a6ce-a7c0-4184-af16-641925ae62db service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.852041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a6ce-a7c0-4184-af16-641925ae62db service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.852730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68a6ce-a7c0-4184-af16-641925ae62db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.865359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.867335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.878684 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1416/2800] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:24.879597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:24.893776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274cc40-167d-43b0-b43d-58d3342dfab7 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:24.962602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68a6ce-a7c0-4184-af16-641925ae62db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:24.964188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68a6ce-a7c0-4184-af16-641925ae62db service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:24.978323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bab26-de05-4d41-92ba-f7c5416df078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:24.979619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bab26-de05-4d41-92ba-f7c5416df078 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.980056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bab26-de05-4d41-92ba-f7c5416df078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.980530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bab26-de05-4d41-92ba-f7c5416df078 admin admin] PATH_INFO: `/v3/projects/5cff54bc356c492ba7c917ff045462cc/users/737f5a73ba024d2989cce569bc1177d3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:24.988737 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1385/2801] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:24.990327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:24.990727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:24.991265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.002343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bab26-de05-4d41-92ba-f7c5416df078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cff54bc356c492ba7c917ff045462cc, user_id=737f5a73ba024d2989cce569bc1177d3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:25.005658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bab26-de05-4d41-92ba-f7c5416df078 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:25.030293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:25.032052 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1417/2802] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:24 2022] PUT /identity/v3/projects/5cff54bc356c492ba7c917ff045462cc/users/737f5a73ba024d2989cce569bc1177d3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:25.033437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:25.033791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94b84-9b19-4483-b4b2-5d267c9a9563 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.034273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94b84-9b19-4483-b4b2-5d267c9a9563 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.034697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94b84-9b19-4483-b4b2-5d267c9a9563 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.044923 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1418/2803] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:49:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:49:25.048875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.049513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.050702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.096332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] MFA Rules not processed for user `737f5a73ba024d2989cce569bc1177d3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:25.097797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:25.143330 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1386/2804] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:25.144351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:49:25.146946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:25.260831 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1419/2805] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:25.266856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:25.268258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:25.314136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:25.337323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89844850-7365-4145-a2ab-e00c29b8d229 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:25.342468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:25.343166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.343450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.343727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.384564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:25.389692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:25.406385 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1420/2806] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:25.407607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:25.421741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f9740-3795-4505-ad4b-9ee9de6b5196 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:25.442135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3bbb5-adfd-4d0b-952f-d1e82a2a2db2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:25.444651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a072b6-723e-4198-9c27-639f78f597b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:25.445622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a072b6-723e-4198-9c27-639f78f597b1 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.445915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a072b6-723e-4198-9c27-639f78f597b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.446195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a072b6-723e-4198-9c27-639f78f597b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.456231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60018920b1df4dc286f4a91307fffc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b19fec8d47f6473ead67ca78de83c496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:25.457088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.463054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a072b6-723e-4198-9c27-639f78f597b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:25.466355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a072b6-723e-4198-9c27-639f78f597b1 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:25.467571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.467875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] PATH_INFO: `/v3/projects/9e8e0d71ab744caca68c43441b435233` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.471126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8e0d71ab744caca68c43441b435233)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:25.474304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:25.476469 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1387/2807] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:49:25 2022] GET /identity/v3/projects/9e8e0d71ab744caca68c43441b435233 => generated 395 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:25.490621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1421/2808] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:25.631449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:25.633348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:25.661147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a343f-150b-4125-9c63-2389bb0a313a tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:25.687030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:25.688007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.688272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.688550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] PATH_INFO: `/v3/projects/273e6b1d35a44caaafcda83f27d0a744` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.700977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=273e6b1d35a44caaafcda83f27d0a744)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:25.711413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:25.837284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273e6b1d35a44caaafcda83f27d0a744', 'request_id': 'req-58506d75-08af-47fa-966f-e5c17a8214ea'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:25.850412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273e6b1d35a44caaafcda83f27d0a744', 'request_id': 'req-58506d75-08af-47fa-966f-e5c17a8214ea'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:25.869391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273e6b1d35a44caaafcda83f27d0a744', 'request_id': 'req-58506d75-08af-47fa-966f-e5c17a8214ea'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:25.893454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] The token cache is being invalidate because project 273e6b1d35a44caaafcda83f27d0a744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:25.893579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:25.896960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58506d75-08af-47fa-966f-e5c17a8214ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:25.906960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a088f0-5c11-4b82-b98b-f5e3c8409391 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.907252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a088f0-5c11-4b82-b98b-f5e3c8409391 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.907536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a088f0-5c11-4b82-b98b-f5e3c8409391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.909172 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1388/2809] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:25 2022] DELETE /identity/v3/projects/273e6b1d35a44caaafcda83f27d0a744 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:25.939242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a4a088f0-5c11-4b82-b98b-f5e3c8409391 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:25.942022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a4a088f0-5c11-4b82-b98b-f5e3c8409391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:25.983232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:25.983911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:25.984465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:25.986293 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1389/2810] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:49:25.992139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:49:25.994626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:26.078483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1422/2811] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:26.088722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb914-be4e-4ed6-9543-6d152fdbd9a6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.089022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb914-be4e-4ed6-9543-6d152fdbd9a6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.089310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bb914-be4e-4ed6-9543-6d152fdbd9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.100814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.102369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:26.132747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ee5bb914-be4e-4ed6-9543-6d152fdbd9a6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:26.134158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee5bb914-be4e-4ed6-9543-6d152fdbd9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:26.166308 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1423/2812] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:26.171645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb914-be4e-4ed6-9543-6d152fdbd9a6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.198601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bb914-be4e-4ed6-9543-6d152fdbd9a6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.227101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:26.227738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.227967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.228246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.228996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:26.229302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:26.233443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:26.269850 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1424/2813] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:26.285485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.302261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaf63c-0120-4679-9d25-6741796892d2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.302490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1b4a0-d51c-40af-9096-a6632ed5d9bf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.319494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60018920b1df4dc286f4a91307fffc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b19fec8d47f6473ead67ca78de83c496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:26.320677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.321039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369a30a-9d9e-4ace-91e8-748e92f25bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:26.321493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.321708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369a30a-9d9e-4ace-91e8-748e92f25bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.321994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369a30a-9d9e-4ace-91e8-748e92f25bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.322278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369a30a-9d9e-4ace-91e8-748e92f25bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.322698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] PATH_INFO: `/v3/projects/9e8e0d71ab744caca68c43441b435233` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.322997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369a30a-9d9e-4ace-91e8-748e92f25bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:26.326299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369a30a-9d9e-4ace-91e8-748e92f25bd6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:26.327327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8e0d71ab744caca68c43441b435233)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:26.329720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:26.332056 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1390/2814] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:49:25 2022] GET /identity/v3/projects/9e8e0d71ab744caca68c43441b435233 => generated 395 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:49:26.400233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1425/2815] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:26 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:26.404346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.419957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333290-3947-47be-9165-03c4ef6f3e43 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.555989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12847-aa90-4dc9-b8e6-60d1b57e2af0 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.556376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12847-aa90-4dc9-b8e6-60d1b57e2af0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.556816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12847-aa90-4dc9-b8e6-60d1b57e2af0 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.558447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1426/2816] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:49:26.568048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12847-aa90-4dc9-b8e6-60d1b57e2af0 None None] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:49:26.600765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:26.601474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.601746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.602051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.603138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:26.604811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:26.669937 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1391/2817] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:26 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:26.674716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.696738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b80c7-ecf2-4c16-a564-d38701026833 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.723436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:26.724121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.724402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.724676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.725404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:26.727042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:26.756096 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1392/2818] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:26.757016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.770622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cb578-6e32-4c7b-8fa0-3a334a552bbc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.774055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12847-aa90-4dc9-b8e6-60d1b57e2af0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.777770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:26.778547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.778962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.779430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.780151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:26.782646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:26.800720 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1393/2819] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:26.805640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:26.831878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2da60-1c97-498a-86d6-97adca11eafd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.845684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520e18b-4578-4723-85fe-664cc6b1da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:26.847438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e18b-4578-4723-85fe-664cc6b1da84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.847809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e18b-4578-4723-85fe-664cc6b1da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.848129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e18b-4578-4723-85fe-664cc6b1da84 admin admin] PATH_INFO: `/v3/projects/c7a25b96a7e94d2fbf7b81649197cb8b/users/5ac29538817f43d7acdaaa71f6fc407d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.889756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520e18b-4578-4723-85fe-664cc6b1da84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a25b96a7e94d2fbf7b81649197cb8b, user_id=5ac29538817f43d7acdaaa71f6fc407d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:26.894484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520e18b-4578-4723-85fe-664cc6b1da84 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:26.946316 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1394/2820] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:26 2022] PUT /identity/v3/projects/c7a25b96a7e94d2fbf7b81649197cb8b/users/5ac29538817f43d7acdaaa71f6fc407d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:26.951647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c834-f640-4438-870e-2759a20bd39f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:26.951647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c834-f640-4438-870e-2759a20bd39f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:26.952010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c834-f640-4438-870e-2759a20bd39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:26.961064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12847-aa90-4dc9-b8e6-60d1b57e2af0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:26.981095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-df76c834-f640-4438-870e-2759a20bd39f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:26.982414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-df76c834-f640-4438-870e-2759a20bd39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:27.061673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1395/2821] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:27.073412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76c834-f640-4438-870e-2759a20bd39f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:27.081242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-df76c834-f640-4438-870e-2759a20bd39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:27.117698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df8b3-cea7-4d29-88c1-ec2bb6cbb1bc tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60018920b1df4dc286f4a91307fffc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b19fec8d47f6473ead67ca78de83c496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:27.118989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df8b3-cea7-4d29-88c1-ec2bb6cbb1bc tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:27.119503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df8b3-cea7-4d29-88c1-ec2bb6cbb1bc tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:27.119988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df8b3-cea7-4d29-88c1-ec2bb6cbb1bc tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] PATH_INFO: `/v3/projects/9e8e0d71ab744caca68c43441b435233` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:27.123248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447df8b3-cea7-4d29-88c1-ec2bb6cbb1bc tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8e0d71ab744caca68c43441b435233)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:27.125630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447df8b3-cea7-4d29-88c1-ec2bb6cbb1bc tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:27.129242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1427/2822] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:49:26 2022] GET /identity/v3/projects/9e8e0d71ab744caca68c43441b435233 => generated 395 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:49:27.153705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76c834-f640-4438-870e-2759a20bd39f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:27.161528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:27.162550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:27.162849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:27.163221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:27.175862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:27.177614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:27.195054 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1396/2823] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:49:29.518293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346764e0-997f-403b-9f41-a264accb6ad0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:29.518829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346764e0-997f-403b-9f41-a264accb6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:29.518947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346764e0-997f-403b-9f41-a264accb6ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:29.595255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-346764e0-997f-403b-9f41-a264accb6ad0 None None] MFA Rules not processed for user `5ac29538817f43d7acdaaa71f6fc407d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:29.597048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-346764e0-997f-403b-9f41-a264accb6ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:29.686066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1428/2824] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:30.357818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:30.364220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:30.522870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc8582-afd1-4b6f-bdaa-c8fb292112ae service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:30.542457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92892285-500e-41f2-9755-557b08eed217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:30.543208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92892285-500e-41f2-9755-557b08eed217 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:30.543494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92892285-500e-41f2-9755-557b08eed217 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:30.543772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92892285-500e-41f2-9755-557b08eed217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:30.555027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92892285-500e-41f2-9755-557b08eed217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:30.557008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92892285-500e-41f2-9755-557b08eed217 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:30.578381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1397/2825] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:31.609644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f977-fa19-4d5a-a6ca-6c3e37d72ca2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:31.610512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f977-fa19-4d5a-a6ca-6c3e37d72ca2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:31.611030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f977-fa19-4d5a-a6ca-6c3e37d72ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:31.629868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b638f977-fa19-4d5a-a6ca-6c3e37d72ca2 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:31.631616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b638f977-fa19-4d5a-a6ca-6c3e37d72ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:31.717145 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1429/2826] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:49:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:31.732756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92892285-500e-41f2-9755-557b08eed217 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:31.735020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-92892285-500e-41f2-9755-557b08eed217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:31.782675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f977-fa19-4d5a-a6ca-6c3e37d72ca2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:31.801688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f977-fa19-4d5a-a6ca-6c3e37d72ca2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:31.815341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82007b07-fe98-4e15-b79b-80e733a20fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:31.816096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007b07-fe98-4e15-b79b-80e733a20fa7 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:31.816448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007b07-fe98-4e15-b79b-80e733a20fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:31.816919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82007b07-fe98-4e15-b79b-80e733a20fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:31.822883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-82007b07-fe98-4e15-b79b-80e733a20fa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:31.869368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92892285-500e-41f2-9755-557b08eed217 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:31.893950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb502d-2a61-4b78-8544-db6050c07dec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:31.894602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb502d-2a61-4b78-8544-db6050c07dec service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:31.894933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb502d-2a61-4b78-8544-db6050c07dec service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:31.895209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb502d-2a61-4b78-8544-db6050c07dec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:31.917824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb502d-2a61-4b78-8544-db6050c07dec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:31.922450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb502d-2a61-4b78-8544-db6050c07dec service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:31.933577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007b07-fe98-4e15-b79b-80e733a20fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:31.936423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82007b07-fe98-4e15-b79b-80e733a20fa7 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:31.942030 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1398/2827] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:49:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:49:31.953100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1430/2828] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:33.474992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:33.475453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:33.475550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:33.519872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] MFA Rules not processed for user `c562e7dec6d34cd0a7fc7cea14fa5e74`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:33.527006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:33.663652 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1399/2829] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:34.332941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d66c0-15ac-4962-a3f9-90b3ece41075 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:34.333802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d66c0-15ac-4962-a3f9-90b3ece41075 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:34.334409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d66c0-15ac-4962-a3f9-90b3ece41075 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:34.337019 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1431/2830] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:49:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:49:34.350526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:49:34.400360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:34.437100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d941e02-fa63-43fc-9e00-9f1da44dbc6d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:34.458325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cf73f-de90-4f11-a5e2-17d53084e857 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60018920b1df4dc286f4a91307fffc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b19fec8d47f6473ead67ca78de83c496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:34.460093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cf73f-de90-4f11-a5e2-17d53084e857 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:34.460695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cf73f-de90-4f11-a5e2-17d53084e857 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:34.461316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cf73f-de90-4f11-a5e2-17d53084e857 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] PATH_INFO: `/v3/projects/9e8e0d71ab744caca68c43441b435233` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:34.462666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cf73f-de90-4f11-a5e2-17d53084e857 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8e0d71ab744caca68c43441b435233)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:34.465060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cf73f-de90-4f11-a5e2-17d53084e857 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:34.467733 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1400/2831] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:49:34 2022] GET /identity/v3/projects/9e8e0d71ab744caca68c43441b435233 => generated 395 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:36.003042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:36.003561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:36.003649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:36.032745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] MFA Rules not processed for user `1e3abb274c044cc4b88d57193b5c62d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:36.034436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:36.166507 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1432/2832] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:36.665208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793a75-db94-4d31-a2d2-151f4a7c5525 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:36.665718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793a75-db94-4d31-a2d2-151f4a7c5525 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:36.665837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4793a75-db94-4d31-a2d2-151f4a7c5525 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:36.667439 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1401/2833] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:49:36.673159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:49:36.688486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:36.700789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed84658-c5d3-4429-9994-95074ec93866 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:36.705994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2e497-9202-455a-a185-a346b19a177d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60018920b1df4dc286f4a91307fffc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b19fec8d47f6473ead67ca78de83c496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:36.707202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2e497-9202-455a-a185-a346b19a177d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:36.707697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2e497-9202-455a-a185-a346b19a177d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:36.708180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2e497-9202-455a-a185-a346b19a177d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] PATH_INFO: `/v3/projects/9e8e0d71ab744caca68c43441b435233` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:36.709591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2e497-9202-455a-a185-a346b19a177d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorizing `identity:get_project(project_id=9e8e0d71ab744caca68c43441b435233)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:36.711987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2e497-9202-455a-a185-a346b19a177d tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:36.714760 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1433/2834] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:49:36 2022] GET /identity/v3/projects/9e8e0d71ab744caca68c43441b435233 => generated 395 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:36.852758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793a75-db94-4d31-a2d2-151f4a7c5525 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:36.871768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4793a75-db94-4d31-a2d2-151f4a7c5525 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:36.882531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:36.883253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:36.883534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:36.883812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:36.899567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:36.902480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:36.913794 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1402/2835] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:38.717099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc0dd2-7491-4288-87b4-849b96afd65b None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:38.721969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc0dd2-7491-4288-87b4-849b96afd65b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:38.721969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc0dd2-7491-4288-87b4-849b96afd65b None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:38.721969 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1434/2836] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:49:38.728330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:49:38.745830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:38.764287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d6517-307c-4cf8-9b63-cf5fae6c7144 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:38.775020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60018920b1df4dc286f4a91307fffc33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b19fec8d47f6473ead67ca78de83c496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:38.776458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:38.777650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:38.778439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] PATH_INFO: `/v3/projects/de583b1aaef54fd483197444d6f601a6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:38.781779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorizing `identity:get_project(project_id=de583b1aaef54fd483197444d6f601a6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:38.785455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:38.790077 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1403/2837] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:49:38 2022] GET /identity/v3/projects/de583b1aaef54fd483197444d6f601a6 => generated 395 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:39.527921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc0dd2-7491-4288-87b4-849b96afd65b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:39.533154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09cc0dd2-7491-4288-87b4-849b96afd65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:39.570185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc0dd2-7491-4288-87b4-849b96afd65b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:39.581345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:39.583429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:39.604208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:39.609155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:39.612634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:39.613800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] PATH_INFO: `/v3/users/989bb6e140994164aa31fd17d2023f46` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:39.620804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989bb6e140994164aa31fd17d2023f46)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:39.630335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2924e-18ca-4ec1-be82-9692f74c3d64 tempest-FlavorsAccessNegativeTestJSON-927200295 tempest-FlavorsAccessNegativeTestJSON-927200295-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:39.630942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:39.645824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:39.646764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:39.647065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:39.647340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] PATH_INFO: `/v3/users/737f5a73ba024d2989cce569bc1177d3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:39.650577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=737f5a73ba024d2989cce569bc1177d3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:39.655880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:39.728181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989bb6e140994164aa31fd17d2023f46'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.729699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989bb6e140994164aa31fd17d2023f46'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.743792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989bb6e140994164aa31fd17d2023f46'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.744976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989bb6e140994164aa31fd17d2023f46'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.763902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-24211865-d505-4510-9f6f-16e2dbedafc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989bb6e140994164aa31fd17d2023f46'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.785127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737f5a73ba024d2989cce569bc1177d3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.794488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737f5a73ba024d2989cce569bc1177d3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.795264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737f5a73ba024d2989cce569bc1177d3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.796653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737f5a73ba024d2989cce569bc1177d3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.798337 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1435/2838] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:39 2022] DELETE /identity/v3/users/989bb6e140994164aa31fd17d2023f46 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:39.803486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:39.804046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:39.804500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:39.809144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c5ad4b52-7d70-4145-b5fd-47d17a007d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737f5a73ba024d2989cce569bc1177d3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:39.825395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:39.826898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:39.840302 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1404/2839] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:39 2022] DELETE /identity/v3/users/737f5a73ba024d2989cce569bc1177d3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:39.844706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:39.845212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:39.845692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:39.891681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:39.893040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:39.909329 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1436/2840] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:39.933186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:39.935099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:40.010325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1405/2841] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:40.044165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:40.046163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:40.100559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4090fab-d5b2-47fb-bca0-5aaa130d1cf3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:40.162809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a70cb-e67a-4620-a3ff-7dc9a57a1d59 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:40.177206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:40.178331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:40.178800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:40.179229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:40.196201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:40.200235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09839f3-eaf5-4ec3-a003-72e512ac60a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:40.201112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09839f3-eaf5-4ec3-a003-72e512ac60a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:40.201555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09839f3-eaf5-4ec3-a003-72e512ac60a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:40.201988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09839f3-eaf5-4ec3-a003-72e512ac60a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:40.202942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:40.223075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09839f3-eaf5-4ec3-a003-72e512ac60a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:40.224563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09839f3-eaf5-4ec3-a003-72e512ac60a2 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:40.228449 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1406/2842] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:49:40.237871 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1437/2843] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:49:41.673952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:41.675506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:41.725910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb46b-8ecd-4d11-bc57-1f00bd68670a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:41.740428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:41.741306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:41.741599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:41.741857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] PATH_INFO: `/v3/projects/5cff54bc356c492ba7c917ff045462cc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:41.743563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cff54bc356c492ba7c917ff045462cc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:41.751162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:41.815980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cff54bc356c492ba7c917ff045462cc', 'request_id': 'req-46368b6d-e49f-486f-8282-6d022f42fbc3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:41.828505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cff54bc356c492ba7c917ff045462cc', 'request_id': 'req-46368b6d-e49f-486f-8282-6d022f42fbc3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:41.847237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cff54bc356c492ba7c917ff045462cc', 'request_id': 'req-46368b6d-e49f-486f-8282-6d022f42fbc3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:41.863581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] The token cache is being invalidate because project 5cff54bc356c492ba7c917ff045462cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:41.863933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:41.864780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46368b6d-e49f-486f-8282-6d022f42fbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:41.870788 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1407/2844] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:41 2022] DELETE /identity/v3/projects/5cff54bc356c492ba7c917ff045462cc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:41.872960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:41.873416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:41.873533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:41.907910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:41.912217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:42.062285 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1438/2845] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:42.072539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2e5d-ea08-473e-8432-3431485ffa79 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.073241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2e5d-ea08-473e-8432-3431485ffa79 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.074440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb2e5d-ea08-473e-8432-3431485ffa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.118915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.123412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b8cb2e5d-ea08-473e-8432-3431485ffa79 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:42.125770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b8cb2e5d-ea08-473e-8432-3431485ffa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:42.135272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:42.155202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efc775-d58a-441e-947d-43e5b9f4c5d8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.162134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.164367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.165152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.165794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] PATH_INFO: `/v3/projects/9e8e0d71ab744caca68c43441b435233` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.169482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8e0d71ab744caca68c43441b435233)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.173104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.173710 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1408/2846] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:42.177664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2e5d-ea08-473e-8432-3431485ffa79 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.202293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb2e5d-ea08-473e-8432-3431485ffa79 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.212131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.213427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.214004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.215149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.216057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:42.216502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.219880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.259313 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1409/2847] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:49:42.264803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.298337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8e0d71ab744caca68c43441b435233', 'request_id': 'req-95d5255e-5661-45f5-b00e-99805a18edb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.309505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8e0d71ab744caca68c43441b435233', 'request_id': 'req-95d5255e-5661-45f5-b00e-99805a18edb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.320976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8e0d71ab744caca68c43441b435233', 'request_id': 'req-95d5255e-5661-45f5-b00e-99805a18edb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.324249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0270907-ff0c-4891-aae6-4df630a47349 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.337349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] The token cache is being invalidate because project 9e8e0d71ab744caca68c43441b435233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:42.337449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.338279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95d5255e-5661-45f5-b00e-99805a18edb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.341021 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1439/2848] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:42 2022] DELETE /identity/v3/projects/9e8e0d71ab744caca68c43441b435233 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:42.342841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.343936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.344477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.371195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] MFA Rules not processed for user `1e3abb274c044cc4b88d57193b5c62d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:42.374311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:42.480385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.481205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.481365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.482216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.483657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.489176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.507193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1440/2849] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:42.508413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.513303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:42.544556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf01b2-647a-49b9-872e-62ac256dae23 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.549697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.550665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.551064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.551413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] PATH_INFO: `/v3/users/60018920b1df4dc286f4a91307fffc33` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.552857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60018920b1df4dc286f4a91307fffc33)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.555069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.556299 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1410/2850] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:42 2022] POST /identity/v3/projects => generated 365 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:42.560793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.563055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:42.637224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ae8f2-d56f-4410-a6ed-620267c3b2ec admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.640316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60018920b1df4dc286f4a91307fffc33'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.641057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60018920b1df4dc286f4a91307fffc33'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.644350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.645250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.645749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.646233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.647165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.649302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.656203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60018920b1df4dc286f4a91307fffc33'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.657020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60018920b1df4dc286f4a91307fffc33'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.668589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60018920b1df4dc286f4a91307fffc33'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:42.690718 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1441/2851] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:42 2022] DELETE /identity/v3/users/60018920b1df4dc286f4a91307fffc33 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:42.693041 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1411/2852] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:42 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:49:42.697408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.700728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:42.795693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0168624-e04b-4785-8975-7845f50bb73a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.802425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.803244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.803595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.803948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.804789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.806465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.819162 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1442/2853] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:42.823168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.836984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cd682-69f9-4a6c-9f4d-44a560cc1c7b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.844494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163b2cf-0835-4026-ba68-9e23e9cd6537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.845907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b2cf-0835-4026-ba68-9e23e9cd6537 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.846390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b2cf-0835-4026-ba68-9e23e9cd6537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.846751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163b2cf-0835-4026-ba68-9e23e9cd6537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.847629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b2cf-0835-4026-ba68-9e23e9cd6537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.849550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163b2cf-0835-4026-ba68-9e23e9cd6537 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.862264 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1412/2854] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:42.866578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:42.877617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d315fd-ab8c-47a4-b27d-338622299d6f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:42.883305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:42.884224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.884505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.884780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] PATH_INFO: `/v3/projects/487fc10ff315438ca2de090c396e3cfb/users/63270cc27d704b5095bc8d1133544eeb/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.900897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=487fc10ff315438ca2de090c396e3cfb, user_id=63270cc27d704b5095bc8d1133544eeb, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:42.903641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:42.927804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1443/2855] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:42 2022] PUT /identity/v3/projects/487fc10ff315438ca2de090c396e3cfb/users/63270cc27d704b5095bc8d1133544eeb/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:42.931693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:42.931989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:42.932709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:42.959268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:42.960506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:43.022137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1413/2856] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:43.039799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:43.042016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:43.120191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6c42b-089a-4ee9-9f79-365d407ce03d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:43.125454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:43.126588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:43.126897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:43.127176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:43.137749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:43.139330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:43.152119 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1444/2857] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:43.204200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:43.206714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:43.220351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3504a-6bcf-4583-9868-2ef687212a60 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:43.225385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:43.226608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:43.227143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:43.227648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] PATH_INFO: `/v3/projects/b19fec8d47f6473ead67ca78de83c496` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:43.229162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19fec8d47f6473ead67ca78de83c496)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:43.231993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:43.303020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19fec8d47f6473ead67ca78de83c496', 'request_id': 'req-db83f191-ca24-4821-8c42-001d56b99b02'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.313971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19fec8d47f6473ead67ca78de83c496', 'request_id': 'req-db83f191-ca24-4821-8c42-001d56b99b02'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.326243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19fec8d47f6473ead67ca78de83c496', 'request_id': 'req-db83f191-ca24-4821-8c42-001d56b99b02'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.348568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] The token cache is being invalidate because project b19fec8d47f6473ead67ca78de83c496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:43.348904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.349614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.352548 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1414/2858] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:43 2022] DELETE /identity/v3/projects/b19fec8d47f6473ead67ca78de83c496 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:43.357236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:43.373220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d76be-ca6d-4b56-bd6c-afdea0847f15 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:43.508854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:43.512491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:43.514130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:43.515186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] PATH_INFO: `/v3/users/500330010d7b4e29912158a27ac095e4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:43.518506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500330010d7b4e29912158a27ac095e4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:43.523596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:43.624993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500330010d7b4e29912158a27ac095e4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.625878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500330010d7b4e29912158a27ac095e4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.635959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500330010d7b4e29912158a27ac095e4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.636986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500330010d7b4e29912158a27ac095e4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.653178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5df53a8d-4987-44d4-9831-ca66593fa930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500330010d7b4e29912158a27ac095e4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:43.696288 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1445/2859] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:43 2022] DELETE /identity/v3/users/500330010d7b4e29912158a27ac095e4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:49:44.685753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:44.688453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:44.717411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83f191-ca24-4821-8c42-001d56b99b02 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:44.797486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:44.798561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:44.799181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:44.800204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] PATH_INFO: `/v3/projects/de583b1aaef54fd483197444d6f601a6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:44.801852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de583b1aaef54fd483197444d6f601a6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:44.804621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:44.869783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de583b1aaef54fd483197444d6f601a6', 'request_id': 'req-28dc6e33-62e5-454e-9e16-051b600ce7a6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:44.884369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de583b1aaef54fd483197444d6f601a6', 'request_id': 'req-28dc6e33-62e5-454e-9e16-051b600ce7a6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:44.896641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de583b1aaef54fd483197444d6f601a6', 'request_id': 'req-28dc6e33-62e5-454e-9e16-051b600ce7a6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:44.911328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] The token cache is being invalidate because project de583b1aaef54fd483197444d6f601a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:44.911852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:44.915226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28dc6e33-62e5-454e-9e16-051b600ce7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:44.917951 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1415/2860] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:44 2022] DELETE /identity/v3/projects/de583b1aaef54fd483197444d6f601a6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:44.924133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00e16-8915-4b74-8edc-96a20393289f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:44.924608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00e16-8915-4b74-8edc-96a20393289f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:44.924786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd00e16-8915-4b74-8edc-96a20393289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:44.978011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3cd00e16-8915-4b74-8edc-96a20393289f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:44.982730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3cd00e16-8915-4b74-8edc-96a20393289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:45.136762 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1446/2861] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:45.145504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4f61-c919-4622-b041-caac6f6eedf5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.146100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4f61-c919-4622-b041-caac6f6eedf5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.146586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4f61-c919-4622-b041-caac6f6eedf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.189043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5a2d4f61-c919-4622-b041-caac6f6eedf5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:45.199111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5a2d4f61-c919-4622-b041-caac6f6eedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:45.223599 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1416/2862] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:45.228328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00e16-8915-4b74-8edc-96a20393289f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:45.243618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd00e16-8915-4b74-8edc-96a20393289f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:45.249739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:45.250534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.251144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.251271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.252454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:45.252843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:45.254557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:45.280936 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1447/2863] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:45.281390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4f61-c919-4622-b041-caac6f6eedf5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:45.295190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4f61-c919-4622-b041-caac6f6eedf5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:45.311230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:45.312043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.312430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.312807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.313864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:45.316124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:45.395283 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1417/2864] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:45 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:45.396505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:45.409057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1fa1ee-4b4f-44f9-bcc4-cdd7db99c818 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:45.517039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:45.517898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.518452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.519053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.520720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:45.523316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:45.552697 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1448/2865] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:45 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:45.554312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:45.566592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa42040-3d9c-460a-8053-cd1c85459e39 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:45.573362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:45.574371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.574967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.575399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.576956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:45.579437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:45.598170 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1418/2866] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:45.599040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:45.619027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983bcd1-aa64-4542-88f7-164ab760011f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:45.626103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640f16f-001c-4fce-aea8-e9abc4e7e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:45.626840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640f16f-001c-4fce-aea8-e9abc4e7e25b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.627133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640f16f-001c-4fce-aea8-e9abc4e7e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.627411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640f16f-001c-4fce-aea8-e9abc4e7e25b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.628216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640f16f-001c-4fce-aea8-e9abc4e7e25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:45.629921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640f16f-001c-4fce-aea8-e9abc4e7e25b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:45.646003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:45.657125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1449/2867] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:49:45.671103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bfbd3-f275-4782-b4c6-23a1d058dc14 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:45.699890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:45.700841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.703168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.703475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] PATH_INFO: `/v3/projects/b9cc5823c77e468cb0a1b2274809d18f/users/ddd1f525e53342b1be9ca8e8bd6a014f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.735723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cc5823c77e468cb0a1b2274809d18f, user_id=ddd1f525e53342b1be9ca8e8bd6a014f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:45.739261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:45.786917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1419/2868] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:45 2022] PUT /identity/v3/projects/b9cc5823c77e468cb0a1b2274809d18f/users/ddd1f525e53342b1be9ca8e8bd6a014f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:49:45.792806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83139040-b938-48f6-81a3-080dc66a7787 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:45.793101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83139040-b938-48f6-81a3-080dc66a7787 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:45.793383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83139040-b938-48f6-81a3-080dc66a7787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:45.837725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-83139040-b938-48f6-81a3-080dc66a7787 None None] MFA Rules not processed for user `ddd1f525e53342b1be9ca8e8bd6a014f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:45.839669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-83139040-b938-48f6-81a3-080dc66a7787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:45.956471 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1450/2869] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:45.957153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:46.038369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0100d9-a065-4a1d-bf2c-f6e433091784 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:46.044758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:46.045677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:46.046133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:46.046592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:46.047552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:46.049757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:46.098352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1420/2870] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:45 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:49:46.103666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83139040-b938-48f6-81a3-080dc66a7787 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:46.119329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83139040-b938-48f6-81a3-080dc66a7787 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:46.212437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:46.213540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:46.214758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:46.215301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:46.216401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:46.219781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:46.254848 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1451/2871] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:46 2022] POST /identity/v3/users => generated 303 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:46.258974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:46.275881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f38b-c3ee-4538-8655-34c3a4aea921 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:46.288679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:46.289711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:46.289711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:46.290319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:46.292040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:46.293164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:46.321516 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1421/2872] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:46.322619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:46.342965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b7c5-46cc-46e4-a520-3ac3c2efb656 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:46.366514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:46.367571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:46.367745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:46.368025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] PATH_INFO: `/v3/projects/7816b8644e42430fb8133a4b9dc37dd7/users/0e43d05cf09243a4939f5b2fd00a7a05/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:46.386908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7816b8644e42430fb8133a4b9dc37dd7, user_id=0e43d05cf09243a4939f5b2fd00a7a05, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:46.390131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:46.436700 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1452/2873] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:46 2022] PUT /identity/v3/projects/7816b8644e42430fb8133a4b9dc37dd7/users/0e43d05cf09243a4939f5b2fd00a7a05/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:46.443739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:46.458509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b468e00-0713-4e78-8142-5c25ebe1bcf4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:46.566209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355622b9-8ba7-4408-b55e-4ccd76f8aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:46.567162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355622b9-8ba7-4408-b55e-4ccd76f8aadf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:46.567464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355622b9-8ba7-4408-b55e-4ccd76f8aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:46.567713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355622b9-8ba7-4408-b55e-4ccd76f8aadf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:46.568821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355622b9-8ba7-4408-b55e-4ccd76f8aadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:46.570812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355622b9-8ba7-4408-b55e-4ccd76f8aadf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:46.614985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:46.615787 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1422/2874] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:46.639235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fed4bf-0754-49fd-bd96-aee28a4cf98e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:46.659537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:46.661579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:46.661875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:46.662157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] PATH_INFO: `/v3/projects/7816b8644e42430fb8133a4b9dc37dd7/users/0e43d05cf09243a4939f5b2fd00a7a05/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:46.664420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7816b8644e42430fb8133a4b9dc37dd7, user_id=0e43d05cf09243a4939f5b2fd00a7a05, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:46.667264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:46.697085 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1453/2875] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:46 2022] PUT /identity/v3/projects/7816b8644e42430fb8133a4b9dc37dd7/users/0e43d05cf09243a4939f5b2fd00a7a05/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:46.709275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e99d33-e4a6-4a3b-98ed-2a5dd78a13e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:46.709856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e99d33-e4a6-4a3b-98ed-2a5dd78a13e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:46.710212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e99d33-e4a6-4a3b-98ed-2a5dd78a13e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:46.765720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-45e99d33-e4a6-4a3b-98ed-2a5dd78a13e6 None None] MFA Rules not processed for user `0e43d05cf09243a4939f5b2fd00a7a05`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:46.767382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45e99d33-e4a6-4a3b-98ed-2a5dd78a13e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:46.919743 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1423/2876] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:47.149600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:47.152572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:47.269994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb736b-aa7a-4dd1-8246-b9e55fca0af2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:47.277008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ce06-93fb-4b9d-addb-d20876b3747f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:47.277764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ce06-93fb-4b9d-addb-d20876b3747f service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:47.278046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ce06-93fb-4b9d-addb-d20876b3747f service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:47.278377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ce06-93fb-4b9d-addb-d20876b3747f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:47.289109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67ce06-93fb-4b9d-addb-d20876b3747f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:47.291037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67ce06-93fb-4b9d-addb-d20876b3747f service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:47.319118 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1454/2877] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:48.021399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e3e7-30a2-45a4-8119-b93170e9b356 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:48.021917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e3e7-30a2-45a4-8119-b93170e9b356 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:48.022154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e3e7-30a2-45a4-8119-b93170e9b356 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:48.023642 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1424/2878] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:49:48.030553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a0ed-92fe-4f6f-b928-dd69ddcf4f5d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:48.030889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a0ed-92fe-4f6f-b928-dd69ddcf4f5d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:48.031178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a0ed-92fe-4f6f-b928-dd69ddcf4f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:48.058342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-57c3a0ed-92fe-4f6f-b928-dd69ddcf4f5d None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:48.060281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-57c3a0ed-92fe-4f6f-b928-dd69ddcf4f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:48.155321 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1455/2879] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:49:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:48.190251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e3e7-30a2-45a4-8119-b93170e9b356 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:48.192090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c832e3e7-30a2-45a4-8119-b93170e9b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:48.224401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e3e7-30a2-45a4-8119-b93170e9b356 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:48.235789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fee4f6-a86d-4ef9-81fa-95a8c814ffd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:48.236494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fee4f6-a86d-4ef9-81fa-95a8c814ffd9 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:48.236953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fee4f6-a86d-4ef9-81fa-95a8c814ffd9 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:48.237387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fee4f6-a86d-4ef9-81fa-95a8c814ffd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:48.256665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fee4f6-a86d-4ef9-81fa-95a8c814ffd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:48.259079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fee4f6-a86d-4ef9-81fa-95a8c814ffd9 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:48.281793 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1425/2880] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:51.434844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a0ed-92fe-4f6f-b928-dd69ddcf4f5d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:51.519347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a0ed-92fe-4f6f-b928-dd69ddcf4f5d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:51.528524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:51.529547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:51.529934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:51.530463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] PATH_INFO: `/v3/users/ddd1f525e53342b1be9ca8e8bd6a014f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:51.531923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd1f525e53342b1be9ca8e8bd6a014f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:51.533976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:51.588676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd1f525e53342b1be9ca8e8bd6a014f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:51.590094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd1f525e53342b1be9ca8e8bd6a014f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:51.597953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd1f525e53342b1be9ca8e8bd6a014f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:51.599003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd1f525e53342b1be9ca8e8bd6a014f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:51.607884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd1f525e53342b1be9ca8e8bd6a014f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:51.641143 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1456/2881] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:51 2022] DELETE /identity/v3/users/ddd1f525e53342b1be9ca8e8bd6a014f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:51.642189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:51.642686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:51.642822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:51.660603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:51.663339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:51.782389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1426/2882] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:51.810554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:51.816329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:51.936013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6aba00-9428-499a-a4c9-d9b1d7845015 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:51.939873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:51.940535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:51.940817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:51.941092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:51.954370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:51.955783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:51.970821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1457/2883] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:52.503482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:52.507574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:52.543503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e248777-b6a5-4747-89f8-3c996dfca61b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:52.560990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:52.561927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:52.562278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:52.562700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] PATH_INFO: `/v3/projects/b9cc5823c77e468cb0a1b2274809d18f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:52.564145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cc5823c77e468cb0a1b2274809d18f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:52.566402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:52.675602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cc5823c77e468cb0a1b2274809d18f', 'request_id': 'req-fc6d35aa-2556-45b2-bd43-559cf3323cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.704862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cc5823c77e468cb0a1b2274809d18f', 'request_id': 'req-fc6d35aa-2556-45b2-bd43-559cf3323cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.718360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cc5823c77e468cb0a1b2274809d18f', 'request_id': 'req-fc6d35aa-2556-45b2-bd43-559cf3323cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.740375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] The token cache is being invalidate because project b9cc5823c77e468cb0a1b2274809d18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:52.740663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.743557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.749140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1427/2884] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:52 2022] DELETE /identity/v3/projects/b9cc5823c77e468cb0a1b2274809d18f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:52.754968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:52.780790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2d9da-35b0-4f0e-ad2a-cd55af9bc07d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:52.863796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:52.864689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:52.865319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:52.865759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] PATH_INFO: `/v3/users/0e43d05cf09243a4939f5b2fd00a7a05` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:52.867344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e43d05cf09243a4939f5b2fd00a7a05)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:52.870578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:52.961720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e43d05cf09243a4939f5b2fd00a7a05'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.962870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e43d05cf09243a4939f5b2fd00a7a05'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.976522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e43d05cf09243a4939f5b2fd00a7a05'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.977280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e43d05cf09243a4939f5b2fd00a7a05'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:52.993552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b2e0df8-d3cc-44a6-ad19-a08f0114dfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e43d05cf09243a4939f5b2fd00a7a05'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:53.029810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1458/2885] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:52 2022] DELETE /identity/v3/users/0e43d05cf09243a4939f5b2fd00a7a05 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:53.604052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:53.605626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:53.655415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d35aa-2556-45b2-bd43-559cf3323cab admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:53.807107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:53.808623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:53.809176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:53.809673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] PATH_INFO: `/v3/projects/7816b8644e42430fb8133a4b9dc37dd7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:53.811194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7816b8644e42430fb8133a4b9dc37dd7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:53.813375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:53.888145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7816b8644e42430fb8133a4b9dc37dd7', 'request_id': 'req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:53.899083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7816b8644e42430fb8133a4b9dc37dd7', 'request_id': 'req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:53.918708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7816b8644e42430fb8133a4b9dc37dd7', 'request_id': 'req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:53.932404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] The token cache is being invalidate because project 7816b8644e42430fb8133a4b9dc37dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:53.933617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:53.934531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7a58ed9b-5d7a-4643-85f7-ddfcafc212d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:53.940693 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1428/2886] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:53 2022] DELETE /identity/v3/projects/7816b8644e42430fb8133a4b9dc37dd7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:53.941465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f3e71-d3fd-4e62-8bf2-6e2cdce53a74 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:53.941926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f3e71-d3fd-4e62-8bf2-6e2cdce53a74 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:53.942013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f3e71-d3fd-4e62-8bf2-6e2cdce53a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:53.961044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a02f3e71-d3fd-4e62-8bf2-6e2cdce53a74 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:53.962680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a02f3e71-d3fd-4e62-8bf2-6e2cdce53a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:53.988894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb874-cc04-4a5a-8fab-89e221178531 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:53.989332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb874-cc04-4a5a-8fab-89e221178531 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:53.989711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efb874-cc04-4a5a-8fab-89e221178531 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:53.991259 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1429/2887] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:49:54.006729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.007248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.007603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.031110 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1459/2888] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:54.038562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c45b4-3a45-4c4a-b1f3-293ff7bf892a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.039203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c45b4-3a45-4c4a-b1f3-293ff7bf892a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.039833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c45b4-3a45-4c4a-b1f3-293ff7bf892a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.051325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:54.052592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:54.061494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4f6c45b4-3a45-4c4a-b1f3-293ff7bf892a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:54.063683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4f6c45b4-3a45-4c4a-b1f3-293ff7bf892a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:54.079706 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1460/2889] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:54.083819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c45b4-3a45-4c4a-b1f3-293ff7bf892a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:54.094267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c45b4-3a45-4c4a-b1f3-293ff7bf892a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:54.102071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:54.103343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.103874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.104420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.105513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:54.106289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:54.108530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:54.129224 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1461/2890] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:54.130589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:54.147797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15f80d-41d8-498f-8522-e13f29b62cb1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:54.156382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1430/2891] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:49:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 07 21:49:54.160634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:54.161399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.162169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.162632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.163787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:54.165647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:54.189494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:54.191508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:54.220449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1462/2892] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:54 2022] POST /identity/v3/projects => generated 395 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:54.222438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d7a9a-f139-415a-92f4-a65b42c52c3a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:54.224883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:54.343372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:54.345195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.345654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.346111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.359221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652a6b3-37ea-4a48-8028-cb30d9693e6a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:54.360728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:54.362627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:54.377606 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1431/2893] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:54.391298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:54.391987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.394866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.395179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.395905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:54.398118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:54.466337 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1463/2894] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:54 2022] POST /identity/v3/users => generated 298 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:54.469367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:54.486440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8edde-a9b6-468c-80ae-a5a6f591cd06 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:54.494617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:54.497793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.498452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.499033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.500190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:54.501979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:54.529763 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1432/2895] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:54.542535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:54.573606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07a4cf-6080-49c9-ac85-66d539f12af1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:54.586155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ccfc7-cd2d-4685-8777-133470464283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:54.589323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ccfc7-cd2d-4685-8777-133470464283 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.589766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ccfc7-cd2d-4685-8777-133470464283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.590053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ccfc7-cd2d-4685-8777-133470464283 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.592960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ccfc7-cd2d-4685-8777-133470464283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:54.596256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ccfc7-cd2d-4685-8777-133470464283 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:54.641382 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1464/2896] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:54.643410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:54.663436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defc49e-8974-4725-bcc5-50cb1f12f95c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:54.678598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:54.679673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.682329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.682684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] PATH_INFO: `/v3/projects/8dbf61851cda4307ade2765015a64bd9/users/564f1db7546b4449b2c6954f42807f32/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.710813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbf61851cda4307ade2765015a64bd9, user_id=564f1db7546b4449b2c6954f42807f32, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:54.716212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:54.752300 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1433/2897] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:54 2022] PUT /identity/v3/projects/8dbf61851cda4307ade2765015a64bd9/users/564f1db7546b4449b2c6954f42807f32/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:54.756100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c554d6-9aac-4759-afd7-1b4b03dbdcea None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:54.760466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c554d6-9aac-4759-afd7-1b4b03dbdcea None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:54.762259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c554d6-9aac-4759-afd7-1b4b03dbdcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:54.824442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-16c554d6-9aac-4759-afd7-1b4b03dbdcea None None] MFA Rules not processed for user `564f1db7546b4449b2c6954f42807f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:54.829503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-16c554d6-9aac-4759-afd7-1b4b03dbdcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:55.022587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1465/2898] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:55.028952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:55.152545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2ba52-cb31-4651-b5b2-820b2f20f0ac admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:55.158561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:55.159291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:55.159583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:55.160870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:55.161648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:55.164984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:55.226801 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1434/2899] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:55 2022] POST /identity/v3/projects => generated 391 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:55.227338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c554d6-9aac-4759-afd7-1b4b03dbdcea None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:55.243507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c554d6-9aac-4759-afd7-1b4b03dbdcea None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:55.319697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:55.321617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:55.321862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:55.322079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:55.322826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:55.326463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:55.352158 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1466/2900] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:55 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:49:55.356651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:55.369684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc08e96-c50e-4717-b43a-afc9f7937f5f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:55.387299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:55.388275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:55.389043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:55.389043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:55.400841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:55.405484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:55.429817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1435/2901] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:55.430565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:55.444083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6933-cd32-4e44-86d6-941c2192ff19 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:55.450227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:55.451314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:55.451738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:55.452100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] PATH_INFO: `/v3/projects/2117e0e2abb54ae4a97cf163d210b230/users/a240895ad013493485b283da61636131/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:55.487129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2117e0e2abb54ae4a97cf163d210b230, user_id=a240895ad013493485b283da61636131, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:55.490357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:55.517446 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1467/2902] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:55 2022] PUT /identity/v3/projects/2117e0e2abb54ae4a97cf163d210b230/users/a240895ad013493485b283da61636131/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:55.521430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:55.532390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3023d-1191-4cd8-86ee-280db64df5ea admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:55.610929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39f8c7-f1cd-4dd5-bbbe-9db4bbc6ac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:55.611556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f8c7-f1cd-4dd5-bbbe-9db4bbc6ac1a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:55.611848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f8c7-f1cd-4dd5-bbbe-9db4bbc6ac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:55.612165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39f8c7-f1cd-4dd5-bbbe-9db4bbc6ac1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:55.613078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39f8c7-f1cd-4dd5-bbbe-9db4bbc6ac1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:55.615128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39f8c7-f1cd-4dd5-bbbe-9db4bbc6ac1a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:55.630007 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1436/2903] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:55.634178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:55.653565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853bede-b03c-40e3-993a-c5838679a0fb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:55.666480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76994303-472c-4558-9224-d233d067d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:55.667648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994303-472c-4558-9224-d233d067d27c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:55.667938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994303-472c-4558-9224-d233d067d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:55.668212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76994303-472c-4558-9224-d233d067d27c admin admin] PATH_INFO: `/v3/projects/2117e0e2abb54ae4a97cf163d210b230/users/a240895ad013493485b283da61636131/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:55.670408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76994303-472c-4558-9224-d233d067d27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2117e0e2abb54ae4a97cf163d210b230, user_id=a240895ad013493485b283da61636131, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:55.673501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76994303-472c-4558-9224-d233d067d27c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:55.705641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:55.706332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:55.706872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:55.711919 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1468/2904] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:55 2022] PUT /identity/v3/projects/2117e0e2abb54ae4a97cf163d210b230/users/a240895ad013493485b283da61636131/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:55.775051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] MFA Rules not processed for user `a240895ad013493485b283da61636131`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:55.776450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:55.887061 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1437/2905] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:56.192651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ab9-2ada-47ed-a285-8ea28a4acdfc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:56.193092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ab9-2ada-47ed-a285-8ea28a4acdfc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:56.194025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246ab9-2ada-47ed-a285-8ea28a4acdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:56.265361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c0246ab9-2ada-47ed-a285-8ea28a4acdfc None None] MFA Rules not processed for user `63270cc27d704b5095bc8d1133544eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:56.267442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c0246ab9-2ada-47ed-a285-8ea28a4acdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:56.422356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1469/2906] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:56.477886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:56.480242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:56.661760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0bde-ec5e-4791-935a-9412caf39ef5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:56.670387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:56.671605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:56.673475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:56.673475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:56.686935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:56.688784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:56.710887 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1438/2907] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:49:56.765579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246ab9-2ada-47ed-a285-8ea28a4acdfc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:56.782330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246ab9-2ada-47ed-a285-8ea28a4acdfc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:56.800796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:56.801539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:56.801937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:56.802226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:56.814226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:56.816617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:56.837068 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1470/2908] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:57.258463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:57.259625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:57.395028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ef918-493b-4ae4-9c94-dbdb365150dd service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:57.400051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:57.401058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:57.401656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:57.402262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] PATH_INFO: `/v3/users/5ac29538817f43d7acdaaa71f6fc407d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:57.404219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac29538817f43d7acdaaa71f6fc407d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:57.406587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:57.490035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac29538817f43d7acdaaa71f6fc407d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.507045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac29538817f43d7acdaaa71f6fc407d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.515258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac29538817f43d7acdaaa71f6fc407d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.516188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac29538817f43d7acdaaa71f6fc407d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.559954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5675b4b3-ee78-4e9c-8575-e38e0328ae43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac29538817f43d7acdaaa71f6fc407d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.589520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:57.610118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1439/2909] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:57 2022] DELETE /identity/v3/users/5ac29538817f43d7acdaaa71f6fc407d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:57.615797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207e7c5-8007-41fe-9c6c-c0e6de492aef service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:57.794233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:57.796911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:57.800307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:57.800920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] PATH_INFO: `/v3/users/564f1db7546b4449b2c6954f42807f32` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:57.805018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564f1db7546b4449b2c6954f42807f32)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:57.808406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:57.949740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564f1db7546b4449b2c6954f42807f32'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.950487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564f1db7546b4449b2c6954f42807f32'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.958740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564f1db7546b4449b2c6954f42807f32'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.959702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564f1db7546b4449b2c6954f42807f32'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.972270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564f1db7546b4449b2c6954f42807f32'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:57.998371 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1471/2910] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:57 2022] DELETE /identity/v3/users/564f1db7546b4449b2c6954f42807f32 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:49:58.002881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:58.003463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:58.003845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:58.060473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:58.066162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:58.173488 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1440/2911] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:58.180106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:58.181723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:58.228261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:58.232403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:58.242078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02dde3-fcab-4267-b2f8-ceb8ec9e5ea7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:58.273780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:58.277016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:58.278973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:58.281955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] PATH_INFO: `/v3/projects/c7a25b96a7e94d2fbf7b81649197cb8b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:58.284450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a25b96a7e94d2fbf7b81649197cb8b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:58.291386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:58.452593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e87f2-c9fe-4397-b5de-c98493f0c7d5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:58.478185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a25b96a7e94d2fbf7b81649197cb8b', 'request_id': 'req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:58.515303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a25b96a7e94d2fbf7b81649197cb8b', 'request_id': 'req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:58.541600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a25b96a7e94d2fbf7b81649197cb8b', 'request_id': 'req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:58.586262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] The token cache is being invalidate because project c7a25b96a7e94d2fbf7b81649197cb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:58.587874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:58.590385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bcdf5e9a-ff55-496a-a6a1-8f7d4ba45b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:58.596241 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1472/2912] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:58 2022] DELETE /identity/v3/projects/c7a25b96a7e94d2fbf7b81649197cb8b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:58.610527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbefb6-bf6c-4a5f-927b-dc589b5e0870 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:58.611043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbefb6-bf6c-4a5f-927b-dc589b5e0870 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:58.611496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbefb6-bf6c-4a5f-927b-dc589b5e0870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:58.658893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:58.659691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:58.659981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:58.660307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:58.663583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:58.668814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b3fbefb6-bf6c-4a5f-927b-dc589b5e0870 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:58.672824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3fbefb6-bf6c-4a5f-927b-dc589b5e0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:58.788348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:58.789999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:58.793759 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1473/2913] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:49:58.801924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40225a-2539-4b7d-ade4-93f1aabad51b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:58.802452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40225a-2539-4b7d-ade4-93f1aabad51b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:58.802961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40225a-2539-4b7d-ade4-93f1aabad51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:58.809721 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1441/2914] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:49:58.834183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2f40225a-2539-4b7d-ade4-93f1aabad51b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:58.835858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f40225a-2539-4b7d-ade4-93f1aabad51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:58.846151 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1474/2915] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:58.850157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:58.861619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d086e-8f5b-480c-a70e-17bc3a2e8909 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:58.869568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:58.871478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:58.871979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:58.872646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:58.873711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:49:58.875063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:58.877575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:58.899768 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1442/2916] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:49:58.900156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40225a-2539-4b7d-ade4-93f1aabad51b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:58.913626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40225a-2539-4b7d-ade4-93f1aabad51b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:58.923281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:58.924526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:58.928191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:58.928845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:58.932142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:58.937286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:58.992173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:59.000528 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1475/2917] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:49:58 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:49:59.007519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0cf2b-106c-4593-80a9-b41bc851a406 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:59.103859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:59.105212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.106007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.106617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.108311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:59.110920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:59.164840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1443/2918] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:49:58 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:49:59.169299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:59.185651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096bf9-fb6a-4323-9aa9-795413cc0143 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:59.194013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:59.199789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.199789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.199789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.199789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:59.199789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:59.226716 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1476/2919] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:49:59.228096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:59.243847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4b5d1-e887-4c0a-9ca5-71a64ba23214 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:59.254876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894efc5-a3b7-4ef1-8985-a3aa61db6286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:59.256899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894efc5-a3b7-4ef1-8985-a3aa61db6286 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.257471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894efc5-a3b7-4ef1-8985-a3aa61db6286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.257861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894efc5-a3b7-4ef1-8985-a3aa61db6286 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.259176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894efc5-a3b7-4ef1-8985-a3aa61db6286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:59.262386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894efc5-a3b7-4ef1-8985-a3aa61db6286 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:59.285019 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1444/2920] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:49:59.286306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:59.298912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d1baa-9762-49d6-a4f7-98ce8e195590 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:59.306059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:59.307642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.308105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.308849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] PATH_INFO: `/v3/projects/2a463927927b488ebe8a6e118484e8df/users/cd60e0534aac4bc697aafe66723e1ab8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.329926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a463927927b488ebe8a6e118484e8df, user_id=cd60e0534aac4bc697aafe66723e1ab8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:59.333499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:59.358542 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1477/2921] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:49:59 2022] PUT /identity/v3/projects/2a463927927b488ebe8a6e118484e8df/users/cd60e0534aac4bc697aafe66723e1ab8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:59.359706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.360004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.360290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.381929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:49:59.383271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:59.473769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:59.475761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:59.509149 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1445/2922] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:49:59.518516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:59.520180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:49:59.637685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5366474-70af-41de-8238-3b433abf6fc5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:59.652845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:59.656947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.657463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.657749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] PATH_INFO: `/v3/projects/8dbf61851cda4307ade2765015a64bd9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.661477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbf61851cda4307ade2765015a64bd9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:59.667580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:59.690546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc37421-ee2e-402b-b82f-125496487875 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:59.697122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:59.698869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.699605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.700629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.714573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:59.717160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:49:59.731574 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1446/2923] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:49:59.775768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbf61851cda4307ade2765015a64bd9', 'request_id': 'req-1509a6bd-4e60-4699-8aca-b0c344d79066'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:59.786487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbf61851cda4307ade2765015a64bd9', 'request_id': 'req-1509a6bd-4e60-4699-8aca-b0c344d79066'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:59.805820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbf61851cda4307ade2765015a64bd9', 'request_id': 'req-1509a6bd-4e60-4699-8aca-b0c344d79066'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:59.838996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] The token cache is being invalidate because project 8dbf61851cda4307ade2765015a64bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:49:59.839289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:59.839976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1509a6bd-4e60-4699-8aca-b0c344d79066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:49:59.841620 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1478/2924] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:49:59 2022] DELETE /identity/v3/projects/8dbf61851cda4307ade2765015a64bd9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:49:59.846557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:49:59.860316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66f498-2830-4e7e-bf2e-1b17632b2e4a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:49:59.937955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:49:59.939219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:49:59.939505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:49:59.939781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] PATH_INFO: `/v3/users/a240895ad013493485b283da61636131` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:49:59.941809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a240895ad013493485b283da61636131)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:49:59.944743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:00.032559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a240895ad013493485b283da61636131'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:00.044662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a240895ad013493485b283da61636131'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:00.045952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a240895ad013493485b283da61636131'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:00.046680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a240895ad013493485b283da61636131'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:00.080098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a240895ad013493485b283da61636131'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:00.121440 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1447/2925] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:49:59 2022] DELETE /identity/v3/users/a240895ad013493485b283da61636131 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:00.517244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d491d1d-3784-49c9-b523-d8d7b6fe1670 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:00.517739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d491d1d-3784-49c9-b523-d8d7b6fe1670 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:00.518110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d491d1d-3784-49c9-b523-d8d7b6fe1670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:00.580786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9d491d1d-3784-49c9-b523-d8d7b6fe1670 None None] MFA Rules not processed for user `63270cc27d704b5095bc8d1133544eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:00.584104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9d491d1d-3784-49c9-b523-d8d7b6fe1670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:00.698584 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1479/2926] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:01.914536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:01.917506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:02.009673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095dd5-731a-42c5-8c57-993f9150a396 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:02.017616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:02.018639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.018961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.019244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] PATH_INFO: `/v3/projects/2117e0e2abb54ae4a97cf163d210b230` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.020488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2117e0e2abb54ae4a97cf163d210b230)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:02.022571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:02.149322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2117e0e2abb54ae4a97cf163d210b230', 'request_id': 'req-bf860175-b21e-4cd5-aa10-d0dc85e93821'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:02.157638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2117e0e2abb54ae4a97cf163d210b230', 'request_id': 'req-bf860175-b21e-4cd5-aa10-d0dc85e93821'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:02.171236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2117e0e2abb54ae4a97cf163d210b230', 'request_id': 'req-bf860175-b21e-4cd5-aa10-d0dc85e93821'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:02.192360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] The token cache is being invalidate because project 2117e0e2abb54ae4a97cf163d210b230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:02.192737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:02.193786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf860175-b21e-4cd5-aa10-d0dc85e93821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:02.202015 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1448/2927] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:01 2022] DELETE /identity/v3/projects/2117e0e2abb54ae4a97cf163d210b230 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:02.207870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654994-6dbf-4f13-bdb5-b4da2c6deb50 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.207870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654994-6dbf-4f13-bdb5-b4da2c6deb50 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.208363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654994-6dbf-4f13-bdb5-b4da2c6deb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.253904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e3654994-6dbf-4f13-bdb5-b4da2c6deb50 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:02.255197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3654994-6dbf-4f13-bdb5-b4da2c6deb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:02.336492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1480/2928] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:02.340777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ba5e1-ad16-4a42-81e9-57ddb3939fba None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.341287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ba5e1-ad16-4a42-81e9-57ddb3939fba None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.341721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ba5e1-ad16-4a42-81e9-57ddb3939fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.396780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-818ba5e1-ad16-4a42-81e9-57ddb3939fba None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:02.398014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-818ba5e1-ad16-4a42-81e9-57ddb3939fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:02.415649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1449/2929] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:02.415851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654994-6dbf-4f13-bdb5-b4da2c6deb50 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:02.426200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654994-6dbf-4f13-bdb5-b4da2c6deb50 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:02.431077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:02.431938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.432415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.432874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.433778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:02.434241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:02.436116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:02.459743 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1481/2930] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:50:02.464604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ba5e1-ad16-4a42-81e9-57ddb3939fba None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:02.478706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ba5e1-ad16-4a42-81e9-57ddb3939fba None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:02.486140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:02.487199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.487764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.488080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.488754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:02.490712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:02.526844 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1450/2931] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:02 2022] POST /identity/v3/projects => generated 409 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:02.530379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:02.541457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451285-948f-4040-a712-e7f361a2da74 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:02.608150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:02.609228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.610517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.611380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.612278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:02.614399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:02.656773 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1482/2932] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:02 2022] POST /identity/v3/users => generated 305 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:02.661047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:02.674184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403a0c-d0f6-451b-b939-5859b5396171 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:02.682188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:02.685735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.686037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.686317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.689193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:02.695130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:02.734944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1451/2933] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:02.738553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:02.759939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b845c1-9b48-4d48-a3a8-a9afa6d709a2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:02.769658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f598d1e-082a-4a0e-996b-801efabd963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:02.770635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f598d1e-082a-4a0e-996b-801efabd963d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.771265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f598d1e-082a-4a0e-996b-801efabd963d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.772536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f598d1e-082a-4a0e-996b-801efabd963d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.773291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f598d1e-082a-4a0e-996b-801efabd963d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:02.775110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f598d1e-082a-4a0e-996b-801efabd963d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:02.791090 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1483/2934] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:02.805891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:02.817607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597d3e2-7acd-4ee9-b48e-217ef34654a0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:02.823517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076d1ad-4b16-4f4f-8f80-81abf662d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:02.824537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d1ad-4b16-4f4f-8f80-81abf662d14b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.824919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d1ad-4b16-4f4f-8f80-81abf662d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.825295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076d1ad-4b16-4f4f-8f80-81abf662d14b admin admin] PATH_INFO: `/v3/projects/2cde6b55f49a40cba5aaf99ac1b8723d/users/998318cac1694d988e8740803f6229a9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.847760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b044-47d7-4122-8fc4-8206ccb34da6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.848200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b044-47d7-4122-8fc4-8206ccb34da6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.848539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1b044-47d7-4122-8fc4-8206ccb34da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.869746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076d1ad-4b16-4f4f-8f80-81abf662d14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cde6b55f49a40cba5aaf99ac1b8723d, user_id=998318cac1694d988e8740803f6229a9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:02.876309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076d1ad-4b16-4f4f-8f80-81abf662d14b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:02.877863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f4b1b044-47d7-4122-8fc4-8206ccb34da6 None None] MFA Rules not processed for user `3eb85bfb49aa4a519099c6f43ac77099`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:02.882984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f4b1b044-47d7-4122-8fc4-8206ccb34da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:02.915369 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1452/2935] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:02 2022] PUT /identity/v3/projects/2cde6b55f49a40cba5aaf99ac1b8723d/users/998318cac1694d988e8740803f6229a9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:02.920254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81727042-ecb8-4c96-876f-89cc766f0187 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:02.920903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81727042-ecb8-4c96-876f-89cc766f0187 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:02.926121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81727042-ecb8-4c96-876f-89cc766f0187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:02.994030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-81727042-ecb8-4c96-876f-89cc766f0187 None None] MFA Rules not processed for user `998318cac1694d988e8740803f6229a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:02.997255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-81727042-ecb8-4c96-876f-89cc766f0187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:03.060962 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1484/2936] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:03.137390 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1453/2937] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:03.138965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b044-47d7-4122-8fc4-8206ccb34da6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:03.154729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1b044-47d7-4122-8fc4-8206ccb34da6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:03.323323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:03.324792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:03.325249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:03.325699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:03.326596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:03.328796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:03.376843 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1485/2938] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:03 2022] POST /identity/v3/projects => generated 411 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:50:03.380827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81727042-ecb8-4c96-876f-89cc766f0187 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:03.395443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81727042-ecb8-4c96-876f-89cc766f0187 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:03.459237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:03.459911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:03.460365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:03.460729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:03.461457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:03.464342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:03.514426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1454/2939] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:03 2022] POST /identity/v3/users => generated 312 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:03.519401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:03.533418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0265a6-8efd-4211-9937-77e14e2af644 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:03.539920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:03.541348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:03.542327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:03.543080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:03.544144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:03.546161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:03.569456 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1486/2940] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:03.569790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:03.582669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb5964-6cb5-4333-b51d-cfc772094238 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:03.594704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:03.596247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:03.596449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:03.596730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] PATH_INFO: `/v3/projects/df8cce0afe5543f58c8a4bfcad518833/users/09abb6885b394ea989f32222522ae100/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:03.632571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8cce0afe5543f58c8a4bfcad518833, user_id=09abb6885b394ea989f32222522ae100, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:03.638658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:03.668128 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1455/2941] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:03 2022] PUT /identity/v3/projects/df8cce0afe5543f58c8a4bfcad518833/users/09abb6885b394ea989f32222522ae100/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:03.669687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:03.683673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5916498-8d22-4b12-a1f4-d5bd5256df31 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:03.848667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72ec5e-1136-4269-b805-e4d04fd7da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:03.849572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ec5e-1136-4269-b805-e4d04fd7da63 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:03.849945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ec5e-1136-4269-b805-e4d04fd7da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:03.850324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ec5e-1136-4269-b805-e4d04fd7da63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:03.853924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72ec5e-1136-4269-b805-e4d04fd7da63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:03.856911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa72ec5e-1136-4269-b805-e4d04fd7da63 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:03.889394 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1487/2942] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:50:03.890489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:03.908522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a00ff-230b-4ebb-a227-422c905a49d8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:03.914143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:03.915215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:03.915607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:03.916174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] PATH_INFO: `/v3/projects/df8cce0afe5543f58c8a4bfcad518833/users/09abb6885b394ea989f32222522ae100/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:03.919690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8cce0afe5543f58c8a4bfcad518833, user_id=09abb6885b394ea989f32222522ae100, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:03.922921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:03.937032 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1456/2943] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:03 2022] PUT /identity/v3/projects/df8cce0afe5543f58c8a4bfcad518833/users/09abb6885b394ea989f32222522ae100/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:03.949620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:03.949990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:03.950288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:04.015515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] MFA Rules not processed for user `09abb6885b394ea989f32222522ae100`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:04.016946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:04.166695 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1488/2944] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:04.478158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:04.479993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:04.581618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84750c3d-fc6e-4502-847c-7e9525b5eadb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:04.593983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:04.595012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:04.596500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:04.597100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:04.611615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:04.613730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:04.633193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1457/2945] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:04 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:04.842244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:04.844589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:04.871720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46939c0a-d674-4855-9e7e-70ade262a3c9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:04.880031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f879e-6ac4-4e6b-85f5-c5fcdfe0b698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:04.881508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f879e-6ac4-4e6b-85f5-c5fcdfe0b698 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:04.882023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f879e-6ac4-4e6b-85f5-c5fcdfe0b698 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:04.882605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f879e-6ac4-4e6b-85f5-c5fcdfe0b698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:04.982751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f879e-6ac4-4e6b-85f5-c5fcdfe0b698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:04.986930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f879e-6ac4-4e6b-85f5-c5fcdfe0b698 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:05.004550 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1489/2946] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:50:05.348816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:05.495479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a23f1-e4e4-4d22-873d-a9c41ebed35d service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:05.501121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:05.502066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:05.502405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:05.502689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] PATH_INFO: `/v3/users/998318cac1694d988e8740803f6229a9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:05.504605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=998318cac1694d988e8740803f6229a9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:05.506836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:05.582930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998318cac1694d988e8740803f6229a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:05.618932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998318cac1694d988e8740803f6229a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:05.622624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998318cac1694d988e8740803f6229a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:05.623937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998318cac1694d988e8740803f6229a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:05.642180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998318cac1694d988e8740803f6229a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:05.689251 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1458/2947] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:05 2022] DELETE /identity/v3/users/998318cac1694d988e8740803f6229a9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:05.695625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:05.696119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:05.696432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:05.728154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:05.731391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:05.887988 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1490/2948] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:05.901638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:05.903462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:06.025251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a697bce-1dfc-4800-8d01-53f74a26af6d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:06.031888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:06.033145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:06.035154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:06.035541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:06.053711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:06.055626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:06.088137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1459/2949] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:08.577010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:08.583125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:08.614087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff74289-e4ea-4c42-95ac-e8b4a98d8f20 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:08.622612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:08.623991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:08.624470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:08.625407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] PATH_INFO: `/v3/projects/2cde6b55f49a40cba5aaf99ac1b8723d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:08.628460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cde6b55f49a40cba5aaf99ac1b8723d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:08.631849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:08.711917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cde6b55f49a40cba5aaf99ac1b8723d', 'request_id': 'req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:08.738860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cde6b55f49a40cba5aaf99ac1b8723d', 'request_id': 'req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:08.754317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cde6b55f49a40cba5aaf99ac1b8723d', 'request_id': 'req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:08.774814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] The token cache is being invalidate because project 2cde6b55f49a40cba5aaf99ac1b8723d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:08.775129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:08.777587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:08.783010 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1491/2950] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:08 2022] DELETE /identity/v3/projects/2cde6b55f49a40cba5aaf99ac1b8723d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:08.784551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:08.804754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11efe3-c277-4545-9cb0-3b28c31d74b1 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:08.939532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:08.940458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:08.940939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:08.941546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] PATH_INFO: `/v3/users/09abb6885b394ea989f32222522ae100` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:08.943054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09abb6885b394ea989f32222522ae100)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:08.945327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:09.002327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09abb6885b394ea989f32222522ae100'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.018918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09abb6885b394ea989f32222522ae100'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.020191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09abb6885b394ea989f32222522ae100'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.021325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09abb6885b394ea989f32222522ae100'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.033230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09abb6885b394ea989f32222522ae100'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.060670 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1460/2951] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:08 2022] DELETE /identity/v3/users/09abb6885b394ea989f32222522ae100 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:09.661917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:09.663702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:09.679992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd4037-fa8f-4019-8c30-b9d2fd8d4990 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:09.767076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:09.767980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:09.768267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:09.768545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] PATH_INFO: `/v3/users/c562e7dec6d34cd0a7fc7cea14fa5e74` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:09.770308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c562e7dec6d34cd0a7fc7cea14fa5e74)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:09.773941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:09.883340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c562e7dec6d34cd0a7fc7cea14fa5e74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.884111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c562e7dec6d34cd0a7fc7cea14fa5e74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.897537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c562e7dec6d34cd0a7fc7cea14fa5e74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.907327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c562e7dec6d34cd0a7fc7cea14fa5e74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.922008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c562e7dec6d34cd0a7fc7cea14fa5e74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:09.952075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1492/2952] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:09 2022] DELETE /identity/v3/users/c562e7dec6d34cd0a7fc7cea14fa5e74 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:10.791642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:10.794862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:10.817633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6169a-a23b-4f15-a94e-0e96026cf811 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:10.973214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:10.974586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:10.975060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:10.976336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] PATH_INFO: `/v3/projects/df8cce0afe5543f58c8a4bfcad518833` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:10.980361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8cce0afe5543f58c8a4bfcad518833)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:10.983322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.011801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:11.013850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:11.041401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b83aa7-0ae8-401e-93cd-52978c16bc32 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:11.062115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:11.064802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.065503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.066736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] PATH_INFO: `/v3/projects/bd92ab7de4f3456e82ccaa60aa378562` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.075143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8cce0afe5543f58c8a4bfcad518833', 'request_id': 'req-8256dc9d-1981-49ba-941c-1fe4675e6db5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.075687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd92ab7de4f3456e82ccaa60aa378562)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:11.079388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.088009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8cce0afe5543f58c8a4bfcad518833', 'request_id': 'req-8256dc9d-1981-49ba-941c-1fe4675e6db5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.103825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8cce0afe5543f58c8a4bfcad518833', 'request_id': 'req-8256dc9d-1981-49ba-941c-1fe4675e6db5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.138820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] The token cache is being invalidate because project df8cce0afe5543f58c8a4bfcad518833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:11.139251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.140156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8256dc9d-1981-49ba-941c-1fe4675e6db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.145388 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1461/2953] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:10 2022] DELETE /identity/v3/projects/df8cce0afe5543f58c8a4bfcad518833 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:11.147931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d718-76d5-46a8-8315-55312bd952ea None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.148481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d718-76d5-46a8-8315-55312bd952ea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.149003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d718-76d5-46a8-8315-55312bd952ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.170139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2df2d718-76d5-46a8-8315-55312bd952ea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:11.171803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2df2d718-76d5-46a8-8315-55312bd952ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:11.263972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd92ab7de4f3456e82ccaa60aa378562', 'request_id': 'req-e32af5c3-cec7-44ef-873e-1099151187a7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.283061 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1462/2954] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:11.285706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbed02-284e-4447-af6f-4752d549bdf7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.287061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbed02-284e-4447-af6f-4752d549bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.287659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbed02-284e-4447-af6f-4752d549bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.300211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd92ab7de4f3456e82ccaa60aa378562', 'request_id': 'req-e32af5c3-cec7-44ef-873e-1099151187a7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.321274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c1bbed02-284e-4447-af6f-4752d549bdf7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:11.322558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c1bbed02-284e-4447-af6f-4752d549bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:11.346123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd92ab7de4f3456e82ccaa60aa378562', 'request_id': 'req-e32af5c3-cec7-44ef-873e-1099151187a7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.387628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] The token cache is being invalidate because project bd92ab7de4f3456e82ccaa60aa378562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:11.394260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.396554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e32af5c3-cec7-44ef-873e-1099151187a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:11.402623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1493/2955] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:11 2022] DELETE /identity/v3/projects/bd92ab7de4f3456e82ccaa60aa378562 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:11.408053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf411888-6b24-4b20-a772-0fa22730f1af None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.408394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf411888-6b24-4b20-a772-0fa22730f1af None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.408673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf411888-6b24-4b20-a772-0fa22730f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.425167 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1463/2956] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:11.429713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbed02-284e-4447-af6f-4752d549bdf7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:11.458962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbed02-284e-4447-af6f-4752d549bdf7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:11.465774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cf411888-6b24-4b20-a772-0fa22730f1af None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:11.467305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf411888-6b24-4b20-a772-0fa22730f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:11.473858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b37d9-ff25-49b7-842a-d047b7973311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:11.482223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b37d9-ff25-49b7-842a-d047b7973311 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.484365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b37d9-ff25-49b7-842a-d047b7973311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.485997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b37d9-ff25-49b7-842a-d047b7973311 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.488061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b37d9-ff25-49b7-842a-d047b7973311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:11.488549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b37d9-ff25-49b7-842a-d047b7973311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:11.490017 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1494/2957] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:11.497319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b37d9-ff25-49b7-842a-d047b7973311 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.520664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1464/2958] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:11.529316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf411888-6b24-4b20-a772-0fa22730f1af None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:11.566345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf411888-6b24-4b20-a772-0fa22730f1af None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:11.571738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3de80-b226-4a49-85b8-75a81a776389 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.572039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3de80-b226-4a49-85b8-75a81a776389 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.572331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3de80-b226-4a49-85b8-75a81a776389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.580302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:11.581834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.582328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.582811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.589431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:11.592713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.621009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-80c3de80-b226-4a49-85b8-75a81a776389 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:11.624121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-80c3de80-b226-4a49-85b8-75a81a776389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:11.649368 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1495/2959] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:11 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:50:11.655151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:11.662177 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1465/2960] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:11.664148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3de80-b226-4a49-85b8-75a81a776389 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:11.688980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3de80-b226-4a49-85b8-75a81a776389 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:11.817644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa821b21-012a-4522-9659-3870719951f0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:11.835716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:11.838153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.838488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.840278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.842361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:11.847798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.855071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:11.861106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.862500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.862881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.863692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:11.864101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:11.867314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.910212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1466/2961] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:11.910844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1496/2962] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:11 2022] POST /identity/v3/users => generated 302 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:50:11.913360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:11.914618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:11.940395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b94474-38ad-43a7-ba2f-9067b65a4f63 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:11.943907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddd1b6-fb81-442a-880e-15a236eda7e1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:11.953975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:11.955969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.956723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:11.957431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.957713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.958896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:11.959020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:11.959252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:11.959495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:11.961399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:11.963368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.966202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:11.991391 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1497/2963] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:11.998581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.022112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d40857-b9e4-429c-b150-67659cd12900 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:12.066933 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1467/2964] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:11 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:12.069320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:12.072072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.076210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.077679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.078330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.084699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:12.088081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:12.111386 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1498/2965] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:12.118343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.139050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2753e2-e843-46dd-8d4e-afca429185d1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:12.221659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25097ef-12c0-4e46-9b48-fafd0d57a71a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:12.229518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:12.230843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.231143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.231596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.232700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:12.236522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:12.262495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252325fc-3ae1-4eba-8616-6b239e31f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:12.263975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252325fc-3ae1-4eba-8616-6b239e31f6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.264434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252325fc-3ae1-4eba-8616-6b239e31f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.264907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252325fc-3ae1-4eba-8616-6b239e31f6e6 admin admin] PATH_INFO: `/v3/projects/a70e6d26bd4e47d2a3e560421ddadc44/users/0c1ced81c6de4445a6815875dd58dc92/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.266377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1468/2966] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:12 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:12.271261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.299005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7042-ff45-40d2-9dfb-8d107e9a08e2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:12.300975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252325fc-3ae1-4eba-8616-6b239e31f6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70e6d26bd4e47d2a3e560421ddadc44, user_id=0c1ced81c6de4445a6815875dd58dc92, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:12.305433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252325fc-3ae1-4eba-8616-6b239e31f6e6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:12.313086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:12.315185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.315487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.317232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.320048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:12.322684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:12.342005 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1499/2967] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:12 2022] PUT /identity/v3/projects/a70e6d26bd4e47d2a3e560421ddadc44/users/0c1ced81c6de4445a6815875dd58dc92/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:12.357755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff37cf-7771-4f65-9389-ac0235c881e7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.358089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff37cf-7771-4f65-9389-ac0235c881e7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.358317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff37cf-7771-4f65-9389-ac0235c881e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.383402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1469/2968] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:12.388050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.424107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7dd4-7337-476b-aa63-3997d905e522 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:12.429554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c6ff37cf-7771-4f65-9389-ac0235c881e7 None None] MFA Rules not processed for user `0c1ced81c6de4445a6815875dd58dc92`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:12.435834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c6ff37cf-7771-4f65-9389-ac0235c881e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:12.581060 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1500/2969] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:12.582938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff37cf-7771-4f65-9389-ac0235c881e7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.603101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:12.603101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.603375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.603627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.608614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:12.609792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff37cf-7771-4f65-9389-ac0235c881e7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:12.611707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:12.616856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:12.620188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.620188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.620658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.621350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:12.623574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:12.659338 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1470/2970] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:50:12.661130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.690163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64589b-4901-4fea-80bc-4040860027bb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:12.692784 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1501/2971] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:12 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:12.699194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:12.735565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea8793-38d1-46c3-9588-f7de5624b633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:12.736777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8793-38d1-46c3-9588-f7de5624b633 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.737061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8793-38d1-46c3-9588-f7de5624b633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.737317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8793-38d1-46c3-9588-f7de5624b633 admin admin] PATH_INFO: `/v3/projects/4dec7bfa7c714d57b00fff10b741b35f/users/e4b11b21ab0845edb9e1053d45e58e50/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.768136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea8793-38d1-46c3-9588-f7de5624b633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dec7bfa7c714d57b00fff10b741b35f, user_id=e4b11b21ab0845edb9e1053d45e58e50, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:12.772686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea8793-38d1-46c3-9588-f7de5624b633 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:12.844180 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1471/2972] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:12 2022] PUT /identity/v3/projects/4dec7bfa7c714d57b00fff10b741b35f/users/e4b11b21ab0845edb9e1053d45e58e50/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:12.849339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6259960-600b-4bd1-80aa-ce294f4a64e1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:12.849638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6259960-600b-4bd1-80aa-ce294f4a64e1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:12.849920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6259960-600b-4bd1-80aa-ce294f4a64e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:12.939833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f6259960-600b-4bd1-80aa-ce294f4a64e1 None None] MFA Rules not processed for user `e4b11b21ab0845edb9e1053d45e58e50`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:12.941754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f6259960-600b-4bd1-80aa-ce294f4a64e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:13.038972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69ab8d-12f0-46fe-9554-d87f694a21fc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:13.098613 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1472/2973] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:13.250088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:13.251180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:13.251180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:13.251433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:13.252280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:13.254583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:13.300922 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1502/2974] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:12 2022] POST /identity/v3/users => generated 307 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:13.301154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6259960-600b-4bd1-80aa-ce294f4a64e1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:13.331358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6259960-600b-4bd1-80aa-ce294f4a64e1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:13.349304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:13.352730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:13.352730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:13.360424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:13.364095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:13.373225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:13.419253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:13.424490 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1473/2975] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:13.437760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd04306-17a7-44d4-a762-08e8e159cd4b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:13.459882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:13.460883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:13.461172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:13.463072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] PATH_INFO: `/v3/projects/fa2b262027224d4ea3f79418923698ba/users/e407e8fde2a84fceb96bbad72527f51e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:13.486118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2b262027224d4ea3f79418923698ba, user_id=e407e8fde2a84fceb96bbad72527f51e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:13.489576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:13.520066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1503/2976] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:13 2022] PUT /identity/v3/projects/fa2b262027224d4ea3f79418923698ba/users/e407e8fde2a84fceb96bbad72527f51e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:13.521839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:13.546204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7388e-4467-4526-b823-04c451a6f57a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:13.680683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:13.681786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:13.683284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:13.683591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:13.684572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:13.686380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:13.705100 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1474/2977] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:13.709717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:13.726346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99f6b-4763-4b03-bca6-d742a6cb37bb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:13.747451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9bea4-d81e-43d3-a275-4ed3d870f400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:13.748873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9bea4-d81e-43d3-a275-4ed3d870f400 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:13.748873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9bea4-d81e-43d3-a275-4ed3d870f400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:13.754242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9bea4-d81e-43d3-a275-4ed3d870f400 admin admin] PATH_INFO: `/v3/projects/fa2b262027224d4ea3f79418923698ba/users/e407e8fde2a84fceb96bbad72527f51e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:13.755607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:13.758061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:13.772308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9bea4-d81e-43d3-a275-4ed3d870f400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2b262027224d4ea3f79418923698ba, user_id=e407e8fde2a84fceb96bbad72527f51e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:13.775276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9bea4-d81e-43d3-a275-4ed3d870f400 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:13.825224 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1504/2978] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:13 2022] PUT /identity/v3/projects/fa2b262027224d4ea3f79418923698ba/users/e407e8fde2a84fceb96bbad72527f51e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:13.903635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975829-c7cf-47f0-93f4-27165a3329bc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:13.904969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975829-c7cf-47f0-93f4-27165a3329bc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:13.906349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22975829-c7cf-47f0-93f4-27165a3329bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:13.964179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-22975829-c7cf-47f0-93f4-27165a3329bc None None] MFA Rules not processed for user `e407e8fde2a84fceb96bbad72527f51e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:13.967276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-22975829-c7cf-47f0-93f4-27165a3329bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:13.986887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab1692-0426-4427-937d-2ab6d95bf242 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:14.138680 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1505/2979] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:14.204985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:14.205498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:14.205784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:14.206741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:14.342317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:14.343993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:14.357191 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1475/2980] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:14.722911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22975829-c7cf-47f0-93f4-27165a3329bc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:14.739269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22975829-c7cf-47f0-93f4-27165a3329bc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:14.751092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996b15d-6221-4116-899d-56f53aadbb20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:14.755249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996b15d-6221-4116-899d-56f53aadbb20 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:14.755831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996b15d-6221-4116-899d-56f53aadbb20 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:14.757053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996b15d-6221-4116-899d-56f53aadbb20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:14.775145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996b15d-6221-4116-899d-56f53aadbb20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:14.777112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996b15d-6221-4116-899d-56f53aadbb20 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:14.803416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1506/2981] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:15.303726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:15.382614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:15.383159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:15.383281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:15.438643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688cdeb-0854-49ac-938b-90a3c6dab952 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:15.447505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:15.449795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:15.450278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:15.451722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] PATH_INFO: `/v3/users/e4b11b21ab0845edb9e1053d45e58e50` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:15.455212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b11b21ab0845edb9e1053d45e58e50)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:15.457637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:15.458115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] MFA Rules not processed for user `cd60e0534aac4bc697aafe66723e1ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:15.459800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:15.528398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b11b21ab0845edb9e1053d45e58e50'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:15.538705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b11b21ab0845edb9e1053d45e58e50'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:15.539580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b11b21ab0845edb9e1053d45e58e50'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:15.540601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b11b21ab0845edb9e1053d45e58e50'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:15.558369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7c7be5a-a608-4e1f-87de-6957cb3d47e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b11b21ab0845edb9e1053d45e58e50'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:15.592822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1476/2982] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:15 2022] DELETE /identity/v3/users/e4b11b21ab0845edb9e1053d45e58e50 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:15.597304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:15.597637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:15.597879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:15.601345 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1507/2983] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:15.620307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:15.625034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:15.629514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:15.631055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:15.649634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320143ab-38e7-4499-b0ea-cc95d03a3a88 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:15.720933 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1477/2984] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:15.724582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:15.724582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:15.750100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:15.750856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:15.751232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:15.751884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:15.809780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40ad63-c631-4374-969b-620aae7eaf1c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:15.816512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:15.817329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:15.817784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:15.818593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:15.820933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:15.835913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:15.837721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:15.848801 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1508/2985] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:15.849992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:15.851682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:15.899210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:15.902031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:15.921672 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1478/2986] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:15.943203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:15.945237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:15.971515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014ce1e-4b80-4e83-98ef-3603bed6ea72 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:15.971942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d890a-99a5-48de-a0dc-f5ef014dbf08 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:15.977696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:15.978714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:15.979892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:15.980272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] PATH_INFO: `/v3/users/0c1ced81c6de4445a6815875dd58dc92` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:15.983122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1ced81c6de4445a6815875dd58dc92)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:15.985490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:15.992639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e4033-92f2-4264-b62f-d1b614b3efc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:15.993297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4033-92f2-4264-b62f-d1b614b3efc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:15.993577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4033-92f2-4264-b62f-d1b614b3efc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:15.993851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4033-92f2-4264-b62f-d1b614b3efc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:16.020970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e4033-92f2-4264-b62f-d1b614b3efc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:16.025464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e4033-92f2-4264-b62f-d1b614b3efc2 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:16.051517 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1509/2987] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:16.058747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1ced81c6de4445a6815875dd58dc92'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:16.077864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1ced81c6de4445a6815875dd58dc92'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:16.079951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1ced81c6de4445a6815875dd58dc92'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:16.081424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1ced81c6de4445a6815875dd58dc92'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:16.093783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1ced81c6de4445a6815875dd58dc92'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:16.121690 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1479/2988] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:15 2022] DELETE /identity/v3/users/0c1ced81c6de4445a6815875dd58dc92 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:16.122757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:16.123070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:16.123343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:16.151193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:16.153642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:16.308166 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1510/2989] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:16.326570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:16.328744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:16.501675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecac3e-d151-45c5-b4af-868da19b7577 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:16.515597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd09f6e-d2c8-4766-96e3-2727cd7d5b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:16.516413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09f6e-d2c8-4766-96e3-2727cd7d5b6d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:16.516826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09f6e-d2c8-4766-96e3-2727cd7d5b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:16.517325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd09f6e-d2c8-4766-96e3-2727cd7d5b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:16.556689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd09f6e-d2c8-4766-96e3-2727cd7d5b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:16.559167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd09f6e-d2c8-4766-96e3-2727cd7d5b6d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:16.587137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1480/2990] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:17.152348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:17.154554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:17.168433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66de79b-e154-4ec7-a6ec-30323ed9963c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:17.184290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:17.185567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:17.186056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:17.186487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] PATH_INFO: `/v3/projects/4dec7bfa7c714d57b00fff10b741b35f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:17.189400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dec7bfa7c714d57b00fff10b741b35f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:17.192616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:17.334506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dec7bfa7c714d57b00fff10b741b35f', 'request_id': 'req-e8452538-2e39-4f8b-a012-8fc8432e8baf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:17.374099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dec7bfa7c714d57b00fff10b741b35f', 'request_id': 'req-e8452538-2e39-4f8b-a012-8fc8432e8baf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:17.403108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dec7bfa7c714d57b00fff10b741b35f', 'request_id': 'req-e8452538-2e39-4f8b-a012-8fc8432e8baf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:17.429435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] The token cache is being invalidate because project 4dec7bfa7c714d57b00fff10b741b35f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:17.430747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:17.434500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e8452538-2e39-4f8b-a012-8fc8432e8baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:17.443719 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1511/2991] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:17 2022] DELETE /identity/v3/projects/4dec7bfa7c714d57b00fff10b741b35f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:17.446202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405edc-84aa-478e-82ca-1141db700f34 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:17.450319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405edc-84aa-478e-82ca-1141db700f34 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:17.450989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405edc-84aa-478e-82ca-1141db700f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:17.495804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-70405edc-84aa-478e-82ca-1141db700f34 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:17.499651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-70405edc-84aa-478e-82ca-1141db700f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:17.625529 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1481/2992] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:17.636282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787da8d-dae4-404c-a4b4-0064de1a6834 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:17.636622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787da8d-dae4-404c-a4b4-0064de1a6834 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:17.636904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787da8d-dae4-404c-a4b4-0064de1a6834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:17.678666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9787da8d-dae4-404c-a4b4-0064de1a6834 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:17.679948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9787da8d-dae4-404c-a4b4-0064de1a6834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:17.708605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1512/2993] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:17.710545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70405edc-84aa-478e-82ca-1141db700f34 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:17.743834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70405edc-84aa-478e-82ca-1141db700f34 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:17.758256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:17.761417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:17.762521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:17.763704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:17.765634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:17.767521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:17.776173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:17.816258 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1482/2994] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:17.818663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787da8d-dae4-404c-a4b4-0064de1a6834 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:17.836824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787da8d-dae4-404c-a4b4-0064de1a6834 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:17.846644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:17.846994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:17.847096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:17.847385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:17.848092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:17.850637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:17.898270 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1513/2995] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:17 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:17.902995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:17.918687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70860d6f-d3e2-4950-a9fb-1ce5fac1ba7a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:18.124645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:18.125907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:18.126349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:18.127186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:18.128816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:18.135764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:18.229740 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1483/2996] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:17 2022] POST /identity/v3/users => generated 292 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:50:18.233762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:18.247984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c766b8-cc90-41c4-b71b-14f3b889d8b5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:18.261983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:18.263191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:18.263485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:18.263785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:18.264595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:18.270720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:18.318152 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1514/2997] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:18.320019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:18.335598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961faec3-9ec4-4ffb-b8a9-2bab23567d09 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:18.348532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:18.349042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:18.349435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:18.349742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:18.350565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:18.355613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:18.378371 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1484/2998] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:18.382852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:18.395355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5225f-ad17-442f-adfe-dde2448b30f0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:18.403289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac85a73-35cf-46b1-b254-c29bf95b40f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:18.404653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85a73-35cf-46b1-b254-c29bf95b40f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:18.404992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85a73-35cf-46b1-b254-c29bf95b40f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:18.405292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac85a73-35cf-46b1-b254-c29bf95b40f0 admin admin] PATH_INFO: `/v3/projects/6a76c4307b504f23b442ba15422665e8/users/8fb80ca48f9a4db7bb427145e7cf20ea/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:18.442037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac85a73-35cf-46b1-b254-c29bf95b40f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a76c4307b504f23b442ba15422665e8, user_id=8fb80ca48f9a4db7bb427145e7cf20ea, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:18.457999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac85a73-35cf-46b1-b254-c29bf95b40f0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:18.478008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:18.481171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:18.486263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1515/2999] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:18 2022] PUT /identity/v3/projects/6a76c4307b504f23b442ba15422665e8/users/8fb80ca48f9a4db7bb427145e7cf20ea/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:18.500148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:18.500383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:18.502343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:18.513078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c5f53-5c7e-4a27-9baa-ff14da45d0f0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:18.550522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] MFA Rules not processed for user `8fb80ca48f9a4db7bb427145e7cf20ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:18.552114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:18.674143 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1516/3000] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:18.690389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:18.692373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:18.693729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:18.694493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:18.694799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] PATH_INFO: `/v3/projects/a70e6d26bd4e47d2a3e560421ddadc44` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:18.696529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:18.696661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70e6d26bd4e47d2a3e560421ddadc44)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:18.699011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:18.788846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70e6d26bd4e47d2a3e560421ddadc44', 'request_id': 'req-ac449379-3d21-41aa-8871-8e76af198a23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:18.800939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70e6d26bd4e47d2a3e560421ddadc44', 'request_id': 'req-ac449379-3d21-41aa-8871-8e76af198a23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:18.815491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70e6d26bd4e47d2a3e560421ddadc44', 'request_id': 'req-ac449379-3d21-41aa-8871-8e76af198a23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:18.835572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] The token cache is being invalidate because project a70e6d26bd4e47d2a3e560421ddadc44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:18.836180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:18.837108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:18.839701 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1485/3001] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:18 2022] DELETE /identity/v3/projects/a70e6d26bd4e47d2a3e560421ddadc44 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:18.845197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:18.855638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:18.871842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c48e85-3740-40fb-a1f9-e7b9064879f5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:18.998603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac449379-3d21-41aa-8871-8e76af198a23 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:19.007262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:19.008844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:19.009144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:19.009428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:19.013195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:19.016167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:19.017515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:19.017814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:19.018094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] PATH_INFO: `/v3/users/e407e8fde2a84fceb96bbad72527f51e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:19.021270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e407e8fde2a84fceb96bbad72527f51e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:19.023431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:19.139048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e407e8fde2a84fceb96bbad72527f51e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:19.158400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e407e8fde2a84fceb96bbad72527f51e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:19.159917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e407e8fde2a84fceb96bbad72527f51e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:19.160876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e407e8fde2a84fceb96bbad72527f51e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:19.170697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:19.170697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:19.175634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e407e8fde2a84fceb96bbad72527f51e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:19.218153 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1517/3002] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:19.223386 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1486/3003] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:18 2022] DELETE /identity/v3/users/e407e8fde2a84fceb96bbad72527f51e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:20.708837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:20.710695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:20.736844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d20ee2-84e5-442a-af9d-45adaca7776b service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:20.850931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:20.852141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:20.852428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:20.852706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] PATH_INFO: `/v3/users/8fb80ca48f9a4db7bb427145e7cf20ea` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:20.854583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb80ca48f9a4db7bb427145e7cf20ea)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:20.857566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:20.950491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb80ca48f9a4db7bb427145e7cf20ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:20.952092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb80ca48f9a4db7bb427145e7cf20ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:20.972198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb80ca48f9a4db7bb427145e7cf20ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:20.973263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb80ca48f9a4db7bb427145e7cf20ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:20.985890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa8a9020-aec6-4558-b500-31acf2c2b7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb80ca48f9a4db7bb427145e7cf20ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:20.995345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:20.998019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:21.018953 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1518/3004] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:20 2022] DELETE /identity/v3/users/8fb80ca48f9a4db7bb427145e7cf20ea => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:21.020874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d85a-9d84-4a61-8486-c4fa098e9ccb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:21.021479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d85a-9d84-4a61-8486-c4fa098e9ccb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:21.021824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6d85a-9d84-4a61-8486-c4fa098e9ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:21.024748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18324-c019-460a-a148-77af790afb68 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:21.087470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d6c6d85a-9d84-4a61-8486-c4fa098e9ccb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:21.092843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d6c6d85a-9d84-4a61-8486-c4fa098e9ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:21.116851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:21.118811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:21.119224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:21.120145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] PATH_INFO: `/v3/projects/fa2b262027224d4ea3f79418923698ba` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:21.121716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2b262027224d4ea3f79418923698ba)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:21.123866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:21.196485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2b262027224d4ea3f79418923698ba', 'request_id': 'req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:21.209996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2b262027224d4ea3f79418923698ba', 'request_id': 'req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:21.223063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2b262027224d4ea3f79418923698ba', 'request_id': 'req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:21.233202 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1519/3005] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:21.255114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] The token cache is being invalidate because project fa2b262027224d4ea3f79418923698ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:21.256690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:21.258455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:21.261388 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1487/3006] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:20 2022] DELETE /identity/v3/projects/fa2b262027224d4ea3f79418923698ba => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:21.267476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999bc5c-774c-4ab0-837b-e7ddd2ca7a12 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:21.268351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999bc5c-774c-4ab0-837b-e7ddd2ca7a12 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:21.268750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999bc5c-774c-4ab0-837b-e7ddd2ca7a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:21.304906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3999bc5c-774c-4ab0-837b-e7ddd2ca7a12 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:21.306560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3999bc5c-774c-4ab0-837b-e7ddd2ca7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:21.347429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:21.349033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:21.537933 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1520/3007] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:21.550546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dda84-9a2e-4c5e-b13a-c28a9b0ae4ef None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:21.551114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dda84-9a2e-4c5e-b13a-c28a9b0ae4ef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:21.552185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dda84-9a2e-4c5e-b13a-c28a9b0ae4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:21.553265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff03885-5926-40c2-8bfb-86fbfc6c5ebc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:21.570319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:21.571203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:21.571566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:21.571869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:21.573843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:21.597723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-314dda84-9a2e-4c5e-b13a-c28a9b0ae4ef None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:21.603631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-314dda84-9a2e-4c5e-b13a-c28a9b0ae4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:21.608382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:21.612906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:21.622858 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1521/3008] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:21.624727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dda84-9a2e-4c5e-b13a-c28a9b0ae4ef None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:21.670584 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1488/3009] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:21.671604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314dda84-9a2e-4c5e-b13a-c28a9b0ae4ef None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:21.681374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:21.684545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:21.686585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:21.689028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:21.690242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:21.692085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:21.699726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:21.744138 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1522/3010] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:21.744990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:21.756706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b247e-11c6-4c93-97f4-c2d5b5659940 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:21.796731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0094804-edc2-4dc4-8118-0ccf490aa518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:21.798177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0094804-edc2-4dc4-8118-0ccf490aa518 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:21.798963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0094804-edc2-4dc4-8118-0ccf490aa518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:21.799463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0094804-edc2-4dc4-8118-0ccf490aa518 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:21.802710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0094804-edc2-4dc4-8118-0ccf490aa518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:21.809005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0094804-edc2-4dc4-8118-0ccf490aa518 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:21.914650 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1489/3011] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:21 2022] POST /identity/v3/projects => generated 399 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:21.920068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:21.941788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e916d4-304d-4910-8337-dbd37b1a722b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:22.111261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:22.114669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.115442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.116706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.118526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:22.125460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:22.151861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04804c6-764a-4e33-8fa2-8f9632d326bc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.152435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04804c6-764a-4e33-8fa2-8f9632d326bc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.152435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04804c6-764a-4e33-8fa2-8f9632d326bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.178397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d04804c6-764a-4e33-8fa2-8f9632d326bc None None] MFA Rules not processed for user `cd60e0534aac4bc697aafe66723e1ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:22.179722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d04804c6-764a-4e33-8fa2-8f9632d326bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:22.196083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1523/3012] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:21 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:22.197244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:22.235140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79875f60-9cea-4d3d-a127-8a6d2a3e0a7d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:22.247220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:22.248021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.248344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.248638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.252009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:22.257188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:22.297810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1524/3013] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:22.299969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:22.321085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40f238-86e1-4e25-866d-e7398732d2f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:22.333554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7894c-fedf-4ea4-82b7-b1aaacc12b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:22.334629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7894c-fedf-4ea4-82b7-b1aaacc12b48 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.335131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7894c-fedf-4ea4-82b7-b1aaacc12b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.336462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7894c-fedf-4ea4-82b7-b1aaacc12b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.340888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7894c-fedf-4ea4-82b7-b1aaacc12b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:22.343027 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1490/3014] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:22.343513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7894c-fedf-4ea4-82b7-b1aaacc12b48 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:22.367431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04804c6-764a-4e33-8fa2-8f9632d326bc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:22.378581 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1525/3015] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:22.384016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04804c6-764a-4e33-8fa2-8f9632d326bc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:22.389813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:22.391053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.391192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.392028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] PATH_INFO: `/v3/projects/00dedc5654754e7fbb60abf79a14666e/users/29d121c7d37142d6a935ae607c0e062b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.414129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00dedc5654754e7fbb60abf79a14666e, user_id=29d121c7d37142d6a935ae607c0e062b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:22.420138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:22.443227 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1491/3016] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:22 2022] PUT /identity/v3/projects/00dedc5654754e7fbb60abf79a14666e/users/29d121c7d37142d6a935ae607c0e062b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:22.451607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.452052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.452215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.476405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:22.477844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:22.612804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1526/3017] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:22.620130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:22.733560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:22.739709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:22.751661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96068f-83e4-405e-bc2c-801cd9b8535d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:22.764435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00858-7569-46cc-80f6-551b659c3de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:22.765351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00858-7569-46cc-80f6-551b659c3de8 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.765829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00858-7569-46cc-80f6-551b659c3de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.766237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00858-7569-46cc-80f6-551b659c3de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.769954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b06c41-ff1f-4e0f-9cd0-0c6b746edc8e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:22.783205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:22.784515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.785056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.785509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] PATH_INFO: `/v3/projects/6a76c4307b504f23b442ba15422665e8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.788481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a76c4307b504f23b442ba15422665e8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:22.789192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00858-7569-46cc-80f6-551b659c3de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:22.790714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00858-7569-46cc-80f6-551b659c3de8 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:22.792192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:22.826712 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1492/3018] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:22.873091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a76c4307b504f23b442ba15422665e8', 'request_id': 'req-5156a14b-e226-477b-b45e-050ff1daf142'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:22.882883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a76c4307b504f23b442ba15422665e8', 'request_id': 'req-5156a14b-e226-477b-b45e-050ff1daf142'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:22.901777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a76c4307b504f23b442ba15422665e8', 'request_id': 'req-5156a14b-e226-477b-b45e-050ff1daf142'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:22.920849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] The token cache is being invalidate because project 6a76c4307b504f23b442ba15422665e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:22.924137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:22.925046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5156a14b-e226-477b-b45e-050ff1daf142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:22.927196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1527/3019] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:22 2022] DELETE /identity/v3/projects/6a76c4307b504f23b442ba15422665e8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:22.933089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e7ea-8d37-47d4-8fa2-95f165c5e996 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:22.933458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e7ea-8d37-47d4-8fa2-95f165c5e996 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:22.933654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e7ea-8d37-47d4-8fa2-95f165c5e996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:22.960757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fce9e7ea-8d37-47d4-8fa2-95f165c5e996 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:22.962272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fce9e7ea-8d37-47d4-8fa2-95f165c5e996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:23.068750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1493/3020] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:23.078250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bef7-14dc-4afc-9a5b-7b1ccf205aa2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.078586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bef7-14dc-4afc-9a5b-7b1ccf205aa2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.078958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7bef7-14dc-4afc-9a5b-7b1ccf205aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.128332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-09f7bef7-14dc-4afc-9a5b-7b1ccf205aa2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:23.129489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09f7bef7-14dc-4afc-9a5b-7b1ccf205aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:23.150343 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1528/3021] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:23.153524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e7ea-8d37-47d4-8fa2-95f165c5e996 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:23.173132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e7ea-8d37-47d4-8fa2-95f165c5e996 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:23.181291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:23.183569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.185692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.185692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.185692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:23.185692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:23.188280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:23.210420 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1494/3022] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:23.215313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7bef7-14dc-4afc-9a5b-7b1ccf205aa2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:23.232081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7bef7-14dc-4afc-9a5b-7b1ccf205aa2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:23.239794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:23.241902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.242389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.243090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.244709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:23.247496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:23.299835 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1529/3023] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:23 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:23.301176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:23.316790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1934fc-f0b4-4e96-9b24-82d5405d9f96 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:23.429092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:23.429864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.430223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.431199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.432396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:23.434535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:23.486110 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1495/3024] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:23 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:23.494443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:23.515026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf51170-c88a-4289-8c6e-257b9535df62 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:23.527081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:23.527897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.528174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.528454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.529961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:23.531825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:23.554261 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1530/3025] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:23.554763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:23.576642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950befbd-544e-4770-a769-8bd48e7fa18e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:23.586994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da7d2d-7b2a-4400-bcc6-5544799c7497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:23.589205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7d2d-7b2a-4400-bcc6-5544799c7497 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.589939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7d2d-7b2a-4400-bcc6-5544799c7497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.590543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da7d2d-7b2a-4400-bcc6-5544799c7497 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.594133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da7d2d-7b2a-4400-bcc6-5544799c7497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:23.611448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da7d2d-7b2a-4400-bcc6-5544799c7497 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:23.641199 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1496/3026] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:23.645823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:23.669331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4dad6-53bd-468f-b518-63d1b6389a4a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:23.680159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:23.682634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.684879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.685192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] PATH_INFO: `/v3/projects/f61b3dd3880d475b939a8543d9bbf481/users/c5c73f7347e64178b56a8331649c576e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.720910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61b3dd3880d475b939a8543d9bbf481, user_id=c5c73f7347e64178b56a8331649c576e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:23.730270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:23.762456 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1531/3027] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:23 2022] PUT /identity/v3/projects/f61b3dd3880d475b939a8543d9bbf481/users/c5c73f7347e64178b56a8331649c576e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:23.767936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecef28-e12d-4692-90a0-478ff40220ab None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:23.768789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecef28-e12d-4692-90a0-478ff40220ab None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:23.769108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecef28-e12d-4692-90a0-478ff40220ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:23.821365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b0ecef28-e12d-4692-90a0-478ff40220ab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:23.825000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0ecef28-e12d-4692-90a0-478ff40220ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:23.984917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1497/3028] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:24.009698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:24.013283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:24.228194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934942d-aa39-4225-aab3-3d2dbee73f39 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:24.234995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a81fd4-fe53-4ee7-bccb-853d4737c3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:24.236563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a81fd4-fe53-4ee7-bccb-853d4737c3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:24.237752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a81fd4-fe53-4ee7-bccb-853d4737c3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:24.238733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a81fd4-fe53-4ee7-bccb-853d4737c3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:24.263822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a81fd4-fe53-4ee7-bccb-853d4737c3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:24.266297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a81fd4-fe53-4ee7-bccb-853d4737c3c9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:24.302198 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1532/3029] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:50:24.516372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:24.517076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:24.517076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:24.581251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] MFA Rules not processed for user `29d121c7d37142d6a935ae607c0e062b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:24.582721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:24.740812 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1498/3030] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:24.751283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cacca-ba9d-4d3a-b7c3-97ecac30f663 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:24.751843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cacca-ba9d-4d3a-b7c3-97ecac30f663 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:24.752205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cacca-ba9d-4d3a-b7c3-97ecac30f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:24.786314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ec7cacca-ba9d-4d3a-b7c3-97ecac30f663 None None] MFA Rules not processed for user `29d121c7d37142d6a935ae607c0e062b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:24.789694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ec7cacca-ba9d-4d3a-b7c3-97ecac30f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:24.808506 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1533/3031] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:24.820442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:24.822353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:24.934138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad91349-81b2-48ab-9658-ad3c17721774 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:24.940282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e63aef-1fdb-4b28-980c-fe86eca6dddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:24.941039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e63aef-1fdb-4b28-980c-fe86eca6dddc service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:24.941392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e63aef-1fdb-4b28-980c-fe86eca6dddc service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:24.941733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e63aef-1fdb-4b28-980c-fe86eca6dddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:24.950953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e63aef-1fdb-4b28-980c-fe86eca6dddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:24.952851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e63aef-1fdb-4b28-980c-fe86eca6dddc service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:24.962860 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1499/3032] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:26.193702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7ded-c191-4094-b4c3-c738c8de4630 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:26.194549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7ded-c191-4094-b4c3-c738c8de4630 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:26.195064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7ded-c191-4094-b4c3-c738c8de4630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:26.204496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da0c9-2001-4c47-a85c-7cc0ae01c6d2 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:26.205014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da0c9-2001-4c47-a85c-7cc0ae01c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:26.205287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10da0c9-2001-4c47-a85c-7cc0ae01c6d2 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:26.207139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1500/3033] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 21:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:50:26.212704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:26.213163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:26.213546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:26.245330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-906a7ded-c191-4094-b4c3-c738c8de4630 None None] MFA Rules not processed for user `c5c73f7347e64178b56a8331649c576e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:26.246567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-906a7ded-c191-4094-b4c3-c738c8de4630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:26.269574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:26.272045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:26.349107 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1534/3034] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:26.360071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a7ded-c191-4094-b4c3-c738c8de4630 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:26.405698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a7ded-c191-4094-b4c3-c738c8de4630 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:26.425234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0790-c5a7-4c5e-9517-1f1956de9990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:26.426169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0790-c5a7-4c5e-9517-1f1956de9990 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:26.426634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0790-c5a7-4c5e-9517-1f1956de9990 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:26.427094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0790-c5a7-4c5e-9517-1f1956de9990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:26.439455 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1501/3035] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:26.478162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0790-c5a7-4c5e-9517-1f1956de9990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:26.487122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:26.488488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0790-c5a7-4c5e-9517-1f1956de9990 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:26.488633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:26.513765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6b79-78b5-4cb5-8b8d-cae86a862179 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:26.529147 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1535/3036] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:26.541910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:26.542617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:26.542904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:26.543186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:26.571622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:26.573943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:26.616760 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1502/3037] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:50:27.428785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e2b46-7b6a-48d2-afa2-51cbed5402e0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:27.430309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e2b46-7b6a-48d2-afa2-51cbed5402e0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:27.430761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e2b46-7b6a-48d2-afa2-51cbed5402e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:27.458200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e92e2b46-7b6a-48d2-afa2-51cbed5402e0 None None] MFA Rules not processed for user `c5c73f7347e64178b56a8331649c576e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:27.461046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e92e2b46-7b6a-48d2-afa2-51cbed5402e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:27.476312 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1536/3038] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:37.529490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:37.531268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:37.551231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca40f9-b264-4c20-af9b-e773e3b7eb5a service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:37.559287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:37.560419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:37.560916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:37.561581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] PATH_INFO: `/v3/users/99e9b91d4fb949f18cc61bf2bbd63ab6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:37.563770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e9b91d4fb949f18cc61bf2bbd63ab6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:37.566480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:37.652628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e9b91d4fb949f18cc61bf2bbd63ab6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:37.670462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e9b91d4fb949f18cc61bf2bbd63ab6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:37.671784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e9b91d4fb949f18cc61bf2bbd63ab6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:37.672827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e9b91d4fb949f18cc61bf2bbd63ab6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:37.684684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e9b91d4fb949f18cc61bf2bbd63ab6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:37.717432 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1503/3039] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:37 2022] DELETE /identity/v3/users/99e9b91d4fb949f18cc61bf2bbd63ab6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:37.934280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e2b46-7b6a-48d2-afa2-51cbed5402e0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:37.950890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e2b46-7b6a-48d2-afa2-51cbed5402e0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:38.032804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:38.033856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:38.034215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:38.034588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] PATH_INFO: `/v3/projects/4db49857a44d4f399959ac625886505a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:38.035929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db49857a44d4f399959ac625886505a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:38.037961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:38.101859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db49857a44d4f399959ac625886505a', 'request_id': 'req-ac4e1ea1-886d-437a-9eb6-a32885609288'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.111718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db49857a44d4f399959ac625886505a', 'request_id': 'req-ac4e1ea1-886d-437a-9eb6-a32885609288'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.124440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db49857a44d4f399959ac625886505a', 'request_id': 'req-ac4e1ea1-886d-437a-9eb6-a32885609288'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.138578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] The token cache is being invalidate because project 4db49857a44d4f399959ac625886505a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:38.140042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.140730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.142434 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1537/3040] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:37 2022] DELETE /identity/v3/projects/4db49857a44d4f399959ac625886505a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:38.150550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:38.152289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:38.168962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4805bbe-8381-4142-afa4-54edbf3ab471 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:38.228248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:38.229154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:38.229434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:38.229878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] PATH_INFO: `/v3/users/78d0f0ba350c45788a39dabf047ac6b0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:38.231113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d0f0ba350c45788a39dabf047ac6b0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:38.233246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:38.286818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d0f0ba350c45788a39dabf047ac6b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.302057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d0f0ba350c45788a39dabf047ac6b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.307363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d0f0ba350c45788a39dabf047ac6b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.308552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d0f0ba350c45788a39dabf047ac6b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.339387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73d30723-aa57-49cf-9945-4dcc7c9ce660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d0f0ba350c45788a39dabf047ac6b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.376430 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1504/3041] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:38 2022] DELETE /identity/v3/users/78d0f0ba350c45788a39dabf047ac6b0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:38.690899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:38.692566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:38.706240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e1ea1-886d-437a-9eb6-a32885609288 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:38.798991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:38.800438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:38.800725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:38.801003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] PATH_INFO: `/v3/projects/c5a38eb0075c4feebad21ad0840ceea3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:38.802308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a38eb0075c4feebad21ad0840ceea3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:38.804812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:38.871656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a38eb0075c4feebad21ad0840ceea3', 'request_id': 'req-fa15a703-d894-4986-b6b3-2ce89a9306c0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.878093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a38eb0075c4feebad21ad0840ceea3', 'request_id': 'req-fa15a703-d894-4986-b6b3-2ce89a9306c0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.887935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a38eb0075c4feebad21ad0840ceea3', 'request_id': 'req-fa15a703-d894-4986-b6b3-2ce89a9306c0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.900243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] The token cache is being invalidate because project c5a38eb0075c4feebad21ad0840ceea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:38.901289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.902270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa15a703-d894-4986-b6b3-2ce89a9306c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:38.903953 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1538/3042] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:38 2022] DELETE /identity/v3/projects/c5a38eb0075c4feebad21ad0840ceea3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:38.908790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba19d-3cc8-44dd-b2c1-8b57dbdf0116 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:38.909271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba19d-3cc8-44dd-b2c1-8b57dbdf0116 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:38.909394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fba19d-3cc8-44dd-b2c1-8b57dbdf0116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:38.935914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-42fba19d-3cc8-44dd-b2c1-8b57dbdf0116 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:38.937430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-42fba19d-3cc8-44dd-b2c1-8b57dbdf0116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:39.011207 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1505/3043] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:39.018706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15650d-6c22-40d2-9346-300db961e522 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.019488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15650d-6c22-40d2-9346-300db961e522 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.019488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15650d-6c22-40d2-9346-300db961e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.044968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6c15650d-6c22-40d2-9346-300db961e522 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:39.047766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6c15650d-6c22-40d2-9346-300db961e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:39.059368 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1539/3044] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:39.064177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fba19d-3cc8-44dd-b2c1-8b57dbdf0116 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.075794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fba19d-3cc8-44dd-b2c1-8b57dbdf0116 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.082501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.083276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.083562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.083834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.085269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:39.085606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.087573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.106370 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1506/3045] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:39.111336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15650d-6c22-40d2-9346-300db961e522 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.122550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15650d-6c22-40d2-9346-300db961e522 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.137208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.138173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.138457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.138738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.141620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.144601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.189122 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1540/3046] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:39 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:39.189654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.208296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40f9cb-1c2d-4e80-8afd-d9e6f1c4501d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.304496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.305326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.305796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.306236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.307200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.309476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.337157 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1507/3047] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:39 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:50:39.341937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.357375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc22aa-543f-4152-8bc5-1da645ed5b02 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.364719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.365474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.365843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.366323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.367259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.369385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.382419 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1541/3048] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:39.386616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.397562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b13c5-7fa0-40e7-96fa-59803471cb7f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.408534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778f1bb-914d-48bd-a632-f3cc8f1a8dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.409511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f1bb-914d-48bd-a632-f3cc8f1a8dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.410003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f1bb-914d-48bd-a632-f3cc8f1a8dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.410521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f1bb-914d-48bd-a632-f3cc8f1a8dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.411406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778f1bb-914d-48bd-a632-f3cc8f1a8dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.413121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778f1bb-914d-48bd-a632-f3cc8f1a8dd3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.424350 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1508/3049] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:39.428145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.440616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757850a1-4ada-48e2-93d7-2277079a2046 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.447937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.450204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.450673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.451154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] PATH_INFO: `/v3/projects/3ed0bf2e98fe4e67abb30f040a638365/users/2e6fd0a2daba417b9e39213a5e4c1f4e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.479204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed0bf2e98fe4e67abb30f040a638365, user_id=2e6fd0a2daba417b9e39213a5e4c1f4e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.485531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.514841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1542/3050] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:39 2022] PUT /identity/v3/projects/3ed0bf2e98fe4e67abb30f040a638365/users/2e6fd0a2daba417b9e39213a5e4c1f4e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:39.519259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb64cc1-c5b9-4bdc-b222-cf160d1040c6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.519557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb64cc1-c5b9-4bdc-b222-cf160d1040c6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.519839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb64cc1-c5b9-4bdc-b222-cf160d1040c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.550490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fcb64cc1-c5b9-4bdc-b222-cf160d1040c6 None None] MFA Rules not processed for user `2e6fd0a2daba417b9e39213a5e4c1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:39.551877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fcb64cc1-c5b9-4bdc-b222-cf160d1040c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:39.628491 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1509/3051] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:39.629695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.707981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688942-625a-4e85-a258-624784da95f4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.714497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.715242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.715530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.715809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.716518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.718485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.747455 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1543/3052] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:39 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:39.751182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb64cc1-c5b9-4bdc-b222-cf160d1040c6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.765889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb64cc1-c5b9-4bdc-b222-cf160d1040c6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.845359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.846321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.846862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.847331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.848378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.850531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.879236 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1510/3053] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:39 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:39.883838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.899267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce715806-7194-43e4-91bc-ebd9220e0b7e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.905918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.906988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.907490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.907979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.909124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:39.911043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:39.925348 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1544/3054] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:39.929486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:39.941732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485efc4-c548-4d05-ab49-05465a9e8e74 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:39.950736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:39.951858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:39.953495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:39.953495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] PATH_INFO: `/v3/projects/847c033bdfee430caac83e15892a461e/users/f6fc45715d8c49578f17eb223e9c9f6f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:39.997247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847c033bdfee430caac83e15892a461e, user_id=f6fc45715d8c49578f17eb223e9c9f6f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:40.003548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:40.031211 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1511/3055] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:39 2022] PUT /identity/v3/projects/847c033bdfee430caac83e15892a461e/users/f6fc45715d8c49578f17eb223e9c9f6f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:40.034985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:40.050584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e988284-e0d6-4ebf-a93f-83632b6e133f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:40.156613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89709-c92e-4b29-ae85-1afd597a845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:40.167947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89709-c92e-4b29-ae85-1afd597a845a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:40.168247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89709-c92e-4b29-ae85-1afd597a845a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:40.171136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89709-c92e-4b29-ae85-1afd597a845a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:40.172191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89709-c92e-4b29-ae85-1afd597a845a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:40.185760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d89709-c92e-4b29-ae85-1afd597a845a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:40.210826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1545/3056] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:50:40.214817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:40.227785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bf3e0-8aea-437c-8a92-7422f4710748 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:40.251580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6f750-82ae-4b8d-9586-a69a829253d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:40.252491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f750-82ae-4b8d-9586-a69a829253d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:40.252778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f750-82ae-4b8d-9586-a69a829253d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:40.253056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6f750-82ae-4b8d-9586-a69a829253d6 admin admin] PATH_INFO: `/v3/projects/847c033bdfee430caac83e15892a461e/users/f6fc45715d8c49578f17eb223e9c9f6f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:40.255396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6f750-82ae-4b8d-9586-a69a829253d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847c033bdfee430caac83e15892a461e, user_id=f6fc45715d8c49578f17eb223e9c9f6f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:40.258784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6f750-82ae-4b8d-9586-a69a829253d6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:40.277554 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1512/3057] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:40 2022] PUT /identity/v3/projects/847c033bdfee430caac83e15892a461e/users/f6fc45715d8c49578f17eb223e9c9f6f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:40.288216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959675b-8c82-4946-b788-8894c2825332 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:40.288970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959675b-8c82-4946-b788-8894c2825332 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:40.289471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959675b-8c82-4946-b788-8894c2825332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:40.332757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a959675b-8c82-4946-b788-8894c2825332 None None] MFA Rules not processed for user `f6fc45715d8c49578f17eb223e9c9f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:40.334607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a959675b-8c82-4946-b788-8894c2825332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:40.418765 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1546/3058] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:40.429101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:40.429490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:40.429850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:40.449997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] MFA Rules not processed for user `2e6fd0a2daba417b9e39213a5e4c1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:40.451351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:40.517990 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1513/3059] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:40.594235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959675b-8c82-4946-b788-8894c2825332 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:40.598149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a959675b-8c82-4946-b788-8894c2825332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:40.680748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959675b-8c82-4946-b788-8894c2825332 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:40.687655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:40.688317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:40.688601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:40.688877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:40.697897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:40.699634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:40.708597 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1547/3060] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:45.845236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:45.846715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:45.923604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfc300-ac01-4621-893c-93631ac92e1d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:45.927688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:45.928352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:45.929003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:45.929003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:45.930792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:45.948118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:45.949667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:45.961161 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1514/3061] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:47.835734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:47.837536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:47.870815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd3ae4-6171-4f21-9b06-cb0b7fbcf39a service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:47.875566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:47.876224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:47.876508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:47.876787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:47.878694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:47.912570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:47.914539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:47.930824 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1548/3062] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:51.939305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:51.941081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:52.065619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d80f88-a33a-45b0-bc6a-775e46fdeab8 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:52.072379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:52.073507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:52.074141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:52.074492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] PATH_INFO: `/v3/users/1e3abb274c044cc4b88d57193b5c62d2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:52.076200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3abb274c044cc4b88d57193b5c62d2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:52.080115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:52.150189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3abb274c044cc4b88d57193b5c62d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.160089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3abb274c044cc4b88d57193b5c62d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.161089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3abb274c044cc4b88d57193b5c62d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.162151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3abb274c044cc4b88d57193b5c62d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.175132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3abb274c044cc4b88d57193b5c62d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.232153 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1515/3063] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:51 2022] DELETE /identity/v3/users/1e3abb274c044cc4b88d57193b5c62d2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:52.532015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:52.535189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:52.556583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1c7f-7778-4724-9741-9623f19410cc service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:52.571921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:52.573460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:52.660086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:52.661683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:52.662248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:52.662808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] PATH_INFO: `/v3/users/7dd9c30816a7410f94b10294234c1dc2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:52.664281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd9c30816a7410f94b10294234c1dc2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:52.667187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:52.689339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a7f9-18f0-43f9-902e-6da005325d00 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:52.700602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:52.701608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:52.701890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:52.702163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] PATH_INFO: `/v3/projects/281216301a5449cdb4c66e9f35e6e582` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:52.703382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] RBAC: Authorizing `identity:delete_project(project_id=281216301a5449cdb4c66e9f35e6e582)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:52.705301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:52.740244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd9c30816a7410f94b10294234c1dc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.743158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd9c30816a7410f94b10294234c1dc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.759405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd9c30816a7410f94b10294234c1dc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.762043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd9c30816a7410f94b10294234c1dc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.777089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-908b9f85-b379-49b9-8d7d-75ff786874fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd9c30816a7410f94b10294234c1dc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.810111 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1549/3064] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:52 2022] DELETE /identity/v3/users/7dd9c30816a7410f94b10294234c1dc2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:52.826351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281216301a5449cdb4c66e9f35e6e582', 'request_id': 'req-a9274139-4a3c-4e65-b28c-e22e4f8d812c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.833380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281216301a5449cdb4c66e9f35e6e582', 'request_id': 'req-a9274139-4a3c-4e65-b28c-e22e4f8d812c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.846283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281216301a5449cdb4c66e9f35e6e582', 'request_id': 'req-a9274139-4a3c-4e65-b28c-e22e4f8d812c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.861496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] The token cache is being invalidate because project 281216301a5449cdb4c66e9f35e6e582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:52.861863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.862472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a9274139-4a3c-4e65-b28c-e22e4f8d812c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:52.864426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1516/3065] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:52 2022] DELETE /identity/v3/projects/281216301a5449cdb4c66e9f35e6e582 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:52.869272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093cd9-ccae-4b74-8837-0a591ad78b60 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:52.869947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093cd9-ccae-4b74-8837-0a591ad78b60 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:52.869947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093cd9-ccae-4b74-8837-0a591ad78b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:52.899496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f7093cd9-ccae-4b74-8837-0a591ad78b60 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:52.901594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f7093cd9-ccae-4b74-8837-0a591ad78b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:52.970806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1550/3066] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:52.978987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaedb3-c65a-4057-8b7f-91c7195c9b57 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:52.979858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaedb3-c65a-4057-8b7f-91c7195c9b57 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:52.980139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaedb3-c65a-4057-8b7f-91c7195c9b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.008254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-80aaedb3-c65a-4057-8b7f-91c7195c9b57 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:53.010425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-80aaedb3-c65a-4057-8b7f-91c7195c9b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.022202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1517/3067] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:53.027575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093cd9-ccae-4b74-8837-0a591ad78b60 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.044943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093cd9-ccae-4b74-8837-0a591ad78b60 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.050379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.051079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.051358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.051660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.052385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:53.052686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.054868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.068664 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1551/3068] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:53.074030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaedb3-c65a-4057-8b7f-91c7195c9b57 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.084323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaedb3-c65a-4057-8b7f-91c7195c9b57 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.085008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.087389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.089488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.090247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.090726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.091035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.091734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.093740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.107088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd9df6-9c74-4819-94ea-3bfae7b4d115 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.120005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.121111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.121523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.121924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] PATH_INFO: `/v3/projects/1bcaffad5d3447b98f0216d3481045e5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.123575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcaffad5d3447b98f0216d3481045e5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.125723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.137450 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1518/3069] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:53 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:53.143755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.198028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcaffad5d3447b98f0216d3481045e5', 'request_id': 'req-f331f692-55a1-4551-9353-048a614569a2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.205520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcaffad5d3447b98f0216d3481045e5', 'request_id': 'req-f331f692-55a1-4551-9353-048a614569a2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.216720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcaffad5d3447b98f0216d3481045e5', 'request_id': 'req-f331f692-55a1-4551-9353-048a614569a2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.229049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] The token cache is being invalidate because project 1bcaffad5d3447b98f0216d3481045e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:53.229506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.230172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.235449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1552/3070] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:53 2022] DELETE /identity/v3/projects/1bcaffad5d3447b98f0216d3481045e5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:53.236224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.240435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.241762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac42f0-eb78-456c-a437-55f76ce2de27 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.317845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331f692-55a1-4551-9353-048a614569a2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.318735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.319484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.319775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.320054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.320743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.323518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.325285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.326229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.326591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.326967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] PATH_INFO: `/v3/users/0f5b7dfeac7e4adb8b1edb35cc8c5044` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.328257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5b7dfeac7e4adb8b1edb35cc8c5044)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.330257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.353378 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1519/3071] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:53 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:53.356181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.358053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.373214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a9bc6e-ce5f-40a0-aad7-ccf40f7be632 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.378073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.378908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.379200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.379481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.380206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.381879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.385309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5b7dfeac7e4adb8b1edb35cc8c5044'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.385995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5b7dfeac7e4adb8b1edb35cc8c5044'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.392759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1520/3072] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:50:53.395811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5b7dfeac7e4adb8b1edb35cc8c5044'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.395811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5b7dfeac7e4adb8b1edb35cc8c5044'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.396893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.399126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.401399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5b7dfeac7e4adb8b1edb35cc8c5044'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.412808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2a552-e7c3-44a2-8a9a-ab7471d08014 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.418371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e71fdb-0dfc-4224-ab3a-b7ea98a3e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.419175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e71fdb-0dfc-4224-ab3a-b7ea98a3e642 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.419537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e71fdb-0dfc-4224-ab3a-b7ea98a3e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.419902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e71fdb-0dfc-4224-ab3a-b7ea98a3e642 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.424049 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1553/3073] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:53 2022] DELETE /identity/v3/users/0f5b7dfeac7e4adb8b1edb35cc8c5044 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:53.424364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e71fdb-0dfc-4224-ab3a-b7ea98a3e642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.424364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e71fdb-0dfc-4224-ab3a-b7ea98a3e642 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.439125 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1521/3074] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:53.442298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.521329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d47af6-4d18-459e-a73c-4d9fc571e720 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.527423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.528521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.528905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.529279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] PATH_INFO: `/v3/projects/c8ae6fafdc4a405a8ba51f68a9a90f65/users/5314d193cd404462bc0e5fe1e69cc052/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.553427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ae6fafdc4a405a8ba51f68a9a90f65, user_id=5314d193cd404462bc0e5fe1e69cc052, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.558566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.586231 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1554/3075] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:53 2022] PUT /identity/v3/projects/c8ae6fafdc4a405a8ba51f68a9a90f65/users/5314d193cd404462bc0e5fe1e69cc052/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:53.599753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f556d3-2155-4f8f-961f-e46e1987a0df None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.600883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f556d3-2155-4f8f-961f-e46e1987a0df None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.601508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f556d3-2155-4f8f-961f-e46e1987a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.633160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-73f556d3-2155-4f8f-961f-e46e1987a0df None None] MFA Rules not processed for user `5314d193cd404462bc0e5fe1e69cc052`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:53.636323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-73f556d3-2155-4f8f-961f-e46e1987a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.720188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.722370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.760095 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1522/3076] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:53.769731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.770014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.770299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.794068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] MFA Rules not processed for user `5314d193cd404462bc0e5fe1e69cc052`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:53.795623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.803668 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1523/3077] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:53.841858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961c5cc-4dca-4380-8e23-0d715a70ad0a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:53.847191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:53.848070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.848359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.848635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] PATH_INFO: `/v3/projects/d5f84194328949aeb7dedf97875a70c5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:53.849876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f84194328949aeb7dedf97875a70c5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:53.852902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:53.904657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:53.909401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:53.938306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f84194328949aeb7dedf97875a70c5', 'request_id': 'req-e98cd2fb-61e9-4d02-ab18-207858255d09'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.947038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f84194328949aeb7dedf97875a70c5', 'request_id': 'req-e98cd2fb-61e9-4d02-ab18-207858255d09'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.957751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f84194328949aeb7dedf97875a70c5', 'request_id': 'req-e98cd2fb-61e9-4d02-ab18-207858255d09'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.981323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] The token cache is being invalidate because project d5f84194328949aeb7dedf97875a70c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:53.982037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.983821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e98cd2fb-61e9-4d02-ab18-207858255d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:53.989328 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1555/3078] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:53 2022] DELETE /identity/v3/projects/d5f84194328949aeb7dedf97875a70c5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:53.990960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1ce80-4539-441a-a746-b4835532d19b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:53.991448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1ce80-4539-441a-a746-b4835532d19b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:53.991903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1ce80-4539-441a-a746-b4835532d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.012344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8bc1ce80-4539-441a-a746-b4835532d19b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:54.015230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8bc1ce80-4539-441a-a746-b4835532d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:54.074552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472e43-8712-4aa7-ba64-96ac427191d2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.138834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1556/3079] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:54.145947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860d71-eff9-4fcb-85ac-713575a49740 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.146373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860d71-eff9-4fcb-85ac-713575a49740 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.146765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860d71-eff9-4fcb-85ac-713575a49740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.169289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b8860d71-eff9-4fcb-85ac-713575a49740 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:54.170586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b8860d71-eff9-4fcb-85ac-713575a49740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:54.177424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.178132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.178485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.179018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.180943 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1557/3080] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:54.181101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:54.185617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8860d71-eff9-4fcb-85ac-713575a49740 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:54.208184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8860d71-eff9-4fcb-85ac-713575a49740 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.220018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.220879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.221604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.223708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.224584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:54.225367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.228764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.260003 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1558/3081] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:50:54.266929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:54.285722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae641c5-f75b-40ff-b805-442e9fbef165 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.286424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.288009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.297566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.298500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.299006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.299388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.300209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.300790 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1524/3082] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:54.302495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.352978 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1559/3083] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:54 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:54.357903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:54.396568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59795135-f434-4b2f-9ad0-39d412fe986c service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.511049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.512109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.512973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.512973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.513635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.515935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.542590 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1525/3084] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:54 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:54.546209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:54.561182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250f53b-02f0-466d-92b2-48aef37e0a21 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.587377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a914878-0d86-4252-b9c7-3e2d5775c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.588226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a914878-0d86-4252-b9c7-3e2d5775c4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.590848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a914878-0d86-4252-b9c7-3e2d5775c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.593418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:54.597870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:54.598381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a914878-0d86-4252-b9c7-3e2d5775c4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.599292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a914878-0d86-4252-b9c7-3e2d5775c4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.604089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a914878-0d86-4252-b9c7-3e2d5775c4b1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.641241 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1560/3085] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:54.643219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9579fe-19cc-44dc-8122-7894100fc5ec None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.644234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9579fe-19cc-44dc-8122-7894100fc5ec None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.644697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9579fe-19cc-44dc-8122-7894100fc5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.679356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6c9579fe-19cc-44dc-8122-7894100fc5ec None None] MFA Rules not processed for user `c5c73f7347e64178b56a8331649c576e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:54.681989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6c9579fe-19cc-44dc-8122-7894100fc5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:54.709405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3dde4-4c33-4086-a435-dc527f8896e7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.720601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.721288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.721638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.722085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.725334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:54.740742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.743273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.756788 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1526/3086] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:50:54.757891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:54.769059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a0e3-9b7c-4d83-9001-8b91b69a36be service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.778464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6a638-e271-42b4-a58f-3a4e70eeea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.779166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6a638-e271-42b4-a58f-3a4e70eeea9a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.779454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6a638-e271-42b4-a58f-3a4e70eeea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.780607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6a638-e271-42b4-a58f-3a4e70eeea9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.781131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6a638-e271-42b4-a58f-3a4e70eeea9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.783741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6a638-e271-42b4-a58f-3a4e70eeea9a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.793734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1561/3087] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:54.804560 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1527/3088] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:54.805780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9579fe-19cc-44dc-8122-7894100fc5ec None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:54.820539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9579fe-19cc-44dc-8122-7894100fc5ec None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:54.826483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:54.827670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.828232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.828705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] PATH_INFO: `/v3/projects/103d019e71b4400d9c62fb8d1ec23057/users/673efb8d99b147cbb0876a77adb3f81f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:54.847992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103d019e71b4400d9c62fb8d1ec23057, user_id=673efb8d99b147cbb0876a77adb3f81f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:54.857755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:54.882915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1562/3089] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:54 2022] PUT /identity/v3/projects/103d019e71b4400d9c62fb8d1ec23057/users/673efb8d99b147cbb0876a77adb3f81f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:54.886532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deedae0-7954-4bd7-a795-ce10aef446fb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:54.886872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deedae0-7954-4bd7-a795-ce10aef446fb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:54.887151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deedae0-7954-4bd7-a795-ce10aef446fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.076755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3deedae0-7954-4bd7-a795-ce10aef446fb None None] MFA Rules not processed for user `673efb8d99b147cbb0876a77adb3f81f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:55.077977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3deedae0-7954-4bd7-a795-ce10aef446fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:55.185372 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1528/3090] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:55.190198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:55.267421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae957517-9e6e-446a-a86b-4a0442bd04d6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:55.276767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:55.277543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.277940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.278955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.279732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:55.281791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:55.317216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1563/3091] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:55 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:55.318624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deedae0-7954-4bd7-a795-ce10aef446fb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:55.333362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deedae0-7954-4bd7-a795-ce10aef446fb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:55.404379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:55.405052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.406209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.406490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.407565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:55.409508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:55.434013 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1529/3092] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:55 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:55.437707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:55.449585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df2d66-030d-4ea6-819f-abaf7b88bccd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:55.454380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:55.455121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.455404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.455817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.456498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:55.458102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:55.468910 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1564/3093] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:55.473101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:55.483251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d73d89-adb4-4da8-ab0a-0777fb2de76a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:55.488151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:55.489028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.489303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.489576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] PATH_INFO: `/v3/projects/395d6553c6844d6b993ec73745da00e1/users/a24cee6731a54dffa89e74e0fa1fbc3e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.505070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395d6553c6844d6b993ec73745da00e1, user_id=a24cee6731a54dffa89e74e0fa1fbc3e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:55.507711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:55.522841 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1530/3094] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:55 2022] PUT /identity/v3/projects/395d6553c6844d6b993ec73745da00e1/users/a24cee6731a54dffa89e74e0fa1fbc3e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:55.526600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:55.536895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ab6cc-f328-4ca0-a9e6-b2c0dacbcb99 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:55.600555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f12263-8332-4227-837d-915b557dcc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:55.601841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12263-8332-4227-837d-915b557dcc2f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.602129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12263-8332-4227-837d-915b557dcc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.602408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12263-8332-4227-837d-915b557dcc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.603224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12263-8332-4227-837d-915b557dcc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:55.604869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12263-8332-4227-837d-915b557dcc2f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:55.614794 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1565/3095] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:55.619644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:55.631317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9eea-82b8-446c-b898-6183ff5a4444 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:55.636474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:55.637347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.637619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.637887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] PATH_INFO: `/v3/projects/395d6553c6844d6b993ec73745da00e1/users/a24cee6731a54dffa89e74e0fa1fbc3e/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.640057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=395d6553c6844d6b993ec73745da00e1, user_id=a24cee6731a54dffa89e74e0fa1fbc3e, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:55.642836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:55.653159 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1531/3096] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:55 2022] PUT /identity/v3/projects/395d6553c6844d6b993ec73745da00e1/users/a24cee6731a54dffa89e74e0fa1fbc3e/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:55.664341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb0f26-ab26-4a70-b545-69eaa474a02f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.664637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb0f26-ab26-4a70-b545-69eaa474a02f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.664966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb0f26-ab26-4a70-b545-69eaa474a02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.693107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d7fb0f26-ab26-4a70-b545-69eaa474a02f None None] MFA Rules not processed for user `a24cee6731a54dffa89e74e0fa1fbc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:55.694605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d7fb0f26-ab26-4a70-b545-69eaa474a02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:55.786821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1566/3097] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:55.798086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:55.800259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:55.904899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b2e66-eed8-45b9-b0f9-016451bf78cd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:55.911937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:55.912420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:55.912702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:55.912974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:55.925764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:55.927944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:55.942960 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1532/3098] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:56.548906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb0f26-ab26-4a70-b545-69eaa474a02f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:56.566824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb0f26-ab26-4a70-b545-69eaa474a02f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:56.576326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73734b8-3a31-4655-bb93-151a66a1c68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:56.578536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73734b8-3a31-4655-bb93-151a66a1c68e service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:56.579109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73734b8-3a31-4655-bb93-151a66a1c68e service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:56.579640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73734b8-3a31-4655-bb93-151a66a1c68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:56.583019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a73734b8-3a31-4655-bb93-151a66a1c68e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:56.630462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:56.675904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73734b8-3a31-4655-bb93-151a66a1c68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:56.678415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73734b8-3a31-4655-bb93-151a66a1c68e service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:56.693734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1567/3099] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:56.760560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b1d29-3b03-4084-bea5-0a55e2385090 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:56.766149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:56.767117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:56.767396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:56.767676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] PATH_INFO: `/v3/users/673efb8d99b147cbb0876a77adb3f81f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:56.768994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=673efb8d99b147cbb0876a77adb3f81f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:56.771284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:56.841331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673efb8d99b147cbb0876a77adb3f81f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:56.849203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673efb8d99b147cbb0876a77adb3f81f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:56.849938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673efb8d99b147cbb0876a77adb3f81f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:56.850540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673efb8d99b147cbb0876a77adb3f81f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:56.858021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673efb8d99b147cbb0876a77adb3f81f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:56.885904 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1533/3100] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:56 2022] DELETE /identity/v3/users/673efb8d99b147cbb0876a77adb3f81f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:56.890528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688897c-2d56-4d6b-a370-766c710e5c48 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:56.890727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688897c-2d56-4d6b-a370-766c710e5c48 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:56.891044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688897c-2d56-4d6b-a370-766c710e5c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:56.915357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1688897c-2d56-4d6b-a370-766c710e5c48 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:56.917813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1688897c-2d56-4d6b-a370-766c710e5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:56.992071 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1568/3101] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:57.004680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:57.006703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:57.058385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f818fa0-6ee7-46ba-851a-c1da7b696d3d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:57.058385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f818fa0-6ee7-46ba-851a-c1da7b696d3d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:57.058385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f818fa0-6ee7-46ba-851a-c1da7b696d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:57.084012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf533c-3ed8-408d-ae31-1b4a0f024b53 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:57.088997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9f818fa0-6ee7-46ba-851a-c1da7b696d3d None None] MFA Rules not processed for user `2e6fd0a2daba417b9e39213a5e4c1f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:57.088997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9f818fa0-6ee7-46ba-851a-c1da7b696d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:57.096423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:57.097452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:57.098386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:57.098907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:57.113078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:57.115361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:57.139855 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1534/3102] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:50:57.184123 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1569/3103] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:57.503899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:57.505352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:57.519604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657def-ee47-4226-9690-ac5b6fe77b57 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:57.524345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:57.525923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:57.526555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:57.526736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] PATH_INFO: `/v3/projects/103d019e71b4400d9c62fb8d1ec23057` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:57.528010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=103d019e71b4400d9c62fb8d1ec23057)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:57.530059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:57.579079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103d019e71b4400d9c62fb8d1ec23057', 'request_id': 'req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.585518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103d019e71b4400d9c62fb8d1ec23057', 'request_id': 'req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.594928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103d019e71b4400d9c62fb8d1ec23057', 'request_id': 'req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.605866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] The token cache is being invalidate because project 103d019e71b4400d9c62fb8d1ec23057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:57.606151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.606822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.611138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1535/3104] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:57 2022] DELETE /identity/v3/projects/103d019e71b4400d9c62fb8d1ec23057 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:57.612357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f818fa0-6ee7-46ba-851a-c1da7b696d3d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:57.626359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f818fa0-6ee7-46ba-851a-c1da7b696d3d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:57.691513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:57.692449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:57.692727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:57.692983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] PATH_INFO: `/v3/users/a24cee6731a54dffa89e74e0fa1fbc3e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:57.694603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24cee6731a54dffa89e74e0fa1fbc3e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:57.696949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:57.726587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:57.728833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:57.782200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24cee6731a54dffa89e74e0fa1fbc3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.783637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24cee6731a54dffa89e74e0fa1fbc3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.793290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24cee6731a54dffa89e74e0fa1fbc3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.795279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24cee6731a54dffa89e74e0fa1fbc3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.827052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24cee6731a54dffa89e74e0fa1fbc3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:57.854689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1570/3105] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:50:57 2022] DELETE /identity/v3/users/a24cee6731a54dffa89e74e0fa1fbc3e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:57.874400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198eab0-ebcf-4aea-80f9-2e3b36e9a31f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:57.976698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564284b-3d42-472c-9846-23c4e4972745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:57.977357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564284b-3d42-472c-9846-23c4e4972745 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:57.977641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564284b-3d42-472c-9846-23c4e4972745 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:57.977912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564284b-3d42-472c-9846-23c4e4972745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:57.980383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6564284b-3d42-472c-9846-23c4e4972745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:58.004514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564284b-3d42-472c-9846-23c4e4972745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:58.014799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564284b-3d42-472c-9846-23c4e4972745 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:58.030274 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1536/3106] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:50:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:50:58.323727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:58.326056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:58.461546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c874435-e27c-49eb-90de-b1c667413b24 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:58.467026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:58.468459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:58.468740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:58.469321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] PATH_INFO: `/v3/projects/395d6553c6844d6b993ec73745da00e1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:58.487619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=395d6553c6844d6b993ec73745da00e1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:58.495011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:58.565403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395d6553c6844d6b993ec73745da00e1', 'request_id': 'req-4bb74e2f-d5ad-47a6-b664-94d832486fff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:58.572916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395d6553c6844d6b993ec73745da00e1', 'request_id': 'req-4bb74e2f-d5ad-47a6-b664-94d832486fff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:58.581780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395d6553c6844d6b993ec73745da00e1', 'request_id': 'req-4bb74e2f-d5ad-47a6-b664-94d832486fff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:58.594133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] The token cache is being invalidate because project 395d6553c6844d6b993ec73745da00e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:50:58.595837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:58.597009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4bb74e2f-d5ad-47a6-b664-94d832486fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:50:58.599477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1571/3107] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:50:58 2022] DELETE /identity/v3/projects/395d6553c6844d6b993ec73745da00e1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:50:58.604166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38184bb9-1ed7-4151-b8fa-70545cb5454c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:58.604719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38184bb9-1ed7-4151-b8fa-70545cb5454c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:58.605338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38184bb9-1ed7-4151-b8fa-70545cb5454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:58.624850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-38184bb9-1ed7-4151-b8fa-70545cb5454c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:58.626051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38184bb9-1ed7-4151-b8fa-70545cb5454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:58.633930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf0fb5-c853-424b-9b20-364fd4d46ee3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:58.635861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf0fb5-c853-424b-9b20-364fd4d46ee3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:58.636387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf0fb5-c853-424b-9b20-364fd4d46ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:58.657172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f5cf0fb5-c853-424b-9b20-364fd4d46ee3 None None] MFA Rules not processed for user `29d121c7d37142d6a935ae607c0e062b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:58.658389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f5cf0fb5-c853-424b-9b20-364fd4d46ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:58.710064 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1537/3108] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:58.711843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3883c-264d-41a1-8faf-4ed629b2cdc1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:58.712240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3883c-264d-41a1-8faf-4ed629b2cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:58.712653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3883c-264d-41a1-8faf-4ed629b2cdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:58.732668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e2a3883c-264d-41a1-8faf-4ed629b2cdc1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:58.734468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e2a3883c-264d-41a1-8faf-4ed629b2cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:58.744434 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1538/3109] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:58.748724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3883c-264d-41a1-8faf-4ed629b2cdc1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:58.754812 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1572/3110] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:50:58.758572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3883c-264d-41a1-8faf-4ed629b2cdc1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:58.763614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:58.764254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:58.764533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:58.764864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:58.765524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:50:58.765833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:58.767766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:58.783591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1539/3111] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:50:58.785201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf0fb5-c853-424b-9b20-364fd4d46ee3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:58.796693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf0fb5-c853-424b-9b20-364fd4d46ee3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:58.802796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:58.803836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:58.804128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:58.804408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:58.805135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:58.807841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:58.847222 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1573/3112] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:58 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:58.848402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:58.861667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78562d7-0285-4e4d-bc61-4ab14d795f6d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:58.941596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:58.952741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:58.952741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:58.952741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:58.952741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:58.952741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:58.994566 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1540/3113] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:58 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:58.997212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.021464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06febb-bd66-42a2-9fa9-04531bfddde5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:59.044433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:59.044720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.045018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.045290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.046030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:59.050522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:59.069910 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1574/3114] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:59.071338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.091181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829d16b-990c-4c9b-9329-cbfae4bec663 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:59.098984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e7019-44fd-45cb-9cf0-e1c6eb15780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:59.099821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7019-44fd-45cb-9cf0-e1c6eb15780c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.100013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7019-44fd-45cb-9cf0-e1c6eb15780c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.100488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7019-44fd-45cb-9cf0-e1c6eb15780c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.101387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e7019-44fd-45cb-9cf0-e1c6eb15780c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:59.104493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e7019-44fd-45cb-9cf0-e1c6eb15780c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:59.119475 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1541/3115] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:59.123444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.135744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f878b-a14f-4b76-8ae0-ecce1d2b53d9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:59.142127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:59.153275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.153275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.153275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] PATH_INFO: `/v3/projects/685eac6c68ea4ecfa3d40ddc970e2ff9/users/beb9b1fc3ecb44ae9517938547c38550/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.174895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=685eac6c68ea4ecfa3d40ddc970e2ff9, user_id=beb9b1fc3ecb44ae9517938547c38550, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:59.178964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:59.207606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1575/3116] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:59 2022] PUT /identity/v3/projects/685eac6c68ea4ecfa3d40ddc970e2ff9/users/beb9b1fc3ecb44ae9517938547c38550/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:59.220755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d27c-97ca-478e-9a79-1f52e69270e0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.221367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d27c-97ca-478e-9a79-1f52e69270e0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.221783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410d27c-97ca-478e-9a79-1f52e69270e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.252974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1410d27c-97ca-478e-9a79-1f52e69270e0 None None] MFA Rules not processed for user `beb9b1fc3ecb44ae9517938547c38550`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:50:59.254320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1410d27c-97ca-478e-9a79-1f52e69270e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:50:59.371634 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1542/3117] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:50:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:50:59.372502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.489303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe4a96-4c07-48e4-a1f9-63bcce938915 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:59.496541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:59.499049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.499490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.499864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.502914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:59.508791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:59.558003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d27c-97ca-478e-9a79-1f52e69270e0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.566713 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1576/3118] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:50:59 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:59.576678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410d27c-97ca-478e-9a79-1f52e69270e0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:59.718834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:59.719634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.719822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.720623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.721377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:59.723333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:59.764470 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1543/3119] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:50:59 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:50:59.775702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.808990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f73fa-159a-487d-bf90-b05e36a5cbde admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:59.820962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:59.822847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.823547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.824069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.828474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:59.833598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:59.873993 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1577/3120] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:50:59.874270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.887209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57336a-93e6-4df5-8b23-589b003e5f19 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:50:59.900495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:50:59.901401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:50:59.901685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:50:59.901963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] PATH_INFO: `/v3/projects/5279fc0a3f0f4d4d98aeb90c6c95df00/users/2683ea95e4b74560b8aa94f3ac9a6db3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:50:59.925436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5279fc0a3f0f4d4d98aeb90c6c95df00, user_id=2683ea95e4b74560b8aa94f3ac9a6db3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:50:59.930126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:50:59.954882 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1544/3121] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:50:59 2022] PUT /identity/v3/projects/5279fc0a3f0f4d4d98aeb90c6c95df00/users/2683ea95e4b74560b8aa94f3ac9a6db3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:50:59.959537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:50:59.977279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccd3bf-1e13-418d-9e53-63c0370deddd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:00.120957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de6fde-8762-4caf-9af1-b1d1fb411971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:00.121933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de6fde-8762-4caf-9af1-b1d1fb411971 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:00.122560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de6fde-8762-4caf-9af1-b1d1fb411971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:00.123063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de6fde-8762-4caf-9af1-b1d1fb411971 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:00.124652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de6fde-8762-4caf-9af1-b1d1fb411971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:00.126463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de6fde-8762-4caf-9af1-b1d1fb411971 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:00.143496 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1578/3122] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:00.147892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:00.164881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0ce9f-7d95-44b4-be4b-0ce9555868a6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:00.178008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:00.180456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:00.182143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:00.182576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] PATH_INFO: `/v3/projects/5279fc0a3f0f4d4d98aeb90c6c95df00/users/2683ea95e4b74560b8aa94f3ac9a6db3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:00.189181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5279fc0a3f0f4d4d98aeb90c6c95df00, user_id=2683ea95e4b74560b8aa94f3ac9a6db3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:00.200261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:00.253962 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1545/3123] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:00 2022] PUT /identity/v3/projects/5279fc0a3f0f4d4d98aeb90c6c95df00/users/2683ea95e4b74560b8aa94f3ac9a6db3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:51:00.259252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804938-1eba-469b-8a17-ccc4d37c8589 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:00.262648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804938-1eba-469b-8a17-ccc4d37c8589 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:00.263036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804938-1eba-469b-8a17-ccc4d37c8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:00.319368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-04804938-1eba-469b-8a17-ccc4d37c8589 None None] MFA Rules not processed for user `2683ea95e4b74560b8aa94f3ac9a6db3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:00.320622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-04804938-1eba-469b-8a17-ccc4d37c8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:00.483080 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1579/3124] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:00.486290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:00.501157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4ca7-16ff-4434-b90b-7bfbf2dc7b7b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:00.515320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:00.516090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:00.516961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:00.517242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:00.517986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:00.518296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:00.523114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:00.538629 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1546/3125] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:00.543147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804938-1eba-469b-8a17-ccc4d37c8589 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:00.577522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804938-1eba-469b-8a17-ccc4d37c8589 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:00.592505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:00.595206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:00.595782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:00.596408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:00.598065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:00.605651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:00.669154 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1580/3126] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:00 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:51:00.673339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:00.689018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dd9d4-8f13-4280-afdb-fb67b1140668 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:00.842616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:00.844162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:00.845374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:00.845824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:00.846898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:00.847430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:00.849289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:00.865736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1547/3127] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:00.898235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:00.900165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:01.031792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dab5a6-d308-4a92-94e3-80ef977d80d7 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:01.038645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419406d7-0c62-442b-9051-c064a96dcdf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:01.039667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419406d7-0c62-442b-9051-c064a96dcdf8 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:01.039816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419406d7-0c62-442b-9051-c064a96dcdf8 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:01.040046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419406d7-0c62-442b-9051-c064a96dcdf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:01.041909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-419406d7-0c62-442b-9051-c064a96dcdf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:01.058033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419406d7-0c62-442b-9051-c064a96dcdf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:01.059990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419406d7-0c62-442b-9051-c064a96dcdf8 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:01.073993 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1581/3128] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:01.291188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:01.318546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd32b5f-0451-45e1-9fff-eb6e2bd1516f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:01.336409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:01.337120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:01.339832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:01.340103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:01.363913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:01.367702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:01.394264 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1548/3129] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:01.413419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099b6ea-c42c-4b20-be9d-15aad29d66fc None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:01.413796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099b6ea-c42c-4b20-be9d-15aad29d66fc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:01.414089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099b6ea-c42c-4b20-be9d-15aad29d66fc None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:01.415649 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1582/3130] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:51:01.424723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:51:01.441345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:01.452804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc13a-588a-42f1-a0bb-257d680ad536 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:01.458951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:01.460714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:01.461261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:01.462204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/projects/9c325c9685e1493a82504edfff44a727` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:01.464206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c325c9685e1493a82504edfff44a727)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:01.467652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:01.475144 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1549/3131] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:51:01 2022] GET /identity/v3/projects/9c325c9685e1493a82504edfff44a727 => generated 371 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:01.874427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da4fc-6f6d-48db-b03c-96549db631b4 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:01.874716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da4fc-6f6d-48db-b03c-96549db631b4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:01.875038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036da4fc-6f6d-48db-b03c-96549db631b4 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:01.876400 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1583/3132] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:51:01.882290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:51:01.910341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:01.919873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8fb31-dc55-496e-89c6-a600df500b58 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:01.925604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:01.926556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:01.927129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:01.927616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/projects/9c325c9685e1493a82504edfff44a727` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:01.928876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c325c9685e1493a82504edfff44a727)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:01.930969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:01.933034 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1550/3133] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:51:01 2022] GET /identity/v3/projects/9c325c9685e1493a82504edfff44a727 => generated 371 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:01.978834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036da4fc-6f6d-48db-b03c-96549db631b4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:01.995654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036da4fc-6f6d-48db-b03c-96549db631b4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:02.000839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:02.001946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.003096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.003606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.004864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:02.005396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:02.007972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:02.023129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1584/3134] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:02.027937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:02.041712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0578f9-775f-46db-b7f6-52754d5572fa tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:02.047882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d988e76-ffd7-4f44-951e-a0608aa00929 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:02.048653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988e76-ffd7-4f44-951e-a0608aa00929 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.049035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988e76-ffd7-4f44-951e-a0608aa00929 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.049386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d988e76-ffd7-4f44-951e-a0608aa00929 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.050402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d988e76-ffd7-4f44-951e-a0608aa00929 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:02.052778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d988e76-ffd7-4f44-951e-a0608aa00929 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:02.090080 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1551/3135] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:02 2022] POST /identity/v3/users => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:02.094327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:02.110830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e4559-e477-4f81-9b8c-6985bf35fa33 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:02.116268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:02.117075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.117369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.117659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.118479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:02.119384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:02.121127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:02.137728 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1585/3136] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:02.227342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7a39-84c8-4faf-9de6-5c74fbca9d7d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.228659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7a39-84c8-4faf-9de6-5c74fbca9d7d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.229175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c7a39-84c8-4faf-9de6-5c74fbca9d7d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.231388 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1552/3137] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:51:02.236089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:51:02.252469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:02.263905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccf7f-686e-408b-b4c7-883d07074242 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:02.268962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:02.269836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.270120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.270405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/projects/9c325c9685e1493a82504edfff44a727` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.271662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c325c9685e1493a82504edfff44a727)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:02.273739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:02.275662 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1586/3138] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:51:02 2022] GET /identity/v3/projects/9c325c9685e1493a82504edfff44a727 => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:02.510542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82a27-9069-4e31-b5d1-a4938f500a0e None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.510951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82a27-9069-4e31-b5d1-a4938f500a0e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.511289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82a27-9069-4e31-b5d1-a4938f500a0e None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.513545 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1553/3139] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:51:02.518492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 21:51:02.531327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:02.540460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09487b1-6a20-41c5-bcf7-47ddb61640d4 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:02.545640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:02.546485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.546794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.547253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/projects/9c325c9685e1493a82504edfff44a727` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.548480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c325c9685e1493a82504edfff44a727)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:02.551415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:02.553375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1587/3140] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 21:51:02 2022] GET /identity/v3/projects/9c325c9685e1493a82504edfff44a727 => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:02.583407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82a27-9069-4e31-b5d1-a4938f500a0e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:02.597213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82a27-9069-4e31-b5d1-a4938f500a0e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:02.601773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:02.602627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.602986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.603916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/users/bb22b98884654ff597d3763608703bb5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.618235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bb22b98884654ff597d3763608703bb5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:02.621004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:02.673861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb22b98884654ff597d3763608703bb5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.683782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb22b98884654ff597d3763608703bb5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.684680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb22b98884654ff597d3763608703bb5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.685301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb22b98884654ff597d3763608703bb5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.699761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb22b98884654ff597d3763608703bb5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.725294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1554/3141] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:02 2022] DELETE /identity/v3/users/bb22b98884654ff597d3763608703bb5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:02.730230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:02.732865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:02.748691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b2fe3-d27e-48ad-accf-06970186af5a tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:02.839414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2683ea95e4b74560b8aa94f3ac9a6db3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:02.840720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:02.841199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:02.841729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] PATH_INFO: `/v3/projects/9c325c9685e1493a82504edfff44a727` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:02.844065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c325c9685e1493a82504edfff44a727)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:02.846162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:02.908733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c325c9685e1493a82504edfff44a727', 'request_id': 'req-45dd7717-6699-4bc1-9807-cb8f2949df4f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.919959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c325c9685e1493a82504edfff44a727', 'request_id': 'req-45dd7717-6699-4bc1-9807-cb8f2949df4f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.931788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c325c9685e1493a82504edfff44a727', 'request_id': 'req-45dd7717-6699-4bc1-9807-cb8f2949df4f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.956979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] The token cache is being invalidate because project 9c325c9685e1493a82504edfff44a727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:02.957712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.959081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45dd7717-6699-4bc1-9807-cb8f2949df4f tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:02.962354 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1588/3142] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:02 2022] DELETE /identity/v3/projects/9c325c9685e1493a82504edfff44a727 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:02.969651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:02.971180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:03.061145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96817bb9-eb83-4409-86bf-fe62ec897247 tempest-QuotasAdminTestV257-1510295643 tempest-QuotasAdminTestV257-1510295643-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:03.122490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:03.123371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:03.123648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:03.123918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] PATH_INFO: `/v3/users/beb9b1fc3ecb44ae9517938547c38550` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:03.125144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb9b1fc3ecb44ae9517938547c38550)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:03.127116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:03.176581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb9b1fc3ecb44ae9517938547c38550'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:03.184193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb9b1fc3ecb44ae9517938547c38550'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:03.185143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb9b1fc3ecb44ae9517938547c38550'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:03.185940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb9b1fc3ecb44ae9517938547c38550'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:03.197701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb9b1fc3ecb44ae9517938547c38550'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:03.225027 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1555/3143] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:02 2022] DELETE /identity/v3/users/beb9b1fc3ecb44ae9517938547c38550 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:03.226439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:03.226928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:03.227061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:03.245701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:03.246985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:03.357187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1589/3144] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:03.378093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:03.380088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:03.456915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4eb71-9ebe-4659-bf27-11158c6a8409 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:03.464818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:03.465501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:03.466475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:03.466757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:03.479788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:03.481462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:03.492540 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1556/3145] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:03.896799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:03.898480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:03.920128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9c6da-1042-4e17-a342-3a8c59c0b393 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:03.929480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:03.930395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:03.930679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:03.930988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] PATH_INFO: `/v3/projects/685eac6c68ea4ecfa3d40ddc970e2ff9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:03.933880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=685eac6c68ea4ecfa3d40ddc970e2ff9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:03.936169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:04.037231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '685eac6c68ea4ecfa3d40ddc970e2ff9', 'request_id': 'req-7ec5a001-9e69-4942-9924-a302dec7b3b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.045444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '685eac6c68ea4ecfa3d40ddc970e2ff9', 'request_id': 'req-7ec5a001-9e69-4942-9924-a302dec7b3b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.054643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '685eac6c68ea4ecfa3d40ddc970e2ff9', 'request_id': 'req-7ec5a001-9e69-4942-9924-a302dec7b3b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.071279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] The token cache is being invalidate because project 685eac6c68ea4ecfa3d40ddc970e2ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:04.071827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.072625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.074356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1590/3146] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:03 2022] DELETE /identity/v3/projects/685eac6c68ea4ecfa3d40ddc970e2ff9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:04.078464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:04.088338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eccdc-3a71-4e37-8cea-c167a9ce2645 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:04.159716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:04.160534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:04.160813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:04.161084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] PATH_INFO: `/v3/users/2683ea95e4b74560b8aa94f3ac9a6db3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:04.162271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2683ea95e4b74560b8aa94f3ac9a6db3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:04.164252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:04.225309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2683ea95e4b74560b8aa94f3ac9a6db3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.233393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2683ea95e4b74560b8aa94f3ac9a6db3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.234452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2683ea95e4b74560b8aa94f3ac9a6db3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.235172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2683ea95e4b74560b8aa94f3ac9a6db3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.243438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bc8907a-cb91-4a4d-9dab-295440d2120c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2683ea95e4b74560b8aa94f3ac9a6db3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:04.269257 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1557/3147] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:04 2022] DELETE /identity/v3/users/2683ea95e4b74560b8aa94f3ac9a6db3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:05.555715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:05.560182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:05.579055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a001-9e69-4942-9924-a302dec7b3b2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:05.657956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:05.658860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:05.659219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:05.659423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] PATH_INFO: `/v3/projects/5279fc0a3f0f4d4d98aeb90c6c95df00` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:05.661036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5279fc0a3f0f4d4d98aeb90c6c95df00)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:05.663081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:05.720519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'request_id': 'req-08951a21-7b8e-4635-a764-b773a5f5604f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:05.731934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'request_id': 'req-08951a21-7b8e-4635-a764-b773a5f5604f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:05.743222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5279fc0a3f0f4d4d98aeb90c6c95df00', 'request_id': 'req-08951a21-7b8e-4635-a764-b773a5f5604f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:05.760213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] The token cache is being invalidate because project 5279fc0a3f0f4d4d98aeb90c6c95df00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:05.761133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:05.762281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-08951a21-7b8e-4635-a764-b773a5f5604f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:05.769622 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1591/3148] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:05 2022] DELETE /identity/v3/projects/5279fc0a3f0f4d4d98aeb90c6c95df00 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:05.772374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd1b4-37b6-43fe-ad3d-f534e7185e83 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:05.772861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd1b4-37b6-43fe-ad3d-f534e7185e83 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:05.773075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cd1b4-37b6-43fe-ad3d-f534e7185e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:05.810893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-da1cd1b4-37b6-43fe-ad3d-f534e7185e83 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:05.814854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da1cd1b4-37b6-43fe-ad3d-f534e7185e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:05.927417 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1558/3149] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:05.929503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1676-f2fe-4c28-b0b2-27bbb64fd893 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:05.929889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1676-f2fe-4c28-b0b2-27bbb64fd893 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:05.930990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef1676-f2fe-4c28-b0b2-27bbb64fd893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:05.969060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f4ef1676-f2fe-4c28-b0b2-27bbb64fd893 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:05.970389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f4ef1676-f2fe-4c28-b0b2-27bbb64fd893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:05.995028 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1592/3150] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:51:05.997058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd1b4-37b6-43fe-ad3d-f534e7185e83 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:06.015629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1cd1b4-37b6-43fe-ad3d-f534e7185e83 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:06.029734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:06.032371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.033602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.035158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.036544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:06.037157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:06.042975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:06.079562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1676-f2fe-4c28-b0b2-27bbb64fd893 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:06.090655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef1676-f2fe-4c28-b0b2-27bbb64fd893 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:06.093309 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1559/3151] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:06.105116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:06.109787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.110075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.110357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.111134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:06.115471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:06.184414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:06.195543 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1593/3152] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:06 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:51:06.197878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc87142-584b-4edc-83d3-62d7eed5c937 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:06.357566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:06.358278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.360597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.360897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.361628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:06.367269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:06.437619 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1560/3153] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:06 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:06.441565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:06.455650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad4ff-cb57-45b6-a44c-851d9e146a02 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:06.463512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:06.464352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.464645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.464963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.466184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:06.468147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:06.485963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:06.496773 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1594/3154] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:06.497883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfd703-93d7-4347-b6b9-79d3e26c6e86 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:06.502962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea24b3a-6a50-4c92-8ec1-bb439876afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:06.503640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24b3a-6a50-4c92-8ec1-bb439876afd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.503920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24b3a-6a50-4c92-8ec1-bb439876afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.504196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea24b3a-6a50-4c92-8ec1-bb439876afd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.504974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea24b3a-6a50-4c92-8ec1-bb439876afd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:06.506989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea24b3a-6a50-4c92-8ec1-bb439876afd9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:06.518840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1561/3155] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:06.523094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:06.533747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36aee0-980b-4c30-9558-c71a098e1077 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:06.539635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:06.541083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.541383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.541641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] PATH_INFO: `/v3/projects/62b1d2f38652407eaa85fbb15aff6307/users/a2d5596fa4984ceab3525ffc0a14d48f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.560555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b1d2f38652407eaa85fbb15aff6307, user_id=a2d5596fa4984ceab3525ffc0a14d48f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:06.563573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:06.580656 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1595/3156] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:06 2022] PUT /identity/v3/projects/62b1d2f38652407eaa85fbb15aff6307/users/a2d5596fa4984ceab3525ffc0a14d48f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:06.586306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.588185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.589120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.614121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:06.615923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:06.699389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:06.700042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1562/3157] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:06.702030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:06.851446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20dd56-6fdd-4e30-965e-1d0376575af9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:06.859985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98b922-cfaf-4c5d-beab-d2915fdf0435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:06.860602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98b922-cfaf-4c5d-beab-d2915fdf0435 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:06.860927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98b922-cfaf-4c5d-beab-d2915fdf0435 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:06.861213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98b922-cfaf-4c5d-beab-d2915fdf0435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:06.877920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98b922-cfaf-4c5d-beab-d2915fdf0435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:06.879479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98b922-cfaf-4c5d-beab-d2915fdf0435 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:06.892000 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1596/3158] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:07.104362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:07.105999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:07.122746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7ca87-fdb1-403f-a572-512b2d69e3fc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:07.135683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:07.136567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:07.136850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:07.137159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] PATH_INFO: `/v3/users/5314d193cd404462bc0e5fe1e69cc052` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:07.141218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5314d193cd404462bc0e5fe1e69cc052)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:07.143300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:07.253674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5314d193cd404462bc0e5fe1e69cc052'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:07.268594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5314d193cd404462bc0e5fe1e69cc052'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:07.270650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5314d193cd404462bc0e5fe1e69cc052'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:07.277427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5314d193cd404462bc0e5fe1e69cc052'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:07.291326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5314d193cd404462bc0e5fe1e69cc052'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:07.316670 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1563/3159] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:07 2022] DELETE /identity/v3/users/5314d193cd404462bc0e5fe1e69cc052 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:07.322516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:07.323088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:07.323597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:07.372424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:07.377660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:07.504620 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1597/3160] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:51:07.555738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:07.560618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:07.725026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533080-b4c7-458e-8d72-5ec972bc9c4d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:07.738288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd274-019f-43ac-b7ac-51bad2339204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:07.739309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd274-019f-43ac-b7ac-51bad2339204 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:07.739694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd274-019f-43ac-b7ac-51bad2339204 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:07.740291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd274-019f-43ac-b7ac-51bad2339204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:07.763304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cd274-019f-43ac-b7ac-51bad2339204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:07.765679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cd274-019f-43ac-b7ac-51bad2339204 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:07.792106 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1564/3161] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:08.570138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:08.575401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:08.601143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065b35-e139-40bf-b17c-4c31ee8f5a73 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:08.614151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:08.615320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:08.617282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:08.618554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] PATH_INFO: `/v3/projects/c8ae6fafdc4a405a8ba51f68a9a90f65` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:08.623344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ae6fafdc4a405a8ba51f68a9a90f65)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:08.627342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:08.721587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'request_id': 'req-0e6b678e-775f-49f2-b400-2cca26631e8f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:08.730054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'request_id': 'req-0e6b678e-775f-49f2-b400-2cca26631e8f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:08.743538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ae6fafdc4a405a8ba51f68a9a90f65', 'request_id': 'req-0e6b678e-775f-49f2-b400-2cca26631e8f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:08.759034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] The token cache is being invalidate because project c8ae6fafdc4a405a8ba51f68a9a90f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:08.760242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:08.761160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e6b678e-775f-49f2-b400-2cca26631e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:08.764060 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1598/3162] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:08 2022] DELETE /identity/v3/projects/c8ae6fafdc4a405a8ba51f68a9a90f65 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:08.769676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f6ec-9fec-409f-9cdc-dc5edaac60e4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:08.770244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f6ec-9fec-409f-9cdc-dc5edaac60e4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:08.770244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911f6ec-9fec-409f-9cdc-dc5edaac60e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:08.809094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1911f6ec-9fec-409f-9cdc-dc5edaac60e4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:08.810355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1911f6ec-9fec-409f-9cdc-dc5edaac60e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:08.911277 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1565/3163] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:08.912603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90d5b-b2a1-4489-a513-85160f15e61d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:08.913603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90d5b-b2a1-4489-a513-85160f15e61d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:08.913891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90d5b-b2a1-4489-a513-85160f15e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:08.939740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0ec90d5b-b2a1-4489-a513-85160f15e61d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:08.941612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0ec90d5b-b2a1-4489-a513-85160f15e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:08.954911 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1599/3164] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:08.955845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f6ec-9fec-409f-9cdc-dc5edaac60e4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:08.966419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911f6ec-9fec-409f-9cdc-dc5edaac60e4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:08.972695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:08.983612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:08.984145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:08.984615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:08.985617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:08.986393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:08.997091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:09.015295 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1566/3165] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:09.019726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90d5b-b2a1-4489-a513-85160f15e61d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:09.044967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90d5b-b2a1-4489-a513-85160f15e61d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:09.048896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:09.049572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:09.049890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:09.050126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:09.050855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:09.052780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:09.088137 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1600/3166] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:09 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:09.091899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:09.103119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec757050-8ad9-4af1-aab3-3320bfbc09f4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:09.174680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:09.175661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:09.176107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:09.176569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:09.177643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:09.180290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:09.208680 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1567/3167] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:09 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:09.218410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:09.229688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c4010-82a6-40bd-9773-390da6d08cd5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:09.235779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:09.236713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:09.237065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:09.237578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:09.238399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:09.255384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:09.275657 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1601/3168] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:51:09.279476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:09.290355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03057fff-bb3d-4cec-8348-75f0d41ac1bc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:09.299230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b5b81-13bd-44da-9a34-5b13774c854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:09.300274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5b81-13bd-44da-9a34-5b13774c854e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:09.300765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5b81-13bd-44da-9a34-5b13774c854e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:09.301261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b5b81-13bd-44da-9a34-5b13774c854e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:09.302248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5b81-13bd-44da-9a34-5b13774c854e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:09.303975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b5b81-13bd-44da-9a34-5b13774c854e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:09.315124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1568/3169] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:09.319802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:09.330368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edffc72-ab48-40af-ae2b-b54dff9bd366 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:09.339065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:09.341455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:09.341913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:09.342351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] PATH_INFO: `/v3/projects/aa0a7786f72343d6a66da6b4e40aee4e/users/c0cb82fc11df4dddb6401647d91d09df/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:09.359362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0a7786f72343d6a66da6b4e40aee4e, user_id=c0cb82fc11df4dddb6401647d91d09df, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:09.363147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:09.382946 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1602/3170] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:09 2022] PUT /identity/v3/projects/aa0a7786f72343d6a66da6b4e40aee4e/users/c0cb82fc11df4dddb6401647d91d09df/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:51:09.387812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:09.388214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:09.388593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:09.411796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:09.413451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:09.507901 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1569/3171] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:09.534461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:09.537251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:09.646291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95ef65-695f-4c9d-ad12-70541bddcee8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:09.653280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0dbe5-8dc7-4824-96bd-2b0de20de1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:09.654260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0dbe5-8dc7-4824-96bd-2b0de20de1ae service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:09.654762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0dbe5-8dc7-4824-96bd-2b0de20de1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:09.655179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0dbe5-8dc7-4824-96bd-2b0de20de1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:09.671037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0dbe5-8dc7-4824-96bd-2b0de20de1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:09.673148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0dbe5-8dc7-4824-96bd-2b0de20de1ae service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:09.707575 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1603/3172] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:11.153739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:11.155515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:11.316734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f1e2d-ef55-45fe-b684-dc36760b957e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:11.325632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6c5fc-f64b-414e-94f6-ed748a89514f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:11.326637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6c5fc-f64b-414e-94f6-ed748a89514f service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:11.327223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6c5fc-f64b-414e-94f6-ed748a89514f service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:11.328256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6c5fc-f64b-414e-94f6-ed748a89514f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:11.330472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3fb6c5fc-f64b-414e-94f6-ed748a89514f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:11.354512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6c5fc-f64b-414e-94f6-ed748a89514f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:11.356263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6c5fc-f64b-414e-94f6-ed748a89514f service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:11.379420 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1570/3173] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:12.746516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515234-1694-49b7-82d3-941cb03737d6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:12.747074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515234-1694-49b7-82d3-941cb03737d6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:12.747074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16515234-1694-49b7-82d3-941cb03737d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:12.791834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-16515234-1694-49b7-82d3-941cb03737d6 None None] MFA Rules not processed for user `c0cb82fc11df4dddb6401647d91d09df`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:12.793551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-16515234-1694-49b7-82d3-941cb03737d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:12.869601 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1604/3174] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:12.879294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:12.880170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:12.880612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:12.903175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] MFA Rules not processed for user `c0cb82fc11df4dddb6401647d91d09df`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:12.905530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:12.914609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1571/3175] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:51:12.925503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515234-1694-49b7-82d3-941cb03737d6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:12.940448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16515234-1694-49b7-82d3-941cb03737d6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:12.947487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:12.948292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:12.948746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:12.949040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:12.959764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:12.961408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:12.974186 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1605/3176] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:13.608085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:13.610290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:13.625216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71df9a8-6d2d-452d-84d2-62d448201c90 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:13.630573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c85d8d-ba20-461b-8510-54e609c403ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:13.631583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c85d8d-ba20-461b-8510-54e609c403ed service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:13.632088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c85d8d-ba20-461b-8510-54e609c403ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:13.632947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c85d8d-ba20-461b-8510-54e609c403ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:13.635948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-96c85d8d-ba20-461b-8510-54e609c403ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:13.651159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c85d8d-ba20-461b-8510-54e609c403ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:13.653854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c85d8d-ba20-461b-8510-54e609c403ed service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:13.668844 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1572/3177] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:16.034538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:16.058378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6209de-a1ae-4770-8181-2353e54189b6 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:16.062175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:16.062909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:16.063189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:16.063469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:16.065314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:16.078182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:16.080190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:16.100982 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1606/3178] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:18.485340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:18.486050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:18.486050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:18.528103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] MFA Rules not processed for user `a2d5596fa4984ceab3525ffc0a14d48f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:18.529496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:18.654434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:18.656682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:18.666018 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1573/3179] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:18.679726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85bdb-7e1e-483e-9457-a4b3c75cb9a5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:18.695812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:18.697508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:18.697790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:18.698062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:18.699037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:18.704193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:18.760296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:18.762222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:18.786064 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1607/3180] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:18 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:18.787259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:18.798869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461ef14-cb91-4923-b5d4-9bffc28ee951 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:18.909892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:18.910974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:18.916445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:18.917553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] PATH_INFO: `/v3/users/63270cc27d704b5095bc8d1133544eeb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:18.923601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63270cc27d704b5095bc8d1133544eeb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:18.929569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:18.950602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e019ff-da58-4cd6-814a-d34327145732 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:18.960898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:18.961587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:18.961868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:18.962185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:18.962902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:18.964848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:19.021434 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1608/3181] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:18 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:19.022802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:19.034253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1ce0-365c-483d-a727-ed9667bfbbf0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:19.039654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:19.041583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:19.041865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:19.042528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:19.043368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:19.044991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:19.052808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63270cc27d704b5095bc8d1133544eeb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:19.062244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63270cc27d704b5095bc8d1133544eeb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:19.063111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63270cc27d704b5095bc8d1133544eeb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:19.063740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63270cc27d704b5095bc8d1133544eeb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:19.078439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63270cc27d704b5095bc8d1133544eeb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:19.083002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1609/3182] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:19.083981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:19.086443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:19.101939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7925c-bbd6-4cba-b27a-0afff44b8fb3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:19.104011 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1574/3183] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:18 2022] DELETE /identity/v3/users/63270cc27d704b5095bc8d1133544eeb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:19.169783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:19.171091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:19.171372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:19.171682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] PATH_INFO: `/v3/projects/90ce3cad9a044db6a6f73cbbe92dc662/users/ef9db3cf1fa74bb6bf86e64c2e93c964/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:19.190335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ce3cad9a044db6a6f73cbbe92dc662, user_id=ef9db3cf1fa74bb6bf86e64c2e93c964, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:19.202580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:19.234876 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1610/3184] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:19 2022] PUT /identity/v3/projects/90ce3cad9a044db6a6f73cbbe92dc662/users/ef9db3cf1fa74bb6bf86e64c2e93c964/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:19.236872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:19.260465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673b046-7117-425a-8719-c5cf377b3a2d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:19.390792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:19.392846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:19.393223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:19.395027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:19.395838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:19.400966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:19.426986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1575/3185] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:19.427384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:19.441530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7314-5cf9-4138-83b6-b3be5649c049 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:19.451198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097d81-b318-42f7-9108-dc867cc567da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:19.452709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097d81-b318-42f7-9108-dc867cc567da admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:19.453651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097d81-b318-42f7-9108-dc867cc567da admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:19.454209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097d81-b318-42f7-9108-dc867cc567da admin admin] PATH_INFO: `/v3/projects/90ce3cad9a044db6a6f73cbbe92dc662/users/ef9db3cf1fa74bb6bf86e64c2e93c964/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:19.459129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097d81-b318-42f7-9108-dc867cc567da admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ce3cad9a044db6a6f73cbbe92dc662, user_id=ef9db3cf1fa74bb6bf86e64c2e93c964, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:19.464480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097d81-b318-42f7-9108-dc867cc567da admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:19.508625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1611/3186] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:19 2022] PUT /identity/v3/projects/90ce3cad9a044db6a6f73cbbe92dc662/users/ef9db3cf1fa74bb6bf86e64c2e93c964/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:19.811473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:19.813681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:19.835706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f6203-5591-4ac4-9832-0df47ae8abfd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:19.969781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:19.971051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:19.971657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:19.971938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] PATH_INFO: `/v3/projects/487fc10ff315438ca2de090c396e3cfb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:19.973343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=487fc10ff315438ca2de090c396e3cfb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:19.975466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:20.091626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487fc10ff315438ca2de090c396e3cfb', 'request_id': 'req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:20.103521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487fc10ff315438ca2de090c396e3cfb', 'request_id': 'req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:20.123502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487fc10ff315438ca2de090c396e3cfb', 'request_id': 'req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:20.156743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] The token cache is being invalidate because project 487fc10ff315438ca2de090c396e3cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:20.157220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:20.158135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f63ad3eb-e872-4895-b8b3-5dc0fb07c15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:20.175404 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1576/3187] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:19 2022] DELETE /identity/v3/projects/487fc10ff315438ca2de090c396e3cfb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:20.178749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526826-962a-416e-8e9e-2834904172ce None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.179769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526826-962a-416e-8e9e-2834904172ce None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.180280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc526826-962a-416e-8e9e-2834904172ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.242146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dc526826-962a-416e-8e9e-2834904172ce None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:20.250502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc526826-962a-416e-8e9e-2834904172ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:20.410696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1612/3188] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:20.418304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84660ff-910f-4f49-b774-c43397687dcc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.418543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84660ff-910f-4f49-b774-c43397687dcc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.420772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84660ff-910f-4f49-b774-c43397687dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.474181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b84660ff-910f-4f49-b774-c43397687dcc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:20.475541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b84660ff-910f-4f49-b774-c43397687dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:20.493073 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1577/3189] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:20.497853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc526826-962a-416e-8e9e-2834904172ce None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:20.511654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc526826-962a-416e-8e9e-2834904172ce None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:20.518011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:20.519483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.519938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.520395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.521357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:20.521825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:20.524164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:20.543312 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1613/3190] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:20.548148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84660ff-910f-4f49-b774-c43397687dcc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:20.561225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84660ff-910f-4f49-b774-c43397687dcc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:20.568014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:20.570373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.570908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.571405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.572772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:20.575712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:20.626223 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1578/3191] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:20 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:51:20.629050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:20.657288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4de05-ca43-4157-b8fd-abf1d93dc99c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:20.686283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:20.688836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:20.829316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:20.833357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.833662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.834295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.837262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:20.843573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:20.852787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254ec8-9f78-4962-bfef-97b492921874 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:20.869559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:20.870363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.870892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.871384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.877670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:20.896684 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1614/3192] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:20 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:20.900948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:20.920157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34081bf-1a54-4ecf-ba44-f50f7801b617 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:20.928345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:20.929134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.929735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.930030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.930694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:20.932108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:20.933967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:20.936378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:20.949806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1615/3193] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:20.953333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:20.968744 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1579/3194] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:51:20.980150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7ac9-adfd-4f68-8360-8062193d9a2b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:20.989625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6fe9-70b6-4b28-87e1-058a65d4a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:20.990602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6fe9-70b6-4b28-87e1-058a65d4a8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:20.993810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6fe9-70b6-4b28-87e1-058a65d4a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:20.994330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6fe9-70b6-4b28-87e1-058a65d4a8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:20.995986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c6fe9-70b6-4b28-87e1-058a65d4a8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:20.998116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c6fe9-70b6-4b28-87e1-058a65d4a8d7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:21.030349 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1616/3195] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:51:21.035029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:21.058577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9939f-ed9d-4ee9-a9a2-3688d878417b service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:21.071722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:21.075426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:21.076143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:21.077650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] PATH_INFO: `/v3/projects/7a05b8a866c04fe78b04ec616e62b70f/users/396f4d7fe37343dcb4aeeb0839383f6f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:21.130094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a05b8a866c04fe78b04ec616e62b70f, user_id=396f4d7fe37343dcb4aeeb0839383f6f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:21.136285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:21.164840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1580/3196] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:21 2022] PUT /identity/v3/projects/7a05b8a866c04fe78b04ec616e62b70f/users/396f4d7fe37343dcb4aeeb0839383f6f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:21.171005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:21.171312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:21.171688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:21.192074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:21.193629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:21.306350 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1617/3197] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:21.324431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:21.326449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:21.441858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e2271-8d20-4903-b8bf-891d29bc1ad9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:21.452799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9b126-7782-442a-8f58-1b6867d83fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:21.454034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b126-7782-442a-8f58-1b6867d83fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:21.454472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b126-7782-442a-8f58-1b6867d83fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:21.457754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b126-7782-442a-8f58-1b6867d83fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:21.484203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9b126-7782-442a-8f58-1b6867d83fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:21.486047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9b126-7782-442a-8f58-1b6867d83fe6 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:21.500146 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1581/3198] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:32.824555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:32.826252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:32.842042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51021c1e-c1f8-4a59-b7cc-8278e37b7190 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:32.854491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:32.855972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:32.858460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:32.858885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] PATH_INFO: `/v3/users/2e6fd0a2daba417b9e39213a5e4c1f4e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:32.861516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6fd0a2daba417b9e39213a5e4c1f4e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:32.867637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:32.995649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6fd0a2daba417b9e39213a5e4c1f4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:32.996362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6fd0a2daba417b9e39213a5e4c1f4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:33.035697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6fd0a2daba417b9e39213a5e4c1f4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:33.039027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6fd0a2daba417b9e39213a5e4c1f4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:33.059853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6fd0a2daba417b9e39213a5e4c1f4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:33.094200 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1618/3199] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:32 2022] DELETE /identity/v3/users/2e6fd0a2daba417b9e39213a5e4c1f4e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:33.098724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5b67-5c10-4a10-8fd7-0472920b523a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:33.099187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5b67-5c10-4a10-8fd7-0472920b523a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:33.099415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea5b67-5c10-4a10-8fd7-0472920b523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:33.157679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c8ea5b67-5c10-4a10-8fd7-0472920b523a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:33.164119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c8ea5b67-5c10-4a10-8fd7-0472920b523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:33.353499 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1582/3200] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:33.381057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:33.383195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:33.503708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df479-4a72-43cb-b57b-6f60a0240400 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:33.512131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:33.513041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:33.513431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:33.513873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:33.526475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:33.528675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:33.541180 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1619/3201] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:51:33.920287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f839c4-5797-4c36-87b2-81e0f3b87655 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:33.920583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f839c4-5797-4c36-87b2-81e0f3b87655 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:33.920878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f839c4-5797-4c36-87b2-81e0f3b87655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:33.942450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-44f839c4-5797-4c36-87b2-81e0f3b87655 None None] MFA Rules not processed for user `29d121c7d37142d6a935ae607c0e062b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:33.944563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-44f839c4-5797-4c36-87b2-81e0f3b87655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:34.049899 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1583/3202] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:34.745752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:34.750701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:34.800440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cc60b-c79c-4c08-a660-5de240a5887c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:34.809464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:34.810630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:34.811095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:34.811529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] PATH_INFO: `/v3/projects/3ed0bf2e98fe4e67abb30f040a638365` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:34.815237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed0bf2e98fe4e67abb30f040a638365)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:34.817588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:34.874199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed0bf2e98fe4e67abb30f040a638365', 'request_id': 'req-c4b69a1c-cef6-42a2-abdc-2db43281d690'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:34.882358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed0bf2e98fe4e67abb30f040a638365', 'request_id': 'req-c4b69a1c-cef6-42a2-abdc-2db43281d690'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:34.894756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed0bf2e98fe4e67abb30f040a638365', 'request_id': 'req-c4b69a1c-cef6-42a2-abdc-2db43281d690'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:34.915935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] The token cache is being invalidate because project 3ed0bf2e98fe4e67abb30f040a638365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:34.928658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:34.929913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4b69a1c-cef6-42a2-abdc-2db43281d690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:34.934129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1620/3203] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:34 2022] DELETE /identity/v3/projects/3ed0bf2e98fe4e67abb30f040a638365 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:34.937831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f839c4-5797-4c36-87b2-81e0f3b87655 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:34.961516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f839c4-5797-4c36-87b2-81e0f3b87655 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:35.039144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:35.040278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:35.040656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:35.041052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] PATH_INFO: `/v3/users/f6fc45715d8c49578f17eb223e9c9f6f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:35.043439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6fc45715d8c49578f17eb223e9c9f6f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:35.044973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:35.073237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:35.073637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:35.074016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:35.139760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] MFA Rules not processed for user `396f4d7fe37343dcb4aeeb0839383f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:35.141993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:35.157212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6fc45715d8c49578f17eb223e9c9f6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:35.177697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6fc45715d8c49578f17eb223e9c9f6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:35.179775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6fc45715d8c49578f17eb223e9c9f6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:35.181834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6fc45715d8c49578f17eb223e9c9f6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:35.225453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6fc45715d8c49578f17eb223e9c9f6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:35.295475 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1621/3204] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:35.306972 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1584/3205] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:34 2022] DELETE /identity/v3/users/f6fc45715d8c49578f17eb223e9c9f6f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:35.312352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:35.314035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:35.552079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea5926-f99b-4739-8481-372c57fb1747 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:35.670667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70edcf-b964-49d0-aa08-220132f3d287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:35.671496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70edcf-b964-49d0-aa08-220132f3d287 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:35.671685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70edcf-b964-49d0-aa08-220132f3d287 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:35.671964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70edcf-b964-49d0-aa08-220132f3d287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:35.790999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70edcf-b964-49d0-aa08-220132f3d287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:35.793162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70edcf-b964-49d0-aa08-220132f3d287 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:35.809035 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1622/3206] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:36.102378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:36.110312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:36.288223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40126e70-ccaa-4fd8-9b48-a48db315445e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:36.300450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:36.301667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:36.302255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:36.302932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] PATH_INFO: `/v3/projects/847c033bdfee430caac83e15892a461e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:36.308656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] RBAC: Authorizing `identity:delete_project(project_id=847c033bdfee430caac83e15892a461e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:36.314821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:36.415919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847c033bdfee430caac83e15892a461e', 'request_id': 'req-a2514e34-b2fc-4ffb-975f-91473b87280a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:36.425652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847c033bdfee430caac83e15892a461e', 'request_id': 'req-a2514e34-b2fc-4ffb-975f-91473b87280a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:36.438816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:36.439360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:36.440369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847c033bdfee430caac83e15892a461e', 'request_id': 'req-a2514e34-b2fc-4ffb-975f-91473b87280a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:36.440926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:36.459503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] The token cache is being invalidate because project 847c033bdfee430caac83e15892a461e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:36.467145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:36.468928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a2514e34-b2fc-4ffb-975f-91473b87280a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:36.474753 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1585/3207] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:36 2022] DELETE /identity/v3/projects/847c033bdfee430caac83e15892a461e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:36.479670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea710-bd2e-4d0e-82f3-beaa813b46e1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:36.480066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea710-bd2e-4d0e-82f3-beaa813b46e1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:36.480448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea710-bd2e-4d0e-82f3-beaa813b46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:36.520098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] MFA Rules not processed for user `ef9db3cf1fa74bb6bf86e64c2e93c964`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:36.520525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fd7ea710-bd2e-4d0e-82f3-beaa813b46e1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:36.521922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:36.523335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd7ea710-bd2e-4d0e-82f3-beaa813b46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:36.671885 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1586/3208] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:51:36.679502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6e56-2b18-40a4-881e-c2aecdacf9a3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:36.680007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6e56-2b18-40a4-881e-c2aecdacf9a3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:36.680483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae6e56-2b18-40a4-881e-c2aecdacf9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:36.692585 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1623/3209] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:51:36.703851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f7ae6e56-2b18-40a4-881e-c2aecdacf9a3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:36.705076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f7ae6e56-2b18-40a4-881e-c2aecdacf9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:36.713061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:36.714870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:36.715803 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1587/3210] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:36.719816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6e56-2b18-40a4-881e-c2aecdacf9a3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:36.736014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae6e56-2b18-40a4-881e-c2aecdacf9a3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:36.744742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:36.746170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:36.747455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:36.747821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:36.749923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:36.750371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:36.754871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:36.772761 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1588/3211] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:36.777693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:36.792584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7e6e5-101c-4f49-a4c8-dff9e332dfdb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:36.799251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687746bf-9bb5-44a7-ac98-9d340477a241 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:36.803203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:36.804484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:36.804933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:36.805371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:36.808119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:36.809084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:36.809241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:36.809581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:36.810320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:36.813671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:36.822334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:36.824867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:36.837958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1624/3212] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:36.868274 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1589/3213] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:36 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:36.869390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:36.885183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81255fc-be2c-44a7-9cb1-f9fbd267f6bf service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:37.173791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:37.174818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:37.175351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:37.175774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:37.177696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:37.182736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:37.255773 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1625/3214] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:36 2022] POST /identity/v3/users => generated 293 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:51:37.257089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:37.274966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed6da-3205-4958-8400-563492b3e4fa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:37.295151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:37.296140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:37.298530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:37.298997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:37.303211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:37.307927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:37.357412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:37.369627 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1590/3215] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:37.371042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481661e7-ec7b-46bd-beb4-6b79dc7db59c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:37.393644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a78add-3d98-48e6-aa65-89290e4f4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:37.394704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78add-3d98-48e6-aa65-89290e4f4a08 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:37.395828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78add-3d98-48e6-aa65-89290e4f4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:37.396345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78add-3d98-48e6-aa65-89290e4f4a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:37.397348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a78add-3d98-48e6-aa65-89290e4f4a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:37.400224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a78add-3d98-48e6-aa65-89290e4f4a08 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:37.431352 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1626/3216] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:51:37.432419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:37.450714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11bda63-57dc-49e2-9113-0a77390f3cf0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:37.469457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:37.470718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:37.471035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:37.471315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] PATH_INFO: `/v3/projects/85f29512cce1477d94e91ae394ecbbcb/users/809d6c48e931489cba4e521b9a42e097/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:37.535308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f29512cce1477d94e91ae394ecbbcb, user_id=809d6c48e931489cba4e521b9a42e097, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:37.538057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:37.588166 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1591/3217] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:37 2022] PUT /identity/v3/projects/85f29512cce1477d94e91ae394ecbbcb/users/809d6c48e931489cba4e521b9a42e097/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:37.593004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:37.593892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:37.594281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:37.655512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:37.658145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:37.946349 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1627/3218] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:38.112148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:38.114116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:38.274328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd44d-34eb-4a6e-80b2-ce29c0f4faef admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:38.295692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926f35f-ce24-41d1-856b-00aadbe2cfb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:38.296634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926f35f-ce24-41d1-856b-00aadbe2cfb8 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:38.297210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926f35f-ce24-41d1-856b-00aadbe2cfb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:38.297884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926f35f-ce24-41d1-856b-00aadbe2cfb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:38.354993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926f35f-ce24-41d1-856b-00aadbe2cfb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:38.363616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926f35f-ce24-41d1-856b-00aadbe2cfb8 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:38.390277 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1592/3219] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:41.027557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:41.029637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:41.288507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c439f87-26a7-4bf4-841b-aee44012a578 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:41.308195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:41.310369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:41.315302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:41.317291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:41.323683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:41.598325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:41.600380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:41.664002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1628/3220] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:44.613906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e132d9-ff73-4815-b9bc-37f80fc36b84 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:44.614406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e132d9-ff73-4815-b9bc-37f80fc36b84 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:44.614665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e132d9-ff73-4815-b9bc-37f80fc36b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:44.788217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-00e132d9-ff73-4815-b9bc-37f80fc36b84 None None] MFA Rules not processed for user `809d6c48e931489cba4e521b9a42e097`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:44.795329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00e132d9-ff73-4815-b9bc-37f80fc36b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:44.943252 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1593/3221] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:44.944864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:44.964948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0d5c-c258-47f2-b3aa-c21bb3812c69 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:44.973915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941811-815a-4a7b-9c3e-de3bdb9b0058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:44.974857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941811-815a-4a7b-9c3e-de3bdb9b0058 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:44.975301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941811-815a-4a7b-9c3e-de3bdb9b0058 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:44.975751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941811-815a-4a7b-9c3e-de3bdb9b0058 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:44.976725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73941811-815a-4a7b-9c3e-de3bdb9b0058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:44.983153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73941811-815a-4a7b-9c3e-de3bdb9b0058 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:45.057720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1629/3222] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:44 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:45.062305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e132d9-ff73-4815-b9bc-37f80fc36b84 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:45.093178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e132d9-ff73-4815-b9bc-37f80fc36b84 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:45.204024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc646-86aa-49f7-8c76-c5e4c1c29f95 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:45.204318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc646-86aa-49f7-8c76-c5e4c1c29f95 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:45.204608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbc646-86aa-49f7-8c76-c5e4c1c29f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:45.247453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-09dbc646-86aa-49f7-8c76-c5e4c1c29f95 None None] MFA Rules not processed for user `396f4d7fe37343dcb4aeeb0839383f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:45.253266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:45.253954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:45.254233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:45.254506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:45.255225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:45.258060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09dbc646-86aa-49f7-8c76-c5e4c1c29f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:45.267520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:45.327185 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1594/3223] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:45 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:45.332331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:45.361830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191ef89-e0ab-4eed-913f-ff9e19c18437 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:45.379516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:45.380203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:45.380486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:45.380761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:45.381541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:45.391006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:45.419244 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1595/3224] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:45.424370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:45.450891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa684c-a995-4daf-8180-ed1a329dbbd4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:45.453235 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1630/3225] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:51:45.464601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:45.465527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:45.465904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:45.466126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] PATH_INFO: `/v3/projects/b8c7725166154610bb95a936b87998aa/users/c292dd75be154b0294273cf2acf6b5d1/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:45.497184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c7725166154610bb95a936b87998aa, user_id=c292dd75be154b0294273cf2acf6b5d1, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:45.499906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:45.528427 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1596/3226] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:45 2022] PUT /identity/v3/projects/b8c7725166154610bb95a936b87998aa/users/c292dd75be154b0294273cf2acf6b5d1/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:45.532316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbc646-86aa-49f7-8c76-c5e4c1c29f95 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:45.551731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbc646-86aa-49f7-8c76-c5e4c1c29f95 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:45.756802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:45.757482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:45.757773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:45.758036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:45.761275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:45.766682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:45.800459 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1631/3227] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:45.802166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:45.820671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828719f5-f1d8-4a98-b869-4527a19aca3b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:45.837236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe612bc4-6814-4651-a342-f7befa4cdc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:45.838436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe612bc4-6814-4651-a342-f7befa4cdc6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:45.839066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe612bc4-6814-4651-a342-f7befa4cdc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:45.839499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe612bc4-6814-4651-a342-f7befa4cdc6f admin admin] PATH_INFO: `/v3/projects/b8c7725166154610bb95a936b87998aa/users/c292dd75be154b0294273cf2acf6b5d1/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:45.841774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe612bc4-6814-4651-a342-f7befa4cdc6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c7725166154610bb95a936b87998aa, user_id=c292dd75be154b0294273cf2acf6b5d1, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:45.844717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe612bc4-6814-4651-a342-f7befa4cdc6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:45.868069 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1597/3228] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:45 2022] PUT /identity/v3/projects/b8c7725166154610bb95a936b87998aa/users/c292dd75be154b0294273cf2acf6b5d1/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:49.978792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:49.980655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:50.008954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ab10-a73a-47e3-ad76-49b672ea0299 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:50.173041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:50.177338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:50.178036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:50.178595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] PATH_INFO: `/v3/users/3eb85bfb49aa4a519099c6f43ac77099` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:50.185033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb85bfb49aa4a519099c6f43ac77099)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:50.189388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:50.311848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb85bfb49aa4a519099c6f43ac77099'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:50.312670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb85bfb49aa4a519099c6f43ac77099'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:50.331848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb85bfb49aa4a519099c6f43ac77099'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:50.332548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb85bfb49aa4a519099c6f43ac77099'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:50.367806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb85bfb49aa4a519099c6f43ac77099'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:50.408870 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1632/3229] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:49 2022] DELETE /identity/v3/users/3eb85bfb49aa4a519099c6f43ac77099 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:50.413410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae3227-9c71-4fa1-adb5-097289bb3478 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:50.415387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae3227-9c71-4fa1-adb5-097289bb3478 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:50.415387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae3227-9c71-4fa1-adb5-097289bb3478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:50.481669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4bae3227-9c71-4fa1-adb5-097289bb3478 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:50.484646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4bae3227-9c71-4fa1-adb5-097289bb3478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:50.716567 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1598/3230] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:50.832591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:50.834231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:50.949748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7df09-4241-47be-a1f0-73bdb387e41b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:50.958939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47076663-42ed-4062-bdbf-8c36d89725c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:50.959611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076663-42ed-4062-bdbf-8c36d89725c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:50.960011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076663-42ed-4062-bdbf-8c36d89725c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:50.960257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076663-42ed-4062-bdbf-8c36d89725c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:50.982822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47076663-42ed-4062-bdbf-8c36d89725c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:50.984375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47076663-42ed-4062-bdbf-8c36d89725c5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:51.039989 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1633/3231] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:51.320775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:51.321621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:51.322584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:51.356665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:51.359569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:51.377698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:51.378018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:51.378259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:51.476570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] MFA Rules not processed for user `c292dd75be154b0294273cf2acf6b5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:51.479003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:51.485881 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1599/3232] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:51:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:51.560903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:51.563804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:51.757304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518f0d9-5f18-4174-91ad-4692ed5a3901 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:51.760752 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1634/3233] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:51.762018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:51.769954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:51.788172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115acef-9a23-41f3-9592-010f62f8db40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:51.789122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115acef-9a23-41f3-9592-010f62f8db40 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:51.789589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115acef-9a23-41f3-9592-010f62f8db40 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:51.790468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115acef-9a23-41f3-9592-010f62f8db40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:51.799791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd5c7-f01d-4f1b-9c09-3f09d21a56b6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:51.805450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115acef-9a23-41f3-9592-010f62f8db40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:51.808595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115acef-9a23-41f3-9592-010f62f8db40 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:51.811550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:51.812739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:51.813255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:51.813766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] PATH_INFO: `/v3/users/c0cb82fc11df4dddb6401647d91d09df` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:51.817701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cb82fc11df4dddb6401647d91d09df)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:51.821564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:51.837125 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1600/3234] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:51:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 21:51:51.840882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:51.841166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:51.841439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:51.918470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] MFA Rules not processed for user `809d6c48e931489cba4e521b9a42e097`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:51.919729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:51.942699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cb82fc11df4dddb6401647d91d09df'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:51.944618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cb82fc11df4dddb6401647d91d09df'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:51.972377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cb82fc11df4dddb6401647d91d09df'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:51.973375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cb82fc11df4dddb6401647d91d09df'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:51.994446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cb82fc11df4dddb6401647d91d09df'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:52.032587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1635/3235] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:51 2022] DELETE /identity/v3/users/c0cb82fc11df4dddb6401647d91d09df => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:52.158405 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1601/3236] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:52.254680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:52.256530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:52.351539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:52.353381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:52.381555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25ca53-533f-459d-85b9-8de343867a81 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:52.405345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7fee4-059d-4115-8fbc-00406c33fd2f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:52.445182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:52.446530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:52.446911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:52.447267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:52.452753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:52.524946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:52.528102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:52.528643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:52.529129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] PATH_INFO: `/v3/projects/7789855db11445de842c4df75bd05e10` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:52.531737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7789855db11445de842c4df75bd05e10)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:52.535226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:52.642370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7789855db11445de842c4df75bd05e10', 'request_id': 'req-93d906b2-f781-4727-8f22-8c0bf067b3ca'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:52.651441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7789855db11445de842c4df75bd05e10', 'request_id': 'req-93d906b2-f781-4727-8f22-8c0bf067b3ca'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:52.665486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7789855db11445de842c4df75bd05e10', 'request_id': 'req-93d906b2-f781-4727-8f22-8c0bf067b3ca'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:52.667364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:52.669131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:52.681969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] The token cache is being invalidate because project 7789855db11445de842c4df75bd05e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:52.682338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:52.683260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:52.685884 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1602/3237] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:52 2022] DELETE /identity/v3/projects/7789855db11445de842c4df75bd05e10 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:52.689699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:52.692202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:52.711193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1636/3238] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:52.925119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d906b2-f781-4727-8f22-8c0bf067b3ca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:52.931482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:52.932660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:52.933034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:52.933420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] PATH_INFO: `/v3/users/a6edc155dc2646fbb81df7bb279aeee0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:52.934784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6edc155dc2646fbb81df7bb279aeee0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:52.938254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:53.016670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6edc155dc2646fbb81df7bb279aeee0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.053191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6edc155dc2646fbb81df7bb279aeee0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.055758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6edc155dc2646fbb81df7bb279aeee0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.056445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6edc155dc2646fbb81df7bb279aeee0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.097175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6edc155dc2646fbb81df7bb279aeee0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.241403 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1603/3239] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:52 2022] DELETE /identity/v3/users/a6edc155dc2646fbb81df7bb279aeee0 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:53.303832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:53.305871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:53.330601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ca6ca-c1ec-4eb8-be60-c68f4a32ebf7 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:53.460099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:53.460965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:53.461246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:53.461552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] PATH_INFO: `/v3/projects/aa0a7786f72343d6a66da6b4e40aee4e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:53.466706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0a7786f72343d6a66da6b4e40aee4e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:53.469321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:53.590572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0a7786f72343d6a66da6b4e40aee4e', 'request_id': 'req-6c6fdaaf-f352-4818-8800-61f177566804'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.632937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0a7786f72343d6a66da6b4e40aee4e', 'request_id': 'req-6c6fdaaf-f352-4818-8800-61f177566804'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.642910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:53.644337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:53.658031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0a7786f72343d6a66da6b4e40aee4e', 'request_id': 'req-6c6fdaaf-f352-4818-8800-61f177566804'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.666013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680eda0-ade4-40db-ad32-a76c5a831586 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:53.756094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] The token cache is being invalidate because project aa0a7786f72343d6a66da6b4e40aee4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:53.757267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.760848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c6fdaaf-f352-4818-8800-61f177566804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.762832 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1637/3240] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:53 2022] DELETE /identity/v3/projects/aa0a7786f72343d6a66da6b4e40aee4e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:53.771407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bec65-4c44-4e39-ab67-877ed91f8d14 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:53.771627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bec65-4c44-4e39-ab67-877ed91f8d14 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:53.771874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bec65-4c44-4e39-ab67-877ed91f8d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:53.820383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:53.821955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:53.822537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:53.823086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] PATH_INFO: `/v3/users/cd60e0534aac4bc697aafe66723e1ab8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:53.830260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd60e0534aac4bc697aafe66723e1ab8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:53.830260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:53.838916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d01bec65-4c44-4e39-ab67-877ed91f8d14 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:53.840187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d01bec65-4c44-4e39-ab67-877ed91f8d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:53.881148 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1638/3241] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:53.882536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d991d-f25f-4b21-93e4-d139dbefe6b1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:53.883370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d991d-f25f-4b21-93e4-d139dbefe6b1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:53.883370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d991d-f25f-4b21-93e4-d139dbefe6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:53.923010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd60e0534aac4bc697aafe66723e1ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.931743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd60e0534aac4bc697aafe66723e1ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.932925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd60e0534aac4bc697aafe66723e1ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.933634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd60e0534aac4bc697aafe66723e1ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.938757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-951d991d-f25f-4b21-93e4-d139dbefe6b1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:53.940167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-951d991d-f25f-4b21-93e4-d139dbefe6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:53.959158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd60e0534aac4bc697aafe66723e1ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:53.964775 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1639/3242] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:53.965694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d991d-f25f-4b21-93e4-d139dbefe6b1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:53.985089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d991d-f25f-4b21-93e4-d139dbefe6b1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:53.996570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:53.996840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:53.997108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:53.997372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:53.998108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:53.998407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:54.001994 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1604/3243] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:53 2022] DELETE /identity/v3/users/cd60e0534aac4bc697aafe66723e1ab8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:54.003557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:54.043210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1640/3244] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:54.046031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:54.182720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7acd30-fac7-4543-ae25-a90e52045c1f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:54.189169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:54.189868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:54.190148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:54.190420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:54.191179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:54.193466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:54.235543 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1605/3245] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:54 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:54.236286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:54.249316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938ca3-5aad-4905-a6f6-580ec6409a38 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:54.344906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:54.346368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:54.346756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:54.347170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:54.348509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:54.353818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:54.394588 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1641/3246] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:54 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:51:54.400561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:54.426264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d350c-28d4-4398-8470-4c781b87ebb0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:54.435284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:54.435974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:54.436260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:54.436538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:54.437270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:54.439250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:54.456728 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1606/3247] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:54.456950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:54.470132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f28d5-5c80-4a37-80ee-f2cc3523a970 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:54.479986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf9dcb-846c-45ce-90b6-692adcd4f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:54.480319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9dcb-846c-45ce-90b6-692adcd4f6be admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:54.480614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9dcb-846c-45ce-90b6-692adcd4f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:54.480987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9dcb-846c-45ce-90b6-692adcd4f6be admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:54.481681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf9dcb-846c-45ce-90b6-692adcd4f6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:54.483404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf9dcb-846c-45ce-90b6-692adcd4f6be admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:54.495298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1642/3248] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:51:54.499930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:54.512680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505b4c8-3233-43e7-80dc-debc89b4c5a1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:54.517613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:54.518681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:54.519575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:54.520047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] PATH_INFO: `/v3/projects/aa1cd49355d840abbda4ccda9d86705f/users/eedcf10ae62840029976cb842190a948/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:54.539216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1cd49355d840abbda4ccda9d86705f, user_id=eedcf10ae62840029976cb842190a948, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:54.542636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:54.565171 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1607/3249] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:54 2022] PUT /identity/v3/projects/aa1cd49355d840abbda4ccda9d86705f/users/eedcf10ae62840029976cb842190a948/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:54.567302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:54.568155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:54.568918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:54.599240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:54.600766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:54.719221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:54.722764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:54.769991 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1643/3250] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:51:54.835137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c4fa6-ca99-48a5-952c-1fe4305997c4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:54.846254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:54.848178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:54.850102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:54.850420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] PATH_INFO: `/v3/projects/566d958787dd43a0be6c8221f003c8f4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:54.851828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566d958787dd43a0be6c8221f003c8f4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:54.854141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:54.914377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:54.916359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:54.959161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566d958787dd43a0be6c8221f003c8f4', 'request_id': 'req-49650f0e-3545-429d-8782-63c408f805f0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:54.969025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566d958787dd43a0be6c8221f003c8f4', 'request_id': 'req-49650f0e-3545-429d-8782-63c408f805f0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:54.977945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566d958787dd43a0be6c8221f003c8f4', 'request_id': 'req-49650f0e-3545-429d-8782-63c408f805f0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:54.991763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] The token cache is being invalidate because project 566d958787dd43a0be6c8221f003c8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:54.993353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:54.994396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49650f0e-3545-429d-8782-63c408f805f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:54.996505 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1608/3251] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:54 2022] DELETE /identity/v3/projects/566d958787dd43a0be6c8221f003c8f4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:55.003167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6b4bb-275e-435c-9232-10781accf777 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.003892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6b4bb-275e-435c-9232-10781accf777 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.004386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6b4bb-275e-435c-9232-10781accf777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.032016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-58d6b4bb-275e-435c-9232-10781accf777 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:55.035174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-58d6b4bb-275e-435c-9232-10781accf777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:55.083151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c75908-5bf1-423b-a295-b9c77e377faf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.163054 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1609/3252] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:55.171519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54545fa0-0b75-46ea-b6fa-a217ec353370 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.171932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54545fa0-0b75-46ea-b6fa-a217ec353370 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.175052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54545fa0-0b75-46ea-b6fa-a217ec353370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.239197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-54545fa0-0b75-46ea-b6fa-a217ec353370 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:55.240685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54545fa0-0b75-46ea-b6fa-a217ec353370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:55.254359 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1610/3253] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:55.259646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54545fa0-0b75-46ea-b6fa-a217ec353370 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.283505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54545fa0-0b75-46ea-b6fa-a217ec353370 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.300950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.302436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.302748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.303442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.309262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:55.309778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.314600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.314968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.317283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.320049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:55.320345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.329841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:55.349384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.354846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:55.381073 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1611/3254] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:55.383677 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1644/3255] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:55.387828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.410181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271e25-c543-415e-b190-9a4c0983ac57 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.425844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.426204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.427260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.427793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.427911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:55.428384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.429312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.431507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:55.447853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02954-c5ab-45ce-a0ca-06e3ac171ee4 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.455946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.456757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.457043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.457892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] PATH_INFO: `/v3/projects/2a463927927b488ebe8a6e118484e8df` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.459687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a463927927b488ebe8a6e118484e8df)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.462458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:55.489104 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1612/3256] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:55 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:55.493622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.612283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a463927927b488ebe8a6e118484e8df', 'request_id': 'req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:55.622193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a463927927b488ebe8a6e118484e8df', 'request_id': 'req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:55.622597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269da6d-ebe3-4a0e-9415-0de3f966f579 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.641167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a463927927b488ebe8a6e118484e8df', 'request_id': 'req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:55.658458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] The token cache is being invalidate because project 2a463927927b488ebe8a6e118484e8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:51:55.659084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:55.659912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0f6b319c-b2be-462b-a7c8-b48d9a34f3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:55.662342 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1645/3257] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:51:55 2022] DELETE /identity/v3/projects/2a463927927b488ebe8a6e118484e8df => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:55.667735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732947-07e4-4acb-8172-054c3b64a271 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.668417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732947-07e4-4acb-8172-054c3b64a271 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.668886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38732947-07e4-4acb-8172-054c3b64a271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.695381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-38732947-07e4-4acb-8172-054c3b64a271 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:55.698406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-38732947-07e4-4acb-8172-054c3b64a271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:55.728906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.731692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.733810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.734190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.735583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.743515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:55.790915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1646/3258] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:55.802791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d89c9-0df7-49ab-a39f-685b2ff70535 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.802791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d89c9-0df7-49ab-a39f-685b2ff70535 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.803193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d89c9-0df7-49ab-a39f-685b2ff70535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.821529 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1613/3259] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:55 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:55.822747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.826042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:55.870101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b4005-0221-49f9-89d9-55e59e70300d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.877364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.878155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.878594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.878941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9b1d89c9-0df7-49ab-a39f-685b2ff70535 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:55.879097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.880057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.880185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9b1d89c9-0df7-49ab-a39f-685b2ff70535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:55.881800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:55.904697 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1614/3260] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:51:55.906115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.921529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94732a89-69b5-4afc-908c-7887de6cb20c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.927765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.928538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.928895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.929263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.930265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.932031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:55.936779 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1647/3261] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:55.943292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d89c9-0df7-49ab-a39f-685b2ff70535 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.949198 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1615/3262] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:55.950439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:55.969675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d89c9-0df7-49ab-a39f-685b2ff70535 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.981758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd875ea-c235-47bc-91aa-1c5ff60e31cc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:55.986599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1eb10-88a1-42e5-98a5-da14f2fd1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.989027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1eb10-88a1-42e5-98a5-da14f2fd1183 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.989250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:55.989390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1eb10-88a1-42e5-98a5-da14f2fd1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.989579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1eb10-88a1-42e5-98a5-da14f2fd1183 admin admin] PATH_INFO: `/v3/projects/5f74dd980cd74657aa113c80e3da73f0/users/99445f58e5b24ac2814e999b1928e15f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.990548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:55.990878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:55.991165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:55.991914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:51:55.992222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:55.993916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.022985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1eb10-88a1-42e5-98a5-da14f2fd1183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f74dd980cd74657aa113c80e3da73f0, user_id=99445f58e5b24ac2814e999b1928e15f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.029194 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1648/3263] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:51:56.031960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.036073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1eb10-88a1-42e5-98a5-da14f2fd1183 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.061725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658475-da0b-4922-a0ba-a820360bf8bf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.074142 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1616/3264] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:55 2022] PUT /identity/v3/projects/5f74dd980cd74657aa113c80e3da73f0/users/99445f58e5b24ac2814e999b1928e15f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:56.089155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d35f6-261a-4311-988f-a6e5fd015ae4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.089519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d35f6-261a-4311-988f-a6e5fd015ae4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.089762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d35f6-261a-4311-988f-a6e5fd015ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.167940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-452d35f6-261a-4311-988f-a6e5fd015ae4 None None] MFA Rules not processed for user `99445f58e5b24ac2814e999b1928e15f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:56.172552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-452d35f6-261a-4311-988f-a6e5fd015ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:56.263620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.264559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.265005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.265453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.266696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.273800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.330504 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1617/3265] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:56.335591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d35f6-261a-4311-988f-a6e5fd015ae4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.345370 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1649/3266] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:56 2022] POST /identity/v3/projects => generated 379 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:56.350178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.364329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d35f6-261a-4311-988f-a6e5fd015ae4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.476304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.477937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.478226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.478507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.479241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.480868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f499348-eb62-4ef8-93d6-5a2f054f70ed admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.482062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.498815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.500470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.501054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.501634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.503068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.505920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.534564 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1618/3267] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:51:56 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:56.536239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.552928 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1650/3268] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:56 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:51:56.554085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.578794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a6a39-1942-48fc-9ffc-5d7c40b54f35 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.695454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.696693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.697229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.697744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.698695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.700563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.703085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80122ddc-22cf-49f7-97b9-04dab16617f4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.721196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.722119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.722628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.723176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.724085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.726240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.729236 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1651/3269] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:51:56.731779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.753130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65c9fb-fcd1-4303-a0ac-1db6bf185b6b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.777324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.778994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.799863 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1619/3270] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:51:56 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:51:56.800841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.804219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.806149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.807193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.811822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754e3bf-c526-4f12-bd32-ef5e97c72aa8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.814891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.835921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.837461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.837989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.838511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.839641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.841472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.847188 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1652/3271] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:56.851433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.858453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1620/3272] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:56.859812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.873721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86334ced-5569-41ca-b75c-c04b305ee406 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.878728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d453f8-14e7-4e69-8da9-25c2874dc744 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:56.881042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.882904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.883301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.883650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] PATH_INFO: `/v3/projects/cd3288e10816476083f8dbbb6f534eff/users/bdcefedd42c140b0a9e7c41d53bb0a38/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.906335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d0ed6-6ebc-4598-8c6a-16e02cf8cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:56.908028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d0ed6-6ebc-4598-8c6a-16e02cf8cf47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.908553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3288e10816476083f8dbbb6f534eff, user_id=bdcefedd42c140b0a9e7c41d53bb0a38, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.908969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d0ed6-6ebc-4598-8c6a-16e02cf8cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.910826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d0ed6-6ebc-4598-8c6a-16e02cf8cf47 admin admin] PATH_INFO: `/v3/projects/aae91bd9874141989a0896953655d3de/users/8e35b8f3a2eb4ed98800638dd51618ff/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:56.911314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.938055 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1621/3273] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:56 2022] PUT /identity/v3/projects/cd3288e10816476083f8dbbb6f534eff/users/bdcefedd42c140b0a9e7c41d53bb0a38/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:56.939204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:56.948542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d0ed6-6ebc-4598-8c6a-16e02cf8cf47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae91bd9874141989a0896953655d3de, user_id=8e35b8f3a2eb4ed98800638dd51618ff, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:56.953152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d0ed6-6ebc-4598-8c6a-16e02cf8cf47 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:56.988849 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1653/3274] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:56 2022] PUT /identity/v3/projects/aae91bd9874141989a0896953655d3de/users/8e35b8f3a2eb4ed98800638dd51618ff/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:56.994277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:56.994678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:56.995065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:57.045962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:57.047246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:57.092894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508ab94-16e1-4592-9787-b1b37e40dc03 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:57.143581 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1654/3275] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:57.167868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:57.168753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:57.216089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:57.216776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:57.217205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:57.217556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:57.219070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:57.220985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:57.232543 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1622/3276] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:51:57.236369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:57.265422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cc64e-1a49-4dc5-9dad-e9f2d5d14ab7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:57.283267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:57.288146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:57.288778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:57.289334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] PATH_INFO: `/v3/projects/cd3288e10816476083f8dbbb6f534eff/users/bdcefedd42c140b0a9e7c41d53bb0a38/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:57.293559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3288e10816476083f8dbbb6f534eff, user_id=bdcefedd42c140b0a9e7c41d53bb0a38, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:57.304696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b3736-cbef-4edb-9837-050292577468 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:57.306401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:57.311319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111bad8-cbc1-4fbb-8c92-4097d759605a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:57.311723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bad8-cbc1-4fbb-8c92-4097d759605a service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:57.312087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bad8-cbc1-4fbb-8c92-4097d759605a service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:57.312450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bad8-cbc1-4fbb-8c92-4097d759605a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:57.324813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111bad8-cbc1-4fbb-8c92-4097d759605a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:57.326536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111bad8-cbc1-4fbb-8c92-4097d759605a service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:57.339122 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1655/3277] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:51:57.364606 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1623/3278] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:51:57 2022] PUT /identity/v3/projects/cd3288e10816476083f8dbbb6f534eff/users/bdcefedd42c140b0a9e7c41d53bb0a38/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:57.374823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50474e37-0b15-4681-b823-fd0c218325bb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:57.376989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50474e37-0b15-4681-b823-fd0c218325bb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:57.377275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50474e37-0b15-4681-b823-fd0c218325bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:57.415604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-50474e37-0b15-4681-b823-fd0c218325bb None None] MFA Rules not processed for user `bdcefedd42c140b0a9e7c41d53bb0a38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:57.417438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-50474e37-0b15-4681-b823-fd0c218325bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:57.529442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1656/3279] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:57.541460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:57.544864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:57.665958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c8a56-61b9-4012-9ca2-dfa205f73219 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:57.677324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e74df-3229-49fd-9f9a-c281a4b17346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:57.679371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e74df-3229-49fd-9f9a-c281a4b17346 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:57.679949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e74df-3229-49fd-9f9a-c281a4b17346 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:57.680966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e74df-3229-49fd-9f9a-c281a4b17346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:57.693520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e74df-3229-49fd-9f9a-c281a4b17346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:57.695277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e74df-3229-49fd-9f9a-c281a4b17346 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:57.710744 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1624/3280] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:58.186514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50474e37-0b15-4681-b823-fd0c218325bb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:58.294046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50474e37-0b15-4681-b823-fd0c218325bb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:58.311282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:58.313098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:58.313838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:58.314251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] PATH_INFO: `/v3/users/99445f58e5b24ac2814e999b1928e15f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:58.315782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99445f58e5b24ac2814e999b1928e15f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:58.323092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:58.393899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99445f58e5b24ac2814e999b1928e15f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:58.395749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99445f58e5b24ac2814e999b1928e15f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:58.404301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99445f58e5b24ac2814e999b1928e15f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:58.405349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99445f58e5b24ac2814e999b1928e15f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:58.428514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99445f58e5b24ac2814e999b1928e15f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:51:58.482301 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1657/3281] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:51:58 2022] DELETE /identity/v3/users/99445f58e5b24ac2814e999b1928e15f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:51:58.483997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bc90-0e9f-4d8f-ab14-47c08009f0ed None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:58.484491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bc90-0e9f-4d8f-ab14-47c08009f0ed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:58.484636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bc90-0e9f-4d8f-ab14-47c08009f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:58.517048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-84d0bc90-0e9f-4d8f-ab14-47c08009f0ed None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:58.518409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-84d0bc90-0e9f-4d8f-ab14-47c08009f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:58.627519 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1625/3282] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:58.654225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:58.655911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:58.786159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159a28-b021-4b1f-b42c-c50a343cd0c8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:58.797819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b6a30-5801-4ccb-b1ef-2e14fcbef510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:58.798517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6a30-5801-4ccb-b1ef-2e14fcbef510 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:58.798812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6a30-5801-4ccb-b1ef-2e14fcbef510 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:58.799093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b6a30-5801-4ccb-b1ef-2e14fcbef510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:58.846196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b6a30-5801-4ccb-b1ef-2e14fcbef510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:58.849097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b6a30-5801-4ccb-b1ef-2e14fcbef510 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:58.872872 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1658/3283] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:51:59.307597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:59.308162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:59.309266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:59.358941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] MFA Rules not processed for user `eedcf10ae62840029976cb842190a948`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:59.360439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:59.488293 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1626/3284] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:59.501274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bb9e-2a2c-4049-a6de-0df831034ce2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:59.501855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bb9e-2a2c-4049-a6de-0df831034ce2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:59.502009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bb9e-2a2c-4049-a6de-0df831034ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:59.530848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8743bb9e-2a2c-4049-a6de-0df831034ce2 None None] MFA Rules not processed for user `eedcf10ae62840029976cb842190a948`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:51:59.532235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8743bb9e-2a2c-4049-a6de-0df831034ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:59.573912 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1659/3285] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:51:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:51:59.582132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:51:59.583758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:51:59.779741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1bacb-b6f5-43ef-a67d-c7425638f69a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:51:59.787280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607aaaa-b753-4019-9b7f-91b81125c470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:51:59.788353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607aaaa-b753-4019-9b7f-91b81125c470 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:51:59.789578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607aaaa-b753-4019-9b7f-91b81125c470 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:51:59.790111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607aaaa-b753-4019-9b7f-91b81125c470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:51:59.804228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607aaaa-b753-4019-9b7f-91b81125c470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:51:59.807710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607aaaa-b753-4019-9b7f-91b81125c470 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:51:59.821622 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1627/3286] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:51:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:52:00.286840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743bb9e-2a2c-4049-a6de-0df831034ce2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:00.307633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743bb9e-2a2c-4049-a6de-0df831034ce2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:00.311472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3cdb5-29c9-43ab-bf88-c41b84b42c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:00.312127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3cdb5-29c9-43ab-bf88-c41b84b42c46 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:00.312406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3cdb5-29c9-43ab-bf88-c41b84b42c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:00.312680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3cdb5-29c9-43ab-bf88-c41b84b42c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:00.323984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8cd3cdb5-29c9-43ab-bf88-c41b84b42c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:00.338624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3cdb5-29c9-43ab-bf88-c41b84b42c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:00.340136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3cdb5-29c9-43ab-bf88-c41b84b42c46 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:00.359397 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1660/3287] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:00.477612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:00.477845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:00.478081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:00.534214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] MFA Rules not processed for user `8e35b8f3a2eb4ed98800638dd51618ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:00.535554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:00.699170 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1628/3288] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:00.753525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3021-0b6d-48c4-a460-2a778909cf92 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:00.754128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3021-0b6d-48c4-a460-2a778909cf92 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:00.754128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3021-0b6d-48c4-a460-2a778909cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:00.785767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3b9d3021-0b6d-48c4-a460-2a778909cf92 None None] MFA Rules not processed for user `8e35b8f3a2eb4ed98800638dd51618ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:00.787201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3b9d3021-0b6d-48c4-a460-2a778909cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:00.809300 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1661/3289] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:00.826735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:00.828264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:00.860426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1bca4-8d3d-4809-b2a9-abd9f69917be None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:00.865591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:00.866463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:00.866742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:00.867794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] PATH_INFO: `/v3/projects/5f74dd980cd74657aa113c80e3da73f0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:00.869480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f74dd980cd74657aa113c80e3da73f0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:00.873541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:00.968822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f74dd980cd74657aa113c80e3da73f0', 'request_id': 'req-59c9dfae-d728-4da4-a571-447990d20736'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:00.981523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f74dd980cd74657aa113c80e3da73f0', 'request_id': 'req-59c9dfae-d728-4da4-a571-447990d20736'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:00.994485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f74dd980cd74657aa113c80e3da73f0', 'request_id': 'req-59c9dfae-d728-4da4-a571-447990d20736'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.025204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d3021-0b6d-48c4-a460-2a778909cf92 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:01.026164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] The token cache is being invalidate because project 5f74dd980cd74657aa113c80e3da73f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:01.026459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.029818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.037196 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1629/3290] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:00 2022] DELETE /identity/v3/projects/5f74dd980cd74657aa113c80e3da73f0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:01.038310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:01.041313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:01.044384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d3021-0b6d-48c4-a460-2a778909cf92 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:01.179418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9dfae-d728-4da4-a571-447990d20736 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:01.186803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:01.187453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:01.187736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:01.188068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:01.190988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:01.194253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:01.195169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:01.195446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:01.196256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] PATH_INFO: `/v3/users/bdcefedd42c140b0a9e7c41d53bb0a38` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:01.197614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdcefedd42c140b0a9e7c41d53bb0a38)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:01.206025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:01.326533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdcefedd42c140b0a9e7c41d53bb0a38'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.339267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdcefedd42c140b0a9e7c41d53bb0a38'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.340116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdcefedd42c140b0a9e7c41d53bb0a38'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.340816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdcefedd42c140b0a9e7c41d53bb0a38'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.353654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d280dafa-6a96-4960-8525-4dd5772d0099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdcefedd42c140b0a9e7c41d53bb0a38'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:01.364052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:01.366278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:01.378397 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1662/3291] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:52:01.407135 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1630/3292] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:01 2022] DELETE /identity/v3/users/bdcefedd42c140b0a9e7c41d53bb0a38 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:02.418849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:02.431220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47f3ec-a69f-40cc-8846-d5d1c30878e7 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:02.513400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:02.514555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:02.515087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:02.515558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] PATH_INFO: `/v3/projects/cd3288e10816476083f8dbbb6f534eff` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:02.517676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3288e10816476083f8dbbb6f534eff)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:02.520159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:02.589398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3288e10816476083f8dbbb6f534eff', 'request_id': 'req-706d2fd9-78c3-4948-8735-86da76ec15eb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:02.598198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3288e10816476083f8dbbb6f534eff', 'request_id': 'req-706d2fd9-78c3-4948-8735-86da76ec15eb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:02.609956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3288e10816476083f8dbbb6f534eff', 'request_id': 'req-706d2fd9-78c3-4948-8735-86da76ec15eb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:02.629461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] The token cache is being invalidate because project cd3288e10816476083f8dbbb6f534eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:02.629915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:02.630765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-706d2fd9-78c3-4948-8735-86da76ec15eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:02.632898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1663/3293] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:02 2022] DELETE /identity/v3/projects/cd3288e10816476083f8dbbb6f534eff => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:02.638440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1e8e5-c4d3-453d-a107-5a1fbd03a521 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:02.638994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1e8e5-c4d3-453d-a107-5a1fbd03a521 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:02.639109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1e8e5-c4d3-453d-a107-5a1fbd03a521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:02.685728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9ee1e8e5-c4d3-453d-a107-5a1fbd03a521 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:02.687556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ee1e8e5-c4d3-453d-a107-5a1fbd03a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:02.798008 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1631/3294] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:02.807973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626f57-a4f1-4a3a-80aa-84a942a36a62 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:02.808265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626f57-a4f1-4a3a-80aa-84a942a36a62 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:02.808544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25626f57-a4f1-4a3a-80aa-84a942a36a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:02.838820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-25626f57-a4f1-4a3a-80aa-84a942a36a62 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:02.840372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25626f57-a4f1-4a3a-80aa-84a942a36a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:02.856061 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1664/3295] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:02.856863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1e8e5-c4d3-453d-a107-5a1fbd03a521 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:02.876637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1e8e5-c4d3-453d-a107-5a1fbd03a521 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:02.889127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:02.889289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:02.889602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:02.889868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:02.890642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:02.891026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:02.894922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:02.925867 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1632/3296] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:52:02.928752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25626f57-a4f1-4a3a-80aa-84a942a36a62 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:02.949426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25626f57-a4f1-4a3a-80aa-84a942a36a62 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:02.966518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:02.967372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:02.967517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:02.967765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:02.968477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:02.974744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:03.042030 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1665/3297] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:02 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:52:03.046128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:03.061344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2880f33-b8a3-4cf5-9390-5a958b26caed admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:03.230334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:03.230941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:03.231223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:03.231497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:03.232416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:03.239284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:03.283124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1633/3298] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:03 2022] POST /identity/v3/users => generated 296 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:52:03.287681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:03.314145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298d614-c7b6-48f8-ab60-81816c43c3e4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:03.322606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:03.323708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:03.323708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:03.323948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:03.325109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:03.327357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:03.380952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:03.381525 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1666/3299] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:03.397029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8d7e5-e60f-4da0-a43c-beb639b4c66a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:03.405389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e848e-2b4e-4283-98da-8359f85d734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:03.406072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e848e-2b4e-4283-98da-8359f85d734d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:03.406535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e848e-2b4e-4283-98da-8359f85d734d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:03.406853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e848e-2b4e-4283-98da-8359f85d734d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:03.408178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e848e-2b4e-4283-98da-8359f85d734d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:03.410937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e848e-2b4e-4283-98da-8359f85d734d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:03.451822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1634/3300] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:03.453088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:03.466317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb300fa-eeb3-4715-a961-3797fa2cf8b1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:03.473000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:03.474294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:03.474881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:03.475392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] PATH_INFO: `/v3/projects/1b7435ea59a346c98eaee9a991bc9bcd/users/3a0bf58eb81e4298a946bdd037751ccd/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:03.497455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7435ea59a346c98eaee9a991bc9bcd, user_id=3a0bf58eb81e4298a946bdd037751ccd, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:03.501456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:03.540540 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1667/3301] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:03 2022] PUT /identity/v3/projects/1b7435ea59a346c98eaee9a991bc9bcd/users/3a0bf58eb81e4298a946bdd037751ccd/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:52:03.551096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f300-20b9-4dd8-8a81-93da8a568e64 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:03.551389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f300-20b9-4dd8-8a81-93da8a568e64 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:03.551667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127f300-20b9-4dd8-8a81-93da8a568e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:03.644232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d127f300-20b9-4dd8-8a81-93da8a568e64 None None] MFA Rules not processed for user `3a0bf58eb81e4298a946bdd037751ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:03.646022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d127f300-20b9-4dd8-8a81-93da8a568e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:03.782286 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1635/3302] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:03.788126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:03.991270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed88fc-01ea-4d0e-918d-a51354d9d10e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:04.014747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:04.025006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:04.032033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:04.033494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:04.036385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:04.042845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:04.128187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1668/3303] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:03 2022] POST /identity/v3/projects => generated 391 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:04.131648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127f300-20b9-4dd8-8a81-93da8a568e64 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:04.158304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127f300-20b9-4dd8-8a81-93da8a568e64 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:04.342915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:04.343785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:04.344281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:04.344705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:04.345737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:04.354764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:04.399647 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1636/3304] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:04 2022] POST /identity/v3/users => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:04.400947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:04.413331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d662e-1533-4f7c-b205-1353794cc425 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:04.421792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:04.424332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:04.424843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:04.425388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:04.432948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:04.435752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:04.458860 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1669/3305] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:04.463527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:04.481944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2cdf3-816f-492f-bd7b-c169bfbaa8e9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:04.509699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:04.511997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:04.512499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:04.512979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] PATH_INFO: `/v3/projects/aa4c082539b1477dac49218af5de65c2/users/3415a2a307bb414181a80030fe40e442/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:04.541093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4c082539b1477dac49218af5de65c2, user_id=3415a2a307bb414181a80030fe40e442, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:04.545764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:04.599382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1637/3306] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:04 2022] PUT /identity/v3/projects/aa4c082539b1477dac49218af5de65c2/users/3415a2a307bb414181a80030fe40e442/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:04.600719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:04.613323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393b26a-9cbb-4d70-9c10-1036b04a1ac0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:04.734613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3ac02-15a7-4366-8383-fceb46ac0d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:04.735407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3ac02-15a7-4366-8383-fceb46ac0d9a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:04.735803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3ac02-15a7-4366-8383-fceb46ac0d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:04.736083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3ac02-15a7-4366-8383-fceb46ac0d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:04.736869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3ac02-15a7-4366-8383-fceb46ac0d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:04.738781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3ac02-15a7-4366-8383-fceb46ac0d9a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:04.763171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:04.772101 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1670/3307] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:04.777482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d077da4-4eaa-4ec8-a5bb-69664ed0bdff admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:04.783816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:04.785316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:04.785674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:04.785872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] PATH_INFO: `/v3/projects/aa4c082539b1477dac49218af5de65c2/users/3415a2a307bb414181a80030fe40e442/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:04.788692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4c082539b1477dac49218af5de65c2, user_id=3415a2a307bb414181a80030fe40e442, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:04.792427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:04.823074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:04.823386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:04.823674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:04.853183 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1638/3308] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:04 2022] PUT /identity/v3/projects/aa4c082539b1477dac49218af5de65c2/users/3415a2a307bb414181a80030fe40e442/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:04.927515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] MFA Rules not processed for user `3415a2a307bb414181a80030fe40e442`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:04.928899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:05.128252 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1671/3309] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:05.977628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:05.979403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:06.117004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540b3c-f08b-4e46-a8c6-62be93a12b01 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:06.125333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:06.126200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:06.127349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:06.127891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:06.264050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:06.266047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:06.283749 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1639/3310] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:07.843866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:07.845890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:07.997118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c138ad-9d7a-4fe9-b0cf-80b1438fe122 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:08.003644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:08.004985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:08.005485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:08.006155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] PATH_INFO: `/v3/users/c5c73f7347e64178b56a8331649c576e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:08.007725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c73f7347e64178b56a8331649c576e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:08.010894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:08.125970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c73f7347e64178b56a8331649c576e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:08.127244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c73f7347e64178b56a8331649c576e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:08.158020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c73f7347e64178b56a8331649c576e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:08.158962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c73f7347e64178b56a8331649c576e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:08.221001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8b2d97fd-ccc8-4a17-8909-a5bcff7c338d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c73f7347e64178b56a8331649c576e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:08.273149 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1672/3311] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:07 2022] DELETE /identity/v3/users/c5c73f7347e64178b56a8331649c576e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:09.408456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:09.422056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4d594-3af5-40ba-b542-4ac49a844522 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:09.498549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:09.500468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:09.501360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:09.501873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] PATH_INFO: `/v3/projects/f61b3dd3880d475b939a8543d9bbf481` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:09.503363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61b3dd3880d475b939a8543d9bbf481)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:09.505490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:09.684355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61b3dd3880d475b939a8543d9bbf481', 'request_id': 'req-2a653ff7-5225-42de-beca-bfcfc9f4f314'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:09.691983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61b3dd3880d475b939a8543d9bbf481', 'request_id': 'req-2a653ff7-5225-42de-beca-bfcfc9f4f314'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:09.705135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61b3dd3880d475b939a8543d9bbf481', 'request_id': 'req-2a653ff7-5225-42de-beca-bfcfc9f4f314'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:09.726641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] The token cache is being invalidate because project f61b3dd3880d475b939a8543d9bbf481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:09.727155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:09.729220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2a653ff7-5225-42de-beca-bfcfc9f4f314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:09.731284 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1640/3312] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:09 2022] DELETE /identity/v3/projects/f61b3dd3880d475b939a8543d9bbf481 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:09.736649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289cfd1-8e2e-4471-a387-6b3ffec89883 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:09.739647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289cfd1-8e2e-4471-a387-6b3ffec89883 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:09.740552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289cfd1-8e2e-4471-a387-6b3ffec89883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:09.769587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f289cfd1-8e2e-4471-a387-6b3ffec89883 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:09.778457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f289cfd1-8e2e-4471-a387-6b3ffec89883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:09.907630 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1673/3313] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:09.915939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065342-28d2-4f9e-9694-4ec6e149058b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:09.916318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065342-28d2-4f9e-9694-4ec6e149058b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:09.916686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065342-28d2-4f9e-9694-4ec6e149058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:09.957547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-39065342-28d2-4f9e-9694-4ec6e149058b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:09.960568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39065342-28d2-4f9e-9694-4ec6e149058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:09.993766 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1641/3314] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:09.994988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289cfd1-8e2e-4471-a387-6b3ffec89883 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.013448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289cfd1-8e2e-4471-a387-6b3ffec89883 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:10.022331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:10.023091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.024089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.024411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.025210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:10.025551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:10.027366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:10.054554 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1674/3315] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:52:10.058820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39065342-28d2-4f9e-9694-4ec6e149058b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.071659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39065342-28d2-4f9e-9694-4ec6e149058b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:10.085455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:10.086362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.086763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.087183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.088560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:10.090701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:10.160569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.168442 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1642/3316] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:10 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:10.178330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fd221-2ae6-4cab-8f47-3aa06ab12fbc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:10.340918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:10.341701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.342062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.342408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.343229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:10.346117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:10.389185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1675/3317] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:10 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:10.392988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.411662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd034-17d9-4413-acb2-ccbb36af026b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:10.424638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:10.425326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.425694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.425972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.426760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:10.431991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:10.454257 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1643/3318] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:10.458089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.469485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27dd713-3ecf-489a-9b7c-51df57e83cfa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:10.474459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e8425-bed8-456d-a885-6c5a1e08e39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:10.475255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8425-bed8-456d-a885-6c5a1e08e39d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.475622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8425-bed8-456d-a885-6c5a1e08e39d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.475968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e8425-bed8-456d-a885-6c5a1e08e39d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.477355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e8425-bed8-456d-a885-6c5a1e08e39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:10.481003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e8425-bed8-456d-a885-6c5a1e08e39d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:10.497688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.510991 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1676/3319] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:52:10.512804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36be60-9805-4d4a-b00c-b05508824ceb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:10.531099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:10.532048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.532367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.532857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] PATH_INFO: `/v3/projects/f75cb675742543209bcbb75d99b60e97/users/60446154374c4fac9315543687cdc0b3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.584193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75cb675742543209bcbb75d99b60e97, user_id=60446154374c4fac9315543687cdc0b3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:10.587849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:10.613588 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1644/3320] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:10 2022] PUT /identity/v3/projects/f75cb675742543209bcbb75d99b60e97/users/60446154374c4fac9315543687cdc0b3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:10.619090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.619391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.619687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.658252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:10.660311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:10.662757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.665483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:10.799050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2dad0-7f25-4fdc-b0de-57664da2cf8f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:10.806510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:10.807319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:10.807772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:10.808139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:10.810473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:10.840580 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1677/3321] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:10.907149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:10.908862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:10.964401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:10.970737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:11.010005 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1645/3322] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:11.046663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eb270-9693-45d6-a24c-0e096747e622 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:11.056074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:11.056741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:11.057022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:11.057298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:11.077064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:11.078523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:11.106056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1678/3323] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:52:11.477951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:11.479456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:11.507133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fc1e6-9403-4893-9fd8-48540590731a service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:11.512707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:11.513605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:11.513886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:11.514159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] PATH_INFO: `/v3/users/29d121c7d37142d6a935ae607c0e062b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:11.518895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d121c7d37142d6a935ae607c0e062b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:11.521133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:11.620110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d121c7d37142d6a935ae607c0e062b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:11.643729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d121c7d37142d6a935ae607c0e062b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:11.644498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d121c7d37142d6a935ae607c0e062b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:11.645126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d121c7d37142d6a935ae607c0e062b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:11.663099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1a959a4f-ef7e-4a9c-a665-fe1536442484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d121c7d37142d6a935ae607c0e062b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:11.695935 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1646/3324] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:11 2022] DELETE /identity/v3/users/29d121c7d37142d6a935ae607c0e062b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:12.804668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:12.818972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e86e1-5138-4556-b4f8-77cf265f6d2a service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:12.925422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:12.926836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:12.927444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:12.930594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] PATH_INFO: `/v3/projects/00dedc5654754e7fbb60abf79a14666e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:12.932531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00dedc5654754e7fbb60abf79a14666e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:12.934707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:13.044984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00dedc5654754e7fbb60abf79a14666e', 'request_id': 'req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:13.054102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00dedc5654754e7fbb60abf79a14666e', 'request_id': 'req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:13.089643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00dedc5654754e7fbb60abf79a14666e', 'request_id': 'req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:13.112520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] The token cache is being invalidate because project 00dedc5654754e7fbb60abf79a14666e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:13.112938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:13.114208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2c2d37fb-2968-4a6b-8a06-ae4fa2bdd6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:13.139784 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1679/3325] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:12 2022] DELETE /identity/v3/projects/00dedc5654754e7fbb60abf79a14666e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:13.141683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab074-bd3d-4c6c-b4e0-dd4a483932f7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.142129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab074-bd3d-4c6c-b4e0-dd4a483932f7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.142129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ab074-bd3d-4c6c-b4e0-dd4a483932f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.174562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d53ab074-bd3d-4c6c-b4e0-dd4a483932f7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:13.184866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d53ab074-bd3d-4c6c-b4e0-dd4a483932f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:13.339523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1647/3326] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:13.348236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafd27-579d-43df-8477-201f34d248da None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.348789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafd27-579d-43df-8477-201f34d248da None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.349229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecafd27-579d-43df-8477-201f34d248da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.385903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3ecafd27-579d-43df-8477-201f34d248da None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:13.393287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3ecafd27-579d-43df-8477-201f34d248da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:13.411257 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1680/3327] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:13.417592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab074-bd3d-4c6c-b4e0-dd4a483932f7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:13.436504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ab074-bd3d-4c6c-b4e0-dd4a483932f7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:13.446088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:13.447306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.447798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.448331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.450191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:13.450997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:13.454183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:13.486921 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1648/3328] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:52:13.490456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafd27-579d-43df-8477-201f34d248da None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:13.502621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecafd27-579d-43df-8477-201f34d248da None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:13.519638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:13.520557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.521035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.521471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.522352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:13.525764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:13.598610 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1681/3329] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:13 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:52:13.604035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:13.618384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f44a70-813f-421d-83ed-446d44a66cd4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:13.753046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:13.753655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.755808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.756105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.758986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:13.762570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:13.803650 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1649/3330] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:13 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:13.806864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:13.821241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcdcecc-f10e-471e-99a5-129d6b18cd99 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:13.832892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:13.833678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.834148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.834680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.836584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:13.842484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:13.869304 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1682/3331] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:13.872822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:13.885582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c87655-705d-4d6f-b94c-cc8d9a280129 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:13.898087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02292a46-02f6-494f-83ae-5191b15373f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:13.899659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292a46-02f6-494f-83ae-5191b15373f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.900162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292a46-02f6-494f-83ae-5191b15373f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.900600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02292a46-02f6-494f-83ae-5191b15373f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.901504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292a46-02f6-494f-83ae-5191b15373f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:13.909162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02292a46-02f6-494f-83ae-5191b15373f7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:13.931140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1650/3332] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:13.935744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:13.950483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4001b3-95a5-40f8-9cf8-864aa497a925 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:13.962241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:13.963361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:13.963642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:13.963962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] PATH_INFO: `/v3/projects/561130cf49e5493988451055404d1146/users/92aa3e30b4984c7db37325d0ce498d3d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:13.999957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561130cf49e5493988451055404d1146, user_id=92aa3e30b4984c7db37325d0ce498d3d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:14.002795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:14.094183 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1683/3333] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:13 2022] PUT /identity/v3/projects/561130cf49e5493988451055404d1146/users/92aa3e30b4984c7db37325d0ce498d3d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:14.106709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa40ed-44d6-4f10-bb55-dad8cb6a7e3d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:14.107215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa40ed-44d6-4f10-bb55-dad8cb6a7e3d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:14.107411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa40ed-44d6-4f10-bb55-dad8cb6a7e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:14.163686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-94fa40ed-44d6-4f10-bb55-dad8cb6a7e3d None None] MFA Rules not processed for user `92aa3e30b4984c7db37325d0ce498d3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:14.164972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-94fa40ed-44d6-4f10-bb55-dad8cb6a7e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:14.368659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1651/3334] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:14.813823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:14.817020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:14.963892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b620ec-006e-4277-86d0-316af6e12912 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:14.990762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:14.993602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:14.994131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:14.994668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:15.010112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:15.012873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:15.046029 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1684/3335] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:16.730686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa40ed-44d6-4f10-bb55-dad8cb6a7e3d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:16.744306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa40ed-44d6-4f10-bb55-dad8cb6a7e3d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:16.750733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaecfea-a550-4e2a-b604-154142c604e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:16.755593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaecfea-a550-4e2a-b604-154142c604e7 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:16.755880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaecfea-a550-4e2a-b604-154142c604e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:16.756163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaecfea-a550-4e2a-b604-154142c604e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:16.761104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3eaecfea-a550-4e2a-b604-154142c604e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:16.837118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaecfea-a550-4e2a-b604-154142c604e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:16.838750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaecfea-a550-4e2a-b604-154142c604e7 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:16.851020 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1652/3336] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:18.388453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:18.403808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3cbb-a3b6-46ec-863c-39c2751e22f1 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:18.413430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73b4b1-f978-4c7d-a718-1f5bbb24e36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:18.415107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b4b1-f978-4c7d-a718-1f5bbb24e36f service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:18.415580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b4b1-f978-4c7d-a718-1f5bbb24e36f service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:18.416043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73b4b1-f978-4c7d-a718-1f5bbb24e36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:18.418615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dd73b4b1-f978-4c7d-a718-1f5bbb24e36f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:18.496909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73b4b1-f978-4c7d-a718-1f5bbb24e36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:18.498639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73b4b1-f978-4c7d-a718-1f5bbb24e36f service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:18.520250 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1685/3337] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:21.526707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:21.527330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:21.527729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:21.574376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] MFA Rules not processed for user `a2d5596fa4984ceab3525ffc0a14d48f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:21.575897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:21.585401 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1653/3338] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:22.442549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830ae07-ff13-4120-95fb-9840766d7567 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:22.443962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830ae07-ff13-4120-95fb-9840766d7567 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:22.445075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830ae07-ff13-4120-95fb-9840766d7567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:22.486128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6830ae07-ff13-4120-95fb-9840766d7567 None None] MFA Rules not processed for user `60446154374c4fac9315543687cdc0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:22.487378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6830ae07-ff13-4120-95fb-9840766d7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:22.610289 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1686/3339] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:22.614463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:22.617282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:22.828623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7c552-60b8-4481-9b6b-addf75e1f008 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:22.851022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:22.851817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:22.852034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:22.852312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:22.853028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:22.855800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:22.895908 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1654/3340] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:22 2022] POST /identity/v3/projects => generated 389 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:22.900296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830ae07-ff13-4120-95fb-9840766d7567 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:22.915756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830ae07-ff13-4120-95fb-9840766d7567 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:23.040843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:23.041782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:23.043930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:23.044541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:23.047232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:23.060453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:23.121373 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1687/3341] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:22 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:23.125454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:23.134025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:23.144774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7128d-f7a3-4a76-9513-19734c35096e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:23.159239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:23.159912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:23.160249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:23.160536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:23.161467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:23.166911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:23.183348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8a4d-962e-4b4f-8560-796ac45d6e8f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:23.197944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1655/3342] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:52:23.199277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:23.230208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:23.231131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:23.231410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:23.231677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] PATH_INFO: `/v3/users/92aa3e30b4984c7db37325d0ce498d3d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:23.234388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=92aa3e30b4984c7db37325d0ce498d3d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:23.235065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59d8e-2e58-45e9-9f03-4393741c3530 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:23.236367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:23.248115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:23.250798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:23.251545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:23.252414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] PATH_INFO: `/v3/projects/776799dc9f9540fbaa14d08d316b0eef/users/64f95294dd51410894a99fba07bdfe9d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:23.288421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776799dc9f9540fbaa14d08d316b0eef, user_id=64f95294dd51410894a99fba07bdfe9d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:23.293430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:23.322903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1656/3343] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:23 2022] PUT /identity/v3/projects/776799dc9f9540fbaa14d08d316b0eef/users/64f95294dd51410894a99fba07bdfe9d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:23.326698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:23.427153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92aa3e30b4984c7db37325d0ce498d3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:23.428742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92aa3e30b4984c7db37325d0ce498d3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:23.440603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92aa3e30b4984c7db37325d0ce498d3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:23.446141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92aa3e30b4984c7db37325d0ce498d3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:23.469249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-94cad475-bfc7-471a-8dfe-ec3950e95cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92aa3e30b4984c7db37325d0ce498d3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:23.486924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88330d9f-4090-41ad-8e67-0c0ace906d25 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:23.499937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:23.507798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:23.508600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:23.509181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:23.510701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:23.512558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:23.526702 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1688/3344] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:23 2022] DELETE /identity/v3/users/92aa3e30b4984c7db37325d0ce498d3d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:23.541262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:23.541552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:23.541829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:23.552196 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1657/3345] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:23.557960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:23.560414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:23.583913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51a26-856a-42b5-b982-b0b320d5bdbf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:23.597940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:23.600043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:23.685128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:23.686706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:23.687264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:23.687781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] PATH_INFO: `/v3/projects/776799dc9f9540fbaa14d08d316b0eef/users/64f95294dd51410894a99fba07bdfe9d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:23.690335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=776799dc9f9540fbaa14d08d316b0eef, user_id=64f95294dd51410894a99fba07bdfe9d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:23.694724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:23.709331 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1658/3346] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:23 2022] PUT /identity/v3/projects/776799dc9f9540fbaa14d08d316b0eef/users/64f95294dd51410894a99fba07bdfe9d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:23.829848 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1689/3347] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:23.859282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:23.862272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:24.044463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:24.047001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:24.103133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4f9b9-6e50-40bc-aa41-1fac6ebd8aae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:24.119449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49829754-4736-4e5b-9939-7300a9294eb1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:24.136166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f84d9e-8a4f-4c2d-bd73-7fa461380959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:24.136860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f84d9e-8a4f-4c2d-bd73-7fa461380959 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:24.142268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f84d9e-8a4f-4c2d-bd73-7fa461380959 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:24.142585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f84d9e-8a4f-4c2d-bd73-7fa461380959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:24.310144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:24.315253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:24.316890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:24.318306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] PATH_INFO: `/v3/users/3a0bf58eb81e4298a946bdd037751ccd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:24.321304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0bf58eb81e4298a946bdd037751ccd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:24.338596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:24.368530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f84d9e-8a4f-4c2d-bd73-7fa461380959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:24.371956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f84d9e-8a4f-4c2d-bd73-7fa461380959 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:24.417274 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1659/3348] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:24.501936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0bf58eb81e4298a946bdd037751ccd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:24.504220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0bf58eb81e4298a946bdd037751ccd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:24.525542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0bf58eb81e4298a946bdd037751ccd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:24.529141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0bf58eb81e4298a946bdd037751ccd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:24.549247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0bf58eb81e4298a946bdd037751ccd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:24.582191 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1690/3349] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:24 2022] DELETE /identity/v3/users/3a0bf58eb81e4298a946bdd037751ccd => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:24.583451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82219ec-ab6a-41e6-b74b-20f9d43d31d5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:24.584000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82219ec-ab6a-41e6-b74b-20f9d43d31d5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:24.584309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82219ec-ab6a-41e6-b74b-20f9d43d31d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:24.631998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a82219ec-ab6a-41e6-b74b-20f9d43d31d5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:24.634733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a82219ec-ab6a-41e6-b74b-20f9d43d31d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:24.870231 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1660/3350] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:24.883237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:24.887173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:25.071826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f0dca-8542-4c4c-b1c2-9619d019594a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:25.082329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:25.085051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:25.085355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:25.086739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:25.111263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:25.115176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:25.169295 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1691/3351] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:25.345490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:25.346023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:25.346596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:25.426195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:25.433351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:25.653585 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1661/3352] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:52:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:25.670425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:25.672818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:25.880632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22fab4-3c82-403c-8ce1-479e4618c013 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:25.889032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:25.889963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:25.890392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:25.890857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:25.901973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:25.906727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:25.944062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1692/3353] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:52:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:52:25.982968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:25.984675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:26.050916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84620bb1-9598-43e0-b5a4-1cf0753846a1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:26.076852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:26.083596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:26.086408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:26.088111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] PATH_INFO: `/v3/projects/1b7435ea59a346c98eaee9a991bc9bcd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:26.093242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7435ea59a346c98eaee9a991bc9bcd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:26.100876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:26.271866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7435ea59a346c98eaee9a991bc9bcd', 'request_id': 'req-51186c71-728c-46cf-b44e-f59838d62d5f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.289331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7435ea59a346c98eaee9a991bc9bcd', 'request_id': 'req-51186c71-728c-46cf-b44e-f59838d62d5f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.313113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7435ea59a346c98eaee9a991bc9bcd', 'request_id': 'req-51186c71-728c-46cf-b44e-f59838d62d5f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.389223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] The token cache is being invalidate because project 1b7435ea59a346c98eaee9a991bc9bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:26.397202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.401458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51186c71-728c-46cf-b44e-f59838d62d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.407555 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1662/3354] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:25 2022] DELETE /identity/v3/projects/1b7435ea59a346c98eaee9a991bc9bcd => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:26.420831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:26.423051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:26.423543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:26.424029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:26.463805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e695e2c-f8fa-4e1e-ab95-4a0788f58335 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:26.501138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] MFA Rules not processed for user `8e35b8f3a2eb4ed98800638dd51618ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:26.511347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:26.642443 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1663/3355] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:26.645065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:26.649699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:26.678083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:26.679062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:26.680197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:26.680685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] PATH_INFO: `/v3/users/3415a2a307bb414181a80030fe40e442` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:26.683297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3415a2a307bb414181a80030fe40e442)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:26.686145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:26.796902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3415a2a307bb414181a80030fe40e442'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.800291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3415a2a307bb414181a80030fe40e442'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.840412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3415a2a307bb414181a80030fe40e442'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.843423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3415a2a307bb414181a80030fe40e442'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.863327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde84e23-3546-4c8a-b47d-b8b1f50ebb24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3415a2a307bb414181a80030fe40e442'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:26.884478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35856e4-deb7-4461-b0dc-a2b455ddff83 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:26.891304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:26.892899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:26.893438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:26.893970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] PATH_INFO: `/v3/projects/561130cf49e5493988451055404d1146` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:26.896341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=561130cf49e5493988451055404d1146)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:26.904573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:26.937862 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1693/3356] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:26 2022] DELETE /identity/v3/users/3415a2a307bb414181a80030fe40e442 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:27.001437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561130cf49e5493988451055404d1146', 'request_id': 'req-9848d951-b00c-49a1-a687-384f35735015'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:27.009521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561130cf49e5493988451055404d1146', 'request_id': 'req-9848d951-b00c-49a1-a687-384f35735015'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:27.038441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561130cf49e5493988451055404d1146', 'request_id': 'req-9848d951-b00c-49a1-a687-384f35735015'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:27.066582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] The token cache is being invalidate because project 561130cf49e5493988451055404d1146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:27.067181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:27.069180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9848d951-b00c-49a1-a687-384f35735015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:27.073696 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1664/3357] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:26 2022] DELETE /identity/v3/projects/561130cf49e5493988451055404d1146 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:27.079957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10c49-8657-4526-9c07-5b0409ab1034 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:27.080448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10c49-8657-4526-9c07-5b0409ab1034 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:27.081074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a10c49-8657-4526-9c07-5b0409ab1034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:27.171599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e4a10c49-8657-4526-9c07-5b0409ab1034 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:27.172945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4a10c49-8657-4526-9c07-5b0409ab1034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:27.381119 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1694/3358] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:27.389164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a125-4a9a-44e8-ab43-ea8c0c4c8894 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:27.389603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a125-4a9a-44e8-ab43-ea8c0c4c8894 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:27.390006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a125-4a9a-44e8-ab43-ea8c0c4c8894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:27.457190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ef22a125-4a9a-44e8-ab43-ea8c0c4c8894 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:27.469209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ef22a125-4a9a-44e8-ab43-ea8c0c4c8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:27.525148 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1665/3359] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:27.529615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a10c49-8657-4526-9c07-5b0409ab1034 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:27.572023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a10c49-8657-4526-9c07-5b0409ab1034 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:27.590293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:27.593798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:27.595571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:27.596521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:27.597546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:27.597645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:27.599304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:27.639343 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1695/3360] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:52:27.643712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a125-4a9a-44e8-ab43-ea8c0c4c8894 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:27.659300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a125-4a9a-44e8-ab43-ea8c0c4c8894 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:27.672332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:27.673405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:27.673911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:27.674409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:27.675405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:27.687785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:27.745451 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1666/3361] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:27 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:27.753010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:27.772364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409bae53-4805-4e43-8995-9da1ce9a25f2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:27.888120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:27.889761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:27.890178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:27.890611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:27.891459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:27.894335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:27.933773 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1696/3362] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:27 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:27.935101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:27.949298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1df4-8fa3-485c-b3d1-8aa62966a2c2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:27.956721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:27.958081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:27.958376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:27.958652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:27.959476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:27.962583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:27.979407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:27.982505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:27.997158 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1667/3363] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:27.997656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:28.027231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e681ad8-a521-4a4e-abd8-830995b77b76 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:28.035721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d31e8-e2b6-4cec-90ff-cd4845a3b3b6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:28.038412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:28.043573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.044483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.045153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] PATH_INFO: `/v3/projects/aa4c082539b1477dac49218af5de65c2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.052492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:28.053218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.053508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.053853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.054540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:28.058225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:28.072264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4c082539b1477dac49218af5de65c2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:28.078455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:28.085342 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1668/3364] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:28.088089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:28.112267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51360b7c-dcb3-47ea-b19d-e2e489d687d6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:28.136201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f54335-c083-4526-81ab-f32ecc855c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:28.137107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f54335-c083-4526-81ab-f32ecc855c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.137402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f54335-c083-4526-81ab-f32ecc855c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.137662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f54335-c083-4526-81ab-f32ecc855c8e admin admin] PATH_INFO: `/v3/projects/ebeab82cd8e44ded895875eddba72d7c/users/b902f15f51f54d9eadaf39c00d2c6b0e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.168802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f54335-c083-4526-81ab-f32ecc855c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebeab82cd8e44ded895875eddba72d7c, user_id=b902f15f51f54d9eadaf39c00d2c6b0e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:28.175737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f54335-c083-4526-81ab-f32ecc855c8e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:28.193193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4c082539b1477dac49218af5de65c2', 'request_id': 'req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:28.219387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4c082539b1477dac49218af5de65c2', 'request_id': 'req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:28.223175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1669/3365] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:28 2022] PUT /identity/v3/projects/ebeab82cd8e44ded895875eddba72d7c/users/b902f15f51f54d9eadaf39c00d2c6b0e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:52:28.229052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.229392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.229721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.235767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4c082539b1477dac49218af5de65c2', 'request_id': 'req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:28.262955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] The token cache is being invalidate because project aa4c082539b1477dac49218af5de65c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:28.263209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:28.264281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe45f5c3-0a95-48a4-8d14-b518200ebb6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:28.266277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:28.268198 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1697/3366] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:27 2022] DELETE /identity/v3/projects/aa4c082539b1477dac49218af5de65c2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:52:28.268457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:28.272774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54b41a-de72-4d02-ab9d-f063fcc9cae4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.273124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54b41a-de72-4d02-ab9d-f063fcc9cae4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.274201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54b41a-de72-4d02-ab9d-f063fcc9cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.306987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3c54b41a-de72-4d02-ab9d-f063fcc9cae4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:28.308196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3c54b41a-de72-4d02-ab9d-f063fcc9cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:28.414253 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1670/3367] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:28.426520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:28.428680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:28.452218 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1698/3368] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:28.455156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e41d3-8ae7-4267-9108-9e452efe6326 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.455527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e41d3-8ae7-4267-9108-9e452efe6326 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.455811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e41d3-8ae7-4267-9108-9e452efe6326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.494286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4d8e41d3-8ae7-4267-9108-9e452efe6326 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:28.496910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4d8e41d3-8ae7-4267-9108-9e452efe6326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:28.532521 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1699/3369] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:28.533812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e41d3-8ae7-4267-9108-9e452efe6326 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:28.566596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e41d3-8ae7-4267-9108-9e452efe6326 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:28.587013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:28.587694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.588058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.588241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.588974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:28.589284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:28.604216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:28.657019 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1700/3370] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:52:28.658073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:28.659913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba833f7-1ab7-4623-a615-10a1a57be1e6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:28.672837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:28.674335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.674854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.675312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.682599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37902dec-2c8e-4122-a5be-f953a590b618 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:28.697150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:28.697795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:28.698476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:28.698755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:28.699559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:28.700546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:28.701246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:28.724947 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1671/3371] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:52:28.740401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:28.843086 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1701/3372] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:28 2022] POST /identity/v3/projects => generated 395 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:28.847353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:28.868129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63cf3c-9cdc-410c-ad7f-92b808a08732 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:29.100626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:29.102751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:29.104377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:29.105420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:29.108055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:29.114132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:29.204364 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1672/3373] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:28 2022] POST /identity/v3/users => generated 298 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:29.207385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:29.221345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac84cfd-ccae-467a-a768-db217db06714 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:29.226654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:29.227519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:29.228254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:29.228730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:29.230195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:29.232540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:29.248048 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1702/3374] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:52:29.254662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:29.276270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1309ba4-e9bc-4067-bfd7-1131c1ed2181 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:29.299671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8044e4-459b-4b57-b059-d57bf20323cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:29.301579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8044e4-459b-4b57-b059-d57bf20323cf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:29.303055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8044e4-459b-4b57-b059-d57bf20323cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:29.303435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8044e4-459b-4b57-b059-d57bf20323cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:29.310052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8044e4-459b-4b57-b059-d57bf20323cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:29.316425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8044e4-459b-4b57-b059-d57bf20323cf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:29.336300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:29.336954 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1673/3375] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:29.393652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bff71e-e57f-490a-8512-d2961b8d3993 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:29.421040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:29.423548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:29.425191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:29.427158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] PATH_INFO: `/v3/projects/4642753b5d1548038be79eb12ce7b20b/users/bc1c955ccc0c48dcbb11eba3718d7865/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:29.465364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4642753b5d1548038be79eb12ce7b20b, user_id=bc1c955ccc0c48dcbb11eba3718d7865, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:29.473257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:29.509138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d704a-6e2b-4cf0-81cc-1d3a7a9e09ea None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:29.509701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d704a-6e2b-4cf0-81cc-1d3a7a9e09ea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:29.510352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d704a-6e2b-4cf0-81cc-1d3a7a9e09ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:29.517991 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1703/3376] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:29 2022] PUT /identity/v3/projects/4642753b5d1548038be79eb12ce7b20b/users/bc1c955ccc0c48dcbb11eba3718d7865/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:29.554209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f94d704a-6e2b-4cf0-81cc-1d3a7a9e09ea None None] MFA Rules not processed for user `bc1c955ccc0c48dcbb11eba3718d7865`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:29.556427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f94d704a-6e2b-4cf0-81cc-1d3a7a9e09ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:29.815908 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1674/3377] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:29.821101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:29.982113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8e668-d7c7-4595-b250-96b9e3967a15 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:30.015129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:30.015965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:30.016587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:30.017016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:30.017758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:30.021155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:30.118102 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1704/3378] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:29 2022] POST /identity/v3/projects => generated 393 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:30.121802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d704a-6e2b-4cf0-81cc-1d3a7a9e09ea None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:30.165144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d704a-6e2b-4cf0-81cc-1d3a7a9e09ea None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:30.423171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:30.424164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:30.426947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:30.429442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:30.432123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:30.437542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:30.523454 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1675/3379] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:30 2022] POST /identity/v3/users => generated 303 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:30.528235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:30.548061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e885c-9160-4ce9-a9cf-246b82bbfaec admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:30.560933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:30.562139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:30.562980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:30.563504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:30.564456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:30.568222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:30.627972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1705/3380] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:30.633258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:30.652717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932459f-fe90-47ac-9eab-929269db8d72 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:30.682400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:30.688065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:30.688553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:30.689354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] PATH_INFO: `/v3/projects/05250a914cc243099a43a26636874755/users/887bae4afdd641628d0f256174bf1755/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:30.741268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=05250a914cc243099a43a26636874755, user_id=887bae4afdd641628d0f256174bf1755, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:30.766153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:30.793926 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1676/3381] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:30 2022] PUT /identity/v3/projects/05250a914cc243099a43a26636874755/users/887bae4afdd641628d0f256174bf1755/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:52:30.797871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:30.827600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735c022-4134-4074-97ae-5f9a4842d5d1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:31.027828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f10bf-b106-4a78-b756-95458951232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:31.028407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f10bf-b106-4a78-b756-95458951232c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:31.028632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f10bf-b106-4a78-b756-95458951232c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:31.029359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f10bf-b106-4a78-b756-95458951232c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:31.029605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f10bf-b106-4a78-b756-95458951232c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:31.031256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f10bf-b106-4a78-b756-95458951232c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:31.059095 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1706/3382] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:31.060274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:31.073751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23420832-84c0-4daa-8441-cbb33bf39dfb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:31.090966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76217505-6130-472c-8c3f-3596e123ea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:31.092290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217505-6130-472c-8c3f-3596e123ea25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:31.092574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217505-6130-472c-8c3f-3596e123ea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:31.092845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76217505-6130-472c-8c3f-3596e123ea25 admin admin] PATH_INFO: `/v3/projects/05250a914cc243099a43a26636874755/users/887bae4afdd641628d0f256174bf1755/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:31.100888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76217505-6130-472c-8c3f-3596e123ea25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05250a914cc243099a43a26636874755, user_id=887bae4afdd641628d0f256174bf1755, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:31.106647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76217505-6130-472c-8c3f-3596e123ea25 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:31.155889 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1677/3383] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:31 2022] PUT /identity/v3/projects/05250a914cc243099a43a26636874755/users/887bae4afdd641628d0f256174bf1755/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:31.158389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:31.159123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:31.159741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:31.220329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] MFA Rules not processed for user `887bae4afdd641628d0f256174bf1755`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:31.222058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:31.456068 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1707/3384] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:31.466756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6cec-8b01-4091-9ca0-62b442e7d40d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:31.467369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6cec-8b01-4091-9ca0-62b442e7d40d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:31.471730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef6cec-8b01-4091-9ca0-62b442e7d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:31.548969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f1ef6cec-8b01-4091-9ca0-62b442e7d40d None None] MFA Rules not processed for user `bc1c955ccc0c48dcbb11eba3718d7865`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:31.550182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1ef6cec-8b01-4091-9ca0-62b442e7d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:31.703986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1678/3385] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:32.735986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:32.740035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:32.950828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabd74c-c452-4b4b-a46a-de7cb25bcb6d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:32.966745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:32.967568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:32.967858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:32.968142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:32.991264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:32.996036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:33.023130 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1708/3386] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:33.862817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:33.863974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:33.864486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:33.930244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] MFA Rules not processed for user `b902f15f51f54d9eadaf39c00d2c6b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:33.932632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:34.094469 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1679/3387] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:35.082227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:35.102643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd5f76-cad3-45f6-80d6-2bd396ce1715 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:35.119958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:35.120642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:35.123335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:35.123654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:35.173014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:35.174666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:35.208761 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1709/3388] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:43.371717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:43.373827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:43.512421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d633f7c-4ee2-4262-ba41-54e0a39f7778 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:43.531882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:43.535106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:43.536234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:43.537342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] PATH_INFO: `/v3/users/eedcf10ae62840029976cb842190a948` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:43.539174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedcf10ae62840029976cb842190a948)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:43.541726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:43.619349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedcf10ae62840029976cb842190a948'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:43.629213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedcf10ae62840029976cb842190a948'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:43.630340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedcf10ae62840029976cb842190a948'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:43.631305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedcf10ae62840029976cb842190a948'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:43.644234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c856ffaa-8d12-4519-850c-8ff99b6454da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedcf10ae62840029976cb842190a948'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:43.675091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1680/3389] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:43 2022] DELETE /identity/v3/users/eedcf10ae62840029976cb842190a948 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:44.724764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:44.754832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd5d44-1718-466f-b685-23aa340e7dda service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:44.856653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:44.857524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:44.857806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:44.858080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] PATH_INFO: `/v3/projects/aa1cd49355d840abbda4ccda9d86705f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:44.862717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1cd49355d840abbda4ccda9d86705f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:44.866037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:44.946880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1cd49355d840abbda4ccda9d86705f', 'request_id': 'req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:44.955630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1cd49355d840abbda4ccda9d86705f', 'request_id': 'req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:44.966076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1cd49355d840abbda4ccda9d86705f', 'request_id': 'req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:44.991220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] The token cache is being invalidate because project aa1cd49355d840abbda4ccda9d86705f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:44.992523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:44.993476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f38bb36f-88d7-4ef5-a008-d08a72b03c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:44.997295 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1710/3390] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:44 2022] DELETE /identity/v3/projects/aa1cd49355d840abbda4ccda9d86705f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:45.001835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b14e7-93d6-4546-a0c7-7216c23b73a4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.002633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b14e7-93d6-4546-a0c7-7216c23b73a4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.003136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b14e7-93d6-4546-a0c7-7216c23b73a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.039506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d87b14e7-93d6-4546-a0c7-7216c23b73a4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:45.041712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d87b14e7-93d6-4546-a0c7-7216c23b73a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:45.164844 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1681/3391] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:45.172401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afe68e-5a2d-4b47-ad14-adc6f44c1ed2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.172694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afe68e-5a2d-4b47-ad14-adc6f44c1ed2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.173256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afe68e-5a2d-4b47-ad14-adc6f44c1ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.208167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-52afe68e-5a2d-4b47-ad14-adc6f44c1ed2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:45.209124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-52afe68e-5a2d-4b47-ad14-adc6f44c1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:45.236484 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1711/3392] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:45.240753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b14e7-93d6-4546-a0c7-7216c23b73a4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:45.264428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b14e7-93d6-4546-a0c7-7216c23b73a4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:45.271597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:45.272457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.273851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.274907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.276803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:45.278313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:45.285190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:45.301420 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1682/3393] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:52:45.306213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afe68e-5a2d-4b47-ad14-adc6f44c1ed2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:45.318806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afe68e-5a2d-4b47-ad14-adc6f44c1ed2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:45.324858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:45.325473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.325747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.326047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.327046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:45.328722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:45.367384 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1712/3394] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:45 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:52:45.370740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:45.382239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f41515-9d29-4911-b5f5-d54f0a28c810 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:45.467133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:45.468333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.468790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.469487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.470382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:45.473863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:45.529870 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1683/3395] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:45 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:45.531821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:45.551800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec8cf3-1fac-4821-946a-6af4d58edaac admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:45.561496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:45.562750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.563083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.563362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.564761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:45.567303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:45.582213 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1713/3396] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:45.586614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:45.596833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30fce4-8f4f-4653-93f7-e1dec4200a12 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:45.603099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0003ad-e5e2-4bd3-8bc4-c42c4394197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:45.604069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0003ad-e5e2-4bd3-8bc4-c42c4394197e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.604662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0003ad-e5e2-4bd3-8bc4-c42c4394197e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.605177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0003ad-e5e2-4bd3-8bc4-c42c4394197e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.606141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0003ad-e5e2-4bd3-8bc4-c42c4394197e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:45.608287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0003ad-e5e2-4bd3-8bc4-c42c4394197e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:45.623748 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1684/3397] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:45.625144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:45.635909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3aab5-8fa1-4cad-b8a6-1edf00c83d2d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:45.642878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3ebc2-064b-4031-8243-dd54e032d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:45.644179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ebc2-064b-4031-8243-dd54e032d37c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.644706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ebc2-064b-4031-8243-dd54e032d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.645218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ebc2-064b-4031-8243-dd54e032d37c admin admin] PATH_INFO: `/v3/projects/09fe0f4d227c4e7d9c5c8afafd82f975/users/5d64d1550858400a8a7804dcdb7a0110/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.666836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ebc2-064b-4031-8243-dd54e032d37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09fe0f4d227c4e7d9c5c8afafd82f975, user_id=5d64d1550858400a8a7804dcdb7a0110, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:45.670217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ebc2-064b-4031-8243-dd54e032d37c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:45.719485 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1714/3398] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:45 2022] PUT /identity/v3/projects/09fe0f4d227c4e7d9c5c8afafd82f975/users/5d64d1550858400a8a7804dcdb7a0110/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:45.721213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.721569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.721853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.756574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] MFA Rules not processed for user `5d64d1550858400a8a7804dcdb7a0110`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:45.757880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:45.839638 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1685/3399] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:45.843694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d8bf3-5526-4c7b-9292-b81c7b757f82 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:45.844231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d8bf3-5526-4c7b-9292-b81c7b757f82 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:45.845244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d8bf3-5526-4c7b-9292-b81c7b757f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:45.866994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a72d8bf3-5526-4c7b-9292-b81c7b757f82 None None] MFA Rules not processed for user `5d64d1550858400a8a7804dcdb7a0110`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:45.868414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a72d8bf3-5526-4c7b-9292-b81c7b757f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:45.876656 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1715/3400] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:45.970378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:45.972503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:46.054268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee915bc1-a0f8-4500-be0e-4f6e4b0cfb9d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:46.057212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:46.058311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:46.058594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:46.058899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] PATH_INFO: `/v3/users/809d6c48e931489cba4e521b9a42e097` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:46.060165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=809d6c48e931489cba4e521b9a42e097)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:46.062362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:46.119122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809d6c48e931489cba4e521b9a42e097'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:46.142180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809d6c48e931489cba4e521b9a42e097'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:46.142180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809d6c48e931489cba4e521b9a42e097'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:46.142180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809d6c48e931489cba4e521b9a42e097'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:46.145532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:46.146105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:46.146868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:46.157452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809d6c48e931489cba4e521b9a42e097'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:46.186888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1686/3401] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:45 2022] DELETE /identity/v3/users/809d6c48e931489cba4e521b9a42e097 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:46.235635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] MFA Rules not processed for user `64f95294dd51410894a99fba07bdfe9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:46.236914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:46.358933 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1716/3402] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:46.377929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:46.379416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:46.458995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:46.460759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:46.585366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af8e25-d88c-427c-8b66-e2a3704810e7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:46.592016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:46.592945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:46.593669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:46.594123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:46.598420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:46.628741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25f5a5-edf7-448e-b79f-a4604496e023 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:46.645838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:46.646667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:46.647088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:46.647458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:46.655574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:46.700853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:46.703271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:46.719058 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1687/3403] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:46.721432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:46.722989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:46.836802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:46.838440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:46.850115 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1717/3404] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:52:46.866275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82511ae1-dbc8-4199-b874-e47c6d832558 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:46.873165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:46.874724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:46.874985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:46.875261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] PATH_INFO: `/v3/projects/85f29512cce1477d94e91ae394ecbbcb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:46.880165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f29512cce1477d94e91ae394ecbbcb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:46.883831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:47.007439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f29512cce1477d94e91ae394ecbbcb', 'request_id': 'req-74d05602-19c6-4175-a066-27187282d085'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.016578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f29512cce1477d94e91ae394ecbbcb', 'request_id': 'req-74d05602-19c6-4175-a066-27187282d085'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.044410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f29512cce1477d94e91ae394ecbbcb', 'request_id': 'req-74d05602-19c6-4175-a066-27187282d085'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.090059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] The token cache is being invalidate because project 85f29512cce1477d94e91ae394ecbbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:47.092097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.092870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.095314 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1688/3405] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:46 2022] DELETE /identity/v3/projects/85f29512cce1477d94e91ae394ecbbcb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:47.099310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:47.128491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f696b-3a47-41f3-af04-e24277ed42b2 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:47.308449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:47.309385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:47.309672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:47.309951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] PATH_INFO: `/v3/users/c292dd75be154b0294273cf2acf6b5d1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:47.312134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c292dd75be154b0294273cf2acf6b5d1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:47.314388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:47.419023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c292dd75be154b0294273cf2acf6b5d1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.420104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c292dd75be154b0294273cf2acf6b5d1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.429918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c292dd75be154b0294273cf2acf6b5d1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.431012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c292dd75be154b0294273cf2acf6b5d1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.444047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0a104c09-2a6c-4e91-b667-8e80fe32c641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c292dd75be154b0294273cf2acf6b5d1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:47.467778 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1718/3406] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:47 2022] DELETE /identity/v3/users/c292dd75be154b0294273cf2acf6b5d1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:52:48.452611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:48.455164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:48.518386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d05602-19c6-4175-a066-27187282d085 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:48.799293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:48.800443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:48.800720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:48.803157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] PATH_INFO: `/v3/projects/b8c7725166154610bb95a936b87998aa` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:48.805976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c7725166154610bb95a936b87998aa)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:48.818194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:48.939057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c7725166154610bb95a936b87998aa', 'request_id': 'req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:48.961905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c7725166154610bb95a936b87998aa', 'request_id': 'req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:48.974203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c7725166154610bb95a936b87998aa', 'request_id': 'req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:48.989638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] The token cache is being invalidate because project b8c7725166154610bb95a936b87998aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:48.990220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:48.991209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c0e9531-8c3b-41ac-af4d-c9f04c8d25c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:48.994153 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1689/3407] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:48 2022] DELETE /identity/v3/projects/b8c7725166154610bb95a936b87998aa => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:49.002265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14ff77-1575-4849-8151-8bd19f6326fb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:49.002946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14ff77-1575-4849-8151-8bd19f6326fb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:49.005578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14ff77-1575-4849-8151-8bd19f6326fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:49.087922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5e14ff77-1575-4849-8151-8bd19f6326fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:49.089300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5e14ff77-1575-4849-8151-8bd19f6326fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:49.301251 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1719/3408] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:49.310319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362809-0b84-4066-b265-d9a069bde7b7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:49.310676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362809-0b84-4066-b265-d9a069bde7b7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:49.310985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f362809-0b84-4066-b265-d9a069bde7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:49.348795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7f362809-0b84-4066-b265-d9a069bde7b7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:49.350044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7f362809-0b84-4066-b265-d9a069bde7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:49.394737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14ff77-1575-4849-8151-8bd19f6326fb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:49.395764 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1690/3409] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:49.423975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14ff77-1575-4849-8151-8bd19f6326fb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:49.439479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:49.440179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:49.440465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:49.440743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:49.444365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:49.445237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:49.461501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:49.489015 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1720/3410] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:52:49.492651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362809-0b84-4066-b265-d9a069bde7b7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:49.515927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f362809-0b84-4066-b265-d9a069bde7b7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:49.529957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:49.530982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:49.531472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:49.531731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:49.532582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:49.535693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:49.586412 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1691/3411] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:49 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:49.592261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:49.619853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba54574-8a02-4466-b133-cdeafe1f7f24 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:49.797583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:49.798264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:49.798956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:49.799495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:49.803687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:49.807089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:49.850182 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1721/3412] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:49 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:49.852066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:49.876373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197122f9-49a7-4689-8aa8-96f8ac010788 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:49.887032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:49.888276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:49.889224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:49.889908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:49.890962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:49.892946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:49.910473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1692/3413] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:52:49.919195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:49.956937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0b7ed-0ca3-464a-8699-26d4fb3a3d51 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:50.003602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f18983-0c45-40d7-abce-746982696aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:50.005204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18983-0c45-40d7-abce-746982696aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:50.005740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18983-0c45-40d7-abce-746982696aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:50.006244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f18983-0c45-40d7-abce-746982696aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:50.007281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f18983-0c45-40d7-abce-746982696aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:50.010721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f18983-0c45-40d7-abce-746982696aa8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:50.036142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1722/3414] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:50.041039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:50.058662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc571f-0bae-4c44-ba95-d0c4d6d64abe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:50.067832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:50.068807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:50.069137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:50.069677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] PATH_INFO: `/v3/projects/5ecd6989a3d040e18aa72478a26a2b11/users/26ff6800e2954597a701fc3d67359357/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:50.099501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecd6989a3d040e18aa72478a26a2b11, user_id=26ff6800e2954597a701fc3d67359357, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:50.104506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:50.129742 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1693/3415] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:50 2022] PUT /identity/v3/projects/5ecd6989a3d040e18aa72478a26a2b11/users/26ff6800e2954597a701fc3d67359357/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:50.140667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0171-da55-40c5-92ed-9c6d1cdf294b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:50.140968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0171-da55-40c5-92ed-9c6d1cdf294b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:50.143320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0171-da55-40c5-92ed-9c6d1cdf294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:50.197376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d18a0171-da55-40c5-92ed-9c6d1cdf294b None None] MFA Rules not processed for user `26ff6800e2954597a701fc3d67359357`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:50.198757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d18a0171-da55-40c5-92ed-9c6d1cdf294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:50.363489 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1723/3416] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:50.426848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:50.430488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:50.657415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cdb8b-b245-45bb-9f59-dfeb1a2ac4f4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:50.671315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:50.672246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:50.672725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:50.673165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:50.693268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:50.694970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:50.719123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1694/3417] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:50.989178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94480cec-59a9-4146-a02b-790c8982afc3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:50.989178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94480cec-59a9-4146-a02b-790c8982afc3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:50.989178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94480cec-59a9-4146-a02b-790c8982afc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:51.017606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-94480cec-59a9-4146-a02b-790c8982afc3 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:51.023597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-94480cec-59a9-4146-a02b-790c8982afc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:51.160204 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1724/3418] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:52:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:51.187076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:51.189100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:51.362115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3ff4f-595e-4fe8-bfac-96033e234016 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:51.368940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:51.370008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:51.370334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:51.370664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:51.381010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:51.383077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:51.412530 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1695/3419] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:52:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:52:51.658980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e239e23-2025-4f54-9d71-416d2f8be4e1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:51.659757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e239e23-2025-4f54-9d71-416d2f8be4e1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:51.660387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e239e23-2025-4f54-9d71-416d2f8be4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:51.694262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9e239e23-2025-4f54-9d71-416d2f8be4e1 None None] MFA Rules not processed for user `26ff6800e2954597a701fc3d67359357`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:51.696584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9e239e23-2025-4f54-9d71-416d2f8be4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:51.730560 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1725/3420] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:52.135245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:52.135245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:52.211500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a4631-7a9a-440f-9d45-fa39d31824dc service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:52.221443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:52.222327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:52.222609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:52.222922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] PATH_INFO: `/v3/users/b902f15f51f54d9eadaf39c00d2c6b0e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:52.224356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b902f15f51f54d9eadaf39c00d2c6b0e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:52.226357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:52.280754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b902f15f51f54d9eadaf39c00d2c6b0e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.294696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b902f15f51f54d9eadaf39c00d2c6b0e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.295879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b902f15f51f54d9eadaf39c00d2c6b0e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.296526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b902f15f51f54d9eadaf39c00d2c6b0e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.309969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b902f15f51f54d9eadaf39c00d2c6b0e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.342901 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1696/3421] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:52 2022] DELETE /identity/v3/users/b902f15f51f54d9eadaf39c00d2c6b0e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:52.504289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:52.504814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:52.505169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:52.551476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:52.555587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:52.577151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:52.579713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:52.681477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1726/3422] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:52:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:52.697002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:52.699178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:52.718281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6efd2d-7887-4139-85a5-fb34f0a021f2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:52.723242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:52.724259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:52.724651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:52.724984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] PATH_INFO: `/v3/projects/ebeab82cd8e44ded895875eddba72d7c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:52.726332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebeab82cd8e44ded895875eddba72d7c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:52.728531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:52.808486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebeab82cd8e44ded895875eddba72d7c', 'request_id': 'req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.843197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebeab82cd8e44ded895875eddba72d7c', 'request_id': 'req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.862758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebeab82cd8e44ded895875eddba72d7c', 'request_id': 'req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.866473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c78519-5440-45f6-9701-8d5271687443 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:52.889033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] The token cache is being invalidate because project ebeab82cd8e44ded895875eddba72d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:52.890756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.891796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dac5410b-4d17-47c0-8f19-c57d0bc2fe52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:52.898279 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1697/3423] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:52 2022] DELETE /identity/v3/projects/ebeab82cd8e44ded895875eddba72d7c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:52:52.913707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca05d-9e35-4829-a343-1bdefc5c5a51 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:52.916515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca05d-9e35-4829-a343-1bdefc5c5a51 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:52.917174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca05d-9e35-4829-a343-1bdefc5c5a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:52.980777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-477ca05d-9e35-4829-a343-1bdefc5c5a51 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:52.982822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-477ca05d-9e35-4829-a343-1bdefc5c5a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:53.063450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.064793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.065240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.065821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.079955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:53.186835 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1698/3424] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:53.194747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ddd84-de9b-4d91-9f8c-db56a43a3afe None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.195272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ddd84-de9b-4d91-9f8c-db56a43a3afe None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.195737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ddd84-de9b-4d91-9f8c-db56a43a3afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.202099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.203841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.223125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1727/3425] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:52:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:52:53.223895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d24ddd84-de9b-4d91-9f8c-db56a43a3afe None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:53.225229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d24ddd84-de9b-4d91-9f8c-db56a43a3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:53.248282 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1699/3426] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:53.252625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:53.265892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d26f98-81e7-409b-a7f4-88b991e3b9b3 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:53.280250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.281035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.281269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.281653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.282258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:53.282646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.284268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.323713 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1728/3427] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:52:53.324496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ddd84-de9b-4d91-9f8c-db56a43a3afe None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:53.346734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ddd84-de9b-4d91-9f8c-db56a43a3afe None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:53.368218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.369042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.369799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.383823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.384580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.388037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.457771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:53.461448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:53.465817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1700/3428] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:53 2022] POST /identity/v3/projects => generated 361 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:53.470219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:53.491126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353ec1a-8b45-4694-a240-6309f3e7cea7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:53.625325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903e2e-30f7-48d0-8478-e9cde67406e4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:53.642204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.644543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.645526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.646379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.646896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.647379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] PATH_INFO: `/v3/users/26ff6800e2954597a701fc3d67359357` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.649008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.649472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.650385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.653130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ff6800e2954597a701fc3d67359357)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.655138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.655965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.694212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1701/3429] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:53 2022] POST /identity/v3/users => generated 281 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:53.697027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:53.743757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5a8be-a753-48c4-a48d-66cbb845d4ac admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:53.753377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.754845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.755290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.756146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.756704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.759824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.771330 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1702/3430] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:53.775794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:53.789860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95288fe3-5877-4c7c-b3b3-5156cf3b8a94 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:53.793216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ff6800e2954597a701fc3d67359357'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:53.793910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ff6800e2954597a701fc3d67359357'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:53.798592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.799351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.799631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.799910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.800640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.802379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.805941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ff6800e2954597a701fc3d67359357'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:53.806688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ff6800e2954597a701fc3d67359357'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:53.821577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0b381e13-8d93-4581-9b71-bb23d92c16ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ff6800e2954597a701fc3d67359357'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:53.835484 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1703/3431] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:53.836667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:53.840396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:53.848314 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1729/3432] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:53 2022] DELETE /identity/v3/users/26ff6800e2954597a701fc3d67359357 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:53.856364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013c6a8-a0dc-489e-9b4e-f67cd8851d15 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.857004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013c6a8-a0dc-489e-9b4e-f67cd8851d15 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.857488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013c6a8-a0dc-489e-9b4e-f67cd8851d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.863549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0695cf-db02-47cd-96d6-fa963ab74dca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:53.885806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1013c6a8-a0dc-489e-9b4e-f67cd8851d15 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:53.887667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1013c6a8-a0dc-489e-9b4e-f67cd8851d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:53.953033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:53.954186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:53.954507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:53.954860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] PATH_INFO: `/v3/projects/b51f9737ab3a40768af164288a727d83/users/cbcda0fff1a34cb2a064e3fe356ee16b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:53.974932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51f9737ab3a40768af164288a727d83, user_id=cbcda0fff1a34cb2a064e3fe356ee16b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:53.978057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:53.998887 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1730/3433] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:54.011499 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1704/3434] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:53 2022] PUT /identity/v3/projects/b51f9737ab3a40768af164288a727d83/users/cbcda0fff1a34cb2a064e3fe356ee16b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:54.016628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:54.017103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:54.017603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:54.028758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:54.031618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:54.077807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] MFA Rules not processed for user `cbcda0fff1a34cb2a064e3fe356ee16b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:54.079705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:54.123590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9909dd7-4dbd-4f4f-ba64-2c12c6f4a0a9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:54.130537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:54.131612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:54.132841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:54.133120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:54.196334 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1731/3435] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:54.209215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:54.212157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:54.231943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:54.234518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:54.250181 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1705/3436] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:52:54.322692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a3e5a-f943-4595-89ce-04b8b057a349 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:54.331292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81bb56-c0b0-498c-a045-839b327e9917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:54.332069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bb56-c0b0-498c-a045-839b327e9917 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:54.332428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bb56-c0b0-498c-a045-839b327e9917 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:54.332904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81bb56-c0b0-498c-a045-839b327e9917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:54.344489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bb56-c0b0-498c-a045-839b327e9917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:54.346375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81bb56-c0b0-498c-a045-839b327e9917 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:54.359463 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1732/3437] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:54.408825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:54.421834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577836d-8602-46eb-a3f7-9f86d6939e1a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:54.439157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:54.440153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:54.440550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:54.440994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] PATH_INFO: `/v3/users/cbcda0fff1a34cb2a064e3fe356ee16b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:54.442495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbcda0fff1a34cb2a064e3fe356ee16b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:54.446726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:54.558134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbcda0fff1a34cb2a064e3fe356ee16b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:54.575200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbcda0fff1a34cb2a064e3fe356ee16b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:54.576214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbcda0fff1a34cb2a064e3fe356ee16b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:54.577048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbcda0fff1a34cb2a064e3fe356ee16b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:54.595187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbcda0fff1a34cb2a064e3fe356ee16b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:54.630517 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1706/3438] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:52:54 2022] DELETE /identity/v3/users/cbcda0fff1a34cb2a064e3fe356ee16b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:54.635491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:54.636508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:54.636508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:54.680086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:54.683644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:54.844494 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1733/3439] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:54.880625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:54.882435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:54.907611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:54.909642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:54.934648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c8ef-18a5-4385-beab-2040d27c4e7b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:54.950301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:54.951456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:54.951924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:54.952517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] PATH_INFO: `/v3/projects/5ecd6989a3d040e18aa72478a26a2b11` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:54.954051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecd6989a3d040e18aa72478a26a2b11)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:54.957818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:54.995490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45902659-0beb-49db-a6ca-693a4c9858f5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:55.008970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8827aa9-31f8-4963-a690-85923080ad55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:55.015487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827aa9-31f8-4963-a690-85923080ad55 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.015800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827aa9-31f8-4963-a690-85923080ad55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.016091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827aa9-31f8-4963-a690-85923080ad55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.042179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8827aa9-31f8-4963-a690-85923080ad55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:55.043702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8827aa9-31f8-4963-a690-85923080ad55 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:55.045844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecd6989a3d040e18aa72478a26a2b11', 'request_id': 'req-22480f9e-31db-4659-8489-e648ecc5124d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:55.056054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecd6989a3d040e18aa72478a26a2b11', 'request_id': 'req-22480f9e-31db-4659-8489-e648ecc5124d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:55.071002 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1707/3440] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:55.074376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecd6989a3d040e18aa72478a26a2b11', 'request_id': 'req-22480f9e-31db-4659-8489-e648ecc5124d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:55.086884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] The token cache is being invalidate because project 5ecd6989a3d040e18aa72478a26a2b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:55.087360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:55.089086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-22480f9e-31db-4659-8489-e648ecc5124d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:55.100335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fab3f-8fd5-4855-b35b-380b2b9626f3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.100867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fab3f-8fd5-4855-b35b-380b2b9626f3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.101406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fab3f-8fd5-4855-b35b-380b2b9626f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.103098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1734/3441] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:54 2022] DELETE /identity/v3/projects/5ecd6989a3d040e18aa72478a26a2b11 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:55.145558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6b7fab3f-8fd5-4855-b35b-380b2b9626f3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:55.159913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b7fab3f-8fd5-4855-b35b-380b2b9626f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:55.242620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58669b5-12f7-487f-9014-b9cc00295352 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.243191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58669b5-12f7-487f-9014-b9cc00295352 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.243723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58669b5-12f7-487f-9014-b9cc00295352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.288100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c58669b5-12f7-487f-9014-b9cc00295352 None None] MFA Rules not processed for user `396f4d7fe37343dcb4aeeb0839383f6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:55.292013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c58669b5-12f7-487f-9014-b9cc00295352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:55.352879 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1708/3442] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:55.355732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1cd2c-29df-4394-ae02-e4157717599a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.356028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1cd2c-29df-4394-ae02-e4157717599a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.356305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1cd2c-29df-4394-ae02-e4157717599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.378031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cec1cd2c-29df-4394-ae02-e4157717599a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:55.379390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cec1cd2c-29df-4394-ae02-e4157717599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:55.391727 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1709/3443] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:55.393282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1cd2c-29df-4394-ae02-e4157717599a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:55.404583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1cd2c-29df-4394-ae02-e4157717599a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:55.410817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:55.416561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.416561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.416561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.416561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:55.416561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:55.416561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:55.417935 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1735/3444] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:55.432635 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1710/3445] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:52:55.437126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58669b5-12f7-487f-9014-b9cc00295352 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:55.449350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58669b5-12f7-487f-9014-b9cc00295352 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:55.456710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:55.457461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.457818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.458163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.459697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:55.462571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:55.501891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1736/3446] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:55 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:55.505582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:55.521289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8e639-2d22-4153-8acc-f4b0030bdbae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:55.614858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:55.616031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.616591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.617252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.619144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:55.621980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:55.653800 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1711/3447] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:55 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:55.658164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:55.674431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572b513-5161-4d8a-ac57-80b700479d91 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:55.688651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:55.690365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.691325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.691851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.693129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:55.696648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:55.714654 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1737/3448] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:52:55.720040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:55.734275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783a476-8f6b-4d3c-8287-d0ae0c8bc41b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:55.742270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c466935-08ee-49e0-80b2-39f1f54430e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:55.743500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c466935-08ee-49e0-80b2-39f1f54430e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.743905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c466935-08ee-49e0-80b2-39f1f54430e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.744360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c466935-08ee-49e0-80b2-39f1f54430e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.745431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c466935-08ee-49e0-80b2-39f1f54430e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:55.754025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c466935-08ee-49e0-80b2-39f1f54430e0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:55.770974 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1712/3449] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:55.772377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:55.788563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe69616-802f-4374-9d98-6d662a2a375b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:55.795705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:55.796729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.797110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.797486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] PATH_INFO: `/v3/projects/0b9502da27d64dffaf0859d1f6b5663f/users/63a6acdebf9648698ee5f3a5cac02675/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.815414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9502da27d64dffaf0859d1f6b5663f, user_id=63a6acdebf9648698ee5f3a5cac02675, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:55.821000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:55.861403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1738/3450] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:55 2022] PUT /identity/v3/projects/0b9502da27d64dffaf0859d1f6b5663f/users/63a6acdebf9648698ee5f3a5cac02675/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:55.863741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:55.864921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:55.864921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:55.904131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:55.910109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:56.056319 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1713/3451] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:56.091928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:56.094151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:56.175129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edfbef-0cf2-410f-a511-892936eee6db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:56.180980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eda12-13b4-486d-a133-344f2ef4acfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:56.182201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eda12-13b4-486d-a133-344f2ef4acfa service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:56.182966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eda12-13b4-486d-a133-344f2ef4acfa service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:56.183440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eda12-13b4-486d-a133-344f2ef4acfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:56.201746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eda12-13b4-486d-a133-344f2ef4acfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:56.204585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8eda12-13b4-486d-a133-344f2ef4acfa service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:56.221823 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1739/3452] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:52:56.423926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:56.430797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:56.455321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23f753-592d-4268-b1ee-8c620b499f89 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:56.464501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:56.465727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:56.465869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:56.466293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] PATH_INFO: `/v3/projects/b51f9737ab3a40768af164288a727d83` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:56.471272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51f9737ab3a40768af164288a727d83)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:56.478264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:56.572727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51f9737ab3a40768af164288a727d83', 'request_id': 'req-63e5b748-7228-4fa4-8412-c1f3c41fd277'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:56.580199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51f9737ab3a40768af164288a727d83', 'request_id': 'req-63e5b748-7228-4fa4-8412-c1f3c41fd277'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:56.591736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51f9737ab3a40768af164288a727d83', 'request_id': 'req-63e5b748-7228-4fa4-8412-c1f3c41fd277'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:56.625908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] The token cache is being invalidate because project b51f9737ab3a40768af164288a727d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:52:56.626218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:56.626970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63e5b748-7228-4fa4-8412-c1f3c41fd277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:52:56.629311 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1714/3453] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:52:56 2022] DELETE /identity/v3/projects/b51f9737ab3a40768af164288a727d83 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:56.634430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32c77-3e47-410c-a965-6dc4e8e59cfa None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:56.635002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32c77-3e47-410c-a965-6dc4e8e59cfa None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:56.636351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b32c77-3e47-410c-a965-6dc4e8e59cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:56.675906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e8b32c77-3e47-410c-a965-6dc4e8e59cfa None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:56.679421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e8b32c77-3e47-410c-a965-6dc4e8e59cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:56.777315 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1740/3454] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:56.785161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97caba0-95c4-4231-bd0b-d20de2867aab None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:56.785457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97caba0-95c4-4231-bd0b-d20de2867aab None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:56.785729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97caba0-95c4-4231-bd0b-d20de2867aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:56.820625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b97caba0-95c4-4231-bd0b-d20de2867aab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:56.822334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b97caba0-95c4-4231-bd0b-d20de2867aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:56.834851 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1715/3455] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:52:56.837536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32c77-3e47-410c-a965-6dc4e8e59cfa None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:56.864772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b32c77-3e47-410c-a965-6dc4e8e59cfa None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:56.907495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:56.911524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:56.911816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:56.913999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:56.914803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:52:56.916052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:56.917965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:56.935047 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1741/3456] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:52:56.939408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97caba0-95c4-4231-bd0b-d20de2867aab None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:56.954375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97caba0-95c4-4231-bd0b-d20de2867aab None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:56.961167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:56.962063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:56.962448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:56.962830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:56.963639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:56.966479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:57.006186 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1716/3457] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:52:56 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:57.010249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:57.028765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54ba0-1292-4822-bd54-c6515951d6b8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:57.175014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:57.176279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:57.176849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:57.177120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:57.177839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:57.180737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:57.299780 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1742/3458] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:52:57 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:52:57.304005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:57.318229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370b9e0-32c6-476f-a098-4ce8913130ac admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:57.341500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:57.342912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:57.343223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:57.343504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:57.344244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:57.345878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:57.378664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1717/3459] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:52:57.379129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:57.393489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe87002-beda-43cc-ae90-5e925b2e353b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:57.413997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7770d9-b078-45a3-bab8-8f421ea8a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:57.414688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7770d9-b078-45a3-bab8-8f421ea8a42c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:57.415502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7770d9-b078-45a3-bab8-8f421ea8a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:57.415794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7770d9-b078-45a3-bab8-8f421ea8a42c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:57.416588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7770d9-b078-45a3-bab8-8f421ea8a42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:57.418172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7770d9-b078-45a3-bab8-8f421ea8a42c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:57.445073 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1743/3460] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:52:57.446868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:57.472402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3e19e-f1ab-411a-b6ac-045b39fdd497 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:57.490703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:57.492538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:57.493320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:57.493831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] PATH_INFO: `/v3/projects/4f4c556805a24040a7131d879ee91498/users/3e390d65f16c47ec89f5f834bccfdd8c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:57.536024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4c556805a24040a7131d879ee91498, user_id=3e390d65f16c47ec89f5f834bccfdd8c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:57.542655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:57.576764 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1718/3461] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:52:57 2022] PUT /identity/v3/projects/4f4c556805a24040a7131d879ee91498/users/3e390d65f16c47ec89f5f834bccfdd8c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:52:57.581837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd243d-b8b1-4977-8739-525342749f36 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:57.582093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd243d-b8b1-4977-8739-525342749f36 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:57.582374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd243d-b8b1-4977-8739-525342749f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:57.607992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5ecd243d-b8b1-4977-8739-525342749f36 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:52:57.609288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ecd243d-b8b1-4977-8739-525342749f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:57.732804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1744/3462] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:52:57.743757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:52:57.747001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:52:57.835427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837bc97-b5f6-413a-bd45-4083b56feea7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:52:57.839882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf540e-5a25-439d-819a-13d0ea94ab3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:52:57.840631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf540e-5a25-439d-819a-13d0ea94ab3a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:52:57.840972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf540e-5a25-439d-819a-13d0ea94ab3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:52:57.841294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf540e-5a25-439d-819a-13d0ea94ab3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:52:57.851890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf540e-5a25-439d-819a-13d0ea94ab3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:52:57.853469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf540e-5a25-439d-819a-13d0ea94ab3a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:52:57.865897 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1719/3463] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:00.115106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:00.115658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:00.116873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:00.206408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] MFA Rules not processed for user `3e390d65f16c47ec89f5f834bccfdd8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:00.209996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:00.394588 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1745/3464] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:00.408740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:00.410140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:00.410795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:00.444820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] MFA Rules not processed for user `3e390d65f16c47ec89f5f834bccfdd8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:00.446524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:00.468445 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1720/3465] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:00.469264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:00.472198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:00.648866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dd296-bdf4-4852-af0c-9a29731bace8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:00.658806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fc12c-7999-478a-bcf7-dc61b254452d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:00.659504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc12c-7999-478a-bcf7-dc61b254452d service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:00.659954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc12c-7999-478a-bcf7-dc61b254452d service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:00.660234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fc12c-7999-478a-bcf7-dc61b254452d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:00.672849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fc12c-7999-478a-bcf7-dc61b254452d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:00.675006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fc12c-7999-478a-bcf7-dc61b254452d service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:00.689022 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1746/3466] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:53:02.537828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:02.539835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:02.576862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9275-bf70-4193-bee2-4326b8ef2485 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:02.607644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:02.608998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:02.614695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:02.615012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] PATH_INFO: `/v3/users/bc1c955ccc0c48dcbb11eba3718d7865` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:02.620261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1c955ccc0c48dcbb11eba3718d7865)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:02.626191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:02.755061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1c955ccc0c48dcbb11eba3718d7865'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:02.779884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1c955ccc0c48dcbb11eba3718d7865'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:02.780671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1c955ccc0c48dcbb11eba3718d7865'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:02.781299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1c955ccc0c48dcbb11eba3718d7865'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:02.791596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1c955ccc0c48dcbb11eba3718d7865'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:02.828134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1721/3467] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:53:02 2022] DELETE /identity/v3/users/bc1c955ccc0c48dcbb11eba3718d7865 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:02.829712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:02.830864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:02.833814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:02.902926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:02.907104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:03.011100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1747/3468] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:03.056066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:03.057713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:03.245135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3345e3-3323-4047-a2d1-f89b6f3dc00e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:03.264595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:03.266526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:03.267247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:03.269354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:03.314664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:03.319674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:03.368040 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1722/3469] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:04.983446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:04.988922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:05.025436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820382-523f-44b8-8039-1ce97c839159 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:05.073558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:05.077423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:05.077969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:05.086886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] PATH_INFO: `/v3/projects/4642753b5d1548038be79eb12ce7b20b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:05.088961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4642753b5d1548038be79eb12ce7b20b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:05.092992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:05.293491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4642753b5d1548038be79eb12ce7b20b', 'request_id': 'req-cbbc5198-3825-49c6-b7ba-f536fffaeba6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.331691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4642753b5d1548038be79eb12ce7b20b', 'request_id': 'req-cbbc5198-3825-49c6-b7ba-f536fffaeba6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.352097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4642753b5d1548038be79eb12ce7b20b', 'request_id': 'req-cbbc5198-3825-49c6-b7ba-f536fffaeba6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.391406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] The token cache is being invalidate because project 4642753b5d1548038be79eb12ce7b20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:53:05.391406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.391406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.395422 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1748/3470] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:53:04 2022] DELETE /identity/v3/projects/4642753b5d1548038be79eb12ce7b20b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:05.401845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:05.430784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8339d-87a8-4a93-8c68-020a344ea19a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:05.595860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:05.596859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:05.597206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:05.597550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] PATH_INFO: `/v3/users/887bae4afdd641628d0f256174bf1755` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:05.600635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=887bae4afdd641628d0f256174bf1755)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:05.606476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:05.725520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887bae4afdd641628d0f256174bf1755'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.743166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887bae4afdd641628d0f256174bf1755'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.749694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887bae4afdd641628d0f256174bf1755'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.757808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887bae4afdd641628d0f256174bf1755'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.774835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5cd1efeb-f0be-48d5-a2c1-8e74b4f90353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887bae4afdd641628d0f256174bf1755'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:05.810591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1723/3471] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:53:05 2022] DELETE /identity/v3/users/887bae4afdd641628d0f256174bf1755 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:07.253570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:07.256468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:07.278514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc5198-3825-49c6-b7ba-f536fffaeba6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:07.382042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:07.382819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:07.383113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:07.383393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] PATH_INFO: `/v3/projects/05250a914cc243099a43a26636874755` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:07.387920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05250a914cc243099a43a26636874755)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:07.390639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:07.463878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05250a914cc243099a43a26636874755', 'request_id': 'req-0d290355-dd2e-4826-9812-4ac123a8e80b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:07.472264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05250a914cc243099a43a26636874755', 'request_id': 'req-0d290355-dd2e-4826-9812-4ac123a8e80b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:07.484182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05250a914cc243099a43a26636874755', 'request_id': 'req-0d290355-dd2e-4826-9812-4ac123a8e80b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:07.508613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] The token cache is being invalidate because project 05250a914cc243099a43a26636874755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:53:07.509175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:07.510149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d290355-dd2e-4826-9812-4ac123a8e80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:07.512842 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1749/3472] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:53:07 2022] DELETE /identity/v3/projects/05250a914cc243099a43a26636874755 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:07.518029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5ba7-cd3c-422f-8cbd-6958f9251f33 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:07.518925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5ba7-cd3c-422f-8cbd-6958f9251f33 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:07.519365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5ba7-cd3c-422f-8cbd-6958f9251f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:07.565240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0f6d5ba7-cd3c-422f-8cbd-6958f9251f33 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:07.567333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0f6d5ba7-cd3c-422f-8cbd-6958f9251f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:07.657501 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1724/3473] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:07.665752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb60c-e651-46b6-86c2-accc2ef40a0d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:07.666045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb60c-e651-46b6-86c2-accc2ef40a0d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:07.666331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb60c-e651-46b6-86c2-accc2ef40a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:07.695654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-21eeb60c-e651-46b6-86c2-accc2ef40a0d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:07.697488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21eeb60c-e651-46b6-86c2-accc2ef40a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:07.709306 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1750/3474] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:07.714514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d5ba7-cd3c-422f-8cbd-6958f9251f33 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:07.724902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d5ba7-cd3c-422f-8cbd-6958f9251f33 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:07.730735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:07.731445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:07.731731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:07.732008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:07.732753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:53:07.733059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:07.734759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:07.752399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eeb60c-e651-46b6-86c2-accc2ef40a0d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:07.759477 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1725/3475] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:53:07.763703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eeb60c-e651-46b6-86c2-accc2ef40a0d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:07.769075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:07.770362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:07.770362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:07.770607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:07.771604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:07.774161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:07.817300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:07.829403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1751/3476] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:53:07 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:07.834172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b21426-c1fd-4f38-93a5-d3a506ee1de8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:07.913638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:07.914193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:07.914479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:07.914759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:07.915491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:07.918592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:07.984095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:07.986038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1726/3477] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:53:07 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:08.000814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281bf7b-cc89-4800-96a0-74f891d00777 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.006527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.008171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.008679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.009174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.012346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.017292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.049721 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1752/3478] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:08.055050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.107398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674740b6-63b4-416e-819e-625db49d74af admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.114623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd778d8-7a7b-41e1-9d1f-4cffff8c90ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.115641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd778d8-7a7b-41e1-9d1f-4cffff8c90ba admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.116544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd778d8-7a7b-41e1-9d1f-4cffff8c90ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.116902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd778d8-7a7b-41e1-9d1f-4cffff8c90ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.117874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd778d8-7a7b-41e1-9d1f-4cffff8c90ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.150635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd778d8-7a7b-41e1-9d1f-4cffff8c90ba admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.182667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1727/3479] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:08.188499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.203843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c064e4d-c1e3-48db-888a-85c76efa4d48 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.215759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.216320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.225016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.225399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] PATH_INFO: `/v3/projects/5dbdf17ebd9e4981b3435b13defa64d6/users/8f0d92d56cf344f0a591c64adea147e8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.265080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbdf17ebd9e4981b3435b13defa64d6, user_id=8f0d92d56cf344f0a591c64adea147e8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.268304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.312895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35883569-d5ef-4dfa-9f14-69c9869c6fd0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.313258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35883569-d5ef-4dfa-9f14-69c9869c6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.313463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35883569-d5ef-4dfa-9f14-69c9869c6fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.315464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1753/3480] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:53:08 2022] PUT /identity/v3/projects/5dbdf17ebd9e4981b3435b13defa64d6/users/8f0d92d56cf344f0a591c64adea147e8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:08.365845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-35883569-d5ef-4dfa-9f14-69c9869c6fd0 None None] MFA Rules not processed for user `8f0d92d56cf344f0a591c64adea147e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:08.368090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-35883569-d5ef-4dfa-9f14-69c9869c6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:08.442952 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1728/3481] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:08.447868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.529733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48ebc9-c86e-45f2-95d7-8948f4462ce9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.534836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.535509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.535793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.536068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.538611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.540818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.575626 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1754/3482] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:53:08 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:08.576197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35883569-d5ef-4dfa-9f14-69c9869c6fd0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.589911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35883569-d5ef-4dfa-9f14-69c9869c6fd0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.674088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.674859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.675153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.675428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.676178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.679246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.707686 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1729/3483] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:53:08 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:08.710695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.723756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36aa129-3e78-4b98-af63-72ea8d7a73f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.730523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.731823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.732394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.733623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.734624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.736864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.764459 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1755/3484] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:08.764818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.780870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530b58-8cb7-4665-b501-9e00f26affdd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.787604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.789182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.789533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.789912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] PATH_INFO: `/v3/projects/95df3259314c43b690366d66d710f9b9/users/b6ff6347f137494a9b987a209f58eabf/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.799323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.801412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:08.823809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dc06e-f0c2-4771-ad87-e2cbff8e88d8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:08.829767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95df3259314c43b690366d66d710f9b9, user_id=b6ff6347f137494a9b987a209f58eabf, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.833756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.838370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:08.839388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:08.842467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:08.842877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] PATH_INFO: `/v3/users/8e35b8f3a2eb4ed98800638dd51618ff` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:08.844989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e35b8f3a2eb4ed98800638dd51618ff)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:08.848932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:08.869490 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1730/3485] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:53:08 2022] PUT /identity/v3/projects/95df3259314c43b690366d66d710f9b9/users/b6ff6347f137494a9b987a209f58eabf/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:53:08.871841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:08.950744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e35b8f3a2eb4ed98800638dd51618ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:08.952166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e35b8f3a2eb4ed98800638dd51618ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:08.968903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e35b8f3a2eb4ed98800638dd51618ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:08.971689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e35b8f3a2eb4ed98800638dd51618ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:08.986561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e35b8f3a2eb4ed98800638dd51618ff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:09.018229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafe316-0954-46cb-9590-9bc608fdad63 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:09.026883 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1756/3486] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:53:08 2022] DELETE /identity/v3/users/8e35b8f3a2eb4ed98800638dd51618ff => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:53:09.031886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcc8a2-7341-41bb-8bab-d33735be71c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:09.033147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc8a2-7341-41bb-8bab-d33735be71c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:09.033453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc8a2-7341-41bb-8bab-d33735be71c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:09.033731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcc8a2-7341-41bb-8bab-d33735be71c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:09.034471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcc8a2-7341-41bb-8bab-d33735be71c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:09.036175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcc8a2-7341-41bb-8bab-d33735be71c1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:09.053921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:09.055569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:09.064597 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1731/3487] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:09.230497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad8faf-007b-4268-bd62-274861f68db8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:09.256724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3539d-43c0-48bf-bf3f-a5ccde489891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:09.257985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3539d-43c0-48bf-bf3f-a5ccde489891 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:09.258366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3539d-43c0-48bf-bf3f-a5ccde489891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:09.258762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3539d-43c0-48bf-bf3f-a5ccde489891 admin admin] PATH_INFO: `/v3/projects/95df3259314c43b690366d66d710f9b9/users/b6ff6347f137494a9b987a209f58eabf/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:09.261945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3539d-43c0-48bf-bf3f-a5ccde489891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95df3259314c43b690366d66d710f9b9, user_id=b6ff6347f137494a9b987a209f58eabf, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:09.265504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3539d-43c0-48bf-bf3f-a5ccde489891 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:09.290475 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1757/3488] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:53:09 2022] PUT /identity/v3/projects/95df3259314c43b690366d66d710f9b9/users/b6ff6347f137494a9b987a209f58eabf/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:53:09.301693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:09.302029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:09.302318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:09.349211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] MFA Rules not processed for user `b6ff6347f137494a9b987a209f58eabf`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:09.350897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:09.467243 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1732/3489] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:09.468758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8039-d846-4319-af51-24825721bb65 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:09.469062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8039-d846-4319-af51-24825721bb65 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:09.469347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb8039-d846-4319-af51-24825721bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:09.508610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1feb8039-d846-4319-af51-24825721bb65 None None] MFA Rules not processed for user `8f0d92d56cf344f0a591c64adea147e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:09.512477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1feb8039-d846-4319-af51-24825721bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:09.605318 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1758/3490] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:09.620025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:09.621976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:09.769742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05bb56-6ac6-4cf3-839d-70fa2fdc5382 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:09.776985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376693b-ab93-451b-942c-f8d8e57b2637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:09.777806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376693b-ab93-451b-942c-f8d8e57b2637 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:09.777954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376693b-ab93-451b-942c-f8d8e57b2637 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:09.788789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376693b-ab93-451b-942c-f8d8e57b2637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:09.791027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3376693b-ab93-451b-942c-f8d8e57b2637 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:09.811480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376693b-ab93-451b-942c-f8d8e57b2637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:09.813254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376693b-ab93-451b-942c-f8d8e57b2637 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:09.841581 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1733/3491] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:10.291693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb8039-d846-4319-af51-24825721bb65 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:10.296055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1feb8039-d846-4319-af51-24825721bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:10.409426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb8039-d846-4319-af51-24825721bb65 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:10.417474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:10.418526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:10.418895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:10.419085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] PATH_INFO: `/v3/projects/aae91bd9874141989a0896953655d3de` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:10.420984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae91bd9874141989a0896953655d3de)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:10.423365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:10.484780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae91bd9874141989a0896953655d3de', 'request_id': 'req-55ae3275-f735-4c21-986a-d8de3defeca8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:10.493339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae91bd9874141989a0896953655d3de', 'request_id': 'req-55ae3275-f735-4c21-986a-d8de3defeca8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:10.514280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae91bd9874141989a0896953655d3de', 'request_id': 'req-55ae3275-f735-4c21-986a-d8de3defeca8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:10.539896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] The token cache is being invalidate because project aae91bd9874141989a0896953655d3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:53:10.540185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:10.540884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55ae3275-f735-4c21-986a-d8de3defeca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:10.545263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1759/3492] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:53:10 2022] DELETE /identity/v3/projects/aae91bd9874141989a0896953655d3de => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:10.550085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01131-8577-47f9-a145-2ab8cc54f9b2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:10.550605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01131-8577-47f9-a145-2ab8cc54f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:10.551088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01131-8577-47f9-a145-2ab8cc54f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:10.595880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4ae01131-8577-47f9-a145-2ab8cc54f9b2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:10.599150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4ae01131-8577-47f9-a145-2ab8cc54f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:10.772829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20c2e-3b94-4999-897d-c5f3463b9356 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:10.773035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20c2e-3b94-4999-897d-c5f3463b9356 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:10.773514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af20c2e-3b94-4999-897d-c5f3463b9356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:10.775385 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1734/3493] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:10.802914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9af20c2e-3b94-4999-897d-c5f3463b9356 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:10.804439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9af20c2e-3b94-4999-897d-c5f3463b9356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:10.817418 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1760/3494] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:10.822582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01131-8577-47f9-a145-2ab8cc54f9b2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:10.835425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01131-8577-47f9-a145-2ab8cc54f9b2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:10.850417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:10.852663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:10.857374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:10.857682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:10.858526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:53:10.858859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:10.865332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:10.903388 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1735/3495] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:53:10.905086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20c2e-3b94-4999-897d-c5f3463b9356 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:10.941266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af20c2e-3b94-4999-897d-c5f3463b9356 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:10.954262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:10.956527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:10.957089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:10.959126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:10.960821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:10.964474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:11.034448 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1761/3496] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:53:10 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:11.038969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:11.067883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005d339-2126-4efa-938c-f2e92fd703c8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:11.244246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:11.244929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:11.245212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:11.245525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:11.246248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:11.248231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:11.298041 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1736/3497] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:53:11 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:11.302194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:11.323924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac1fa1-3933-45a9-b13b-1f906309bcd2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:11.340046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:11.340728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:11.341011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:11.341284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:11.342012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:11.343929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:11.410810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1762/3498] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:11.414878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:11.429595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856f45f-137e-43df-a9d9-d947d3e7f6c5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:11.439466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7829c72-5d7c-48e0-acca-05fbb1647776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:11.440302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7829c72-5d7c-48e0-acca-05fbb1647776 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:11.440512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7829c72-5d7c-48e0-acca-05fbb1647776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:11.440950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7829c72-5d7c-48e0-acca-05fbb1647776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:11.447054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7829c72-5d7c-48e0-acca-05fbb1647776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:11.455875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7829c72-5d7c-48e0-acca-05fbb1647776 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:11.481090 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1737/3499] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:11.485049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:11.496915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d2040-205a-424f-90ac-c3fcd35ac92d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:11.514434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:11.515372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:11.515748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:11.515898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] PATH_INFO: `/v3/projects/30dc61c4cf2b43f986262f0c112abf49/users/f766813e116b4b8fb0cca101161cd635/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:11.566148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dc61c4cf2b43f986262f0c112abf49, user_id=f766813e116b4b8fb0cca101161cd635, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:11.587809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:11.616677 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1763/3500] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:53:11 2022] PUT /identity/v3/projects/30dc61c4cf2b43f986262f0c112abf49/users/f766813e116b4b8fb0cca101161cd635/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:11.623343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a2bc-cdfd-4ddd-b000-98fd5ccd46e2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:11.623627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a2bc-cdfd-4ddd-b000-98fd5ccd46e2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:11.624114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37a2bc-cdfd-4ddd-b000-98fd5ccd46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:11.687403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6b37a2bc-cdfd-4ddd-b000-98fd5ccd46e2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:11.689304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b37a2bc-cdfd-4ddd-b000-98fd5ccd46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:11.905692 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1738/3501] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:11.970109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:11.972387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:12.155734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24a0be-575d-44b9-8a30-2f073a677617 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:12.161668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353fb78-b350-43b3-ae02-23f16ac7b90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:12.162580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fb78-b350-43b3-ae02-23f16ac7b90f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:12.163640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fb78-b350-43b3-ae02-23f16ac7b90f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:12.164119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fb78-b350-43b3-ae02-23f16ac7b90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:12.188493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353fb78-b350-43b3-ae02-23f16ac7b90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:12.191244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353fb78-b350-43b3-ae02-23f16ac7b90f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:12.241125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1764/3502] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:14.065313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5cc63-8b4b-4e3f-99de-eb9805fc7132 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:14.066256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5cc63-8b4b-4e3f-99de-eb9805fc7132 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:14.066759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5cc63-8b4b-4e3f-99de-eb9805fc7132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:14.092019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5cf5cc63-8b4b-4e3f-99de-eb9805fc7132 None None] MFA Rules not processed for user `60446154374c4fac9315543687cdc0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:14.093251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5cf5cc63-8b4b-4e3f-99de-eb9805fc7132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:14.168821 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1739/3503] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:14.179543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:14.180097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:14.180097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:14.211786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] MFA Rules not processed for user `60446154374c4fac9315543687cdc0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:14.211786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:14.217661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77997c47-4fc0-455c-b2b6-3613721dacbc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:14.218508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77997c47-4fc0-455c-b2b6-3613721dacbc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:14.219001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77997c47-4fc0-455c-b2b6-3613721dacbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:14.222403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1765/3504] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:14.263350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-77997c47-4fc0-455c-b2b6-3613721dacbc None None] MFA Rules not processed for user `63a6acdebf9648698ee5f3a5cac02675`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:14.267119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-77997c47-4fc0-455c-b2b6-3613721dacbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:14.361434 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1740/3505] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:14.461309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:14.463942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:14.582531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e58dd5-a534-4d7e-99ab-207dede033ef None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:14.601214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6b5fd-359b-4200-96ac-2a6dcbd52a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:14.602401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6b5fd-359b-4200-96ac-2a6dcbd52a94 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:14.602949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6b5fd-359b-4200-96ac-2a6dcbd52a94 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:14.605204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6b5fd-359b-4200-96ac-2a6dcbd52a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:14.627708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6b5fd-359b-4200-96ac-2a6dcbd52a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:14.631626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6b5fd-359b-4200-96ac-2a6dcbd52a94 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:14.644952 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1766/3506] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:14.710804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201018-d419-451b-a04b-f80bbd18698e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:14.711111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201018-d419-451b-a04b-f80bbd18698e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:14.711403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86201018-d419-451b-a04b-f80bbd18698e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:14.776272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-86201018-d419-451b-a04b-f80bbd18698e None None] MFA Rules not processed for user `f766813e116b4b8fb0cca101161cd635`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:14.777527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-86201018-d419-451b-a04b-f80bbd18698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:14.965593 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1741/3507] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:14.974276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224a39-372a-4f94-ae6d-e671198e2ee7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:14.974592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224a39-372a-4f94-ae6d-e671198e2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:14.974914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224a39-372a-4f94-ae6d-e671198e2ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:15.039717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-12224a39-372a-4f94-ae6d-e671198e2ee7 None None] MFA Rules not processed for user `f766813e116b4b8fb0cca101161cd635`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:15.056922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-12224a39-372a-4f94-ae6d-e671198e2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:15.107359 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1767/3508] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:16.284821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86201018-d419-451b-a04b-f80bbd18698e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:16.316093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86201018-d419-451b-a04b-f80bbd18698e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:16.338151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:16.338915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:16.339208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:16.339669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:16.357322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:16.360760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:16.400700 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1742/3509] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:18.274183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:18.275110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:18.275609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:18.295151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] MFA Rules not processed for user `63a6acdebf9648698ee5f3a5cac02675`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:18.296821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:18.306022 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1768/3510] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:53:20.076856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:20.094072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2ef5-96bb-492d-9c0f-2db598aa1a25 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:20.115137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ae91a-1227-4dc2-ab87-ae720f3a70dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:20.117153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae91a-1227-4dc2-ab87-ae720f3a70dd service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:20.117907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae91a-1227-4dc2-ab87-ae720f3a70dd service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:20.118511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ae91a-1227-4dc2-ab87-ae720f3a70dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:20.121500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-024ae91a-1227-4dc2-ab87-ae720f3a70dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:20.248050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ae91a-1227-4dc2-ab87-ae720f3a70dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:20.254121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ae91a-1227-4dc2-ab87-ae720f3a70dd service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:20.287143 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1743/3511] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:26.425311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:26.427035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:26.451833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e146ef-a1d6-48c2-a495-b44dc1669774 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:26.482376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:26.483070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:26.483353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:26.483749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:26.486323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:26.638076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:26.640488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:26.661709 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1769/3512] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:26.722586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b87f-e320-4d88-b4e7-e46dbfe2c442 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:26.723532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b87f-e320-4d88-b4e7-e46dbfe2c442 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:26.724043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755b87f-e320-4d88-b4e7-e46dbfe2c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:26.785361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f755b87f-e320-4d88-b4e7-e46dbfe2c442 None None] MFA Rules not processed for user `8f0d92d56cf344f0a591c64adea147e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:26.787104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f755b87f-e320-4d88-b4e7-e46dbfe2c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:26.951143 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1744/3513] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:27.014363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:27.017479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:27.039970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe081-5f4b-463f-a7b6-585d6ca7fa6c service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:27.053776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:27.055599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:27.056214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:27.056870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] PATH_INFO: `/v3/users/5d64d1550858400a8a7804dcdb7a0110` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:27.058699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d64d1550858400a8a7804dcdb7a0110)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:27.060996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:27.160145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d64d1550858400a8a7804dcdb7a0110'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:27.161227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d64d1550858400a8a7804dcdb7a0110'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:27.171228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d64d1550858400a8a7804dcdb7a0110'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:27.172291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d64d1550858400a8a7804dcdb7a0110'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:27.189654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d64d1550858400a8a7804dcdb7a0110'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:27.229603 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1770/3514] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:53:27 2022] DELETE /identity/v3/users/5d64d1550858400a8a7804dcdb7a0110 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:27.232283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:27.232694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:27.233069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:27.256603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:27.258382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:27.400104 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1745/3515] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:27.497144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:27.501672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:27.631127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94a9cb-b59b-429c-b7ba-3ead864ebb48 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:27.635952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f3b14-1c04-43d6-942e-c85be8ed4810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:27.636761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f3b14-1c04-43d6-942e-c85be8ed4810 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:27.637177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f3b14-1c04-43d6-942e-c85be8ed4810 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:27.637836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f3b14-1c04-43d6-942e-c85be8ed4810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:27.653848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f3b14-1c04-43d6-942e-c85be8ed4810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:27.655315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f3b14-1c04-43d6-942e-c85be8ed4810 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:27.673120 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1771/3516] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:28.863265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:28.866194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:28.898461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014488da-c5ff-4d9d-bf88-a8b4679f90d8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:28.902677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:28.903713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:28.904211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:28.905231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] PATH_INFO: `/v3/projects/09fe0f4d227c4e7d9c5c8afafd82f975` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:28.911199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09fe0f4d227c4e7d9c5c8afafd82f975)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:28.916141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:29.022399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09fe0f4d227c4e7d9c5c8afafd82f975', 'request_id': 'req-5e53e14b-75f6-4cc7-9101-52e8db910438'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:29.032319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09fe0f4d227c4e7d9c5c8afafd82f975', 'request_id': 'req-5e53e14b-75f6-4cc7-9101-52e8db910438'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:29.050922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09fe0f4d227c4e7d9c5c8afafd82f975', 'request_id': 'req-5e53e14b-75f6-4cc7-9101-52e8db910438'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:29.067774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] The token cache is being invalidate because project 09fe0f4d227c4e7d9c5c8afafd82f975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:53:29.069157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:29.078038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e53e14b-75f6-4cc7-9101-52e8db910438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:29.087480 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1746/3517] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:53:28 2022] DELETE /identity/v3/projects/09fe0f4d227c4e7d9c5c8afafd82f975 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:29.097753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2247eb-3a2d-4474-9acf-c7713a82cd41 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.098745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2247eb-3a2d-4474-9acf-c7713a82cd41 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.099278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2247eb-3a2d-4474-9acf-c7713a82cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.122885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ac2247eb-3a2d-4474-9acf-c7713a82cd41 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:29.135667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac2247eb-3a2d-4474-9acf-c7713a82cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:29.313767 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1772/3518] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:29.316981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e832b-0fc4-4548-adbf-6e6537955b72 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.317648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e832b-0fc4-4548-adbf-6e6537955b72 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.318028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e832b-0fc4-4548-adbf-6e6537955b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.343151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-836e832b-0fc4-4548-adbf-6e6537955b72 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:29.344886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-836e832b-0fc4-4548-adbf-6e6537955b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:29.356125 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1747/3519] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:29.363154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2247eb-3a2d-4474-9acf-c7713a82cd41 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:29.382674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2247eb-3a2d-4474-9acf-c7713a82cd41 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:29.390320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:29.391064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.391554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.392001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.393774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:53:29.394272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:29.396633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:29.413309 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1773/3520] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:53:29.417497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e832b-0fc4-4548-adbf-6e6537955b72 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:29.428223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e832b-0fc4-4548-adbf-6e6537955b72 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:29.433349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:29.434194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.434642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.435134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.435979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:29.438229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:29.482151 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1748/3521] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:53:29 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:29.483515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:29.497179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4541d64-6742-4c03-98b3-da0e50aaea21 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:29.564887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:29.565471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.565843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.566122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.567116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:29.570190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:29.592160 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1774/3522] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:53:29 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:29.595730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:29.623986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4904-5cb9-485e-907f-e566c0ce2071 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:29.636720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:29.637669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.638053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.638432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.639287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:29.641065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:29.653969 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1749/3523] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:29.658345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:29.672818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0214-6ac7-48da-9b55-c5aa9dfe9233 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:29.678134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b5a44-70ec-4de7-9807-198e558253c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:29.679159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b5a44-70ec-4de7-9807-198e558253c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.679835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b5a44-70ec-4de7-9807-198e558253c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.680342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b5a44-70ec-4de7-9807-198e558253c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.681326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b5a44-70ec-4de7-9807-198e558253c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:29.683259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b5a44-70ec-4de7-9807-198e558253c7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:29.702124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:29.704040 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1775/3524] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:29.736075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c1251-2680-43e4-b261-df400b84025e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:29.751636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:29.752775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.753084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.753412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] PATH_INFO: `/v3/projects/93c3c71171814bb7b1018904086ad506/users/bdc18dc6c5214fbb9c1fa61eeb514cc9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.780447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c3c71171814bb7b1018904086ad506, user_id=bdc18dc6c5214fbb9c1fa61eeb514cc9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:29.789956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:29.822007 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1750/3525] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:53:29 2022] PUT /identity/v3/projects/93c3c71171814bb7b1018904086ad506/users/bdc18dc6c5214fbb9c1fa61eeb514cc9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:29.827160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:29.827649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:29.828141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:29.831293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:29.837869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:29.867836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:29.869642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:30.012929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd3d77-4b1d-4f6d-ab8b-df1aa4d098a7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:30.030187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8678d5-d837-4782-b691-3d2d67324f8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:30.031109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8678d5-d837-4782-b691-3d2d67324f8c service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:30.031579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8678d5-d837-4782-b691-3d2d67324f8c service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:30.032011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8678d5-d837-4782-b691-3d2d67324f8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:30.034588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db8678d5-d837-4782-b691-3d2d67324f8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:30.050167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8678d5-d837-4782-b691-3d2d67324f8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:30.052154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8678d5-d837-4782-b691-3d2d67324f8c service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:30.064384 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1776/3526] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:30.065474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:30.066160 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1751/3527] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:30.072809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:30.148682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd18a-24cb-4da4-893e-e5c0c7e56c3e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:30.154363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac137c8-e7a2-4fcf-a505-6090b28c4cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:30.155474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac137c8-e7a2-4fcf-a505-6090b28c4cdb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:30.155750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac137c8-e7a2-4fcf-a505-6090b28c4cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:30.156270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac137c8-e7a2-4fcf-a505-6090b28c4cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:30.172854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac137c8-e7a2-4fcf-a505-6090b28c4cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:30.174318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac137c8-e7a2-4fcf-a505-6090b28c4cdb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:30.187592 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1777/3528] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:33.280384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe58f5-dd87-42a1-889b-b00a9c17988f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:33.280885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe58f5-dd87-42a1-889b-b00a9c17988f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:33.281036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe58f5-dd87-42a1-889b-b00a9c17988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:33.309705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ffbe58f5-dd87-42a1-889b-b00a9c17988f None None] MFA Rules not processed for user `f766813e116b4b8fb0cca101161cd635`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:33.311320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ffbe58f5-dd87-42a1-889b-b00a9c17988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:33.394453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1752/3529] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:34.759800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36bfd1-4ae4-46f1-b8c7-5dd26a873c86 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:34.760641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36bfd1-4ae4-46f1-b8c7-5dd26a873c86 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:34.761110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36bfd1-4ae4-46f1-b8c7-5dd26a873c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:34.796897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2c36bfd1-4ae4-46f1-b8c7-5dd26a873c86 None None] MFA Rules not processed for user `f766813e116b4b8fb0cca101161cd635`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:34.798448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2c36bfd1-4ae4-46f1-b8c7-5dd26a873c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:34.820653 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1778/3530] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:35.275134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e5631-286b-4936-a4fb-447eb55dc89f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:35.275662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e5631-286b-4936-a4fb-447eb55dc89f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:35.276039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e5631-286b-4936-a4fb-447eb55dc89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:35.321601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e25e5631-286b-4936-a4fb-447eb55dc89f None None] MFA Rules not processed for user `f766813e116b4b8fb0cca101161cd635`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:35.323216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e25e5631-286b-4936-a4fb-447eb55dc89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:35.362848 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1753/3531] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:35.859374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740652-6255-4938-8a69-0a1390b03f92 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:35.859871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740652-6255-4938-8a69-0a1390b03f92 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:35.859979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9740652-6255-4938-8a69-0a1390b03f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:35.899835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e9740652-6255-4938-8a69-0a1390b03f92 None None] MFA Rules not processed for user `f766813e116b4b8fb0cca101161cd635`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:35.901065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e9740652-6255-4938-8a69-0a1390b03f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:35.935526 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1779/3532] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:36.140181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:36.140632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:36.141012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:36.173670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] MFA Rules not processed for user `f766813e116b4b8fb0cca101161cd635`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:36.179812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:36.192910 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1754/3533] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:53:40.634701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:40.635314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:40.635475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:40.726447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] MFA Rules not processed for user `bdc18dc6c5214fbb9c1fa61eeb514cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:40.728479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:40.912977 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1780/3534] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:40.962630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:40.962630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:41.056780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616ce22-7aea-455f-a247-25b7bcdefd7f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:41.080546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:41.081222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:41.081615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:41.082954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:41.095870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:41.097951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:41.110742 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1755/3535] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:44.490895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:44.492914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:44.508282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092b3b5-945a-4285-9892-40adbf727935 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:44.514183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:44.515277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:44.515563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:44.515845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] PATH_INFO: `/v3/users/f766813e116b4b8fb0cca101161cd635` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:44.517390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f766813e116b4b8fb0cca101161cd635)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:44.521201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:44.608790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f766813e116b4b8fb0cca101161cd635'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:44.609898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f766813e116b4b8fb0cca101161cd635'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:44.619551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f766813e116b4b8fb0cca101161cd635'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:44.621117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f766813e116b4b8fb0cca101161cd635'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:44.632962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de7404bf-57d6-4bfa-ac4f-d72d5e5b21e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f766813e116b4b8fb0cca101161cd635'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:44.672667 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1781/3536] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:53:44 2022] DELETE /identity/v3/users/f766813e116b4b8fb0cca101161cd635 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:46.276726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:46.295885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdd7c5-7a8b-45f5-92c8-80231cb2efa1 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:46.419252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:46.420871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:46.421688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:46.422409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] PATH_INFO: `/v3/projects/30dc61c4cf2b43f986262f0c112abf49` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:46.423941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dc61c4cf2b43f986262f0c112abf49)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:46.430591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:46.516402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dc61c4cf2b43f986262f0c112abf49', 'request_id': 'req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:46.528210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dc61c4cf2b43f986262f0c112abf49', 'request_id': 'req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:46.547155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dc61c4cf2b43f986262f0c112abf49', 'request_id': 'req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:46.566419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] The token cache is being invalidate because project 30dc61c4cf2b43f986262f0c112abf49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:53:46.567462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:46.569252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ffb14e2-10d1-4146-b627-ec67c3f7acc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:46.571432 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1756/3537] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:53:46 2022] DELETE /identity/v3/projects/30dc61c4cf2b43f986262f0c112abf49 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:46.577241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ad1e-816f-4878-b7aa-33ea9cd65b5b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:46.578374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ad1e-816f-4878-b7aa-33ea9cd65b5b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:46.578905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ad1e-816f-4878-b7aa-33ea9cd65b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:46.613356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5ba3ad1e-816f-4878-b7aa-33ea9cd65b5b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:46.614911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ba3ad1e-816f-4878-b7aa-33ea9cd65b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:46.696842 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1782/3538] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:46.705962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefa04-91e3-4c1c-ae50-02576a536fd8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:46.706230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefa04-91e3-4c1c-ae50-02576a536fd8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:46.706541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fefa04-91e3-4c1c-ae50-02576a536fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:46.741233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-25fefa04-91e3-4c1c-ae50-02576a536fd8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:46.745912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-25fefa04-91e3-4c1c-ae50-02576a536fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:46.770269 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1757/3539] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:46.774721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ad1e-816f-4878-b7aa-33ea9cd65b5b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:46.789025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ad1e-816f-4878-b7aa-33ea9cd65b5b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:46.805515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:46.806199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:46.806456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:46.807084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:46.807990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:53:46.808292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:46.812722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:46.829033 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1783/3540] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:53:46.832408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fefa04-91e3-4c1c-ae50-02576a536fd8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:46.844913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fefa04-91e3-4c1c-ae50-02576a536fd8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:46.851786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:46.852476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:46.852758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:46.853035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:46.853744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:46.866514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:46.942690 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1758/3541] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:53:46 2022] POST /identity/v3/projects => generated 395 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:53:46.952269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:46.987956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07744e6-f15c-42b1-97bc-38121908c6f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:47.124807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:47.125300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:47.126074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:47.126074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:47.126891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:47.129138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:47.178591 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1784/3542] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:53:46 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:47.180031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:47.220800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097ae0b-7719-4beb-b051-c7676e7d2f9a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:47.236625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:47.237801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:47.238093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:47.238802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:47.239558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:47.242259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:47.290844 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1759/3543] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:53:47.292074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:47.306268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba258c1-5237-43e2-9146-de4384dcd509 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:47.314364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006408e-90c2-4df2-8268-4e558c7045af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:47.316373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006408e-90c2-4df2-8268-4e558c7045af admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:47.316667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006408e-90c2-4df2-8268-4e558c7045af admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:47.317829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006408e-90c2-4df2-8268-4e558c7045af admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:47.319540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006408e-90c2-4df2-8268-4e558c7045af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:47.322322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006408e-90c2-4df2-8268-4e558c7045af admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:47.373941 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1785/3544] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:47.378113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:47.391830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd0e48-581a-4d10-843a-5b1d42a37911 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:47.398333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:47.399725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:47.400181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:47.401406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] PATH_INFO: `/v3/projects/addf83b9a69e4628b1b962b7fceeb9ae/users/83a248d0471340df8fa0f09b0547574e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:47.437593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=addf83b9a69e4628b1b962b7fceeb9ae, user_id=83a248d0471340df8fa0f09b0547574e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:47.440413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:47.479490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06c476-8c80-4ab3-b43f-0b03a2a7ceae None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:47.480159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06c476-8c80-4ab3-b43f-0b03a2a7ceae None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:47.480606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06c476-8c80-4ab3-b43f-0b03a2a7ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:47.482134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1760/3545] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:53:47 2022] PUT /identity/v3/projects/addf83b9a69e4628b1b962b7fceeb9ae/users/83a248d0471340df8fa0f09b0547574e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:47.508023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5a06c476-8c80-4ab3-b43f-0b03a2a7ceae None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:47.509254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5a06c476-8c80-4ab3-b43f-0b03a2a7ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:47.579469 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1786/3546] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:47.593804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:47.596607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:47.677445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84aa150-bede-452b-9b0f-abad95704cab admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:47.681971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:47.682921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:47.683368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:47.683856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:47.696038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:47.697684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:47.708453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1761/3547] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:47.810197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905610-6e84-4c20-ae03-5fc116ca0314 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:47.810486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905610-6e84-4c20-ae03-5fc116ca0314 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:47.811345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2905610-6e84-4c20-ae03-5fc116ca0314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:47.858359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c2905610-6e84-4c20-ae03-5fc116ca0314 None None] MFA Rules not processed for user `bdc18dc6c5214fbb9c1fa61eeb514cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:47.859946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c2905610-6e84-4c20-ae03-5fc116ca0314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:47.940564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1787/3548] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:48.525763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:48.528866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:48.642405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ea7-905b-4c2c-9e56-e9b218df6898 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:48.648523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:48.649482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:48.649952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:48.650558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:48.652804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:48.688026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:48.691281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:48.720198 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1762/3549] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:53:54.393337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:54.393893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:54.394007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:54.423875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:54.425369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:54.527355 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1788/3550] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:53:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:54.620642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:54.622998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:54.734956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f55ac3-a43e-4244-b157-356da4a7a866 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:54.742697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:54.743500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:54.743846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:54.744332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:54.753734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:54.756233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:54.771242 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1763/3551] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:53:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:53:57.098497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:57.100723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:57.116044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9b16-1db5-4b7c-9519-0cfa0c84370c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:57.122093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:57.124709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:57.127371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:57.128012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] PATH_INFO: `/v3/users/396f4d7fe37343dcb4aeeb0839383f6f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:57.131179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=396f4d7fe37343dcb4aeeb0839383f6f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:57.133398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:57.218636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396f4d7fe37343dcb4aeeb0839383f6f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:57.229893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396f4d7fe37343dcb4aeeb0839383f6f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:57.241687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396f4d7fe37343dcb4aeeb0839383f6f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:57.246882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396f4d7fe37343dcb4aeeb0839383f6f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:57.258740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c37133fd-6ca4-453a-b9ee-397f04c1e3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396f4d7fe37343dcb4aeeb0839383f6f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:57.308555 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1789/3552] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:53:57 2022] DELETE /identity/v3/users/396f4d7fe37343dcb4aeeb0839383f6f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:57.937590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:57.953705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48023f-dfbd-4f0d-bf83-8b47b87cfb4d service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:58.060736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:58.061618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.061894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.062167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] PATH_INFO: `/v3/projects/7a05b8a866c04fe78b04ec616e62b70f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.063436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a05b8a866c04fe78b04ec616e62b70f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:58.065470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:58.134996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a05b8a866c04fe78b04ec616e62b70f', 'request_id': 'req-16f985f7-1c7e-4e06-8106-af8f5223a5aa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:58.144341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a05b8a866c04fe78b04ec616e62b70f', 'request_id': 'req-16f985f7-1c7e-4e06-8106-af8f5223a5aa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:58.159355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a05b8a866c04fe78b04ec616e62b70f', 'request_id': 'req-16f985f7-1c7e-4e06-8106-af8f5223a5aa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:58.174980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] The token cache is being invalidate because project 7a05b8a866c04fe78b04ec616e62b70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:53:58.175596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:58.176686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16f985f7-1c7e-4e06-8106-af8f5223a5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:53:58.184272 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1764/3553] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:53:57 2022] DELETE /identity/v3/projects/7a05b8a866c04fe78b04ec616e62b70f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:58.185589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee6741-fcdf-4ef1-b93f-9d22a47204dc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.186093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee6741-fcdf-4ef1-b93f-9d22a47204dc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.186202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee6741-fcdf-4ef1-b93f-9d22a47204dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.206097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5fee6741-fcdf-4ef1-b93f-9d22a47204dc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:58.207594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5fee6741-fcdf-4ef1-b93f-9d22a47204dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:58.290606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1790/3554] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:58.298816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce011-c127-450e-90f8-b0bfc4701cbc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.299371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce011-c127-450e-90f8-b0bfc4701cbc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.299823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ce011-c127-450e-90f8-b0bfc4701cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.323685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f57ce011-c127-450e-90f8-b0bfc4701cbc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:58.325323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f57ce011-c127-450e-90f8-b0bfc4701cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:58.338418 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1765/3555] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:58.339382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee6741-fcdf-4ef1-b93f-9d22a47204dc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:58.351485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee6741-fcdf-4ef1-b93f-9d22a47204dc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:58.368608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:58.369479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.369929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.370396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.371412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:53:58.371888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:58.373690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:58.391081 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1791/3556] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:53:58.395178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce011-c127-450e-90f8-b0bfc4701cbc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:58.407277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ce011-c127-450e-90f8-b0bfc4701cbc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:58.414599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:58.415545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.415994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.416434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.417426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:58.419585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:58.472597 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1766/3557] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:53:58 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:53:58.476464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:58.489820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124256f-c508-4174-afb3-01ef1b8455a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:58.645137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:58.645823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.647536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.648098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.648820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:58.661642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:58.726184 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1792/3558] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:53:58 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:53:58.730071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:58.748516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903f9ce-e061-47d0-88e1-efacde9dd054 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:58.773960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:58.774664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.774976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.777695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.778509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:58.781780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:58.830627 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1767/3559] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:58.834512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:58.866256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e7125-7f73-4f7a-b194-f7d320007245 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:58.873927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2cf29-c789-4079-8a9b-684d0ed32c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:58.875461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cf29-c789-4079-8a9b-684d0ed32c37 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.876993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cf29-c789-4079-8a9b-684d0ed32c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.877542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2cf29-c789-4079-8a9b-684d0ed32c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.879080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cf29-c789-4079-8a9b-684d0ed32c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:58.881801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2cf29-c789-4079-8a9b-684d0ed32c37 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:58.904780 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1793/3560] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:53:58.905661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:58.921963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e01a7-79b1-4e09-90ea-1b0a40115999 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:58.934688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:58.935684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:58.935981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:58.936252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] PATH_INFO: `/v3/projects/70a2fded25c74c839c01e55a91e7f7fc/users/58c7ff193f244ddfa887908f05a920c3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:58.994387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a2fded25c74c839c01e55a91e7f7fc, user_id=58c7ff193f244ddfa887908f05a920c3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:58.998100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:59.024931 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1768/3561] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:53:58 2022] PUT /identity/v3/projects/70a2fded25c74c839c01e55a91e7f7fc/users/58c7ff193f244ddfa887908f05a920c3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:53:59.029635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddb67-5da0-4ebc-ad44-621eafbba502 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:59.030440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddb67-5da0-4ebc-ad44-621eafbba502 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:59.030847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddb67-5da0-4ebc-ad44-621eafbba502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:59.066201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-339ddb67-5da0-4ebc-ad44-621eafbba502 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:53:59.068493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-339ddb67-5da0-4ebc-ad44-621eafbba502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:59.214464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1794/3562] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:53:59.272723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:53:59.275452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:53:59.461887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e393-4a24-4056-88d0-e246c55ffbe0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:53:59.472481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c026a-3426-4a53-90c6-0eaab57d29b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:53:59.474522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c026a-3426-4a53-90c6-0eaab57d29b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:53:59.475582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c026a-3426-4a53-90c6-0eaab57d29b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:53:59.476646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c026a-3426-4a53-90c6-0eaab57d29b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:53:59.504842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c026a-3426-4a53-90c6-0eaab57d29b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:53:59.507563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c026a-3426-4a53-90c6-0eaab57d29b5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:53:59.524640 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1769/3563] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:00.528182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781f5c-f711-4996-9b44-7db9a486349b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:00.528768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781f5c-f711-4996-9b44-7db9a486349b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:00.528768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1781f5c-f711-4996-9b44-7db9a486349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:00.551282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f1781f5c-f711-4996-9b44-7db9a486349b None None] MFA Rules not processed for user `3e390d65f16c47ec89f5f834bccfdd8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:00.553251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f1781f5c-f711-4996-9b44-7db9a486349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:00.627112 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1795/3564] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:03.613603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:03.614483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:03.615517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:03.678199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] MFA Rules not processed for user `83a248d0471340df8fa0f09b0547574e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:03.681386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:03.849091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1770/3565] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:03.850727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:03.852342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:03.852794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:03.917957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] MFA Rules not processed for user `83a248d0471340df8fa0f09b0547574e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:03.919654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:03.935005 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1796/3566] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:04.235885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:04.237328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:04.392228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb89c78-fb6c-444f-be95-c4b405353307 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:04.399697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c0bfe-3503-4ebc-bd05-9a84ed907d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:04.400438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0bfe-3503-4ebc-bd05-9a84ed907d3d service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:04.400726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0bfe-3503-4ebc-bd05-9a84ed907d3d service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:04.401207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c0bfe-3503-4ebc-bd05-9a84ed907d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:04.410910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0bfe-3503-4ebc-bd05-9a84ed907d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:04.413142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c0bfe-3503-4ebc-bd05-9a84ed907d3d service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:04.452818 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1771/3567] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:05.497536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:05.499046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:05.528302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3e4c5-e72d-4fab-8616-daa14c04529d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:05.542385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:05.543920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:05.544858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:05.545300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] PATH_INFO: `/v3/users/8f0d92d56cf344f0a591c64adea147e8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:05.547904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0d92d56cf344f0a591c64adea147e8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:05.553521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:05.704994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0d92d56cf344f0a591c64adea147e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:05.705713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0d92d56cf344f0a591c64adea147e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:05.718281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0d92d56cf344f0a591c64adea147e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:05.720912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0d92d56cf344f0a591c64adea147e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:05.747517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0d92d56cf344f0a591c64adea147e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:05.778077 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1797/3568] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:54:05 2022] DELETE /identity/v3/users/8f0d92d56cf344f0a591c64adea147e8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:05.783177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:05.784015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:05.784460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:05.815038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:05.816285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:06.005791 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1772/3569] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:06.048714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:06.051867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:06.207111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec53ce-9671-46a1-aa8d-30b0a33e73b9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:06.244136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:06.245755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:06.247395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:06.247683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:06.278107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:06.279866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:06.293376 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1798/3570] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:07.061038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:07.063024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:07.088267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f0afe-e631-4819-bc1e-237c61442729 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:07.107827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:07.108699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:07.108978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:07.109262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] PATH_INFO: `/v3/projects/5dbdf17ebd9e4981b3435b13defa64d6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:07.110574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbdf17ebd9e4981b3435b13defa64d6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:07.119554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:07.254160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbdf17ebd9e4981b3435b13defa64d6', 'request_id': 'req-0c019b41-c6c5-487e-9fa4-35c29973fecf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.272393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbdf17ebd9e4981b3435b13defa64d6', 'request_id': 'req-0c019b41-c6c5-487e-9fa4-35c29973fecf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.299531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbdf17ebd9e4981b3435b13defa64d6', 'request_id': 'req-0c019b41-c6c5-487e-9fa4-35c29973fecf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.341208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] The token cache is being invalidate because project 5dbdf17ebd9e4981b3435b13defa64d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:54:07.341694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.345589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.348400 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1773/3571] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:54:07 2022] DELETE /identity/v3/projects/5dbdf17ebd9e4981b3435b13defa64d6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:07.354668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:07.388937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af42f8-cbbd-4c19-8479-bb62d5bcc108 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:07.581292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:07.582258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:07.582545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:07.582849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] PATH_INFO: `/v3/users/b6ff6347f137494a9b987a209f58eabf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:07.587613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ff6347f137494a9b987a209f58eabf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:07.589802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:07.689539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ff6347f137494a9b987a209f58eabf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.691929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ff6347f137494a9b987a209f58eabf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.705151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ff6347f137494a9b987a209f58eabf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.706463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ff6347f137494a9b987a209f58eabf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.720286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1411da9c-5b9c-4415-8118-78cf91fd4320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ff6347f137494a9b987a209f58eabf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:07.757074 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1799/3572] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:54:07 2022] DELETE /identity/v3/users/b6ff6347f137494a9b987a209f58eabf => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:08.095874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:08.097336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:08.133324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019b41-c6c5-487e-9fa4-35c29973fecf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:08.256794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:08.257969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:08.258453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:08.258856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] PATH_INFO: `/v3/projects/95df3259314c43b690366d66d710f9b9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:08.261977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95df3259314c43b690366d66d710f9b9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:08.265932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:08.378588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95df3259314c43b690366d66d710f9b9', 'request_id': 'req-70fc6542-c207-4566-9316-59df06582a6b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:08.394717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95df3259314c43b690366d66d710f9b9', 'request_id': 'req-70fc6542-c207-4566-9316-59df06582a6b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:08.423352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95df3259314c43b690366d66d710f9b9', 'request_id': 'req-70fc6542-c207-4566-9316-59df06582a6b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:08.445903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] The token cache is being invalidate because project 95df3259314c43b690366d66d710f9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:54:08.446611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:08.447885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-70fc6542-c207-4566-9316-59df06582a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:08.450559 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1774/3573] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:54:08 2022] DELETE /identity/v3/projects/95df3259314c43b690366d66d710f9b9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:08.457111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41ddd-425f-40ec-9a9d-b2d04928c87f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:08.457684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41ddd-425f-40ec-9a9d-b2d04928c87f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:08.457684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f41ddd-425f-40ec-9a9d-b2d04928c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:08.486512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-94f41ddd-425f-40ec-9a9d-b2d04928c87f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:08.488070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-94f41ddd-425f-40ec-9a9d-b2d04928c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:08.572375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1800/3574] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:08.592814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8851-ab2b-40de-8668-b69bb6282c37 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:08.593444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8851-ab2b-40de-8668-b69bb6282c37 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:08.596005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca8851-ab2b-40de-8668-b69bb6282c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:08.634739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-10ca8851-ab2b-40de-8668-b69bb6282c37 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:08.639989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-10ca8851-ab2b-40de-8668-b69bb6282c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:08.673729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f41ddd-425f-40ec-9a9d-b2d04928c87f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:08.674557 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1775/3575] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:54:08.704559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f41ddd-425f-40ec-9a9d-b2d04928c87f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:08.724443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:08.725997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:08.726285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:08.727244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:08.728644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:54:08.729142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:08.733390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:08.765259 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1801/3576] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:54:08.766276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8851-ab2b-40de-8668-b69bb6282c37 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:08.780014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca8851-ab2b-40de-8668-b69bb6282c37 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:08.791437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:08.792520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:08.793062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:08.793500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:08.794572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:08.797479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:08.850408 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1776/3577] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:54:08 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:54:08.853739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:08.865313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997f553-d69e-4622-a97f-fe0071ca5afd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:08.971029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:08.971805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:08.972249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:08.972529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:08.973221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:08.979138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:09.046246 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1802/3578] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:54:08 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:54:09.051187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:09.069754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2837-87be-4936-93cc-b265961ac0ca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:09.079539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:09.080482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:09.081242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:09.081703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:09.082714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:09.089586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:09.123084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1777/3579] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:09.123825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:09.146647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f2c1d-d5e4-46ae-af14-430b29d24ae6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:09.158422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249bd3d6-3147-4875-9514-c2ddfca7df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:09.162377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd3d6-3147-4875-9514-c2ddfca7df8f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:09.162694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd3d6-3147-4875-9514-c2ddfca7df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:09.163012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249bd3d6-3147-4875-9514-c2ddfca7df8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:09.165228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bd3d6-3147-4875-9514-c2ddfca7df8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:09.166935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249bd3d6-3147-4875-9514-c2ddfca7df8f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:09.205476 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1803/3580] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:09.208024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:09.247172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c715953-26d0-4ad6-9f66-db2594810ed0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:09.254821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:09.257452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:09.258154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:09.258601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] PATH_INFO: `/v3/projects/a24cf19532e0484fabd6dc4e6b66fe30/users/7262be0d7db141e69bdf493bd7a5505a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:09.292930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24cf19532e0484fabd6dc4e6b66fe30, user_id=7262be0d7db141e69bdf493bd7a5505a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:09.295597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:09.322180 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1778/3581] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:54:09 2022] PUT /identity/v3/projects/a24cf19532e0484fabd6dc4e6b66fe30/users/7262be0d7db141e69bdf493bd7a5505a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:09.333090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bb19f-1de1-47c6-a7f6-a4064ef6fbd3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:09.333969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bb19f-1de1-47c6-a7f6-a4064ef6fbd3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:09.334228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bb19f-1de1-47c6-a7f6-a4064ef6fbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:09.374014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-710bb19f-1de1-47c6-a7f6-a4064ef6fbd3 None None] MFA Rules not processed for user `7262be0d7db141e69bdf493bd7a5505a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:09.375377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-710bb19f-1de1-47c6-a7f6-a4064ef6fbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:09.558251 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1804/3582] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:09.563601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:09.725604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5e7fc-4e67-4543-9ae2-c81340872680 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:09.751114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:09.752106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:09.752558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:09.752998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:09.753873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:09.757091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:09.795377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1779/3583] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:54:09 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:54:09.799501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bb19f-1de1-47c6-a7f6-a4064ef6fbd3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:09.817516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bb19f-1de1-47c6-a7f6-a4064ef6fbd3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:09.919843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:09.920837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:09.921283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:09.922022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:09.922924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:09.928000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:09.959368 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1805/3584] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:54:09 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:54:09.964091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:09.981126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8293e8-4f13-4a62-83e6-f88d9516048b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:09.988024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:09.988911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:09.990064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:09.990846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:09.991924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:09.994066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:10.015088 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1780/3585] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:10.019569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:10.033724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac17e-4e57-4257-bbdc-277d25ae8fd2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:10.046151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:10.047253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:10.047649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:10.048076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] PATH_INFO: `/v3/projects/b29b13d7780245b19aae37562ce848cb/users/659e06b5db2a42f8be5a2810ddb9a55b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:10.076607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29b13d7780245b19aae37562ce848cb, user_id=659e06b5db2a42f8be5a2810ddb9a55b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:10.079122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:10.097389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1806/3586] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:54:10 2022] PUT /identity/v3/projects/b29b13d7780245b19aae37562ce848cb/users/659e06b5db2a42f8be5a2810ddb9a55b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:10.102131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:10.113828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dce98-6de8-4791-8a0e-f67f8a0ce2f7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:10.181999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f4e39-254b-4f48-9e47-b93e770ac722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:10.183741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4e39-254b-4f48-9e47-b93e770ac722 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:10.187704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4e39-254b-4f48-9e47-b93e770ac722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:10.188253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f4e39-254b-4f48-9e47-b93e770ac722 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:10.189020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4e39-254b-4f48-9e47-b93e770ac722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:10.191310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f4e39-254b-4f48-9e47-b93e770ac722 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:10.209375 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1781/3587] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:10.213937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:10.226368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed3d5e-62bc-42bb-b4e1-355c53c8cde0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:10.233392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408160c-aa48-4be9-8f49-9dc702382685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:10.234972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408160c-aa48-4be9-8f49-9dc702382685 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:10.235259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408160c-aa48-4be9-8f49-9dc702382685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:10.235537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408160c-aa48-4be9-8f49-9dc702382685 admin admin] PATH_INFO: `/v3/projects/b29b13d7780245b19aae37562ce848cb/users/659e06b5db2a42f8be5a2810ddb9a55b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:10.237684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408160c-aa48-4be9-8f49-9dc702382685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29b13d7780245b19aae37562ce848cb, user_id=659e06b5db2a42f8be5a2810ddb9a55b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:10.241932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408160c-aa48-4be9-8f49-9dc702382685 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:10.254673 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1807/3588] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:54:10 2022] PUT /identity/v3/projects/b29b13d7780245b19aae37562ce848cb/users/659e06b5db2a42f8be5a2810ddb9a55b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:10.266385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:10.266684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:10.267396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:10.304466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] MFA Rules not processed for user `659e06b5db2a42f8be5a2810ddb9a55b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:10.306907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:10.429694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89899f9-891e-4343-be93-b3cf521392c4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:10.429694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89899f9-891e-4343-be93-b3cf521392c4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:10.429694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89899f9-891e-4343-be93-b3cf521392c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:10.431438 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1782/3589] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:10.461858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a89899f9-891e-4343-be93-b3cf521392c4 None None] MFA Rules not processed for user `7262be0d7db141e69bdf493bd7a5505a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:10.463403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a89899f9-891e-4343-be93-b3cf521392c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:10.563477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1808/3590] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:54:10.724829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:10.726417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:10.852967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf33dc-fc54-48ba-8b83-70cadf268497 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:10.873488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:10.874199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:10.874478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:10.874749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:10.896586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:10.898540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:10.923575 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1783/3591] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:18.826518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12ffa1-e4b8-4f9f-ba91-70cbd21b522c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:18.827235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12ffa1-e4b8-4f9f-ba91-70cbd21b522c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:18.827235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12ffa1-e4b8-4f9f-ba91-70cbd21b522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:18.869264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ef12ffa1-e4b8-4f9f-ba91-70cbd21b522c None None] MFA Rules not processed for user `58c7ff193f244ddfa887908f05a920c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:18.871172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ef12ffa1-e4b8-4f9f-ba91-70cbd21b522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:18.964359 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1809/3592] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:18.969023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:18.971289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:19.138210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdbf35-a99e-4137-ac91-529da0d9dd70 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:19.144146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:19.144929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:19.145171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:19.145686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:19.146585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:19.148817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:19.183644 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1784/3593] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:54:18 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:54:19.187784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12ffa1-e4b8-4f9f-ba91-70cbd21b522c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:19.205841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12ffa1-e4b8-4f9f-ba91-70cbd21b522c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:19.281499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:19.282573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:19.283058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:19.283515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:19.284363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:19.288272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:19.327148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:19.343073 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1810/3594] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:54:19 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:54:19.344080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5c1e1-49c5-4f38-8e7e-18916826c452 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:19.354029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:19.355344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:19.355836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:19.356830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:19.357994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:19.360424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:19.385763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:19.393351 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1785/3595] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:19.407598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602cbdd-8d5f-49e8-b000-706ffcf1915e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:19.421128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:19.422628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:19.423118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:19.424557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] PATH_INFO: `/v3/projects/3f39abdb186c4a85b6ebb6fb4a2cd983/users/83a018138b7c4abdb7907dc7cf6331d6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:19.456734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f39abdb186c4a85b6ebb6fb4a2cd983, user_id=83a018138b7c4abdb7907dc7cf6331d6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:19.461301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:19.499625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1811/3596] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:54:19 2022] PUT /identity/v3/projects/3f39abdb186c4a85b6ebb6fb4a2cd983/users/83a018138b7c4abdb7907dc7cf6331d6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:19.504092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:19.521769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9267b-4528-42ba-a79a-8e70a4467413 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:19.674497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:19.675599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:19.676221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:19.676891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:19.678066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:19.679993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:19.702446 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1786/3597] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:19.703060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:19.714745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9f4b-d18d-4534-a0e8-8c1126cabee0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:19.720320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:19.721222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:19.721647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:19.721975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] PATH_INFO: `/v3/projects/3f39abdb186c4a85b6ebb6fb4a2cd983/users/83a018138b7c4abdb7907dc7cf6331d6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:19.724181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f39abdb186c4a85b6ebb6fb4a2cd983, user_id=83a018138b7c4abdb7907dc7cf6331d6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:19.727705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:19.743226 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1812/3598] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:54:19 2022] PUT /identity/v3/projects/3f39abdb186c4a85b6ebb6fb4a2cd983/users/83a018138b7c4abdb7907dc7cf6331d6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:23.369738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:23.371668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:23.393335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a6fa4-f6e7-4d66-a839-bd3c59feec9e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:23.573717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:23.575184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:23.576626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:23.576626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] PATH_INFO: `/v3/users/a2d5596fa4984ceab3525ffc0a14d48f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:23.577816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d5596fa4984ceab3525ffc0a14d48f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:23.585068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:23.679954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d5596fa4984ceab3525ffc0a14d48f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:23.700985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d5596fa4984ceab3525ffc0a14d48f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:23.702125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d5596fa4984ceab3525ffc0a14d48f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:23.703248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d5596fa4984ceab3525ffc0a14d48f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:23.718120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d5596fa4984ceab3525ffc0a14d48f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:23.757173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1787/3599] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:54:23 2022] DELETE /identity/v3/users/a2d5596fa4984ceab3525ffc0a14d48f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:24.181681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:24.184170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:24.219636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae98f04-d329-48c5-aff9-b09c45f3485c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:24.327115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:24.328114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:24.328432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:24.328713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] PATH_INFO: `/v3/projects/62b1d2f38652407eaa85fbb15aff6307` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:24.330721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b1d2f38652407eaa85fbb15aff6307)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:24.333897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:24.405372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b1d2f38652407eaa85fbb15aff6307', 'request_id': 'req-5b6a6da3-efcd-4b62-9d4e-d56773968fef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.417886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b1d2f38652407eaa85fbb15aff6307', 'request_id': 'req-5b6a6da3-efcd-4b62-9d4e-d56773968fef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.429480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b1d2f38652407eaa85fbb15aff6307', 'request_id': 'req-5b6a6da3-efcd-4b62-9d4e-d56773968fef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.445037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] The token cache is being invalidate because project 62b1d2f38652407eaa85fbb15aff6307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:54:24.445430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.446632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.452798 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1813/3600] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:54:24 2022] DELETE /identity/v3/projects/62b1d2f38652407eaa85fbb15aff6307 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:24.454810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:24.468861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491d957-78d1-4f4a-9f3d-1fac889a9350 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:24.600023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:24.601039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:24.601392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:24.601747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] PATH_INFO: `/v3/users/ef9db3cf1fa74bb6bf86e64c2e93c964` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:24.604326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9db3cf1fa74bb6bf86e64c2e93c964)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:24.606440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:24.681954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9db3cf1fa74bb6bf86e64c2e93c964'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.694824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9db3cf1fa74bb6bf86e64c2e93c964'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.697474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9db3cf1fa74bb6bf86e64c2e93c964'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.699001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9db3cf1fa74bb6bf86e64c2e93c964'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.715584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26239199-afd3-4e1d-80ff-50980f882d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9db3cf1fa74bb6bf86e64c2e93c964'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:24.756935 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1788/3601] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:54:24 2022] DELETE /identity/v3/users/ef9db3cf1fa74bb6bf86e64c2e93c964 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:54:25.414746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:25.417393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:25.456108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6da3-efcd-4b62-9d4e-d56773968fef admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:25.567393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:25.575690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:25.576419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:25.577089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] PATH_INFO: `/v3/projects/90ce3cad9a044db6a6f73cbbe92dc662` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:25.578866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ce3cad9a044db6a6f73cbbe92dc662)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:25.581103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:25.670251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ce3cad9a044db6a6f73cbbe92dc662', 'request_id': 'req-1c9e14a3-6699-4f51-b416-107f825b69ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:25.693688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ce3cad9a044db6a6f73cbbe92dc662', 'request_id': 'req-1c9e14a3-6699-4f51-b416-107f825b69ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:25.710933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ce3cad9a044db6a6f73cbbe92dc662', 'request_id': 'req-1c9e14a3-6699-4f51-b416-107f825b69ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:25.747386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] The token cache is being invalidate because project 90ce3cad9a044db6a6f73cbbe92dc662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:54:25.747690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:25.748396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1c9e14a3-6699-4f51-b416-107f825b69ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:54:25.756789 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1814/3602] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:54:25 2022] DELETE /identity/v3/projects/90ce3cad9a044db6a6f73cbbe92dc662 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:25.757887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382a5a-fe74-41d7-8693-4e3f8ae9b002 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:25.759035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382a5a-fe74-41d7-8693-4e3f8ae9b002 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:25.759515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25382a5a-fe74-41d7-8693-4e3f8ae9b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:25.793384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-25382a5a-fe74-41d7-8693-4e3f8ae9b002 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:25.795959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-25382a5a-fe74-41d7-8693-4e3f8ae9b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:25.890442 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1789/3603] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:25.899888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081c28-d8dd-49f4-9ee8-1f000cbc8ccb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:25.900349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081c28-d8dd-49f4-9ee8-1f000cbc8ccb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:25.900479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9081c28-d8dd-49f4-9ee8-1f000cbc8ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.148179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d9081c28-d8dd-49f4-9ee8-1f000cbc8ccb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:26.149959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d9081c28-d8dd-49f4-9ee8-1f000cbc8ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:26.166420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25382a5a-fe74-41d7-8693-4e3f8ae9b002 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:26.166637 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1815/3604] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:26.183826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25382a5a-fe74-41d7-8693-4e3f8ae9b002 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:26.194278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:26.195378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:26.196215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:26.196682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.197726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:54:26.198382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:26.200466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:26.221750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1790/3605] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:54:26.226163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9081c28-d8dd-49f4-9ee8-1f000cbc8ccb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:26.237155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9081c28-d8dd-49f4-9ee8-1f000cbc8ccb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:26.243879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:26.244548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:26.244825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:26.245097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.245940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:26.247896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:26.306026 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1816/3606] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:54:26 2022] POST /identity/v3/projects => generated 397 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:54:26.309853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:26.326177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9b315-1a23-41f8-bef8-cd0880bb9f2a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:26.436593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:26.439126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:26.439628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:26.440263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.441308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:26.444855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:26.478849 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1791/3607] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:54:26 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:54:26.479127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:26.493593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f77b-cbd4-43a4-b3b4-7ba611cf4e2a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:26.508138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:26.511938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:26.512649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:26.513369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.515001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:26.518481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:26.544525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:26.556811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1817/3608] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:26.564151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c0de3-aae0-4116-8e54-2b36eb0a639f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:26.573744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ca7eb-46d6-4d99-8058-feb7491d9076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:26.574973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca7eb-46d6-4d99-8058-feb7491d9076 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:26.575409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca7eb-46d6-4d99-8058-feb7491d9076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:26.575829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ca7eb-46d6-4d99-8058-feb7491d9076 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.578581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca7eb-46d6-4d99-8058-feb7491d9076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:26.582266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ca7eb-46d6-4d99-8058-feb7491d9076 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:26.606523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:26.627457 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1792/3609] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:54:26.630531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da16176-449a-4755-b1de-3837d4847eb7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:26.637020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:26.638498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:26.639035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:26.639456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] PATH_INFO: `/v3/projects/4c2ee723c6a04843b302e255a401b1e7/users/a295663c20584408b634e99490e34883/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.661430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2ee723c6a04843b302e255a401b1e7, user_id=a295663c20584408b634e99490e34883, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:26.666610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:26.700511 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1818/3610] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:54:26 2022] PUT /identity/v3/projects/4c2ee723c6a04843b302e255a401b1e7/users/a295663c20584408b634e99490e34883/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:54:26.701681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e12e2-87ff-49e4-9a7f-a68c6bac22c9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:26.702656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e12e2-87ff-49e4-9a7f-a68c6bac22c9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:26.702656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e12e2-87ff-49e4-9a7f-a68c6bac22c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:26.727550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-145e12e2-87ff-49e4-9a7f-a68c6bac22c9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:26.728963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-145e12e2-87ff-49e4-9a7f-a68c6bac22c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:26.885269 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1793/3611] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:26.947634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:26.949812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:27.122040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d71e2-b47b-4696-9ee9-415b2d01478e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:27.132644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:27.133371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:27.133711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:27.134051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:27.157383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:27.161133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:27.188725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1819/3612] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:30.664856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fe579-8200-42f3-b886-c17e27f146f3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:30.665413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fe579-8200-42f3-b886-c17e27f146f3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:30.665683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fe579-8200-42f3-b886-c17e27f146f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:30.718887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fd3fe579-8200-42f3-b886-c17e27f146f3 None None] MFA Rules not processed for user `83a018138b7c4abdb7907dc7cf6331d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:30.726148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd3fe579-8200-42f3-b886-c17e27f146f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:30.863090 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1794/3613] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:30.872726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:30.874416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:30.967972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a5cb-f1ee-4712-8f01-d67b3303ceb6 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:30.976887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97e30-d0cb-4b95-821d-b18f179a5f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:30.977886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97e30-d0cb-4b95-821d-b18f179a5f50 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:30.978373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97e30-d0cb-4b95-821d-b18f179a5f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:30.979792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97e30-d0cb-4b95-821d-b18f179a5f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:30.984202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b8d97e30-d0cb-4b95-821d-b18f179a5f50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:31.110098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d97e30-d0cb-4b95-821d-b18f179a5f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:31.112354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d97e30-d0cb-4b95-821d-b18f179a5f50 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:31.139546 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1820/3614] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:38.144177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:38.144689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:38.144689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:38.231520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] MFA Rules not processed for user `a295663c20584408b634e99490e34883`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:38.234527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:38.337177 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1795/3615] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:38.349322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:38.350624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:38.351162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:38.388136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] MFA Rules not processed for user `a295663c20584408b634e99490e34883`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:38.390188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:38.401223 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1821/3616] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:54:38.416036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:38.417729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:38.542060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091368f-4069-43b0-b0ab-a607d382cffc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:38.562921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8813-fa97-4e8e-a3d0-fef99ab77c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:38.564734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8813-fa97-4e8e-a3d0-fef99ab77c74 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:38.565291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8813-fa97-4e8e-a3d0-fef99ab77c74 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:38.566183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8813-fa97-4e8e-a3d0-fef99ab77c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:38.579030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b8813-fa97-4e8e-a3d0-fef99ab77c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:38.582201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154b8813-fa97-4e8e-a3d0-fef99ab77c74 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:38.603448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1796/3617] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:44.142540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:44.145627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:44.177174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042e46f-4576-4a82-a24f-906e74f720b6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:44.191288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c3284-4bd4-42cd-acb3-64a741684f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:44.193018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3284-4bd4-42cd-acb3-64a741684f9e service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:44.193549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3284-4bd4-42cd-acb3-64a741684f9e service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:44.194078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c3284-4bd4-42cd-acb3-64a741684f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:44.209945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b32c3284-4bd4-42cd-acb3-64a741684f9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:44.314925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c3284-4bd4-42cd-acb3-64a741684f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:44.319783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c3284-4bd4-42cd-acb3-64a741684f9e service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:44.341101 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1822/3618] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:54:45.717818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a775-51f8-4f7c-b582-875389356d6f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:45.718665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a775-51f8-4f7c-b582-875389356d6f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:45.719344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a775-51f8-4f7c-b582-875389356d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:45.768304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2c13a775-51f8-4f7c-b582-875389356d6f None None] MFA Rules not processed for user `7262be0d7db141e69bdf493bd7a5505a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:45.779820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2c13a775-51f8-4f7c-b582-875389356d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:45.963522 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1797/3619] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:48.277741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfacbea-0208-4f62-b3ed-0e147eab2dfd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:48.278628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfacbea-0208-4f62-b3ed-0e147eab2dfd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:48.279212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfacbea-0208-4f62-b3ed-0e147eab2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:48.312297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8bfacbea-0208-4f62-b3ed-0e147eab2dfd None None] MFA Rules not processed for user `58c7ff193f244ddfa887908f05a920c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:48.314939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8bfacbea-0208-4f62-b3ed-0e147eab2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:48.334003 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1823/3620] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:54:48.335666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864150-b5a0-4b0a-b5ad-66e4860a73df None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:48.336179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864150-b5a0-4b0a-b5ad-66e4860a73df None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:48.336571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69864150-b5a0-4b0a-b5ad-66e4860a73df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:48.372132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-69864150-b5a0-4b0a-b5ad-66e4860a73df None None] MFA Rules not processed for user `58c7ff193f244ddfa887908f05a920c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:54:48.376047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69864150-b5a0-4b0a-b5ad-66e4860a73df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:48.396377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1798/3621] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:54:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:54:52.894441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfacbea-0208-4f62-b3ed-0e147eab2dfd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:54:52.912039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfacbea-0208-4f62-b3ed-0e147eab2dfd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:54:52.918315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dede2-f988-4c88-a7fa-e2096b549023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:54:52.919640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dede2-f988-4c88-a7fa-e2096b549023 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:54:52.920160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dede2-f988-4c88-a7fa-e2096b549023 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:54:52.920673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dede2-f988-4c88-a7fa-e2096b549023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:54:52.924584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e99dede2-f988-4c88-a7fa-e2096b549023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:54:52.982262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dede2-f988-4c88-a7fa-e2096b549023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:54:52.985369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dede2-f988-4c88-a7fa-e2096b549023 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:54:53.044484 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1824/3622] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:54:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:00.596047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:00.596535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:00.596622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:00.632223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] MFA Rules not processed for user `a295663c20584408b634e99490e34883`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:00.633522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:00.646952 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1799/3623] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:07.081843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:07.082658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:07.083110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:07.104371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:07.105852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:07.183741 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1825/3624] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:55:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:55:07.244852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:07.246885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:07.335535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d7c1-1958-4a59-bb2d-fe8a1d1d0cfc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:07.352682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43733d97-ffb5-4579-9f22-b4a1405b38af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:07.353060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733d97-ffb5-4579-9f22-b4a1405b38af service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:07.353350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733d97-ffb5-4579-9f22-b4a1405b38af service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:07.353591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43733d97-ffb5-4579-9f22-b4a1405b38af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:07.368022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733d97-ffb5-4579-9f22-b4a1405b38af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:07.370317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43733d97-ffb5-4579-9f22-b4a1405b38af service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:07.385670 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1800/3625] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:55:13.426481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:13.427945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:13.461557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44295b-d314-49f7-9e38-2b662259aae6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:13.471583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a7d8-69bd-41b3-9731-25e81dfab8c2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:13.473574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a7d8-69bd-41b3-9731-25e81dfab8c2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:13.474082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a7d8-69bd-41b3-9731-25e81dfab8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:13.481792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:13.485279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:13.490469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:13.490878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] PATH_INFO: `/v3/users/63a6acdebf9648698ee5f3a5cac02675` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:13.493026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a6acdebf9648698ee5f3a5cac02675)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:13.496796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:13.516852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2957a7d8-69bd-41b3-9731-25e81dfab8c2 None None] MFA Rules not processed for user `7262be0d7db141e69bdf493bd7a5505a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:13.521677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2957a7d8-69bd-41b3-9731-25e81dfab8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:13.549386 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1801/3626] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:55:13.617986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a6acdebf9648698ee5f3a5cac02675'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:13.618714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a6acdebf9648698ee5f3a5cac02675'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:13.641419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a6acdebf9648698ee5f3a5cac02675'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:13.642390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a6acdebf9648698ee5f3a5cac02675'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:13.662336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-97253a4c-00ed-4b36-b981-3a2febb7a9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a6acdebf9648698ee5f3a5cac02675'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:13.694834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1826/3627] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:55:13 2022] DELETE /identity/v3/users/63a6acdebf9648698ee5f3a5cac02675 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:55:14.376823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a7d8-69bd-41b3-9731-25e81dfab8c2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:14.396221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a7d8-69bd-41b3-9731-25e81dfab8c2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:14.532052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:14.535444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:14.536010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:14.536448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] PATH_INFO: `/v3/projects/0b9502da27d64dffaf0859d1f6b5663f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:14.538136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9502da27d64dffaf0859d1f6b5663f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:14.541569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:14.619548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9502da27d64dffaf0859d1f6b5663f', 'request_id': 'req-42e12c16-1e6f-4716-b0b4-56f6956e50e7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:14.628927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9502da27d64dffaf0859d1f6b5663f', 'request_id': 'req-42e12c16-1e6f-4716-b0b4-56f6956e50e7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:14.648235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9502da27d64dffaf0859d1f6b5663f', 'request_id': 'req-42e12c16-1e6f-4716-b0b4-56f6956e50e7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:14.668652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] The token cache is being invalidate because project 0b9502da27d64dffaf0859d1f6b5663f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:55:14.669294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:14.670145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-42e12c16-1e6f-4716-b0b4-56f6956e50e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:14.673340 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1802/3628] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:55:14 2022] DELETE /identity/v3/projects/0b9502da27d64dffaf0859d1f6b5663f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:55:14.678917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8fb63-2a98-4bf4-8013-0f55d390f04f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:14.679848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8fb63-2a98-4bf4-8013-0f55d390f04f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:14.680313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8fb63-2a98-4bf4-8013-0f55d390f04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:14.717317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-40a8fb63-2a98-4bf4-8013-0f55d390f04f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:14.720016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-40a8fb63-2a98-4bf4-8013-0f55d390f04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:14.835907 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1827/3629] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:14.845816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efc83-d3b2-4aed-89c8-5cd08ee63f56 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:14.846366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efc83-d3b2-4aed-89c8-5cd08ee63f56 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:14.846845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035efc83-d3b2-4aed-89c8-5cd08ee63f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:14.876040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-035efc83-d3b2-4aed-89c8-5cd08ee63f56 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:14.877878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-035efc83-d3b2-4aed-89c8-5cd08ee63f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:14.892981 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1803/3630] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:14.902000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8fb63-2a98-4bf4-8013-0f55d390f04f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:14.915685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8fb63-2a98-4bf4-8013-0f55d390f04f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:14.924479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:14.925600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:14.926048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:14.928392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:14.929428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:55:14.929890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:14.931785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:14.950575 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1828/3631] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:55:14.955002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035efc83-d3b2-4aed-89c8-5cd08ee63f56 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:14.967983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035efc83-d3b2-4aed-89c8-5cd08ee63f56 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:14.974823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:14.976195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:14.976724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:14.977407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:14.978363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:14.980672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:15.014291 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1804/3632] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:55:14 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:55:15.025941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:15.066863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dd1c4-32b0-40f7-bd01-15538b2db858 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:15.206321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:15.221064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:15.221365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:15.221637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:15.226451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:15.235106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:15.284107 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1829/3633] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:55:15 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:55:15.285770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:15.302471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4ea7f-4b6f-452a-af11-b10ba35f91ff admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:15.317520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:15.320163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:15.320614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:15.321630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:15.326219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:15.329924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:15.360146 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1805/3634] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:55:15.362755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:15.374815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede8976-5115-49f2-8dd8-7e907296efc0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:15.392144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ac95-26bb-430e-9a08-210f1d402c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:15.392778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ac95-26bb-430e-9a08-210f1d402c1d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:15.393062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ac95-26bb-430e-9a08-210f1d402c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:15.393335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ac95-26bb-430e-9a08-210f1d402c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:15.394104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ac95-26bb-430e-9a08-210f1d402c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:15.408332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ac95-26bb-430e-9a08-210f1d402c1d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:15.428863 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1830/3635] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:55:15.430363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:15.451147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89204ad1-32a5-4882-870c-fd86c9c110ae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:15.475552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:15.483159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:15.487375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:15.488532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] PATH_INFO: `/v3/projects/85587313eff94af59406aca0c1a96a02/users/228761ebf4c0406ab0977cabe351ac76/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:15.590143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85587313eff94af59406aca0c1a96a02, user_id=228761ebf4c0406ab0977cabe351ac76, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:15.595061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:15.645712 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1806/3636] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:55:15 2022] PUT /identity/v3/projects/85587313eff94af59406aca0c1a96a02/users/228761ebf4c0406ab0977cabe351ac76/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:55:15.647660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a044-1bb1-4a90-8803-415ad2a65744 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:15.647959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a044-1bb1-4a90-8803-415ad2a65744 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:15.648248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3a044-1bb1-4a90-8803-415ad2a65744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:15.720641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1ad3a044-1bb1-4a90-8803-415ad2a65744 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:15.721983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ad3a044-1bb1-4a90-8803-415ad2a65744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:15.849875 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1831/3637] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:15.889104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:15.891644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:16.001461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf911b4-4c36-4662-b7ca-91a5434a6349 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:16.010110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400e66c-4be0-4ab6-ab4e-a8f30cf781aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:16.010803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e66c-4be0-4ab6-ab4e-a8f30cf781aa service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:16.016634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e66c-4be0-4ab6-ab4e-a8f30cf781aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:16.016909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400e66c-4be0-4ab6-ab4e-a8f30cf781aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:16.038525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400e66c-4be0-4ab6-ab4e-a8f30cf781aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:16.040032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400e66c-4be0-4ab6-ab4e-a8f30cf781aa service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:16.071579 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1807/3638] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:19.518855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:19.520203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:19.520644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:19.582618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:19.586292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:19.705178 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1832/3639] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:19.731397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce27ec-4463-48aa-82bd-28d5cbadab13 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:19.731920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce27ec-4463-48aa-82bd-28d5cbadab13 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:19.732307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce27ec-4463-48aa-82bd-28d5cbadab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:19.777426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c4ce27ec-4463-48aa-82bd-28d5cbadab13 None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:19.780222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c4ce27ec-4463-48aa-82bd-28d5cbadab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:19.804462 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1808/3640] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:21.259362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:21.260981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:21.420135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19170e85-dd10-46dd-966d-8563d3d48afd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:21.427060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:21.428171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:21.428638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:21.429814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:21.439897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:21.442497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:21.471740 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1833/3641] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:34.073677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a05b-d2e6-44dd-9345-84fc62d6086d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:34.074530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a05b-d2e6-44dd-9345-84fc62d6086d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:34.074991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297a05b-d2e6-44dd-9345-84fc62d6086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:34.093682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6297a05b-d2e6-44dd-9345-84fc62d6086d None None] MFA Rules not processed for user `3e390d65f16c47ec89f5f834bccfdd8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:34.095208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6297a05b-d2e6-44dd-9345-84fc62d6086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:34.172141 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1809/3642] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:36.225562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:36.228372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:36.318175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a267df-e48e-4a38-8816-2395cea116ce service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:36.322553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:36.323656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:36.324131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:36.324589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:36.326897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:36.347349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:36.349110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:36.365419 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1834/3643] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:36.538147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a05b-d2e6-44dd-9345-84fc62d6086d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:36.558102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297a05b-d2e6-44dd-9345-84fc62d6086d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:36.562222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:36.562999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:36.563395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:36.563920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:36.567561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:36.600120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:36.602385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:36.615047 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1810/3644] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:45.652585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:45.654485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:45.670061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0edb-2bd9-45bf-aeb1-f6f059de97e9 service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:45.675542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d109b-3d80-4a9a-a5b4-2069cf1c280a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:45.676210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d109b-3d80-4a9a-a5b4-2069cf1c280a service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:45.676494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d109b-3d80-4a9a-a5b4-2069cf1c280a service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:45.676770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d109b-3d80-4a9a-a5b4-2069cf1c280a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:45.679047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a01d109b-3d80-4a9a-a5b4-2069cf1c280a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:45.699202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d109b-3d80-4a9a-a5b4-2069cf1c280a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:45.700890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d109b-3d80-4a9a-a5b4-2069cf1c280a service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:45.718572 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1835/3645] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:47.228159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:47.243063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5fc7c-963a-4a65-bd22-9c6344e3be97 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:47.248857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:47.249608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:47.249905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:47.250212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:47.252411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:47.271921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:47.273729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:47.289052 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1811/3646] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:47.451077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e834e-b74c-4aef-9679-862aeb67a9f3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:47.451603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e834e-b74c-4aef-9679-862aeb67a9f3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:47.451753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e834e-b74c-4aef-9679-862aeb67a9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:47.476676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-de2e834e-b74c-4aef-9679-862aeb67a9f3 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:47.479123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de2e834e-b74c-4aef-9679-862aeb67a9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:47.563418 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1836/3647] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:55:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:55:47.576955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:47.579350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:47.696202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0ac95-8ccb-4b05-ad8b-52741fb31494 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:47.711095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:47.713023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:47.714114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:47.714360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:47.726170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:47.728133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:47.737930 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1812/3648] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:55:52.267831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:52.268906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:52.269133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:52.320799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] MFA Rules not processed for user `7262be0d7db141e69bdf493bd7a5505a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:52.327617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:52.479481 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1837/3649] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:54.125180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:54.126934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:54.282799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001c8fd-2e4b-4178-8d7c-5f87127c1dae service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:54.308480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:54.309541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:54.310095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:54.310603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:54.313636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:54.334630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:54.337757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:54.354245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1813/3650] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:57.576959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:57.579731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:57.621326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc585add-dfbd-463f-ac2f-66ac5311d1f8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:57.633646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:57.635702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:57.640564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:57.641144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] PATH_INFO: `/v3/users/83a248d0471340df8fa0f09b0547574e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:57.647765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a248d0471340df8fa0f09b0547574e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:57.651025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:57.806021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a248d0471340df8fa0f09b0547574e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:57.807092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a248d0471340df8fa0f09b0547574e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:57.825691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a248d0471340df8fa0f09b0547574e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:57.826982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a248d0471340df8fa0f09b0547574e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:57.842849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa043a0-a409-41e8-ad70-9256cec0c052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a248d0471340df8fa0f09b0547574e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:57.891170 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1838/3651] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:55:57 2022] DELETE /identity/v3/users/83a248d0471340df8fa0f09b0547574e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:55:58.297944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:58.329015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c5351-7b55-475d-9c74-a686f3b8fd52 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:58.496959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:58.498072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:58.498356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:58.498628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] PATH_INFO: `/v3/projects/addf83b9a69e4628b1b962b7fceeb9ae` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:58.500887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=addf83b9a69e4628b1b962b7fceeb9ae)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:58.503725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:58.673705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addf83b9a69e4628b1b962b7fceeb9ae', 'request_id': 'req-1b42c564-6ef1-489c-8a6d-660059057838'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:58.693281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addf83b9a69e4628b1b962b7fceeb9ae', 'request_id': 'req-1b42c564-6ef1-489c-8a6d-660059057838'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:58.710247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addf83b9a69e4628b1b962b7fceeb9ae', 'request_id': 'req-1b42c564-6ef1-489c-8a6d-660059057838'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:58.740805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] The token cache is being invalidate because project addf83b9a69e4628b1b962b7fceeb9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:55:58.747308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:58.750241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b42c564-6ef1-489c-8a6d-660059057838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:55:58.758930 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1814/3652] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:55:58 2022] DELETE /identity/v3/projects/addf83b9a69e4628b1b962b7fceeb9ae => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:55:58.759823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd644f9-6ba2-479f-b17c-b5db3d570b38 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:58.760284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd644f9-6ba2-479f-b17c-b5db3d570b38 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:58.760373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd644f9-6ba2-479f-b17c-b5db3d570b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:58.831266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bcd644f9-6ba2-479f-b17c-b5db3d570b38 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:58.832663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bcd644f9-6ba2-479f-b17c-b5db3d570b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:58.982325 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1839/3653] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:58.992140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710603c-c184-4b85-a3ce-dc57545646ea None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:58.992403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710603c-c184-4b85-a3ce-dc57545646ea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:58.992862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710603c-c184-4b85-a3ce-dc57545646ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.027193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e710603c-c184-4b85-a3ce-dc57545646ea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:59.028734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e710603c-c184-4b85-a3ce-dc57545646ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:59.052254 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1815/3654] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:55:59.052571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd644f9-6ba2-479f-b17c-b5db3d570b38 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:59.069452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd644f9-6ba2-479f-b17c-b5db3d570b38 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:59.083470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fb40e-073e-4ca5-9449-eabf70e037b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:59.083739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb40e-073e-4ca5-9449-eabf70e037b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.084349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb40e-073e-4ca5-9449-eabf70e037b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.084882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fb40e-073e-4ca5-9449-eabf70e037b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.085899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fb40e-073e-4ca5-9449-eabf70e037b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:55:59.086348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fb40e-073e-4ca5-9449-eabf70e037b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:59.088361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fb40e-073e-4ca5-9449-eabf70e037b0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:59.129495 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1840/3655] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:55:59.134011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710603c-c184-4b85-a3ce-dc57545646ea None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:59.156426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710603c-c184-4b85-a3ce-dc57545646ea None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:59.167612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:59.168288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.168573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.173278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.177131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:59.183635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:59.234338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3081-bbfb-41f7-8f3e-25839896b2a5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.255553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3081-bbfb-41f7-8f3e-25839896b2a5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.260375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3081-bbfb-41f7-8f3e-25839896b2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.320291 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1816/3656] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:55:59 2022] POST /identity/v3/projects => generated 361 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:55:59.321786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:59.328327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:59.333360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5a4e3081-bbfb-41f7-8f3e-25839896b2a5 None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:55:59.339979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5a4e3081-bbfb-41f7-8f3e-25839896b2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:59.476068 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1841/3657] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:55:59.476971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e3081-bbfb-41f7-8f3e-25839896b2a5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:59.513777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbfcb8-019d-4c05-93cc-bb977b084cec admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:59.525306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:59.528026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.528532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.529702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.535916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:55:59.582884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:59.586259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:59.632752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e3081-bbfb-41f7-8f3e-25839896b2a5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:59.633614 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1817/3658] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:55:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:55:59.640884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:59.642349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.642851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.644578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.645272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:59.648937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:59.714615 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1842/3659] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:55:59 2022] POST /identity/v3/users => generated 281 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:55:59.724605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:59.738581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda871b4-3689-4c78-a92d-1781b117f581 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:59.744644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:59.745601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.746089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.746580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.747757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:59.749669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:59.766529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:59.779236 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1818/3660] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:55:59.781289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b8757-fe44-440a-a6e6-306737610833 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:59.791077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e4820-c3e8-4c62-bc18-58b36986795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:59.792118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e4820-c3e8-4c62-bc18-58b36986795f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.792599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e4820-c3e8-4c62-bc18-58b36986795f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.793106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e4820-c3e8-4c62-bc18-58b36986795f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.794195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e4820-c3e8-4c62-bc18-58b36986795f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:59.796732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e4820-c3e8-4c62-bc18-58b36986795f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:59.817241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:55:59.818711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1843/3661] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:55:59.831948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f447c-6295-44b4-85b1-f8018da6bacf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:55:59.837301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:55:59.839151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.839683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.840156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] PATH_INFO: `/v3/projects/194cad4976254796a1abb35ba9c6bd7e/users/56c35676cc1b48239e3e18d826cfc1b3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:55:59.883766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194cad4976254796a1abb35ba9c6bd7e, user_id=56c35676cc1b48239e3e18d826cfc1b3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:55:59.887607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:55:59.914733 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1819/3662] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:55:59 2022] PUT /identity/v3/projects/194cad4976254796a1abb35ba9c6bd7e/users/56c35676cc1b48239e3e18d826cfc1b3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:55:59.926232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594b39-0c09-4d9e-817e-ad64dc811044 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:55:59.927106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594b39-0c09-4d9e-817e-ad64dc811044 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:55:59.927595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29594b39-0c09-4d9e-817e-ad64dc811044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:00.006145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-29594b39-0c09-4d9e-817e-ad64dc811044 None None] MFA Rules not processed for user `56c35676cc1b48239e3e18d826cfc1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:00.007704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-29594b39-0c09-4d9e-817e-ad64dc811044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:00.159995 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1844/3663] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:01.634528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:01.905498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da2d4-5842-4728-8f49-6f78d5644c47 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:01.917338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:01.920533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:01.920913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:01.921271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] PATH_INFO: `/v3/users/56c35676cc1b48239e3e18d826cfc1b3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:01.922788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c35676cc1b48239e3e18d826cfc1b3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:01.925656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:02.031696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c35676cc1b48239e3e18d826cfc1b3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:02.054082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c35676cc1b48239e3e18d826cfc1b3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:02.056563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c35676cc1b48239e3e18d826cfc1b3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:02.057716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c35676cc1b48239e3e18d826cfc1b3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:02.076581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c35676cc1b48239e3e18d826cfc1b3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:02.108010 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1820/3664] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:01 2022] DELETE /identity/v3/users/56c35676cc1b48239e3e18d826cfc1b3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:02.112955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:02.113502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:02.113502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:02.215117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:02.218762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:02.353329 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1845/3665] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:02.377740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:02.379094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:02.567566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832e698-7c67-43e0-8335-fcfa20bbf1c5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:02.573929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:02.574689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:02.575006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:02.575331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:02.607410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:02.611777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:02.639652 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1821/3666] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:03.267405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:03.271454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:03.369795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9449cb-83cc-4373-840b-11c06df1e0c1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:03.376577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fc821-d8fa-4fcf-98b9-fb6e27228c8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:03.378137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fc821-d8fa-4fcf-98b9-fb6e27228c8b service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:03.381103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fc821-d8fa-4fcf-98b9-fb6e27228c8b service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:03.381103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fc821-d8fa-4fcf-98b9-fb6e27228c8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:03.382373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3b5fc821-d8fa-4fcf-98b9-fb6e27228c8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:03.404511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fc821-d8fa-4fcf-98b9-fb6e27228c8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:03.408658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5fc821-d8fa-4fcf-98b9-fb6e27228c8b service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:03.428990 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1846/3667] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:56:03.589567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:03.591442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:03.613969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e884501-e61b-44ec-8a8f-361facfe1826 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:03.620686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:03.621953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:03.622516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:03.623223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] PATH_INFO: `/v3/projects/194cad4976254796a1abb35ba9c6bd7e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:03.624785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194cad4976254796a1abb35ba9c6bd7e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:03.628320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:03.691626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194cad4976254796a1abb35ba9c6bd7e', 'request_id': 'req-9d8bd561-585e-4038-9435-7c49a9f40216'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:03.701363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194cad4976254796a1abb35ba9c6bd7e', 'request_id': 'req-9d8bd561-585e-4038-9435-7c49a9f40216'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:03.713624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194cad4976254796a1abb35ba9c6bd7e', 'request_id': 'req-9d8bd561-585e-4038-9435-7c49a9f40216'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:03.731013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] The token cache is being invalidate because project 194cad4976254796a1abb35ba9c6bd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:03.732252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:03.734926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d8bd561-585e-4038-9435-7c49a9f40216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:03.739749 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1822/3668] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:03 2022] DELETE /identity/v3/projects/194cad4976254796a1abb35ba9c6bd7e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:03.745926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c76c3c-5d1c-4062-8b4a-9fe4dbeb089b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:03.746222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c76c3c-5d1c-4062-8b4a-9fe4dbeb089b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:03.746522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c76c3c-5d1c-4062-8b4a-9fe4dbeb089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:03.818193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c8c76c3c-5d1c-4062-8b4a-9fe4dbeb089b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:03.819960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c8c76c3c-5d1c-4062-8b4a-9fe4dbeb089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:03.970582 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1847/3669] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:03.980266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb82b-2ebd-4ecc-ae03-6d0e263e2b67 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:03.981061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb82b-2ebd-4ecc-ae03-6d0e263e2b67 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:03.981495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb82b-2ebd-4ecc-ae03-6d0e263e2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.010869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-13dbb82b-2ebd-4ecc-ae03-6d0e263e2b67 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:04.012357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-13dbb82b-2ebd-4ecc-ae03-6d0e263e2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:04.025331 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1823/3670] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:04.029787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c76c3c-5d1c-4062-8b4a-9fe4dbeb089b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:04.045486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c76c3c-5d1c-4062-8b4a-9fe4dbeb089b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:04.066872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:04.067959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:04.068232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:04.070261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.072131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:04.074717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:04.079990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:04.107536 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1848/3671] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:04.111644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb82b-2ebd-4ecc-ae03-6d0e263e2b67 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:04.139143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb82b-2ebd-4ecc-ae03-6d0e263e2b67 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:04.153945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:04.154647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:04.156915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:04.157374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.158250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:04.164402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:04.218851 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1824/3672] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:04 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:04.224013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:04.240653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f93b4-75ab-453a-928f-5a0901b89495 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:04.358397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:04.359938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:04.360439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:04.360900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.362102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:04.372447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:04.405728 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1849/3673] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:04 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:04.412569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:04.433417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d97e-01f5-4767-a784-303ac7abad75 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:04.442176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:04.443137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:04.444838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:04.445464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.446422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:04.449079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:04.464344 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1825/3674] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:04.468305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:04.483518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028eb60e-91a1-4f5f-8406-4fb8d2bfd78f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:04.494327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45f996-fd1a-4754-8d79-c48ff5b2d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:04.495966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f996-fd1a-4754-8d79-c48ff5b2d420 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:04.496944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f996-fd1a-4754-8d79-c48ff5b2d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:04.497374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f996-fd1a-4754-8d79-c48ff5b2d420 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.498566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45f996-fd1a-4754-8d79-c48ff5b2d420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:04.503823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45f996-fd1a-4754-8d79-c48ff5b2d420 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:04.519402 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1850/3675] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:04.523302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:04.534686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986c1a0-3094-4941-9fb4-74f165cad2e4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:04.541329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:04.542407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:04.543160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:04.543793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] PATH_INFO: `/v3/projects/09a5512e5960446eb597312b7289a9a9/users/4be2f3c0b9e14887b0348434cf8294c5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.563466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a5512e5960446eb597312b7289a9a9, user_id=4be2f3c0b9e14887b0348434cf8294c5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:04.567631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:04.595365 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1826/3676] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:04 2022] PUT /identity/v3/projects/09a5512e5960446eb597312b7289a9a9/users/4be2f3c0b9e14887b0348434cf8294c5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:04.606679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514238-db55-4b13-95fc-b46fdaf5e567 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:04.607344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514238-db55-4b13-95fc-b46fdaf5e567 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:04.607802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514238-db55-4b13-95fc-b46fdaf5e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:04.656979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-09514238-db55-4b13-95fc-b46fdaf5e567 None None] MFA Rules not processed for user `4be2f3c0b9e14887b0348434cf8294c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:04.661806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09514238-db55-4b13-95fc-b46fdaf5e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:04.828225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1851/3677] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:05.290199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:05.292166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:05.423211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b06249-d8f5-41ab-ac0a-0edf42b7578f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:05.441388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73f0b5-8f48-4fe3-a499-46922d651dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:05.442646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73f0b5-8f48-4fe3-a499-46922d651dbb service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:05.444126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73f0b5-8f48-4fe3-a499-46922d651dbb service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:05.444806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73f0b5-8f48-4fe3-a499-46922d651dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:05.488553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73f0b5-8f48-4fe3-a499-46922d651dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:05.490911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73f0b5-8f48-4fe3-a499-46922d651dbb service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:05.504753 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1827/3678] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:05.909540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514238-db55-4b13-95fc-b46fdaf5e567 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:05.997697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514238-db55-4b13-95fc-b46fdaf5e567 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:06.004680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:06.006580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:06.007099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:06.007574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] PATH_INFO: `/v3/users/4be2f3c0b9e14887b0348434cf8294c5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:06.010081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be2f3c0b9e14887b0348434cf8294c5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:06.012368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:06.100420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be2f3c0b9e14887b0348434cf8294c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:06.102540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be2f3c0b9e14887b0348434cf8294c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:06.113217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be2f3c0b9e14887b0348434cf8294c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:06.119008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be2f3c0b9e14887b0348434cf8294c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:06.140902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be2f3c0b9e14887b0348434cf8294c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:06.180282 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1852/3679] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:05 2022] DELETE /identity/v3/users/4be2f3c0b9e14887b0348434cf8294c5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:06.185283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:06.185581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:06.186086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:06.212256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:06.213675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:06.397667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1828/3680] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:06.430306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:06.432110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:06.566386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c93648-5232-40b0-a1c6-4b0cd2b1cee6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:06.570762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6c01-e9d0-4d88-8ba2-feeb8f5b926c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:06.571523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6c01-e9d0-4d88-8ba2-feeb8f5b926c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:06.571876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6c01-e9d0-4d88-8ba2-feeb8f5b926c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:06.572222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6c01-e9d0-4d88-8ba2-feeb8f5b926c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:06.583688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b6c01-e9d0-4d88-8ba2-feeb8f5b926c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:06.585876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b6c01-e9d0-4d88-8ba2-feeb8f5b926c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:06.604576 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1853/3681] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:07.709744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:07.712007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:07.733461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcd665-29f9-4218-99b2-113e587d8fa1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:07.750544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:07.752192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:07.752796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:07.753301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] PATH_INFO: `/v3/projects/09a5512e5960446eb597312b7289a9a9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:07.759794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a5512e5960446eb597312b7289a9a9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:07.764191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:07.907936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a5512e5960446eb597312b7289a9a9', 'request_id': 'req-f1b75bd2-4f73-4991-8811-395788eac87a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:07.935560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a5512e5960446eb597312b7289a9a9', 'request_id': 'req-f1b75bd2-4f73-4991-8811-395788eac87a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:07.969201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a5512e5960446eb597312b7289a9a9', 'request_id': 'req-f1b75bd2-4f73-4991-8811-395788eac87a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:07.991727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] The token cache is being invalidate because project 09a5512e5960446eb597312b7289a9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:07.993183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:07.996610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1b75bd2-4f73-4991-8811-395788eac87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:07.999463 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1829/3682] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:07 2022] DELETE /identity/v3/projects/09a5512e5960446eb597312b7289a9a9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:08.004483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea0a3-4585-4d14-82b9-87067c0b5108 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.004986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea0a3-4585-4d14-82b9-87067c0b5108 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.005141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea0a3-4585-4d14-82b9-87067c0b5108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.037881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0faea0a3-4585-4d14-82b9-87067c0b5108 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:08.039723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0faea0a3-4585-4d14-82b9-87067c0b5108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:08.129677 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1854/3683] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:08.137482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.137922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.138332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.168550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:08.170017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:08.185994 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1830/3684] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:08.190383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faea0a3-4585-4d14-82b9-87067c0b5108 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.219264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.221658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:08.225658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faea0a3-4585-4d14-82b9-87067c0b5108 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.235907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.238915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.241353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd84bc-fb6a-435a-871d-9ecffa2bd113 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.248462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.248869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.250412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:08.250842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.253055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.255490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.256702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.257133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.257681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] PATH_INFO: `/v3/users/a295663c20584408b634e99490e34883` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.261561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a295663c20584408b634e99490e34883)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.264957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.278423 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1855/3685] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:08.280365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.295188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd388-2343-43e1-b6b4-a6bee8789e67 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.305702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.317269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.317269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.317269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.317269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.317269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.365238 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1856/3686] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:08 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:08.369438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.387418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a295663c20584408b634e99490e34883'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:08.404254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a295663c20584408b634e99490e34883'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:08.405221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a295663c20584408b634e99490e34883'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:08.405971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a295663c20584408b634e99490e34883'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:08.418941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a295663c20584408b634e99490e34883'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:08.456151 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1831/3687] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:08 2022] DELETE /identity/v3/users/a295663c20584408b634e99490e34883 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:08.482615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009909-5505-47f6-8c4d-0a542ca3ae0b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.560201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.562083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.562083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.562083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.563422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.566806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.612961 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1857/3688] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:08 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:08.614588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.616264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:08.641125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c376f-209e-44ab-9dac-9b5de7d8bfea admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.657236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.658027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.658926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.660176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.661129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.664739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.693410 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1832/3689] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:08.697388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.715124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a79790-9915-4cf5-b789-5006e8e5bcd2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.739904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.740327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.741551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.741838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.742238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.742875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.743775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:08.745003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.758526 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1858/3690] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:08.762535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:08.776869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd854d8-ecb3-4a0b-a643-81604538fcde admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.790597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3535f-8a96-443f-8655-1141ff5487e3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:08.792432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.793054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.793430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.794142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] PATH_INFO: `/v3/projects/4c2ee723c6a04843b302e255a401b1e7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.796600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2ee723c6a04843b302e255a401b1e7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.799649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.808989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7a227-5965-4981-ba70-5f9e2a91d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:08.810145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a227-5965-4981-ba70-5f9e2a91d07f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.810525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a227-5965-4981-ba70-5f9e2a91d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.810954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7a227-5965-4981-ba70-5f9e2a91d07f admin admin] PATH_INFO: `/v3/projects/7971681b4a314a9792ea390fad595b24/users/75ba8e2f4ea845cab662f1ae5bcccb88/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.847505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7a227-5965-4981-ba70-5f9e2a91d07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7971681b4a314a9792ea390fad595b24, user_id=75ba8e2f4ea845cab662f1ae5bcccb88, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:08.853044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7a227-5965-4981-ba70-5f9e2a91d07f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:08.895457 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1859/3691] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:08 2022] PUT /identity/v3/projects/7971681b4a314a9792ea390fad595b24/users/75ba8e2f4ea845cab662f1ae5bcccb88/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:08.900653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:08.900861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:08.901062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:08.915783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2ee723c6a04843b302e255a401b1e7', 'request_id': 'req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:08.931919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2ee723c6a04843b302e255a401b1e7', 'request_id': 'req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:08.966801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] MFA Rules not processed for user `75ba8e2f4ea845cab662f1ae5bcccb88`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:08.970247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:08.971972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2ee723c6a04843b302e255a401b1e7', 'request_id': 'req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:09.006218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] The token cache is being invalidate because project 4c2ee723c6a04843b302e255a401b1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:09.006516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:09.007359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ac390f4-f92b-40ab-8a8a-5d42116e04fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:09.009115 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1833/3692] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:08 2022] DELETE /identity/v3/projects/4c2ee723c6a04843b302e255a401b1e7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:09.014486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a31c20-859c-49a8-8d2e-18ca06d98a9e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.014805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a31c20-859c-49a8-8d2e-18ca06d98a9e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.015474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a31c20-859c-49a8-8d2e-18ca06d98a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.042056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-17a31c20-859c-49a8-8d2e-18ca06d98a9e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:09.044224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-17a31c20-859c-49a8-8d2e-18ca06d98a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:09.091945 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1860/3693] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:09.092979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.094401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:09.162493 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1834/3694] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:09.171164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419814a-492d-441d-9449-a89e51674c21 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.171518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419814a-492d-441d-9449-a89e51674c21 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.172586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419814a-492d-441d-9449-a89e51674c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.187833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75b30d-62ad-4040-8408-2558f7a6494a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.195868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.196693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.197069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.197559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.198340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.200562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.219792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d419814a-492d-441d-9449-a89e51674c21 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:09.221728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d419814a-492d-441d-9449-a89e51674c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:09.238533 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1835/3695] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:09.244007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419814a-492d-441d-9449-a89e51674c21 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.245847 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1861/3696] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:09 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:09.251066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.258084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419814a-492d-441d-9449-a89e51674c21 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.358992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.360383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.360972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.363022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.370923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:09.370923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.370923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.401158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55b4b-cab3-4ed3-bb69-002b7619626b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.412397 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1836/3697] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:09.414055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.414510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.414826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.415113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.415812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.417392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.425929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.446263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7a199-34d2-4819-957f-2712396dae38 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.456093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.456943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.457373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.457883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.458837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.459783 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1862/3698] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:09 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:09.461326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.465836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.480765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bdad2-d288-48dd-b950-fada9484be56 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.489885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.490666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.491051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.491447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.493048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.495007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.499260 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1837/3699] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:09 2022] POST /identity/v3/projects => generated 413 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:09.504062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.513091 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1863/3700] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:09.518549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.531229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c6cbd-836f-4b35-bdd9-146c639e0682 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.598173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e1422-cbec-4663-9c6a-adfe305a5362 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.604349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.605290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.605731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.610455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.612167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.612553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.612951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] PATH_INFO: `/v3/projects/fb925a505c2b4ff48e3a8f53e6ebf684/users/04a19e85fa624bee897e97eeaab9ddae/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.613065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.614074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.617199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.645284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb925a505c2b4ff48e3a8f53e6ebf684, user_id=04a19e85fa624bee897e97eeaab9ddae, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.649285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.664782 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1838/3701] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:09 2022] POST /identity/v3/users => generated 307 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:09.673648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.681683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1864/3702] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:09 2022] PUT /identity/v3/projects/fb925a505c2b4ff48e3a8f53e6ebf684/users/04a19e85fa624bee897e97eeaab9ddae/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:09.686104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.690052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e07bb-bba9-4299-8f70-9d54c9fc7555 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.764133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.764924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.765282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.765855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.766916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.768436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ee14-f445-433a-baff-d6c2a3580da8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.769462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.774254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.774975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.775254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.775527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.776417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.778711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.784165 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1839/3703] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:09.787976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.792151 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1865/3704] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:09.796519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.799482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576785b8-d5d3-41a6-b387-a7708901fa4e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.809064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.809752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.810039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.811153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.811722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.817063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.822541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd7833-30da-40b8-9a8d-e645ba15b843 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.832637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a58d4-d497-475a-963b-9d307b454e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:09.834387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a58d4-d497-475a-963b-9d307b454e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.834680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a58d4-d497-475a-963b-9d307b454e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.835106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a58d4-d497-475a-963b-9d307b454e88 admin admin] PATH_INFO: `/v3/projects/fb925a505c2b4ff48e3a8f53e6ebf684/users/04a19e85fa624bee897e97eeaab9ddae/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.837181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a58d4-d497-475a-963b-9d307b454e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb925a505c2b4ff48e3a8f53e6ebf684, user_id=04a19e85fa624bee897e97eeaab9ddae, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:09.840907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a58d4-d497-475a-963b-9d307b454e88 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:09.842173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1840/3705] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:09.847639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:09.869760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107dd6-fd83-4748-89da-2a5347b43158 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:09.876700 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1866/3706] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:09 2022] PUT /identity/v3/projects/fb925a505c2b4ff48e3a8f53e6ebf684/users/04a19e85fa624bee897e97eeaab9ddae/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:09.882923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d62c-cca3-4588-b22b-06ad906c03b3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:09.884521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d62c-cca3-4588-b22b-06ad906c03b3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:09.884814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d62c-cca3-4588-b22b-06ad906c03b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:09.957003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b1a3d62c-cca3-4588-b22b-06ad906c03b3 None None] MFA Rules not processed for user `04a19e85fa624bee897e97eeaab9ddae`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:09.960303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b1a3d62c-cca3-4588-b22b-06ad906c03b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:10.031124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74487d11-3686-410a-8075-8eff55da6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.032249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74487d11-3686-410a-8075-8eff55da6504 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.033045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74487d11-3686-410a-8075-8eff55da6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.033772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74487d11-3686-410a-8075-8eff55da6504 admin admin] PATH_INFO: `/v3/projects/bdb8a8a58b5b4b9b95ac9d6a782df6af/users/2c615ca825f6488fbdddff03a048b94b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.060755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74487d11-3686-410a-8075-8eff55da6504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb8a8a58b5b4b9b95ac9d6a782df6af, user_id=2c615ca825f6488fbdddff03a048b94b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.063581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74487d11-3686-410a-8075-8eff55da6504 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.065675 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1867/3707] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:10.071230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d62c-cca3-4588-b22b-06ad906c03b3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.085444 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1841/3708] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:09 2022] PUT /identity/v3/projects/bdb8a8a58b5b4b9b95ac9d6a782df6af/users/2c615ca825f6488fbdddff03a048b94b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:10.091151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d62c-cca3-4588-b22b-06ad906c03b3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.091408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f046-9b00-4f6f-b5cf-4a13cefd89d1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.091626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f046-9b00-4f6f-b5cf-4a13cefd89d1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.091904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f046-9b00-4f6f-b5cf-4a13cefd89d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.112590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-82d0f046-9b00-4f6f-b5cf-4a13cefd89d1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:10.114033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-82d0f046-9b00-4f6f-b5cf-4a13cefd89d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:10.168428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.169194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.169558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.170126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.171328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.172778 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:10.172778 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:10.172778 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:10.174603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.188786 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1842/3709] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:10.204220 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1868/3710] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:56:10 2022] POST /identity/v3/domains => generated 246 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:10.206702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0f046-9b00-4f6f-b5cf-4a13cefd89d1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.216534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.218987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:10.220252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0f046-9b00-4f6f-b5cf-4a13cefd89d1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.321931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.322670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.323054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.323339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.324866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.327848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.339511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d125-227e-48d7-8f0e-39f3a3135f90 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.347685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.348343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.348628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.348907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.383196 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1843/3711] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:10 2022] POST /identity/v3/projects => generated 408 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:10.386802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.454649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.458563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.475021 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1869/3712] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:10.475936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.477432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:10.485601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaae1d1-eb2b-4be5-a1a9-a7fc5761207e tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.492595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.492871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79439ecb-909a-47f3-bb99-021d950aa7ff service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.493470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.494012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.494881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.495880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.499043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.530216 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1844/3713] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:10 2022] POST /identity/v3/users => generated 347 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:10.532308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.543686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c998adb5-2500-4d72-b384-4f3c520e5c92 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.550332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.551045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.551336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.551620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.552355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.554031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.566949 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1845/3714] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:10.576710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.577272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.577557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.577865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] PATH_INFO: `/v3/users/3e390d65f16c47ec89f5f834bccfdd8c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.579067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e390d65f16c47ec89f5f834bccfdd8c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.581052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.581203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.597544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e14a08-7128-4647-9123-11ab9e26113c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.606535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46586232-2eb8-4b3c-86b6-3929b3c16809 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.608221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46586232-2eb8-4b3c-86b6-3929b3c16809 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.608499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46586232-2eb8-4b3c-86b6-3929b3c16809 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.609095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46586232-2eb8-4b3c-86b6-3929b3c16809 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/projects/77e322fb467b42078cbed52b127a7136/users/32294b7d5ba7406eb33429e7f9697a5b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.632905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46586232-2eb8-4b3c-86b6-3929b3c16809 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:create_grant(project_id=77e322fb467b42078cbed52b127a7136, user_id=32294b7d5ba7406eb33429e7f9697a5b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.635624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46586232-2eb8-4b3c-86b6-3929b3c16809 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.651618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1846/3715] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:10 2022] PUT /identity/v3/projects/77e322fb467b42078cbed52b127a7136/users/32294b7d5ba7406eb33429e7f9697a5b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:10.656968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b88260-b8b9-44ae-8296-e3a375f0fb60 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.657524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b88260-b8b9-44ae-8296-e3a375f0fb60 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.658024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b88260-b8b9-44ae-8296-e3a375f0fb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.659141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e390d65f16c47ec89f5f834bccfdd8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:10.659912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e390d65f16c47ec89f5f834bccfdd8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:10.670624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e390d65f16c47ec89f5f834bccfdd8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:10.671518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e390d65f16c47ec89f5f834bccfdd8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:10.683591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-90e694f3-5585-4429-9835-8ac349a18072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e390d65f16c47ec89f5f834bccfdd8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:10.715098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1870/3716] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:10 2022] DELETE /identity/v3/users/3e390d65f16c47ec89f5f834bccfdd8c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:10.793994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-14b88260-b8b9-44ae-8296-e3a375f0fb60 None None] MFA Rules not processed for user `32294b7d5ba7406eb33429e7f9697a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:10.795410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14b88260-b8b9-44ae-8296-e3a375f0fb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:10.817681 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1847/3717] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:10 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:10.827746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.828248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.829414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.852420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] MFA Rules not processed for user `32294b7d5ba7406eb33429e7f9697a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:10.854043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:10.864298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1871/3718] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:10 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:10.868977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b88260-b8b9-44ae-8296-e3a375f0fb60 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.880617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b88260-b8b9-44ae-8296-e3a375f0fb60 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:10.887707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32294b7d5ba7406eb33429e7f9697a5b', 'user_domain_id': '1135d02f12884c4b95c49bf78935dec9', 'system_scope': None, 'project_id': '77e322fb467b42078cbed52b127a7136', 'project_domain_id': '1135d02f12884c4b95c49bf78935dec9', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:10.888374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:10.888653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:10.889201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:10.900397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:10.902356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:10.914747 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1848/3719] 10.222.0.32 () {56 vars in 1283 bytes} [Sat May 7 21:56:10 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:10.919814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.921426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:10.978460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:10.980881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:11.011838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e937d5-3a2b-4fb0-9309-97a3f06793a0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:11.018547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:11.020099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:11.020924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:11.020924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/users/32294b7d5ba7406eb33429e7f9697a5b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:11.022375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:delete_user(user_id=32294b7d5ba7406eb33429e7f9697a5b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:11.025314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:11.138194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32294b7d5ba7406eb33429e7f9697a5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.139999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32294b7d5ba7406eb33429e7f9697a5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.150177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32294b7d5ba7406eb33429e7f9697a5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.151561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32294b7d5ba7406eb33429e7f9697a5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.156150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489e922-18bb-4108-84e5-12532dcf338e tempest-test_project-599217995 tempest-user-540199583] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:11.162713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32294b7d5ba7406eb33429e7f9697a5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.169919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:11.171045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:11.171556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:11.171928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] PATH_INFO: `/v3/projects/4f4c556805a24040a7131d879ee91498` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:11.174060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4c556805a24040a7131d879ee91498)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:11.176627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:11.218098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1872/3720] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:10 2022] DELETE /identity/v3/users/32294b7d5ba7406eb33429e7f9697a5b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:11.223211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:11.225472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:11.272755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4c556805a24040a7131d879ee91498', 'request_id': 'req-6dc25f31-e920-4f77-9b8b-420e60617f1b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.285494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4c556805a24040a7131d879ee91498', 'request_id': 'req-6dc25f31-e920-4f77-9b8b-420e60617f1b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.301157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4c556805a24040a7131d879ee91498', 'request_id': 'req-6dc25f31-e920-4f77-9b8b-420e60617f1b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.321709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] The token cache is being invalidate because project 4f4c556805a24040a7131d879ee91498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:11.322116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.326187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6dc25f31-e920-4f77-9b8b-420e60617f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.331126 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1849/3721] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:10 2022] DELETE /identity/v3/projects/4f4c556805a24040a7131d879ee91498 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:11.334586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9060ec6-1138-4380-a988-3418550aea6f tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:11.337051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af8a3-db9c-44ec-8a38-90277e7d6d9d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:11.337339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af8a3-db9c-44ec-8a38-90277e7d6d9d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:11.337837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af8a3-db9c-44ec-8a38-90277e7d6d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:11.390252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-aa9af8a3-db9c-44ec-8a38-90277e7d6d9d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:11.395755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aa9af8a3-db9c-44ec-8a38-90277e7d6d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:11.475803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:11.477078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:11.477586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:11.477866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/projects/77e322fb467b42078cbed52b127a7136` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:11.480361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77e322fb467b42078cbed52b127a7136)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:11.482368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:11.520324 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1850/3722] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:11.538029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927ec1a-6f36-4814-a060-f7b8d237abfd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:11.549436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927ec1a-6f36-4814-a060-f7b8d237abfd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:11.549779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927ec1a-6f36-4814-a060-f7b8d237abfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:11.588023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77e322fb467b42078cbed52b127a7136', 'request_id': 'req-fd8c3214-1633-492d-9817-1681e960110c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.591799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6927ec1a-6f36-4814-a060-f7b8d237abfd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:11.595630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6927ec1a-6f36-4814-a060-f7b8d237abfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:11.603665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77e322fb467b42078cbed52b127a7136', 'request_id': 'req-fd8c3214-1633-492d-9817-1681e960110c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.623550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77e322fb467b42078cbed52b127a7136', 'request_id': 'req-fd8c3214-1633-492d-9817-1681e960110c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.645755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] The token cache is being invalidate because project 77e322fb467b42078cbed52b127a7136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:11.646544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.648519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.657031 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1873/3723] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:11 2022] DELETE /identity/v3/projects/77e322fb467b42078cbed52b127a7136 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:11.661635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:11.663380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:11.685134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1851/3724] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:11.699043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927ec1a-6f36-4814-a060-f7b8d237abfd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:11.725033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927ec1a-6f36-4814-a060-f7b8d237abfd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:11.741224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:11.743350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:11.743472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:11.743666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:11.744911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:11.745225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:11.751302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:11.767580 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1852/3725] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:11.769079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:11.771838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:11.826268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c3214-1633-492d-9817-1681e960110c tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:11.841453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:11.842337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:11.842616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:11.842932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/domains/1135d02f12884c4b95c49bf78935dec9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:11.847261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1135d02f12884c4b95c49bf78935dec9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:11.848302 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:11.848302 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:11.848302 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:11.853412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:11.901063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1135d02f12884c4b95c49bf78935dec9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.901979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1135d02f12884c4b95c49bf78935dec9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.954043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc87da-d2df-4bc4-8369-e130fcf2bb61 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:11.975412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1135d02f12884c4b95c49bf78935dec9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.976009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1135d02f12884c4b95c49bf78935dec9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:11.982393 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1874/3726] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:11 2022] PATCH /identity/v3/domains/1135d02f12884c4b95c49bf78935dec9 => generated 247 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:11.983273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:11.984685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.049998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526ec5f-f102-4726-8255-954e80a4d2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:12.050667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ec5f-f102-4726-8255-954e80a4d2ef service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.050999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ec5f-f102-4726-8255-954e80a4d2ef service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.051267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526ec5f-f102-4726-8255-954e80a4d2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.053926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7526ec5f-f102-4726-8255-954e80a4d2ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.071376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ec5f-f102-4726-8255-954e80a4d2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:12.072991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526ec5f-f102-4726-8255-954e80a4d2ef service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:12.094359 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1853/3727] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:12.096794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ebdd3-34ba-4c1e-ac85-3b866f81841a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.097080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ebdd3-34ba-4c1e-ac85-3b866f81841a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.097359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ebdd3-34ba-4c1e-ac85-3b866f81841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.123985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-137ebdd3-34ba-4c1e-ac85-3b866f81841a None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:12.125214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-137ebdd3-34ba-4c1e-ac85-3b866f81841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.129311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69de0c-56af-4756-990c-5c250a324915 tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:12.142226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:12.143535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.143822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.144100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.144804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:12.153903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:12.225264 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1875/3728] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:11 2022] POST /identity/v3/projects => generated 381 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:12.226227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:12.235339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.238161 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1854/3729] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:12.239195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ebdd3-34ba-4c1e-ac85-3b866f81841a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:12.266155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ebdd3-34ba-4c1e-ac85-3b866f81841a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:12.427651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7001cbbe-9f7c-48ff-a929-116f5caefa76 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:12.445435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:12.447061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.447919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04a19e85fa624bee897e97eeaab9ddae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:12.449036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.449529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.450006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.452643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:12.453164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.455195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] PATH_INFO: `/v3/domains/1135d02f12884c4b95c49bf78935dec9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.460177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:12.486167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1135d02f12884c4b95c49bf78935dec9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:12.487699 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:12.487699 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:12.487699 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:12.489042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:12.505685 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1855/3730] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:12 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:12.506580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:12.511087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.540538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1135d02f12884c4b95c49bf78935dec9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.549713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1135d02f12884c4b95c49bf78935dec9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.624025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1135d02f12884c4b95c49bf78935dec9', 'request_id': 'req-467f5ae4-232f-4753-87d7-5479d690f91a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.636931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1135d02f12884c4b95c49bf78935dec9', 'request_id': 'req-467f5ae4-232f-4753-87d7-5479d690f91a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.655648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1135d02f12884c4b95c49bf78935dec9', 'request_id': 'req-467f5ae4-232f-4753-87d7-5479d690f91a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.680754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] The token cache is being invalidate because project 1135d02f12884c4b95c49bf78935dec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:12.681118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.682220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.694096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1135d02f12884c4b95c49bf78935dec9', 'request_id': 'req-467f5ae4-232f-4753-87d7-5479d690f91a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.694963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1db8a-a748-441b-83da-82aa0fa022b6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:12.697337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1135d02f12884c4b95c49bf78935dec9', 'request_id': 'req-467f5ae4-232f-4753-87d7-5479d690f91a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.698145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1135d02f12884c4b95c49bf78935dec9', 'request_id': 'req-467f5ae4-232f-4753-87d7-5479d690f91a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:12.705990 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1876/3731] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:12 2022] DELETE /identity/v3/domains/1135d02f12884c4b95c49bf78935dec9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:12.712622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:12.714262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.867385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f5ae4-232f-4753-87d7-5479d690f91a tempest-TestDefaultProjectId-338533562 tempest-TestDefaultProjectId-338533562-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:12.893841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:12.894678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.895072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.895478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.897725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:12.899647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:12.914751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:12.917246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.917697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.918162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.921818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.930535 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1877/3732] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:12.931473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:12.937559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:12.963174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b52620-2ca1-44d1-873b-dfd007256a30 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:12.974042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:12.975907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:12.976379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:12.976811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] PATH_INFO: `/v3/users/75ba8e2f4ea845cab662f1ae5bcccb88` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:12.979429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ba8e2f4ea845cab662f1ae5bcccb88)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:12.981770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:13.009341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:13.011636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:13.024441 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1856/3733] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:56:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:56:13.025800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:13.042485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74d4e-9c93-4f04-9f8c-2ff19febc8a0 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:13.048052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:13.048813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:13.049099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:13.049366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:13.051043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:13.052755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:13.056004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ba8e2f4ea845cab662f1ae5bcccb88'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:13.061644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ba8e2f4ea845cab662f1ae5bcccb88'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:13.075664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1857/3734] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:13.076042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ba8e2f4ea845cab662f1ae5bcccb88'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:13.076794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ba8e2f4ea845cab662f1ae5bcccb88'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:13.081263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:13.084494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:13.095980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a99fb029-f72d-427b-9d3d-4bc8a83e6483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ba8e2f4ea845cab662f1ae5bcccb88'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:13.119960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428427be-ca8b-4853-89a5-908065d50a37 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:13.130100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1878/3735] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:12 2022] DELETE /identity/v3/users/75ba8e2f4ea845cab662f1ae5bcccb88 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:13.135493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a89ddd-6d32-4035-844d-6fcec82c90ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:13.135641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:13.135975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:13.136772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:13.141052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89ddd-6d32-4035-844d-6fcec82c90ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:13.141445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89ddd-6d32-4035-844d-6fcec82c90ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:13.141797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89ddd-6d32-4035-844d-6fcec82c90ab admin admin] PATH_INFO: `/v3/projects/a017d4c58fe640c5bf85d1d055b3da11/users/2574be3d704f4f46942a5cfa852ff392/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:13.164567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89ddd-6d32-4035-844d-6fcec82c90ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a017d4c58fe640c5bf85d1d055b3da11, user_id=2574be3d704f4f46942a5cfa852ff392, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:13.168134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89ddd-6d32-4035-844d-6fcec82c90ab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:13.188071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:13.200298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:13.267297 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1858/3736] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:13 2022] PUT /identity/v3/projects/a017d4c58fe640c5bf85d1d055b3da11/users/2574be3d704f4f46942a5cfa852ff392/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:13.270000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a767566-9db8-4612-82c0-bc70c636afab None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:13.270362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a767566-9db8-4612-82c0-bc70c636afab None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:13.270727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a767566-9db8-4612-82c0-bc70c636afab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:13.304485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1a767566-9db8-4612-82c0-bc70c636afab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:13.306575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1a767566-9db8-4612-82c0-bc70c636afab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:13.401583 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1879/3737] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:13.425068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:13.426851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:13.541194 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1859/3738] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:13.564022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99105908-1fb2-49d7-b5af-15bd66580824 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:13.580773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a767566-9db8-4612-82c0-bc70c636afab None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:13.684426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a767566-9db8-4612-82c0-bc70c636afab None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:13.693577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949dcc4c-76ab-4e5f-9b13-24b8f2efaecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:13.694421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dcc4c-76ab-4e5f-9b13-24b8f2efaecf service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:13.694850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dcc4c-76ab-4e5f-9b13-24b8f2efaecf service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:13.695199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:13.695326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949dcc4c-76ab-4e5f-9b13-24b8f2efaecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:13.695869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:13.697125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:13.697456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:13.708419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dcc4c-76ab-4e5f-9b13-24b8f2efaecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:13.710140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949dcc4c-76ab-4e5f-9b13-24b8f2efaecf service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:13.722490 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1880/3739] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:56:13.736920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:13.739561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:13.755024 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1860/3740] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:15.344351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa0da-a4db-4072-a0e9-f0c2d6d0fded None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:15.344835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa0da-a4db-4072-a0e9-f0c2d6d0fded None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:15.344931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa0da-a4db-4072-a0e9-f0c2d6d0fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:15.387663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-568fa0da-a4db-4072-a0e9-f0c2d6d0fded None None] MFA Rules not processed for user `7262be0d7db141e69bdf493bd7a5505a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:15.389839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-568fa0da-a4db-4072-a0e9-f0c2d6d0fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:15.530390 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1881/3741] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:15.540587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:15.542431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:15.562333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83b58d-0379-4bb3-a408-7d8e99b3d306 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:15.572167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:15.573833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:15.574492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:15.575133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] PATH_INFO: `/v3/projects/7971681b4a314a9792ea390fad595b24` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:15.578834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7971681b4a314a9792ea390fad595b24)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:15.582908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:15.674885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7971681b4a314a9792ea390fad595b24', 'request_id': 'req-d86771b7-acbc-4cd8-9eac-2e1276059597'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:15.695815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7971681b4a314a9792ea390fad595b24', 'request_id': 'req-d86771b7-acbc-4cd8-9eac-2e1276059597'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:15.709797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7971681b4a314a9792ea390fad595b24', 'request_id': 'req-d86771b7-acbc-4cd8-9eac-2e1276059597'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:15.723864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] The token cache is being invalidate because project 7971681b4a314a9792ea390fad595b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:15.724242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:15.724819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d86771b7-acbc-4cd8-9eac-2e1276059597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:15.728878 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1861/3742] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:15 2022] DELETE /identity/v3/projects/7971681b4a314a9792ea390fad595b24 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:15.732389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa0da-a4db-4072-a0e9-f0c2d6d0fded None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:15.780100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa0da-a4db-4072-a0e9-f0c2d6d0fded None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:15.912130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:15.914348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:15.914348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:15.914348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] PATH_INFO: `/v3/users/04a19e85fa624bee897e97eeaab9ddae` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:15.915774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a19e85fa624bee897e97eeaab9ddae)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:15.920150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:16.001010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a19e85fa624bee897e97eeaab9ddae'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.002572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a19e85fa624bee897e97eeaab9ddae'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.015047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a19e85fa624bee897e97eeaab9ddae'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.016043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a19e85fa624bee897e97eeaab9ddae'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.027136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53dc1856-7178-4409-aabd-f0a8803cb3c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a19e85fa624bee897e97eeaab9ddae'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.051380 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1882/3743] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:15 2022] DELETE /identity/v3/users/04a19e85fa624bee897e97eeaab9ddae => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:16.286932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:16.287304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:16.288203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:16.360204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] MFA Rules not processed for user `2574be3d704f4f46942a5cfa852ff392`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:16.361647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:16.449795 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1862/3744] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:16.461693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:16.463024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:16.463323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:16.529159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] MFA Rules not processed for user `2574be3d704f4f46942a5cfa852ff392`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:16.530192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:16.563543 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1883/3745] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:16.578156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:16.581780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:16.597280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:16.599182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:16.735719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ab26e-8a39-4f6d-a040-f68786a51511 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:16.742874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:16.744231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:16.744521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:16.744805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] PATH_INFO: `/v3/projects/fb925a505c2b4ff48e3a8f53e6ebf684` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:16.751374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff987e7-2e31-4037-93fb-230cd46810d5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:16.751687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb925a505c2b4ff48e3a8f53e6ebf684)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:16.756337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:16.765124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7939d1-9c6f-464f-a08b-5b27b5b65758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:16.765124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7939d1-9c6f-464f-a08b-5b27b5b65758 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:16.765124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7939d1-9c6f-464f-a08b-5b27b5b65758 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:16.765124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7939d1-9c6f-464f-a08b-5b27b5b65758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:16.796889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7939d1-9c6f-464f-a08b-5b27b5b65758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:16.798518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7939d1-9c6f-464f-a08b-5b27b5b65758 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:16.811586 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1863/3746] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:16.864498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'request_id': 'req-964dd402-c8ab-423e-81e0-c57d3c350bf3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.874362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'request_id': 'req-964dd402-c8ab-423e-81e0-c57d3c350bf3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.890877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb925a505c2b4ff48e3a8f53e6ebf684', 'request_id': 'req-964dd402-c8ab-423e-81e0-c57d3c350bf3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.907833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] The token cache is being invalidate because project fb925a505c2b4ff48e3a8f53e6ebf684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:16.908955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.909881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-964dd402-c8ab-423e-81e0-c57d3c350bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:16.914642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1884/3747] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:16 2022] DELETE /identity/v3/projects/fb925a505c2b4ff48e3a8f53e6ebf684 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:16.916378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8574c-e1c2-4ed6-87e5-f0c6b64c637c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:16.917402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8574c-e1c2-4ed6-87e5-f0c6b64c637c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:16.917700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8574c-e1c2-4ed6-87e5-f0c6b64c637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:16.977590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-08e8574c-e1c2-4ed6-87e5-f0c6b64c637c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:16.982029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08e8574c-e1c2-4ed6-87e5-f0c6b64c637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:17.146084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1864/3748] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:17.154743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f10fa8-990a-4135-960d-fe4e0d8bceca None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.155339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f10fa8-990a-4135-960d-fe4e0d8bceca None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.155818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f10fa8-990a-4135-960d-fe4e0d8bceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.199826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-74f10fa8-990a-4135-960d-fe4e0d8bceca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:17.201793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-74f10fa8-990a-4135-960d-fe4e0d8bceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:17.233560 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1885/3749] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:17.240528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8574c-e1c2-4ed6-87e5-f0c6b64c637c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:17.257355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8574c-e1c2-4ed6-87e5-f0c6b64c637c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:17.270531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:17.271618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.272051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.272480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.273362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:17.273850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:17.279163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:17.298386 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1865/3750] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:17.303603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f10fa8-990a-4135-960d-fe4e0d8bceca None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:17.315445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f10fa8-990a-4135-960d-fe4e0d8bceca None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:17.323034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:17.325226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:17.327966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:17.329325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.330611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.331237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.335152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:17.340894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:17.387844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1886/3751] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:17 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:17.394596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:17.430376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285c026-aa61-4d5e-9808-22c03fb8a81e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:17.489523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417737e-2c35-4469-ba72-270374fa1684 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:17.497248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:17.498131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.498522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.498960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.499939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:17.503394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:17.519468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:17.520731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.521030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.521299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.527736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:17.543558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:17.544939 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1887/3752] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:17 2022] POST /identity/v3/users => generated 284 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:17.547619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:17.549772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:17.561117 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1866/3753] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:56:17.570379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c308f9-ab33-47b9-b272-18da85f1a8d5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:17.590136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:17.599716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.599716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.599716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.599716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:17.599716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:17.620542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:17.621405 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1888/3754] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:17.632970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea1003-8f22-4272-9e6a-45e9f23fe0d1 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:17.637805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753a83f-e9e3-4432-ae2d-79b8e298ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:17.638664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753a83f-e9e3-4432-ae2d-79b8e298ed32 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.638911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753a83f-e9e3-4432-ae2d-79b8e298ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.639188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753a83f-e9e3-4432-ae2d-79b8e298ed32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.639912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753a83f-e9e3-4432-ae2d-79b8e298ed32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:17.641763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753a83f-e9e3-4432-ae2d-79b8e298ed32 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:17.653619 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1867/3755] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:17.657574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:17.676571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d416-07b8-45cb-bff5-4ed8b9cb18ef admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:17.684128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:17.698697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.700253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.700739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] PATH_INFO: `/v3/projects/13ed534eb8c3446094e903cd3abafcfe/users/cd58ab5627144555b737739d43799aba/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.731246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ed534eb8c3446094e903cd3abafcfe, user_id=cd58ab5627144555b737739d43799aba, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:17.736257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:17.756066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1889/3756] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:17 2022] PUT /identity/v3/projects/13ed534eb8c3446094e903cd3abafcfe/users/cd58ab5627144555b737739d43799aba/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:17.766213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04b49-9fde-4ed7-a6f0-99fa5496c8b6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:17.766743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04b49-9fde-4ed7-a6f0-99fa5496c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:17.767213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b04b49-9fde-4ed7-a6f0-99fa5496c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:17.801662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a6b04b49-9fde-4ed7-a6f0-99fa5496c8b6 None None] MFA Rules not processed for user `cd58ab5627144555b737739d43799aba`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:17.803107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a6b04b49-9fde-4ed7-a6f0-99fa5496c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:17.941075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1868/3757] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:17.942572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:18.074563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dd2b-a76b-41ef-9ed4-f53366afada0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:18.108667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:18.109366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:18.109652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:18.110002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:18.115797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:18.120812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:18.206316 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1890/3758] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:17 2022] POST /identity/v3/projects => generated 365 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:18.207434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b04b49-9fde-4ed7-a6f0-99fa5496c8b6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:18.224989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b04b49-9fde-4ed7-a6f0-99fa5496c8b6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:18.347839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:18.350048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:18.350048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:18.350410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:18.351474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:18.353920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:18.399327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:18.402424 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1869/3759] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:18 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:18.415381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4f15-135c-47af-bdba-7668d506439e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:18.422925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:18.424048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:18.424499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:18.424850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:18.425933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:18.428478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:18.463226 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1891/3760] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:18.468003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:18.482506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d279fb-1c06-479a-8bb5-5132891dd221 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:18.490914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:18.491827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:18.492978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:18.493271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] PATH_INFO: `/v3/projects/a570c6e188a149058186f8817e454fe8/users/84fd6727e9a04017abc8c49aec85efb9/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:18.526508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a570c6e188a149058186f8817e454fe8, user_id=84fd6727e9a04017abc8c49aec85efb9, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:18.529988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:18.554968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:18.558904 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1870/3761] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:18 2022] PUT /identity/v3/projects/a570c6e188a149058186f8817e454fe8/users/84fd6727e9a04017abc8c49aec85efb9/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:18.582050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30cb3e8-3c51-49b4-bfeb-0fa8709a4092 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:18.740505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b90bd-66b1-4e8e-aede-5eab8ac91103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:18.741324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b90bd-66b1-4e8e-aede-5eab8ac91103 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:18.741511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b90bd-66b1-4e8e-aede-5eab8ac91103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:18.741791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b90bd-66b1-4e8e-aede-5eab8ac91103 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:18.742675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b90bd-66b1-4e8e-aede-5eab8ac91103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:18.744712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b90bd-66b1-4e8e-aede-5eab8ac91103 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:18.764202 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1892/3762] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:18.764969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:18.784363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65dab0-9b7e-46bd-ab1a-b3c752b367f9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:18.790555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:18.791657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:18.791992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:18.793287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] PATH_INFO: `/v3/projects/a570c6e188a149058186f8817e454fe8/users/84fd6727e9a04017abc8c49aec85efb9/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:18.797397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a570c6e188a149058186f8817e454fe8, user_id=84fd6727e9a04017abc8c49aec85efb9, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:18.803604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:18.840656 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1871/3763] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:18 2022] PUT /identity/v3/projects/a570c6e188a149058186f8817e454fe8/users/84fd6727e9a04017abc8c49aec85efb9/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:18.844207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2cf9-f19f-408b-9bc4-246fe1752aff None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:18.844460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2cf9-f19f-408b-9bc4-246fe1752aff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:18.844719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e2cf9-f19f-408b-9bc4-246fe1752aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:18.907559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ea6e2cf9-f19f-408b-9bc4-246fe1752aff None None] MFA Rules not processed for user `84fd6727e9a04017abc8c49aec85efb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:18.917567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea6e2cf9-f19f-408b-9bc4-246fe1752aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:19.176416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:19.177130 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1893/3764] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:19.237602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cfb66-9301-4b1e-9c9e-466e725d92ef admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:19.260233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:19.261286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:19.263250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:19.263646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:19.264512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:19.265596 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:19.265596 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:19.265596 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:19.266563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:19.319391 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1872/3765] 10.222.0.32 () {60 vars in 1149 bytes} [Sat May 7 21:56:19 2022] POST /identity/v3/domains => generated 276 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:19.323241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2cf9-f19f-408b-9bc4-246fe1752aff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:19.341623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e2cf9-f19f-408b-9bc4-246fe1752aff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:19.525340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1657ad1-9fe0-4ead-9ff9-f04406847dce tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:19.527400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657ad1-9fe0-4ead-9ff9-f04406847dce tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:19.527595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657ad1-9fe0-4ead-9ff9-f04406847dce tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:19.527868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657ad1-9fe0-4ead-9ff9-f04406847dce tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:19.530733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1657ad1-9fe0-4ead-9ff9-f04406847dce tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:19.536309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1657ad1-9fe0-4ead-9ff9-f04406847dce tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:19.563558 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1894/3766] 10.222.0.32 () {60 vars in 1149 bytes} [Sat May 7 21:56:19 2022] POST /identity/v3/domains => generated 276 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:19.568443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:19.582506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73654e0e-0754-4eb5-a641-46f0f40974a0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:19.740466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:19.741167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:19.741456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:19.741765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:19.742485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:19.746471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:19.750788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dc7bf-7965-4337-b447-408c6f823ceb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:19.751325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dc7bf-7965-4337-b447-408c6f823ceb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:19.751325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dc7bf-7965-4337-b447-408c6f823ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:19.797700 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1873/3767] 10.222.0.32 () {60 vars in 1149 bytes} [Sat May 7 21:56:19 2022] POST /identity/v3/domains => generated 277 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:19.802623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:19.812703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cf2dc7bf-7965-4337-b447-408c6f823ceb None None] MFA Rules not processed for user `2c615ca825f6488fbdddff03a048b94b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:19.814972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf2dc7bf-7965-4337-b447-408c6f823ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:19.971832 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1895/3768] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:19.983035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:19.983511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:19.983992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:20.034761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] MFA Rules not processed for user `2c615ca825f6488fbdddff03a048b94b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:20.038254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8952-c8c3-4597-9e3a-7dc9063cf096 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:20.039920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:20.056709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:20.058788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:20.060941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:20.062449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:20.063329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:20.068448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:20.075314 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1896/3769] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:20.094555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:20.105687 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1874/3770] 10.222.0.32 () {60 vars in 1149 bytes} [Sat May 7 21:56:19 2022] POST /identity/v3/domains => generated 279 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:20.106071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:20.112126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:20.284395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7dec0-21f3-45f8-a64a-b5b9b231b20b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:20.293318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e861f-e114-4372-9dd7-6e21da51fe06 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:20.311781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:20.312915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:20.313365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:20.313776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/017862b6fc924eefb1d4367d53afea28` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:20.360373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=017862b6fc924eefb1d4367d53afea28)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:20.361846 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:20.361846 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:20.361846 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:20.364348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:20.445316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '017862b6fc924eefb1d4367d53afea28'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.449692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:20.450419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:20.450855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:20.451058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:20.458663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '017862b6fc924eefb1d4367d53afea28'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.549489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017862b6fc924eefb1d4367d53afea28', 'request_id': 'req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.549785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:20.552284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:20.562087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017862b6fc924eefb1d4367d53afea28', 'request_id': 'req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.576089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017862b6fc924eefb1d4367d53afea28', 'request_id': 'req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.584190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1897/3771] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:20 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:20.599618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] The token cache is being invalidate because project 017862b6fc924eefb1d4367d53afea28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:20.600085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.601007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.614227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '017862b6fc924eefb1d4367d53afea28', 'request_id': 'req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.615475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '017862b6fc924eefb1d4367d53afea28', 'request_id': 'req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.620725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '017862b6fc924eefb1d4367d53afea28', 'request_id': 'req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:20.632428 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1875/3772] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:20 2022] DELETE /identity/v3/domains/017862b6fc924eefb1d4367d53afea28 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:20.637573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:20.661647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16e93f-614d-41d4-a60a-046522923267 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:20.764750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:20.765194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:20.765610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:20.766067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:20.766959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:20.770131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:20.817716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:20.820205 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1898/3773] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:56:20 2022] POST /identity/v3/domains => generated 248 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:20.820289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:20.845089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c19fa-cf7b-4ec1-b396-de9d5e44a52f tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:21.024449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:21.027586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:21.028218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:21.030096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/cb55a6d7d6fb4ee9a6ceb45a5c4ad843` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:21.082378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cb55a6d7d6fb4ee9a6ceb45a5c4ad843)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:21.085550 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:21.085550 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:21.085550 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:21.089468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:21.151599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.152826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.232894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.235432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.245291 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1876/3774] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:20 2022] PATCH /identity/v3/domains/cb55a6d7d6fb4ee9a6ceb45a5c4ad843 => generated 249 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:21.245571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:21.247404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:21.293820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd828e6-0b87-49b3-a33a-791aa7d7ee70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:21.446116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:21.447422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:21.447905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:21.449256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/cb55a6d7d6fb4ee9a6ceb45a5c4ad843` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:21.474596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cb55a6d7d6fb4ee9a6ceb45a5c4ad843)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:21.480839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:21.525142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.536913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.738052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843', 'request_id': 'req-7d4b37cc-434f-4f9a-9dc8-a158140711b0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.783584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843', 'request_id': 'req-7d4b37cc-434f-4f9a-9dc8-a158140711b0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.826894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843', 'request_id': 'req-7d4b37cc-434f-4f9a-9dc8-a158140711b0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.847380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] The token cache is being invalidate because project cb55a6d7d6fb4ee9a6ceb45a5c4ad843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:21.847380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.848642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.860778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843', 'request_id': 'req-7d4b37cc-434f-4f9a-9dc8-a158140711b0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.867856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843', 'request_id': 'req-7d4b37cc-434f-4f9a-9dc8-a158140711b0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.868709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cb55a6d7d6fb4ee9a6ceb45a5c4ad843', 'request_id': 'req-7d4b37cc-434f-4f9a-9dc8-a158140711b0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:21.882805 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1899/3775] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:21 2022] DELETE /identity/v3/domains/cb55a6d7d6fb4ee9a6ceb45a5c4ad843 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:21.884443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:21.911137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323577d3-7e2e-4c78-ae92-f5b2ac9084ac tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:22.042215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:22.043611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:22.044274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:22.044713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:22.045675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:22.048242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:22.087664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1877/3776] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:56:21 2022] POST /identity/v3/domains => generated 277 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:22.091726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:22.096180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:22.121741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b37cc-434f-4f9a-9dc8-a158140711b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:22.262883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:22.263215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:22.263498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:22.263967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/72e80c3f905a4d13b2875ff06fca231e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:22.280480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=72e80c3f905a4d13b2875ff06fca231e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:22.282296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:22.329388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.334062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.411025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.412031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.419644 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1900/3777] 10.222.0.32 () {60 vars in 1249 bytes} [Sat May 7 21:56:22 2022] PATCH /identity/v3/domains/72e80c3f905a4d13b2875ff06fca231e => generated 279 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:22.423071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:22.425470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:22.450540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213cf3e-6630-477e-a199-f0a856a8d79a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:22.550471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:22.551413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:22.551700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:22.551982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/72e80c3f905a4d13b2875ff06fca231e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:22.565631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=72e80c3f905a4d13b2875ff06fca231e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:22.568100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:22.570894 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1878/3778] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 21:56:22 2022] GET /identity/v3/domains/72e80c3f905a4d13b2875ff06fca231e => generated 279 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:22.575100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:22.588635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b9c04-4f57-456f-bbd3-88044cb330fc tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:22.603794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:22.604324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:22.604632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:22.604912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/72e80c3f905a4d13b2875ff06fca231e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:22.607430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=72e80c3f905a4d13b2875ff06fca231e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:22.609302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:22.665486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.679705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.774987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e', 'request_id': 'req-3af80623-0cad-464b-85c1-cd3a52862bcf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.788285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e', 'request_id': 'req-3af80623-0cad-464b-85c1-cd3a52862bcf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.803132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e', 'request_id': 'req-3af80623-0cad-464b-85c1-cd3a52862bcf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.824476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] The token cache is being invalidate because project 72e80c3f905a4d13b2875ff06fca231e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:22.824780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.825498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.862681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e', 'request_id': 'req-3af80623-0cad-464b-85c1-cd3a52862bcf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.867169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e', 'request_id': 'req-3af80623-0cad-464b-85c1-cd3a52862bcf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.868303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '72e80c3f905a4d13b2875ff06fca231e', 'request_id': 'req-3af80623-0cad-464b-85c1-cd3a52862bcf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:22.875398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1901/3779] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:22 2022] DELETE /identity/v3/domains/72e80c3f905a4d13b2875ff06fca231e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:22.879702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:22.881824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:22.897211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697bb45-8bb3-4c9b-b0c9-1c591dc98e15 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.003440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.004126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.004410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.004864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.005747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:23.007587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:23.050458 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1879/3780] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:56:22 2022] GET /identity/v3/domains => generated 1347 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:23.054945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:23.067050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80623-0cad-464b-85c1-cd3a52862bcf tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.072881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.074119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.074618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.075215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/72e80c3f905a4d13b2875ff06fca231e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.083841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find domain: 72e80c3f905a4d13b2875ff06fca231e.: keystone.exception.DomainNotFound: Could not find domain: 72e80c3f905a4d13b2875ff06fca231e. May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 72e80c3f905a4d13b2875ff06fca231e. May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:23.095695 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:23.096721 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 72e80c3f905a4d13b2875ff06fca231e. May 07 21:56:23.097599 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:23.100512 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1902/3781] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:23 2022] PATCH /identity/v3/domains/72e80c3f905a4d13b2875ff06fca231e => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 21:56:23.105812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:23.119266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aa286-0a44-4896-b06b-da41e39fbf4c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.131325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.132007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.132290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.132597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.133310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:23.134955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:23.165587 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1880/3782] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:56:23 2022] POST /identity/v3/domains => generated 277 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:23.169856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:23.181978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e27e0-f2af-4d13-9829-9b96a696fd59 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.322646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.324390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.326051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.327814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.329786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:23.335849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:23.374327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:23.376367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:23.416233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1903/3783] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:23 2022] POST /identity/v3/users => generated 348 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:23.418103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:23.451238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696de688-d93a-42d7-ab44-97cd54dbc83c tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.463517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.464378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.464967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.465351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/groups` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.466571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:23.467844 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:23.467844 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:23.467844 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:23.469062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:23.507222 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1904/3784] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:23 2022] POST /identity/v3/groups => generated 322 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:23.516667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:23.528756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35101c-abc4-4720-a86e-a9730983d06d tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.537421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8eb9e3-730e-47f9-b68d-ac5140c1a59a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.538036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.538707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.539173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.539447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.545892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.547093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.547203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:23.548156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.549174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.551132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0073018aa9fe4b52a2fab729c41ec2fe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:23.553200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:23.567766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:23.569170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:23.586399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:23.587210 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1881/3785] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:23.590915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:23.659468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:23.662428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:23.669311 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1905/3786] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:23 2022] PATCH /identity/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe => generated 278 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:23.675795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:23.709905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e06af1-44ee-49f0-8310-7569a602a251 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:23.898090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:23.901342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:23.901658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:23.901942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:23.924297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0073018aa9fe4b52a2fab729c41ec2fe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:23.926595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:23.964371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:23.965057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.199471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9dea4d6e0c4729a703cdb26b457557'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.211418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9dea4d6e0c4729a703cdb26b457557'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.212317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9dea4d6e0c4729a703cdb26b457557'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.213499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9dea4d6e0c4729a703cdb26b457557'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.231423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9dea4d6e0c4729a703cdb26b457557'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.337692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe', 'request_id': 'req-dc4e409f-3813-4e0c-b9ee-f39116967dbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.356771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe', 'request_id': 'req-dc4e409f-3813-4e0c-b9ee-f39116967dbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.377881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe', 'request_id': 'req-dc4e409f-3813-4e0c-b9ee-f39116967dbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.427154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] The token cache is being invalidate because project 0073018aa9fe4b52a2fab729c41ec2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:24.429169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.431499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.454345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe', 'request_id': 'req-dc4e409f-3813-4e0c-b9ee-f39116967dbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.456800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe', 'request_id': 'req-dc4e409f-3813-4e0c-b9ee-f39116967dbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.475753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0073018aa9fe4b52a2fab729c41ec2fe', 'request_id': 'req-dc4e409f-3813-4e0c-b9ee-f39116967dbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:24.498903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1882/3787] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:23 2022] DELETE /identity/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:24.503247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:24.505918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:24.539780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49b317-9cab-470e-82d4-f917c8d498f3 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:24.644416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:24.645346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:24.645671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:24.645956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:24.660827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=0073018aa9fe4b52a2fab729c41ec2fe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:24.660827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe.: keystone.exception.DomainNotFound: Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:24.679731 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:24.680797 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:24.681781 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1906/3788] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 21:56:24 2022] GET /identity/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe => generated 112 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:24.687057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:24.693565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:24.714609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e409f-3813-4e0c-b9ee-f39116967dbb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:24.724292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:24.725136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:24.725253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:24.725449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/users/2c9dea4d6e0c4729a703cdb26b457557` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:24.737478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:get_user(user_id=2c9dea4d6e0c4729a703cdb26b457557)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:24.741129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find user: 2c9dea4d6e0c4729a703cdb26b457557.: keystone.exception.UserNotFound: Could not find user: 2c9dea4d6e0c4729a703cdb26b457557. May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_user(user_id) May 07 21:56:24.765383 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:24.766794 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2c9dea4d6e0c4729a703cdb26b457557. May 07 21:56:24.768503 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:24.769819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1883/3789] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:56:24 2022] GET /identity/v3/users/2c9dea4d6e0c4729a703cdb26b457557 => generated 110 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:24.773644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:24.786037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187bb82-efdd-4aff-bb24-56f21719b260 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:24.792634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:24.794201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:24.794830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:24.795359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/groups/25f999672c5a41659c6d087b9eb41f99` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:24.802154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:get_group(group_id=25f999672c5a41659c6d087b9eb41f99)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:24.803480 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:24.803480 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:24.803480 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:24.804645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find group: 25f999672c5a41659c6d087b9eb41f99.: keystone.exception.GroupNotFound: Could not find group: 25f999672c5a41659c6d087b9eb41f99. May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get May 07 21:56:24.856093 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_group(group_id) May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:24.856980 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 25f999672c5a41659c6d087b9eb41f99. May 07 21:56:24.858605 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:24.863481 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1907/3790] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:24 2022] GET /identity/v3/groups/25f999672c5a41659c6d087b9eb41f99 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:24.867530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:24.886745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bfeda-c881-4cb9-b639-67b402bb4477 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:24.906900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:24.909785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:24.911834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:24.914696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/groups/25f999672c5a41659c6d087b9eb41f99` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:24.923560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find group: 25f999672c5a41659c6d087b9eb41f99.: keystone.exception.GroupNotFound: Could not find group: 25f999672c5a41659c6d087b9eb41f99. May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete May 07 21:56:24.936189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:56:24.937100 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 25f999672c5a41659c6d087b9eb41f99. May 07 21:56:24.938167 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:24.943865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1884/3791] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 21:56:24 2022] DELETE /identity/v3/groups/25f999672c5a41659c6d087b9eb41f99 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:24.949745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:24.977529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e129a3-f543-4952-b125-076d38b9c4ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:24.994423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:24.999015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:24.999554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.000151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/users/2c9dea4d6e0c4729a703cdb26b457557` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.023702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2c9dea4d6e0c4729a703cdb26b457557)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:25.025666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find user: 2c9dea4d6e0c4729a703cdb26b457557.: keystone.exception.UserNotFound: Could not find user: 2c9dea4d6e0c4729a703cdb26b457557. May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete May 07 21:56:25.053633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:25.054690 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2c9dea4d6e0c4729a703cdb26b457557. May 07 21:56:25.056337 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:25.059168 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1908/3792] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:24 2022] DELETE /identity/v3/users/2c9dea4d6e0c4729a703cdb26b457557 => generated 110 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:25.065302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.086707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf30187-6d42-463d-af62-48fb2830c424 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:25.099408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:25.100430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:25.100780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.122941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.147334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe.: keystone.exception.DomainNotFound: Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:25.174499 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:25.175753 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:25.177186 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:25.181172 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1885/3793] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:25 2022] PATCH /identity/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe => generated 112 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:25.186448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.229022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46a183-9a2e-4ab1-8349-f7f12bfd15fa tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:25.235910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:25.238547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:25.239049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.239578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.240455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:25.243788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:25.302545 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1909/3794] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:56:25 2022] GET /identity/v3/domains => generated 1347 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:25.303312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.321719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b21730-e182-43c5-8cec-932dc34c790a tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:25.332260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:25.333154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:25.333405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.333687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.334472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:25.334931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:25.337426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:25.417603 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1886/3795] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:25 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:25.424592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.446863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7173d5-ee11-43b0-bb5f-25caf81af146 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:25.454129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:25.456017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:25.456258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.456820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.457570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-893288704) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:25.458041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:25.459995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:25.474459 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1910/3796] 10.222.0.32 () {58 vars in 1196 bytes} [Sat May 7 21:56:25 2022] GET /identity/v3/domains?name=tempest-test_domain-893288704 => generated 407 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:25.479891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.494174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88034423-974a-49be-a42c-55259fb26b79 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:25.501162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:25.502081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:25.503057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.503057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.512773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe.: keystone.exception.DomainNotFound: Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:25.529526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:25.530526 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0073018aa9fe4b52a2fab729c41ec2fe. May 07 21:56:25.532298 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:25.534320 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1887/3797] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:25 2022] PATCH /identity/v3/domains/0073018aa9fe4b52a2fab729c41ec2fe => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:25.536221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.551046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc77eed-e745-4f5c-bd9c-fa521f87ff65 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:25.566828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:25.567729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:25.568055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.568755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/b5899d049bee4bd9b4966d854bae1762` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.584411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b5899d049bee4bd9b4966d854bae1762)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:25.586356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:25.654355 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1911/3798] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:25 2022] PATCH /identity/v3/domains/b5899d049bee4bd9b4966d854bae1762 => generated 277 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:25.660444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.673673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f07e32-738f-45ba-808d-fb948e96eda8 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:25.683659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:25.687485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:25.687987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:25.688277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/b5899d049bee4bd9b4966d854bae1762` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:25.725629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b5899d049bee4bd9b4966d854bae1762)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:25.727314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:25.757799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.771224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.848027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762', 'request_id': 'req-63ae4042-a385-4c63-bc6a-df25f2a319b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.856844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762', 'request_id': 'req-63ae4042-a385-4c63-bc6a-df25f2a319b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.869227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762', 'request_id': 'req-63ae4042-a385-4c63-bc6a-df25f2a319b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.888276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] The token cache is being invalidate because project b5899d049bee4bd9b4966d854bae1762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:25.889050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.890744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.909205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762', 'request_id': 'req-63ae4042-a385-4c63-bc6a-df25f2a319b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.910723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762', 'request_id': 'req-63ae4042-a385-4c63-bc6a-df25f2a319b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.919128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b5899d049bee4bd9b4966d854bae1762', 'request_id': 'req-63ae4042-a385-4c63-bc6a-df25f2a319b0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:25.928423 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1888/3799] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:25 2022] DELETE /identity/v3/domains/b5899d049bee4bd9b4966d854bae1762 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:25.932503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:25.934557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:25.951538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699e10-1936-4ea8-b416-fdd628771594 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:26.049158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:26.050375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:26.052224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:26.053557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/af9ce97542c34a99aa3996368241d886` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:26.075221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=af9ce97542c34a99aa3996368241d886)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:26.077161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:26.115194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'af9ce97542c34a99aa3996368241d886'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.116219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'af9ce97542c34a99aa3996368241d886'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.186282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'af9ce97542c34a99aa3996368241d886'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.190320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'af9ce97542c34a99aa3996368241d886'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.198439 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1912/3800] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:25 2022] PATCH /identity/v3/domains/af9ce97542c34a99aa3996368241d886 => generated 277 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:26.202623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:26.227238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae4042-a385-4c63-bc6a-df25f2a319b0 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:26.308476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:26.310075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:26.310608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:26.312376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/af9ce97542c34a99aa3996368241d886` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:26.327618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=af9ce97542c34a99aa3996368241d886)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:26.330981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:26.360153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'af9ce97542c34a99aa3996368241d886'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.365698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'af9ce97542c34a99aa3996368241d886'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.444971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9ce97542c34a99aa3996368241d886', 'request_id': 'req-320cb28a-58c1-479f-8ab0-195ae3aa7c70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.455192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9ce97542c34a99aa3996368241d886', 'request_id': 'req-320cb28a-58c1-479f-8ab0-195ae3aa7c70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.471647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9ce97542c34a99aa3996368241d886', 'request_id': 'req-320cb28a-58c1-479f-8ab0-195ae3aa7c70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.500051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] The token cache is being invalidate because project af9ce97542c34a99aa3996368241d886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:26.500698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.501840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.523017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'af9ce97542c34a99aa3996368241d886', 'request_id': 'req-320cb28a-58c1-479f-8ab0-195ae3aa7c70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.524408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'af9ce97542c34a99aa3996368241d886', 'request_id': 'req-320cb28a-58c1-479f-8ab0-195ae3aa7c70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.529657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'af9ce97542c34a99aa3996368241d886', 'request_id': 'req-320cb28a-58c1-479f-8ab0-195ae3aa7c70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.539293 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1889/3801] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:26 2022] DELETE /identity/v3/domains/af9ce97542c34a99aa3996368241d886 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:26.543227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:26.545240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:26.573718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b5f26-87fe-4292-9fb5-3f766c5e63ef tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:26.726452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:26.727833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:26.729619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:26.730101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/5393f4247ec14c2cbc0ff3fabe1bfa38` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:26.750469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5393f4247ec14c2cbc0ff3fabe1bfa38)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:26.753128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:26.826007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.828150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.900608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.902097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-adcf4063-9c33-4640-8290-c0d9b9c89eeb tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:26.907909 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1913/3802] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:26 2022] PATCH /identity/v3/domains/5393f4247ec14c2cbc0ff3fabe1bfa38 => generated 277 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:26.909446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:26.911255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:26.933530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cb28a-58c1-479f-8ab0-195ae3aa7c70 tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:27.047403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fd6727e9a04017abc8c49aec85efb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a570c6e188a149058186f8817e454fe8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:27.063271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:27.063814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:27.064958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] PATH_INFO: `/v3/domains/5393f4247ec14c2cbc0ff3fabe1bfa38` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:27.066026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3348451-3e27-4547-86cc-a1fc42546d76 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:27.066508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3348451-3e27-4547-86cc-a1fc42546d76 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:27.066970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3348451-3e27-4547-86cc-a1fc42546d76 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:27.068887 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1914/3803] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:56:27.080145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:27.080496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:27.080656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:27.090084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5393f4247ec14c2cbc0ff3fabe1bfa38)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:27.093011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:27.138373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.145608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.193277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:27.196396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:27.250493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38', 'request_id': 'req-e3e7bf01-3954-46ff-b369-407f834f7b8e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.265777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38', 'request_id': 'req-e3e7bf01-3954-46ff-b369-407f834f7b8e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.282507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38', 'request_id': 'req-e3e7bf01-3954-46ff-b369-407f834f7b8e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.305711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] The token cache is being invalidate because project 5393f4247ec14c2cbc0ff3fabe1bfa38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:27.306227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.307203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.313178 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1915/3804] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:56:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:27.330734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:27.331710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38', 'request_id': 'req-e3e7bf01-3954-46ff-b369-407f834f7b8e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.332562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38', 'request_id': 'req-e3e7bf01-3954-46ff-b369-407f834f7b8e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.333252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:27.342728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5393f4247ec14c2cbc0ff3fabe1bfa38', 'request_id': 'req-e3e7bf01-3954-46ff-b369-407f834f7b8e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.353822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1890/3805] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:26 2022] DELETE /identity/v3/domains/5393f4247ec14c2cbc0ff3fabe1bfa38 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:27.356620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c00888-ef1c-4c12-9514-46cba4a71717 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:27.368421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:27.373066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:27.433259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f78b03-1af9-4674-90d3-646796f73075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:27.435700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f78b03-1af9-4674-90d3-646796f73075 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:27.436000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f78b03-1af9-4674-90d3-646796f73075 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:27.436277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f78b03-1af9-4674-90d3-646796f73075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:27.441139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d6f78b03-1af9-4674-90d3-646796f73075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:27.464262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f78b03-1af9-4674-90d3-646796f73075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:27.466377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f78b03-1af9-4674-90d3-646796f73075 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:27.477834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1916/3806] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:56:27.562612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7bf01-3954-46ff-b369-407f834f7b8e tempest-DomainsTestJSON-563344020 tempest-DomainsTestJSON-563344020-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:27.573935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:27.574896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:27.575321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:27.575733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] PATH_INFO: `/v3/users/cd58ab5627144555b737739d43799aba` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:27.578152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd58ab5627144555b737739d43799aba)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:27.583886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:27.667923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd58ab5627144555b737739d43799aba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.678305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd58ab5627144555b737739d43799aba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.680238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd58ab5627144555b737739d43799aba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.680710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd58ab5627144555b737739d43799aba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.700571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd58ab5627144555b737739d43799aba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:27.731848 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1891/3807] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:27 2022] DELETE /identity/v3/users/cd58ab5627144555b737739d43799aba => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:27.737695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:27.739207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:27.740151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:27.770664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:27.772400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:27.861620 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1917/3808] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:27.879186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:27.879186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:27.968707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5a610-f65d-4f67-bfd1-35871660f13b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:27.973327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:27.974071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:27.974418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:27.975321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:27.987887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:27.990192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:28.003549 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1892/3809] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:28.496031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:28.498864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:28.512910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b517486-3a70-44f5-9372-36973841ee48 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:28.520723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:28.521598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:28.521861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:28.522118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] PATH_INFO: `/v3/projects/13ed534eb8c3446094e903cd3abafcfe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:28.528844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ed534eb8c3446094e903cd3abafcfe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:28.530793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:28.585431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ed534eb8c3446094e903cd3abafcfe', 'request_id': 'req-6c742acf-db92-41a5-8767-a9d691a16e9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.597262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ed534eb8c3446094e903cd3abafcfe', 'request_id': 'req-6c742acf-db92-41a5-8767-a9d691a16e9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.622062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ed534eb8c3446094e903cd3abafcfe', 'request_id': 'req-6c742acf-db92-41a5-8767-a9d691a16e9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.639048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] The token cache is being invalidate because project 13ed534eb8c3446094e903cd3abafcfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:28.639449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.641255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.642749 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1918/3810] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:28 2022] DELETE /identity/v3/projects/13ed534eb8c3446094e903cd3abafcfe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:28.647079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:28.660594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95fce9-56f0-42a4-a529-4580b6499caa service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:28.743570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:28.744806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:28.745173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:28.746121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] PATH_INFO: `/v3/users/84fd6727e9a04017abc8c49aec85efb9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:28.748428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84fd6727e9a04017abc8c49aec85efb9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:28.749997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:28.848079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84fd6727e9a04017abc8c49aec85efb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.859264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84fd6727e9a04017abc8c49aec85efb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.860111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84fd6727e9a04017abc8c49aec85efb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.860796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84fd6727e9a04017abc8c49aec85efb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.881406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84fd6727e9a04017abc8c49aec85efb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:28.909118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1893/3811] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:28 2022] DELETE /identity/v3/users/84fd6727e9a04017abc8c49aec85efb9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:29.505300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:29.507939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:29.658807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c742acf-db92-41a5-8767-a9d691a16e9f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:29.666229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:29.668478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:29.776487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29df5d-94b5-4f11-b96d-65c32ad5d400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:29.777134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29df5d-94b5-4f11-b96d-65c32ad5d400 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:29.777413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29df5d-94b5-4f11-b96d-65c32ad5d400 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:29.777685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29df5d-94b5-4f11-b96d-65c32ad5d400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:29.779770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a29df5d-94b5-4f11-b96d-65c32ad5d400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:29.787930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be05d9-283f-410d-acc3-173016cf5666 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:29.793955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29df5d-94b5-4f11-b96d-65c32ad5d400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:29.794997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29df5d-94b5-4f11-b96d-65c32ad5d400 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:29.795504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:29.796377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:29.796662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:29.796937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] PATH_INFO: `/v3/projects/a570c6e188a149058186f8817e454fe8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:29.798161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a570c6e188a149058186f8817e454fe8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:29.800817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:29.810297 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1919/3812] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:29.852018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a570c6e188a149058186f8817e454fe8', 'request_id': 'req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:29.858679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a570c6e188a149058186f8817e454fe8', 'request_id': 'req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:29.867206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a570c6e188a149058186f8817e454fe8', 'request_id': 'req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:29.881387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] The token cache is being invalidate because project a570c6e188a149058186f8817e454fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:29.881820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:29.882547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c4d127e9-c6a7-4c27-ad1a-aaee28bd0fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:29.884297 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1894/3813] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:29 2022] DELETE /identity/v3/projects/a570c6e188a149058186f8817e454fe8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:29.891675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e3ea9-3afc-48d9-9bdc-37759475996c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:29.892788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e3ea9-3afc-48d9-9bdc-37759475996c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:29.893632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e3ea9-3afc-48d9-9bdc-37759475996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:29.916715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-435e3ea9-3afc-48d9-9bdc-37759475996c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:29.918074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-435e3ea9-3afc-48d9-9bdc-37759475996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:29.999689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1920/3814] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:30.008635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477dfb4-869c-4ca3-8b3e-2ddbe697db77 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.009092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477dfb4-869c-4ca3-8b3e-2ddbe697db77 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.009574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477dfb4-869c-4ca3-8b3e-2ddbe697db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.039634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5477dfb4-869c-4ca3-8b3e-2ddbe697db77 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:30.041280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5477dfb4-869c-4ca3-8b3e-2ddbe697db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:30.050897 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1895/3815] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:30.055413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e3ea9-3afc-48d9-9bdc-37759475996c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.065599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e3ea9-3afc-48d9-9bdc-37759475996c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.071006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.072098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.072392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.072667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.073398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:30.073959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.075738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.089004 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1921/3816] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:30.093378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477dfb4-869c-4ca3-8b3e-2ddbe697db77 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.103575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477dfb4-869c-4ca3-8b3e-2ddbe697db77 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.108380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.109065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.109340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.109620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.110320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.112339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.140855 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1896/3817] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:30 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:30.145602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.160692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792fe21-789b-4e34-a56c-1448c9088d07 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.320723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.321927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.322204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.322542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.323892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.326719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.366678 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1922/3818] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:30 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:30.371121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.383528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391ba2-fcae-4ea3-8878-98cbb2ddb0f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.389853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.390443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.390800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.391093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.391908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.394665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.424418 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1897/3819] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:30.428794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.449559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17195-c1b2-4fed-adad-f222009fa3e5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.456174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc36364-697a-4d92-8639-380b413e1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.457731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc36364-697a-4d92-8639-380b413e1776 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.458186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc36364-697a-4d92-8639-380b413e1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.458729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc36364-697a-4d92-8639-380b413e1776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.460451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc36364-697a-4d92-8639-380b413e1776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.462624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc36364-697a-4d92-8639-380b413e1776 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.480251 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1923/3820] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:30.481808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.499612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df68a1-941a-46d4-a7fb-5fb05c5be51f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.518995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.533428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.535702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.536069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] PATH_INFO: `/v3/projects/4585769653524628b8fec12002da1378/users/33c4b68cfb2e4f0eac9007d4265d18b4/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.556270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4585769653524628b8fec12002da1378, user_id=33c4b68cfb2e4f0eac9007d4265d18b4, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.559221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.574033 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1898/3821] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:30 2022] PUT /identity/v3/projects/4585769653524628b8fec12002da1378/users/33c4b68cfb2e4f0eac9007d4265d18b4/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:30.584187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae1189-374e-482e-a3ba-11fe2de7add5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.584713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae1189-374e-482e-a3ba-11fe2de7add5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.584713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae1189-374e-482e-a3ba-11fe2de7add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.610712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4aae1189-374e-482e-a3ba-11fe2de7add5 None None] MFA Rules not processed for user `33c4b68cfb2e4f0eac9007d4265d18b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:30.612235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4aae1189-374e-482e-a3ba-11fe2de7add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:30.678507 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1924/3822] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:30.683028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.743230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc98d0-add1-4524-be44-c1ebf0a2b7d9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.748013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578218e-5d39-4e50-b99c-59ede5ca252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.748676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578218e-5d39-4e50-b99c-59ede5ca252e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.748965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578218e-5d39-4e50-b99c-59ede5ca252e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.749242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578218e-5d39-4e50-b99c-59ede5ca252e admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.750013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578218e-5d39-4e50-b99c-59ede5ca252e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.752581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578218e-5d39-4e50-b99c-59ede5ca252e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.798308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae1189-374e-482e-a3ba-11fe2de7add5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.806174 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1899/3823] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:30 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:30.811834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae1189-374e-482e-a3ba-11fe2de7add5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.900817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.901856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.902286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.902705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.903728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.905873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.910344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff2aa-3679-41dd-a5e6-34b63896fe1f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.910955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff2aa-3679-41dd-a5e6-34b63896fe1f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.911240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff2aa-3679-41dd-a5e6-34b63896fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.943793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eb3ff2aa-3679-41dd-a5e6-34b63896fe1f None None] MFA Rules not processed for user `7262be0d7db141e69bdf493bd7a5505a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:30.945040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eb3ff2aa-3679-41dd-a5e6-34b63896fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:30.950109 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1925/3824] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:30 2022] POST /identity/v3/users => generated 301 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:30.951722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:30.962250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf46716-a9f0-4792-b208-7ef5a34bf96a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:30.968292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:30.969171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:30.969454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:30.969780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:30.971274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:30.972905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:30.984913 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1926/3825] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:30.993135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.009710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e709d-a97d-434c-ae27-01ff4ded8e48 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.015031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.016037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.016493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.016876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] PATH_INFO: `/v3/projects/f7fa838baf094d5a96d28d803088f5d6/users/8fd46a9afa0b435ba759c225804db9d4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.021442 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1900/3826] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:31.044006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fa838baf094d5a96d28d803088f5d6, user_id=8fd46a9afa0b435ba759c225804db9d4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.047095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.066236 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1927/3827] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:30 2022] PUT /identity/v3/projects/f7fa838baf094d5a96d28d803088f5d6/users/8fd46a9afa0b435ba759c225804db9d4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:31.067376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ff2aa-3679-41dd-a5e6-34b63896fe1f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.082494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ff2aa-3679-41dd-a5e6-34b63896fe1f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.153460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d4d9d-89b1-4ec8-835b-00c466bd9e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.154143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4d9d-89b1-4ec8-835b-00c466bd9e78 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.154430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4d9d-89b1-4ec8-835b-00c466bd9e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.154708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d4d9d-89b1-4ec8-835b-00c466bd9e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.155474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d4d9d-89b1-4ec8-835b-00c466bd9e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.157083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d4d9d-89b1-4ec8-835b-00c466bd9e78 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.172038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1901/3828] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:31.174584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.190168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70d51e-09d9-47e5-8e1e-d785cb3edb5e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.199869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.202501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.202865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.203146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] PATH_INFO: `/v3/projects/f7fa838baf094d5a96d28d803088f5d6/users/8fd46a9afa0b435ba759c225804db9d4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.207069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fa838baf094d5a96d28d803088f5d6, user_id=8fd46a9afa0b435ba759c225804db9d4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.208819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.219975 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1928/3829] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:31 2022] PUT /identity/v3/projects/f7fa838baf094d5a96d28d803088f5d6/users/8fd46a9afa0b435ba759c225804db9d4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:31.231801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c488-4623-4590-bee8-864e791c9e84 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.232102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c488-4623-4590-bee8-864e791c9e84 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.232383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c488-4623-4590-bee8-864e791c9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.269620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3820c488-4623-4590-bee8-864e791c9e84 None None] MFA Rules not processed for user `8fd46a9afa0b435ba759c225804db9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:31.271104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3820c488-4623-4590-bee8-864e791c9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:31.364446 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1902/3830] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:31.368948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.379651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00601e-0504-4ad0-a294-791d0f0eedf7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.384269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.385115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.385396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.385670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects/4585769653524628b8fec12002da1378` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.386878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:get_project(project_id=4585769653524628b8fec12002da1378)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.389539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.391621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1929/3831] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects/4585769653524628b8fec12002da1378 => generated 389 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:31.396235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c488-4623-4590-bee8-864e791c9e84 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.406184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c488-4623-4590-bee8-864e791c9e84 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.411517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.412174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.412463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.412746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.413556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.415698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.445519 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1903/3832] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:56:31 2022] POST /identity/v3/projects => generated 339 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:31.446723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.467506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda63831-3ace-42ac-a6aa-62182a746b1e tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.543523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.544186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.544690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.544965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.545881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.547741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.572746 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1930/3833] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects => generated 7376 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:31.573694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.588914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2df0d4-f826-4457-8884-bc9a5ab5425f tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.600860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.601744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.602033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.603136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects/4585769653524628b8fec12002da1378` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.605399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:get_project(project_id=4585769653524628b8fec12002da1378)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.610276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.618901 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1904/3834] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects/4585769653524628b8fec12002da1378 => generated 389 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:31.624530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.640597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fba3af-3b63-4bbd-8bfb-2f8118a3062d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.646245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.647280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.647569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.648104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects/5b06301acdfd48e1aa8314ca61499b19` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.649388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b06301acdfd48e1aa8314ca61499b19)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.651563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.655163 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1931/3835] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects/5b06301acdfd48e1aa8314ca61499b19 => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:31.659537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.676266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931ef8-84c5-4c72-a2f7-3b75a189cbb5 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.681794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.682527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.682865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.683230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.684164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.685225 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:31.685225 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:31.685225 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:31.686350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.715520 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1905/3836] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects => generated 7376 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:31.720183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.733107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf75ce-d1e4-4e5a-aa53-b4a2293dc5f8 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.740071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.741011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.741350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.742353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.742490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:31.742878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.745711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.786196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1932/3837] 10.222.0.32 () {58 vars in 1165 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects?domain_id=default => generated 7045 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:31.790162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.800832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b89e8-e020-40ba-9f99-7fe0ff0f0362 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.805777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.806520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.806926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.807274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.808099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.810358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.834566 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1906/3838] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects => generated 7376 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:31.836077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.847585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dcb38-b07d-455d-975c-8af7c5fc6865 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.852722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.853570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.853856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.854130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.855201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:31.855510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.858006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.879336 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1933/3839] 10.222.0.32 () {58 vars in 1165 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects?domain_id=default => generated 7045 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:31.885428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.897295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6166c9-0f96-4766-a7e0-f89ffc66c57c tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.902786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.903489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.904088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.904387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.905248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.907236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.931237 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1907/3840] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects => generated 7376 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:31.932639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.944117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89478-1d05-4890-a47c-e3b126b3722a tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.949486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.950091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.950835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.950835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.951439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1788358881) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:31.951752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:31.953632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:31.973074 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1934/3841] 10.222.0.32 () {58 vars in 1231 bytes} [Sat May 7 21:56:31 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1788358881 => generated 537 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:31.978272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:31.989642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00669d23-0677-4431-a71e-fb4eec831b86 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:31.995902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fd46a9afa0b435ba759c225804db9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7fa838baf094d5a96d28d803088f5d6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:31.996701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:31.996988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:31.997384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] PATH_INFO: `/v3/projects/5b06301acdfd48e1aa8314ca61499b19` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:31.998615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b06301acdfd48e1aa8314ca61499b19)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:32.000585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:32.066079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b06301acdfd48e1aa8314ca61499b19', 'request_id': 'req-4786aec4-0211-41ed-ac55-97ea42760d98'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.075204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b06301acdfd48e1aa8314ca61499b19', 'request_id': 'req-4786aec4-0211-41ed-ac55-97ea42760d98'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.086052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b06301acdfd48e1aa8314ca61499b19', 'request_id': 'req-4786aec4-0211-41ed-ac55-97ea42760d98'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.097508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] The token cache is being invalidate because project 5b06301acdfd48e1aa8314ca61499b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:32.097877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.098728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4786aec4-0211-41ed-ac55-97ea42760d98 tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.101717 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1908/3842] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:31 2022] DELETE /identity/v3/projects/5b06301acdfd48e1aa8314ca61499b19 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:32.105393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:32.107679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:32.253384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83096e53-91b4-4fc8-989e-7f99bdbdff3d tempest-ListProjectsStaticTestJSON-1803783377 tempest-ListProjectsStaticTestJSON-1803783377-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:32.333808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dec5f0-80ad-4179-b688-b91e1084cb1c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:32.334136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dec5f0-80ad-4179-b688-b91e1084cb1c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:32.334417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dec5f0-80ad-4179-b688-b91e1084cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:32.350177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:32.351130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:32.351411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:32.351684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] PATH_INFO: `/v3/users/33c4b68cfb2e4f0eac9007d4265d18b4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:32.353105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-42dec5f0-80ad-4179-b688-b91e1084cb1c None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:32.353405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c4b68cfb2e4f0eac9007d4265d18b4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:32.354350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-42dec5f0-80ad-4179-b688-b91e1084cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:32.355505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:32.405991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c4b68cfb2e4f0eac9007d4265d18b4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.406921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c4b68cfb2e4f0eac9007d4265d18b4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.415974 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1909/3843] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:32.416375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c4b68cfb2e4f0eac9007d4265d18b4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.417114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c4b68cfb2e4f0eac9007d4265d18b4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.426422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c4b68cfb2e4f0eac9007d4265d18b4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:32.450036 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1935/3844] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:32 2022] DELETE /identity/v3/users/33c4b68cfb2e4f0eac9007d4265d18b4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:32.455821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:32.455821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:32.455821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:32.475965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:32.477292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:32.558422 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1910/3845] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:32.584730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:32.586601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:32.661877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0f157-84b8-4dcc-83fd-8e919fda529b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:32.666904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:32.667725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:32.668016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:32.668294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:32.700090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:32.701847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:32.721055 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1936/3846] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:33.197920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:33.217417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:33.263301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4691e-e313-4484-b0e2-5e44508db18b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:33.276380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:33.277387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:33.277677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:33.277967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] PATH_INFO: `/v3/projects/4585769653524628b8fec12002da1378` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:33.280257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4585769653524628b8fec12002da1378)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:33.282199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:33.373418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4585769653524628b8fec12002da1378', 'request_id': 'req-13cb6934-d687-41ab-8d95-70e94202e8b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.397391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4585769653524628b8fec12002da1378', 'request_id': 'req-13cb6934-d687-41ab-8d95-70e94202e8b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.411121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4585769653524628b8fec12002da1378', 'request_id': 'req-13cb6934-d687-41ab-8d95-70e94202e8b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.433722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] The token cache is being invalidate because project 4585769653524628b8fec12002da1378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:33.434160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.435570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-13cb6934-d687-41ab-8d95-70e94202e8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.441651 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1911/3847] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:33 2022] DELETE /identity/v3/projects/4585769653524628b8fec12002da1378 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:33.442604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:33.457029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef353eac-483e-4468-bdaa-eb52889dca0c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:33.542184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961e36b-adf8-4c4b-a920-9dfacf8fa3ab None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:33.542418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961e36b-adf8-4c4b-a920-9dfacf8fa3ab None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:33.542633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961e36b-adf8-4c4b-a920-9dfacf8fa3ab None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:33.544194 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1912/3848] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:56:33.550982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:33.551272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:33.551550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:33.625385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:33.627391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:33.632129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:33.632764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] PATH_INFO: `/v3/users/8fd46a9afa0b435ba759c225804db9d4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:33.635407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd46a9afa0b435ba759c225804db9d4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:33.637730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:33.645134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:33.646721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:33.704216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd46a9afa0b435ba759c225804db9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.705272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd46a9afa0b435ba759c225804db9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.713788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd46a9afa0b435ba759c225804db9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.714606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd46a9afa0b435ba759c225804db9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.738557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd46a9afa0b435ba759c225804db9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:33.767669 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1937/3849] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:33 2022] DELETE /identity/v3/users/8fd46a9afa0b435ba759c225804db9d4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:33.771252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:33.771615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:33.861980 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1913/3850] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:56:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:33.887689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e534188-6367-4fa2-9f35-e2a965d6d592 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:33.897625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1444194b-19f7-462e-aa8b-b5df35b3b493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:33.898376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444194b-19f7-462e-aa8b-b5df35b3b493 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:33.898797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444194b-19f7-462e-aa8b-b5df35b3b493 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:33.899149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1444194b-19f7-462e-aa8b-b5df35b3b493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:33.904391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1444194b-19f7-462e-aa8b-b5df35b3b493 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:33.931482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:33.932276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444194b-19f7-462e-aa8b-b5df35b3b493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:33.933077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:33.934164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1444194b-19f7-462e-aa8b-b5df35b3b493 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:33.965076 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1938/3851] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:33.973792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc95d1-74d3-4b72-a424-0900ce530268 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:34.008826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:34.011496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:34.011838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:34.012233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:34.028582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:34.030849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:34.079649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1914/3852] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:34.349533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc7b4-12bc-4d57-b174-a2896ffc1d65 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:34.349838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc7b4-12bc-4d57-b174-a2896ffc1d65 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:34.350019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc7b4-12bc-4d57-b174-a2896ffc1d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:34.375674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d8ccc7b4-12bc-4d57-b174-a2896ffc1d65 None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:34.377374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d8ccc7b4-12bc-4d57-b174-a2896ffc1d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:34.493893 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1939/3853] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:34.736713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:34.739819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:34.855955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504b521-d729-4f5e-921e-b9166d1ffa8b service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:34.865527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:34.867084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:34.867540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:34.867887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] PATH_INFO: `/v3/projects/f7fa838baf094d5a96d28d803088f5d6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:34.869485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7fa838baf094d5a96d28d803088f5d6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:34.874963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:34.962341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fa838baf094d5a96d28d803088f5d6', 'request_id': 'req-cdd7ec9b-0274-4c82-bba5-29b522550612'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:34.991487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fa838baf094d5a96d28d803088f5d6', 'request_id': 'req-cdd7ec9b-0274-4c82-bba5-29b522550612'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:35.008794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fa838baf094d5a96d28d803088f5d6', 'request_id': 'req-cdd7ec9b-0274-4c82-bba5-29b522550612'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:35.028571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] The token cache is being invalidate because project f7fa838baf094d5a96d28d803088f5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:35.028890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:35.029593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdd7ec9b-0274-4c82-bba5-29b522550612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:35.032078 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1915/3854] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:34 2022] DELETE /identity/v3/projects/f7fa838baf094d5a96d28d803088f5d6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:35.036579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e21c-39dd-4efa-803e-e223460355a4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.037077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e21c-39dd-4efa-803e-e223460355a4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.037342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3e21c-39dd-4efa-803e-e223460355a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.085400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d2a3e21c-39dd-4efa-803e-e223460355a4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:35.087139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d2a3e21c-39dd-4efa-803e-e223460355a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:35.233579 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1940/3855] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:35.237458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef9f-85cd-4ecc-8422-154eac038946 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.237756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef9f-85cd-4ecc-8422-154eac038946 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.238040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef9f-85cd-4ecc-8422-154eac038946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.285084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6282ef9f-85cd-4ecc-8422-154eac038946 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:35.287416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6282ef9f-85cd-4ecc-8422-154eac038946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:35.315503 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1916/3856] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:35.316689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e21c-39dd-4efa-803e-e223460355a4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:35.333171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3e21c-39dd-4efa-803e-e223460355a4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:35.340535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:35.342128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.342893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.343283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.344372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:35.344801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:35.347200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:35.392791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282ef9f-85cd-4ecc-8422-154eac038946 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:35.393944 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1941/3857] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:35.411707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282ef9f-85cd-4ecc-8422-154eac038946 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:35.429590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:35.430270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.430556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.430856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.431554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:35.433885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:35.505999 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1917/3858] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:35 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:35.512760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:35.539149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519fda8-f258-4074-bb58-331c4129f8f7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:35.710627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:35.711505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.711794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.712068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.716413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:35.718734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:35.768243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1942/3859] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:35 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:35.772088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:35.787059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51df0f-d000-4564-9347-c9800f358161 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:35.792229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:35.793197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.793629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.793911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.794646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:35.796496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:35.815197 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1918/3860] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:35.820429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:35.841349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b74b07-0b69-41bb-84da-173ee9a2f9b2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:35.851910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2cafc-2d2a-4e17-ba7a-3babc6540cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:35.854382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2cafc-2d2a-4e17-ba7a-3babc6540cfd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.854382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2cafc-2d2a-4e17-ba7a-3babc6540cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.856447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2cafc-2d2a-4e17-ba7a-3babc6540cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.858425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2cafc-2d2a-4e17-ba7a-3babc6540cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:35.861478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2cafc-2d2a-4e17-ba7a-3babc6540cfd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:35.883620 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1943/3861] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:35.884856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:35.910531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2ac0-872d-4746-a5a5-1e9a8292d16a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:35.915745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:35.916701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.916990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.917269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] PATH_INFO: `/v3/projects/95518b807ab14cbc83fe0031f5ece2c8/users/f64358acdbc144dd90a6b81b55e43b9f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:35.937015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95518b807ab14cbc83fe0031f5ece2c8, user_id=f64358acdbc144dd90a6b81b55e43b9f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:35.940983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:35.975492 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1919/3862] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:35 2022] PUT /identity/v3/projects/95518b807ab14cbc83fe0031f5ece2c8/users/f64358acdbc144dd90a6b81b55e43b9f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:35.985556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9c9da-a886-4df8-911d-afd7775b862f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:35.986481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9c9da-a886-4df8-911d-afd7775b862f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:35.986904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9c9da-a886-4df8-911d-afd7775b862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.027546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-97f9c9da-a886-4df8-911d-afd7775b862f None None] MFA Rules not processed for user `f64358acdbc144dd90a6b81b55e43b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:36.028893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-97f9c9da-a886-4df8-911d-afd7775b862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:36.132613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1944/3863] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:36.137118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:36.218243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2bdd8-de6f-49e5-9376-9a57f5073d7b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:36.233883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:36.234570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.234892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.235173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.237085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:36.238926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:36.270609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1920/3864] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:36 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:36.272222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9c9da-a886-4df8-911d-afd7775b862f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:36.287424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9c9da-a886-4df8-911d-afd7775b862f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:36.378881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:36.379732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.380351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.380633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.381477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:36.384442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:36.424467 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1945/3865] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:36 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:36.428033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:36.442075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85a40e-ea9b-4a6a-8159-f2ae404b7cfb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:36.448498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:36.449357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.450038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.450431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.451703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:36.453820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:36.467269 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1921/3866] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:36.472451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:36.485402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56532332-b19f-40f1-b969-ba40153dca46 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:36.492631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:36.493539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.493770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.494048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] PATH_INFO: `/v3/projects/0837ade3124643759436adbd24f10ad0/users/47c4504468244664bd28eae8c2f2eeef/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.513255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0837ade3124643759436adbd24f10ad0, user_id=47c4504468244664bd28eae8c2f2eeef, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:36.516122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:36.531810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1946/3867] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:36 2022] PUT /identity/v3/projects/0837ade3124643759436adbd24f10ad0/users/47c4504468244664bd28eae8c2f2eeef/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:36.537020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:36.549499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4a9c7-b270-412c-a87a-6255ba046749 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:36.611585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c29ed-3ae8-4604-805f-fac1e973ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:36.612401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c29ed-3ae8-4604-805f-fac1e973ade0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.612729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c29ed-3ae8-4604-805f-fac1e973ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.613011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c29ed-3ae8-4604-805f-fac1e973ade0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.613802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c29ed-3ae8-4604-805f-fac1e973ade0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:36.615715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c29ed-3ae8-4604-805f-fac1e973ade0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:36.626601 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1922/3868] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:36.631221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:36.650428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e9f2-4598-42fc-9697-57691e9f90da admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:36.656059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:36.657054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.657282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.657656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] PATH_INFO: `/v3/projects/0837ade3124643759436adbd24f10ad0/users/47c4504468244664bd28eae8c2f2eeef/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.662809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0837ade3124643759436adbd24f10ad0, user_id=47c4504468244664bd28eae8c2f2eeef, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:36.665424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:36.677671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1947/3869] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:36 2022] PUT /identity/v3/projects/0837ade3124643759436adbd24f10ad0/users/47c4504468244664bd28eae8c2f2eeef/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:36.763209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b50850-2b94-49c6-b61e-ec7d73cc89d5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.763530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b50850-2b94-49c6-b61e-ec7d73cc89d5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.763808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b50850-2b94-49c6-b61e-ec7d73cc89d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.797690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-59b50850-2b94-49c6-b61e-ec7d73cc89d5 None None] MFA Rules not processed for user `47c4504468244664bd28eae8c2f2eeef`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:36.799604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59b50850-2b94-49c6-b61e-ec7d73cc89d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:36.923823 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1923/3870] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:36.930269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:36.942954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964078d-a144-4b27-aec3-ff0263cf87db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:36.948716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:36.949981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:36.950462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:36.951361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:36.952613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:36.954520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.002311 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1948/3871] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:36 2022] POST /identity/v3/projects => generated 360 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:37.003998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b50850-2b94-49c6-b61e-ec7d73cc89d5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.014479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b50850-2b94-49c6-b61e-ec7d73cc89d5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.084254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.085151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.085430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.085719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-1382952672` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.087341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=6e95058f804c47a9b80cf36e53d328e2, value=tempest-tag-1382952672)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.090263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.153140 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1382952672. To ensure interoperability, identifiers should be a valid uuid. May 07 21:56:37.153140 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 21:56:37.153140 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:37.161600 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1924/3872] 10.222.0.32 () {60 vars in 1332 bytes} [Sat May 7 21:56:37 2022] PUT /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-1382952672 => generated 0 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) May 07 21:56:37.168161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.183121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a821a-5012-4310-a806-35d9a952b3d1 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.193287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.195567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.196051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.196487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-1382952672` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.222457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=6e95058f804c47a9b80cf36e53d328e2, value=tempest-tag-1382952672)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.225773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.242334 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1949/3873] 10.222.0.32 () {58 vars in 1313 bytes} [Sat May 7 21:56:37 2022] GET /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-1382952672 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:37.247431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.266720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1823663-de89-4dfb-9bdc-15a48ec4004f tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.275083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.276295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.276506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.276830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.278090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=6e95058f804c47a9b80cf36e53d328e2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.281386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.347330 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1925/3874] 10.222.0.32 () {60 vars in 1264 bytes} [Sat May 7 21:56:37 2022] PUT /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags => generated 140 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:37.349107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.363102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932f966-c57f-4ccd-8dc9-4d4257361ade tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.379838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.380764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.381103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.381397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.396284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=6e95058f804c47a9b80cf36e53d328e2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.398554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.419396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.420955 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1950/3875] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 21:56:37 2022] GET /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags => generated 140 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:37.432752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661dc21-333f-4fbc-bb47-59f277818902 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.440470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.441772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.442052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.442194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-574282918` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.443888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=6e95058f804c47a9b80cf36e53d328e2, value=tempest-tag-574282918)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.447236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.495451 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-574282918. To ensure interoperability, identifiers should be a valid uuid. May 07 21:56:37.495451 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 21:56:37.495451 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:37.501976 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1926/3876] 10.222.0.32 () {58 vars in 1313 bytes} [Sat May 7 21:56:37 2022] DELETE /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-574282918 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:37.506356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.518255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233a37-04fa-4561-a9d6-03f459580e0b tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.524905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.526209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.526622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.527163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-574282918` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.541658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=6e95058f804c47a9b80cf36e53d328e2, value=tempest-tag-574282918)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.544091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Could not find project tag: tempest-tag-574282918.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-574282918. May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get May 07 21:56:37.569781 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) May 07 21:56:37.570705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:37.570705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:37.570705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag May 07 21:56:37.570705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) May 07 21:56:37.570705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-574282918. May 07 21:56:37.570705 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:37.571694 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1951/3877] 10.222.0.32 () {58 vars in 1310 bytes} [Sat May 7 21:56:37 2022] GET /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags/tempest-tag-574282918 => generated 106 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 21:56:37.575494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.588358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398933b5-bc98-419f-a68a-53f7097631fd tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.595937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.597193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.597775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.598174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.599595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=6e95058f804c47a9b80cf36e53d328e2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.602126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.673961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1927/3878] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 21:56:37 2022] DELETE /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:37.677382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.689499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ad3be-0448-4d85-aa53-76dc31824eb3 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.695175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.696312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.696601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.697019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.712057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=6e95058f804c47a9b80cf36e53d328e2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.715386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.732737 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1952/3879] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 21:56:37 2022] GET /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2/tags => generated 66 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 21:56:37.735604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.749821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca36e1-bc59-4bc0-9312-416cf12fb100 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:37.763023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47c4504468244664bd28eae8c2f2eeef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0837ade3124643759436adbd24f10ad0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:37.763889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:37.764175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:37.767061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] PATH_INFO: `/v3/projects/6e95058f804c47a9b80cf36e53d328e2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:37.771861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e95058f804c47a9b80cf36e53d328e2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:37.774220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:37.865542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e95058f804c47a9b80cf36e53d328e2', 'request_id': 'req-9155d7a8-d3e8-41b9-a1b6-60578d33b994'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:37.877531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e95058f804c47a9b80cf36e53d328e2', 'request_id': 'req-9155d7a8-d3e8-41b9-a1b6-60578d33b994'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:37.893058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e95058f804c47a9b80cf36e53d328e2', 'request_id': 'req-9155d7a8-d3e8-41b9-a1b6-60578d33b994'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:37.911803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] The token cache is being invalidate because project 6e95058f804c47a9b80cf36e53d328e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:37.912562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:37.913879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9155d7a8-d3e8-41b9-a1b6-60578d33b994 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:37.921809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1928/3880] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:37 2022] DELETE /identity/v3/projects/6e95058f804c47a9b80cf36e53d328e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:37.923184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:37.925369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:38.021126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651a42d-d024-4c53-8e08-1184776d9b89 tempest-IdentityV3ProjectTagsTest-732714105 tempest-IdentityV3ProjectTagsTest-732714105-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:38.090601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:38.091649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:38.092102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:38.092385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] PATH_INFO: `/v3/users/f64358acdbc144dd90a6b81b55e43b9f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:38.093863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64358acdbc144dd90a6b81b55e43b9f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:38.096524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:38.170370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64358acdbc144dd90a6b81b55e43b9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:38.173828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64358acdbc144dd90a6b81b55e43b9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:38.188194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64358acdbc144dd90a6b81b55e43b9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:38.191082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64358acdbc144dd90a6b81b55e43b9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:38.208647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64358acdbc144dd90a6b81b55e43b9f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:38.245851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1953/3881] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:37 2022] DELETE /identity/v3/users/f64358acdbc144dd90a6b81b55e43b9f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:38.246381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:38.246763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:38.247147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:38.278703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:38.280035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:38.358876 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1929/3882] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:38.400923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:38.402936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:38.482057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cbb6c-cd71-41f8-8f4d-d4a3d53c82fa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:38.489175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:38.490467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:38.490885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:38.491394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:38.503856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:38.505641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:38.523417 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1954/3883] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:38.979601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:38.982704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:39.002978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5d43-f903-408b-b4c0-8e0890eb517d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:39.015860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:39.016830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:39.017733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:39.018014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] PATH_INFO: `/v3/projects/95518b807ab14cbc83fe0031f5ece2c8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:39.020229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=95518b807ab14cbc83fe0031f5ece2c8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:39.049349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:39.124616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95518b807ab14cbc83fe0031f5ece2c8', 'request_id': 'req-77e3e50f-92ff-4222-baad-ac25055333bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.135084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95518b807ab14cbc83fe0031f5ece2c8', 'request_id': 'req-77e3e50f-92ff-4222-baad-ac25055333bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.146073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95518b807ab14cbc83fe0031f5ece2c8', 'request_id': 'req-77e3e50f-92ff-4222-baad-ac25055333bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.163331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] The token cache is being invalidate because project 95518b807ab14cbc83fe0031f5ece2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:39.163966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.165108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.167316 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1930/3884] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:38 2022] DELETE /identity/v3/projects/95518b807ab14cbc83fe0031f5ece2c8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:39.171925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:39.184425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2872e48-7282-4f85-b9fc-f3d7c92bd143 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:39.251957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:39.252808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:39.253082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:39.253350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] PATH_INFO: `/v3/users/47c4504468244664bd28eae8c2f2eeef` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:39.254528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c4504468244664bd28eae8c2f2eeef)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:39.256539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:39.322138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c4504468244664bd28eae8c2f2eeef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.322845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c4504468244664bd28eae8c2f2eeef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.336368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c4504468244664bd28eae8c2f2eeef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.337426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c4504468244664bd28eae8c2f2eeef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.353095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2421755-9e79-4c2d-a602-d0aeea7bb5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c4504468244664bd28eae8c2f2eeef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:39.380474 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1955/3885] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:39 2022] DELETE /identity/v3/users/47c4504468244664bd28eae8c2f2eeef => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:39.911466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:39.913664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:39.934367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3e50f-92ff-4222-baad-ac25055333bf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:40.027235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:40.028166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.028480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.028882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] PATH_INFO: `/v3/projects/0837ade3124643759436adbd24f10ad0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.031192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0837ade3124643759436adbd24f10ad0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:40.035422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:40.088205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0837ade3124643759436adbd24f10ad0', 'request_id': 'req-d3d41961-52af-4793-9733-3def8cf15434'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:40.094208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0837ade3124643759436adbd24f10ad0', 'request_id': 'req-d3d41961-52af-4793-9733-3def8cf15434'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:40.103247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0837ade3124643759436adbd24f10ad0', 'request_id': 'req-d3d41961-52af-4793-9733-3def8cf15434'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:40.117183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] The token cache is being invalidate because project 0837ade3124643759436adbd24f10ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:40.117558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:40.118286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3d41961-52af-4793-9733-3def8cf15434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:40.123381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1931/3886] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:39 2022] DELETE /identity/v3/projects/0837ade3124643759436adbd24f10ad0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:40.125433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe51e74-3a88-448c-9627-19985021b7e0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.125962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe51e74-3a88-448c-9627-19985021b7e0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.126363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe51e74-3a88-448c-9627-19985021b7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.150975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3fe51e74-3a88-448c-9627-19985021b7e0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:40.152417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3fe51e74-3a88-448c-9627-19985021b7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:40.254441 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1956/3887] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:40.265486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0bf9-a77e-4db1-a76b-576fd483e1c9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.265822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0bf9-a77e-4db1-a76b-576fd483e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.266109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df0bf9-a77e-4db1-a76b-576fd483e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.292999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-88df0bf9-a77e-4db1-a76b-576fd483e1c9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:40.294262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-88df0bf9-a77e-4db1-a76b-576fd483e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:40.305088 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1932/3888] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:40.309751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe51e74-3a88-448c-9627-19985021b7e0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:40.322084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe51e74-3a88-448c-9627-19985021b7e0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:40.328356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:40.329031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.329317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.330123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.330885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:40.331196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:40.332819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:40.352098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1957/3889] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:40.360165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0bf9-a77e-4db1-a76b-576fd483e1c9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:40.379630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df0bf9-a77e-4db1-a76b-576fd483e1c9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:40.393194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:40.395878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.396183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.396521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.397244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:40.403717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:40.435903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1933/3890] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:40 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:40.439910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:40.451861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ab77e-8adc-4e1c-bfc0-bbbd95e03008 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:40.553304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:40.553982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.554808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.555426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.556467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:40.559996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:40.595026 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1958/3891] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:40 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:40.597388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:40.615821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054f414-f4e3-45a6-87b9-b3c817a78a9a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:40.624705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:40.625528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.625882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.626560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.627727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:40.629573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:40.646822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1934/3892] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:40.648736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:40.663849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889dd3e-758f-4eea-8454-fb95876c8efa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:40.672574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d68837-f1c6-47ec-adf7-bc136ddd8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:40.673879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68837-f1c6-47ec-adf7-bc136ddd8ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.674386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68837-f1c6-47ec-adf7-bc136ddd8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.675366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d68837-f1c6-47ec-adf7-bc136ddd8ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.677243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d68837-f1c6-47ec-adf7-bc136ddd8ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:40.682148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d68837-f1c6-47ec-adf7-bc136ddd8ea2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:40.697230 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1959/3893] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:40.701779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:40.715369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c570cae-de98-4eaa-83e4-2cc0e4670354 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:40.721939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:40.723590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.723718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.724132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] PATH_INFO: `/v3/projects/5220099ecd6e49c7aa9ad20145e27495/users/a83cf3e8b9fe4939b4bb5eda1d1a0e1e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.741658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5220099ecd6e49c7aa9ad20145e27495, user_id=a83cf3e8b9fe4939b4bb5eda1d1a0e1e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:40.744732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:40.770838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1935/3894] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:40 2022] PUT /identity/v3/projects/5220099ecd6e49c7aa9ad20145e27495/users/a83cf3e8b9fe4939b4bb5eda1d1a0e1e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:40.779204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85309-3760-43ef-9642-450b06eb5122 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:40.780342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85309-3760-43ef-9642-450b06eb5122 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:40.780342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e85309-3760-43ef-9642-450b06eb5122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:40.821854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-68e85309-3760-43ef-9642-450b06eb5122 None None] MFA Rules not processed for user `a83cf3e8b9fe4939b4bb5eda1d1a0e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:40.823805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-68e85309-3760-43ef-9642-450b06eb5122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:40.915511 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1960/3895] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:40.917390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.018645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0f70f-2c72-410c-adfe-735c2e562d02 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.025815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.026593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.026980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.027327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.028841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.030641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.084645 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1936/3896] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:40 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:41.086200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e85309-3760-43ef-9642-450b06eb5122 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.098504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e85309-3760-43ef-9642-450b06eb5122 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.163516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.164268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.164552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.164784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.165481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.167694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.199507 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1961/3897] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:41 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:41.205860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.233439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58a57f-66db-41c3-90bb-e3fe7e31b979 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.239380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.240068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.240642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.240925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.241792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.244347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.256523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1937/3898] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:41.260399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.273253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410106-87db-4c7a-9016-7ef4166e2479 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.279656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.280980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.281420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.281845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] PATH_INFO: `/v3/projects/3dd2a10b4e994f7d90bf34945ab90be8/users/a67fe59db3864663907e4825f20e2fe0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.318739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd2a10b4e994f7d90bf34945ab90be8, user_id=a67fe59db3864663907e4825f20e2fe0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.322250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.352246 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1962/3899] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:41 2022] PUT /identity/v3/projects/3dd2a10b4e994f7d90bf34945ab90be8/users/a67fe59db3864663907e4825f20e2fe0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:41.356605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.379604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cef43-c94a-4999-87fa-0f39363653e4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.469785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516bc6d-ec6c-4608-aa92-b8ea48dc2193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.471380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516bc6d-ec6c-4608-aa92-b8ea48dc2193 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.471856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516bc6d-ec6c-4608-aa92-b8ea48dc2193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.472489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516bc6d-ec6c-4608-aa92-b8ea48dc2193 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.473731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516bc6d-ec6c-4608-aa92-b8ea48dc2193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.475702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516bc6d-ec6c-4608-aa92-b8ea48dc2193 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.491026 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1938/3900] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:41.492244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.504027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59811a-a3b0-4a1b-bc41-321f569db9cc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.509141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.510105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.510311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.510594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] PATH_INFO: `/v3/projects/3dd2a10b4e994f7d90bf34945ab90be8/users/a67fe59db3864663907e4825f20e2fe0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.512796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd2a10b4e994f7d90bf34945ab90be8, user_id=a67fe59db3864663907e4825f20e2fe0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.515542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.528731 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1963/3901] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:41 2022] PUT /identity/v3/projects/3dd2a10b4e994f7d90bf34945ab90be8/users/a67fe59db3864663907e4825f20e2fe0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:41.542032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01dad-6723-4b93-aa7b-5265b9a9735d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.542442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01dad-6723-4b93-aa7b-5265b9a9735d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.543122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d01dad-6723-4b93-aa7b-5265b9a9735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.582755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d4d01dad-6723-4b93-aa7b-5265b9a9735d None None] MFA Rules not processed for user `a67fe59db3864663907e4825f20e2fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:41.584169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d4d01dad-6723-4b93-aa7b-5265b9a9735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:41.700544 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1939/3902] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:41.707097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.727355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c7852-55cd-4c80-b207-900322b841db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.737322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.737771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.738896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.739797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.740193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.743782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.785519 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1964/3903] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:41 2022] POST /identity/v3/projects => generated 360 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:41.790820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d01dad-6723-4b93-aa7b-5265b9a9735d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.802396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d01dad-6723-4b93-aa7b-5265b9a9735d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.898364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.899074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.899376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.899654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.901004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.902378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.928516 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1940/3904] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:41 2022] POST /identity/v3/users => generated 416 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:41.933318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.946708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04104539-f15c-45f0-99e3-a6a5ed662194 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:41.953769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:41.955235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:41.955529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:41.955850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/users/c9e9501d5b4d4e1c814480a5ea97c776` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:41.975646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_user(user_id=c9e9501d5b4d4e1c814480a5ea97c776)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:41.979038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:41.981209 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1965/3905] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:56:41 2022] GET /identity/v3/users/c9e9501d5b4d4e1c814480a5ea97c776 => generated 416 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:41.986500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:41.997443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04f6ea-0f6b-4d93-978f-7e1c810d6f61 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:42.003478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:42.004470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:42.004814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:42.005197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/users/c9e9501d5b4d4e1c814480a5ea97c776` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:42.006492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c9e9501d5b4d4e1c814480a5ea97c776)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:42.008811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:42.071635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e9501d5b4d4e1c814480a5ea97c776'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.079602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e9501d5b4d4e1c814480a5ea97c776'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.080423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e9501d5b4d4e1c814480a5ea97c776'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.081102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e9501d5b4d4e1c814480a5ea97c776'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.094510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e9501d5b4d4e1c814480a5ea97c776'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.119323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1941/3906] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:41 2022] DELETE /identity/v3/users/c9e9501d5b4d4e1c814480a5ea97c776 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:42.124689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:42.128465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:42.144724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7105bf-256b-4b23-8231-7dcbe2f2f461 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:42.216933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:42.217757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:42.218034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:42.218311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/ecef51e0c2684970869af4428f9fd056` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:42.219656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ecef51e0c2684970869af4428f9fd056)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:42.222284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:42.272119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecef51e0c2684970869af4428f9fd056', 'request_id': 'req-e41d597a-0747-46ac-aa20-7758b09107fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.279710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecef51e0c2684970869af4428f9fd056', 'request_id': 'req-e41d597a-0747-46ac-aa20-7758b09107fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.288926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecef51e0c2684970869af4428f9fd056', 'request_id': 'req-e41d597a-0747-46ac-aa20-7758b09107fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.300306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project ecef51e0c2684970869af4428f9fd056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:42.300797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.301561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.303878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1966/3907] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:42 2022] DELETE /identity/v3/projects/ecef51e0c2684970869af4428f9fd056 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:42.308973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:42.323278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac76ee4-a07b-4317-a9b0-8f3e073772f0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:42.400261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:42.401285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:42.401542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:42.402114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:42.402536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:42.404571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:42.421382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1942/3908] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:42 2022] POST /identity/v3/projects => generated 348 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:42.426044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:42.427510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:42.440912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d597a-0747-46ac-aa20-7758b09107fe tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:42.529437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:42.530111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:42.530466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:42.530748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:42.531566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:42.531875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:42.534956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:42.569862 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1967/3909] 10.222.0.32 () {58 vars in 1159 bytes} [Sat May 7 21:56:42 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:42.574874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:42.590340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c18675-44b8-4753-a85c-c8ecf9f6ffc4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:42.599238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:42.600679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:42.601029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:42.601459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:42.602328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:42.604242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:42.622118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1943/3910] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 21:56:42 2022] GET /identity/v3/domains => generated 829 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:42.627213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:42.640474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eb0f6-039c-4217-8bab-5858d13e37ea tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:42.647134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:42.648222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:42.649259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:42.649259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/b846046a3a224d7c84e2534ab4e3a2c3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:42.650557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:update_project(project_id=b846046a3a224d7c84e2534ab4e3a2c3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:42.651736 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:42.651736 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:42.651736 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:42.653025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:42.671276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.673549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.737227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.737956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.742304 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1968/3911] 10.222.0.32 () {60 vars in 1251 bytes} [Sat May 7 21:56:42 2022] PATCH /identity/v3/projects/b846046a3a224d7c84e2534ab4e3a2c3 => generated 362 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:42.746119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:42.749643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:42.771013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9dd2a-7d9e-499a-8085-3fce3d12b6d2 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:42.872915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:42.874516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:42.875364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:42.875935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/b846046a3a224d7c84e2534ab4e3a2c3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:42.891189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b846046a3a224d7c84e2534ab4e3a2c3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:42.895595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:42.925526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:42.930137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.018727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3', 'request_id': 'req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.027976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3', 'request_id': 'req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.038499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3', 'request_id': 'req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.054080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project b846046a3a224d7c84e2534ab4e3a2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:43.054397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.055797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.073743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3', 'request_id': 'req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.075547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3', 'request_id': 'req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.080708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b846046a3a224d7c84e2534ab4e3a2c3', 'request_id': 'req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.092312 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1944/3912] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:42 2022] DELETE /identity/v3/projects/b846046a3a224d7c84e2534ab4e3a2c3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:43.093611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:43.111020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaaa6c-2ced-4ebb-93ce-7de8fc8f745e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:43.210245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:43.211480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:43.211480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:43.211731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:43.213050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:43.215846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:43.260847 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1969/3913] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:43 2022] POST /identity/v3/projects => generated 359 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:43.262500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:43.265231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:43.286129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b3bd6-8daf-4914-a699-afdd9f1c2aa4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:43.403120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:43.404219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:43.404822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:43.405207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/a5c58a8cd69f4d5f9ffc310e0f871efe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:43.406656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=a5c58a8cd69f4d5f9ffc310e0f871efe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:43.409410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:43.414632 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1945/3914] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:43 2022] GET /identity/v3/projects/a5c58a8cd69f4d5f9ffc310e0f871efe => generated 359 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:43.416505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:43.431566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f986a-3a02-45b6-8cab-9315d05d255f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:43.437332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:43.438449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:43.439449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:43.439770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/a5c58a8cd69f4d5f9ffc310e0f871efe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:43.441587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a5c58a8cd69f4d5f9ffc310e0f871efe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:43.443853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:43.516117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c58a8cd69f4d5f9ffc310e0f871efe', 'request_id': 'req-6a294dc9-c239-4cff-bae4-e16326d36720'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.524102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c58a8cd69f4d5f9ffc310e0f871efe', 'request_id': 'req-6a294dc9-c239-4cff-bae4-e16326d36720'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.534324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c58a8cd69f4d5f9ffc310e0f871efe', 'request_id': 'req-6a294dc9-c239-4cff-bae4-e16326d36720'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.548937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project a5c58a8cd69f4d5f9ffc310e0f871efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:43.549347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.550310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.552442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1970/3915] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:43 2022] DELETE /identity/v3/projects/a5c58a8cd69f4d5f9ffc310e0f871efe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:43.558747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:43.560688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:43.575304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e635a-da30-4ec9-964a-8504869a97fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:43.659658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:43.660509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:43.660846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:43.661132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:43.662479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:43.665787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:43.717065 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1946/3916] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:43 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:43.718589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:43.733521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294dc9-c239-4cff-bae4-e16326d36720 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:43.822606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:43.824594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:43.824594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:43.824594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/b1b6d727b1b34ceab050c8ee699d98b1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:43.830280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=b1b6d727b1b34ceab050c8ee699d98b1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:43.834894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:43.834894 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1971/3917] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:43 2022] GET /identity/v3/projects/b1b6d727b1b34ceab050c8ee699d98b1 => generated 361 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:43.840183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:43.864611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02511cf2-59ac-4946-83aa-54c7bb1c279c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:43.875104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:43.877900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:43.878192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:43.878470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/b1b6d727b1b34ceab050c8ee699d98b1` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:43.879949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b1b6d727b1b34ceab050c8ee699d98b1)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:43.882564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:43.956071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b6d727b1b34ceab050c8ee699d98b1', 'request_id': 'req-b3b704af-c19b-405c-8bb8-e617b8f1d58a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.965561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b6d727b1b34ceab050c8ee699d98b1', 'request_id': 'req-b3b704af-c19b-405c-8bb8-e617b8f1d58a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.976317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b6d727b1b34ceab050c8ee699d98b1', 'request_id': 'req-b3b704af-c19b-405c-8bb8-e617b8f1d58a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:43.996109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project b1b6d727b1b34ceab050c8ee699d98b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:43.999030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.000646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.007447 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1947/3918] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:43 2022] DELETE /identity/v3/projects/b1b6d727b1b34ceab050c8ee699d98b1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:44.008507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:44.010807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:44.028224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4894e-6c04-4fcc-a100-0370de8129b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:44.113685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:44.115172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:44.115629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:44.116162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:44.116840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:44.118876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:44.163830 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1972/3919] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:56:44 2022] POST /identity/v3/projects => generated 347 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:44.167687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:44.181230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b704af-c19b-405c-8bb8-e617b8f1d58a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:44.278028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:44.278852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:44.279257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:44.279517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/4ab7b15a4c2c459a80dee8c8f7cad4a2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:44.280959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=4ab7b15a4c2c459a80dee8c8f7cad4a2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:44.283817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:44.285617 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1948/3920] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:44 2022] GET /identity/v3/projects/4ab7b15a4c2c459a80dee8c8f7cad4a2 => generated 347 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:44.290786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:44.304849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283044-9d07-45c9-ad82-2dace3cf7fd9 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:44.311796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:44.313090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:44.313382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:44.313686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/4ab7b15a4c2c459a80dee8c8f7cad4a2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:44.315931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ab7b15a4c2c459a80dee8c8f7cad4a2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:44.318945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:44.398994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab7b15a4c2c459a80dee8c8f7cad4a2', 'request_id': 'req-c899083a-1f36-49e8-b6eb-f40b734ef901'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.407346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab7b15a4c2c459a80dee8c8f7cad4a2', 'request_id': 'req-c899083a-1f36-49e8-b6eb-f40b734ef901'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.424078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab7b15a4c2c459a80dee8c8f7cad4a2', 'request_id': 'req-c899083a-1f36-49e8-b6eb-f40b734ef901'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.439126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project 4ab7b15a4c2c459a80dee8c8f7cad4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:44.440196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.441238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.449420 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1973/3921] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:44 2022] DELETE /identity/v3/projects/4ab7b15a4c2c459a80dee8c8f7cad4a2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:44.451156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:44.453429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:44.469079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012b009-102d-486e-8b0d-34ac4a056805 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:44.546891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:44.552812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:44.552812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:44.552812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:44.552812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:44.554996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:44.586745 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1949/3922] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:56:44 2022] POST /identity/v3/domains => generated 275 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:44.590693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:44.606146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899083a-1f36-49e8-b6eb-f40b734ef901 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:44.713468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:44.713468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:44.713468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:44.713763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:44.713763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:44.713763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:44.772313 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1974/3923] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:44 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:44.773075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:44.785781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cea724-7b23-4051-8468-98d4e9d76ea6 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:44.865049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:44.866201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:44.866914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:44.867280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/5a746c1b716d4be19dc3f110a08c5fc0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:44.868850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=5a746c1b716d4be19dc3f110a08c5fc0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:44.871242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:44.873811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1950/3924] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:44 2022] GET /identity/v3/projects/5a746c1b716d4be19dc3f110a08c5fc0 => generated 405 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:44.878627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:44.893258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8448b3-4a4d-4fc2-a634-50e0a5bbb447 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:44.900998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:44.902044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:44.902549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:44.907079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/5a746c1b716d4be19dc3f110a08c5fc0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:44.909689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5a746c1b716d4be19dc3f110a08c5fc0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:44.912595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:44.971483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a746c1b716d4be19dc3f110a08c5fc0', 'request_id': 'req-35b74402-c1e3-4c20-abc5-528d4fae8055'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.977731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a746c1b716d4be19dc3f110a08c5fc0', 'request_id': 'req-35b74402-c1e3-4c20-abc5-528d4fae8055'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:44.990132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a746c1b716d4be19dc3f110a08c5fc0', 'request_id': 'req-35b74402-c1e3-4c20-abc5-528d4fae8055'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.003288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project 5a746c1b716d4be19dc3f110a08c5fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:45.003823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.004644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.007022 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1975/3925] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:44 2022] DELETE /identity/v3/projects/5a746c1b716d4be19dc3f110a08c5fc0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:45.011329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:45.013112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:45.025833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38e7ea-0097-4284-b2bb-d432fa3b427b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:45.089209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:45.090445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:45.090692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:45.091131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains/15e4f9ef84e041c8b56e5339f047c037` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:45.092939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=15e4f9ef84e041c8b56e5339f047c037)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:45.094598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:45.120805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.121531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.148286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.149094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.151664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1951/3926] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:45 2022] PATCH /identity/v3/domains/15e4f9ef84e041c8b56e5339f047c037 => generated 276 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:45.156028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:45.166883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b74402-c1e3-4c20-abc5-528d4fae8055 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:45.234167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:45.235081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:45.235374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:45.236239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains/15e4f9ef84e041c8b56e5339f047c037` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:45.250590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=15e4f9ef84e041c8b56e5339f047c037)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:45.253053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:45.279241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.284302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.342787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037', 'request_id': 'req-169722c3-ecef-41a6-8ae5-f1a217584534'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.353097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037', 'request_id': 'req-169722c3-ecef-41a6-8ae5-f1a217584534'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.361929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037', 'request_id': 'req-169722c3-ecef-41a6-8ae5-f1a217584534'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.389400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project 15e4f9ef84e041c8b56e5339f047c037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:45.389917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.390820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.402016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037', 'request_id': 'req-169722c3-ecef-41a6-8ae5-f1a217584534'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.407808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037', 'request_id': 'req-169722c3-ecef-41a6-8ae5-f1a217584534'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.408806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '15e4f9ef84e041c8b56e5339f047c037', 'request_id': 'req-169722c3-ecef-41a6-8ae5-f1a217584534'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:45.416271 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1976/3927] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:45 2022] DELETE /identity/v3/domains/15e4f9ef84e041c8b56e5339f047c037 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:45.423864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:45.425545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:45.442882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27da92e-822f-45e1-ae10-9f49983e3a2a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:45.509376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:45.510047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:45.510326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:45.510639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:45.512933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:45.515351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:45.535215 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1952/3928] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:56:45 2022] POST /identity/v3/domains => generated 277 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:45.539221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:45.541127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:45.556919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169722c3-ecef-41a6-8ae5-f1a217584534 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:45.635169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:45.635858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:45.636144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:45.636424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:45.637121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:45.640058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:45.698152 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1977/3929] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:45 2022] POST /identity/v3/projects => generated 410 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:45.702337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:45.721226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e97c7-4a94-409f-a6c8-550f0cc7e1c5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:45.847398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:45.848784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:45.849301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:45.851471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:45.852465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:45.855096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:45.921824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1953/3930] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:45 2022] POST /identity/v3/projects => generated 404 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:45.922466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:45.934483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcea46-eb27-4894-99a0-6eaccd19f273 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:46.020713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:46.021654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:46.021948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:46.022276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/ca8fa95a45854450bb593b3d29d1d3e3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:46.026010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca8fa95a45854450bb593b3d29d1d3e3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:46.028868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:46.105253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8fa95a45854450bb593b3d29d1d3e3', 'request_id': 'req-746cff21-724c-48ad-b747-2559aef96b3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.116102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8fa95a45854450bb593b3d29d1d3e3', 'request_id': 'req-746cff21-724c-48ad-b747-2559aef96b3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.130756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8fa95a45854450bb593b3d29d1d3e3', 'request_id': 'req-746cff21-724c-48ad-b747-2559aef96b3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.151169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project ca8fa95a45854450bb593b3d29d1d3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:46.151481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.153423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.156880 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1978/3931] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:45 2022] DELETE /identity/v3/projects/ca8fa95a45854450bb593b3d29d1d3e3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:46.161177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:46.163759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:46.178452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f020af-7471-47f2-83f7-caab7ed6795b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:46.327811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:46.330465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:46.332042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:46.332688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/35ff008bc61b4bdea7c316ee8891de34` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:46.336825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=35ff008bc61b4bdea7c316ee8891de34)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:46.343342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:46.422270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ff008bc61b4bdea7c316ee8891de34', 'request_id': 'req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.431975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ff008bc61b4bdea7c316ee8891de34', 'request_id': 'req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.445858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ff008bc61b4bdea7c316ee8891de34', 'request_id': 'req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.465793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project 35ff008bc61b4bdea7c316ee8891de34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:46.466359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.468592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.471712 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1954/3932] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:46 2022] DELETE /identity/v3/projects/35ff008bc61b4bdea7c316ee8891de34 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:46.476179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:46.490687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cff21-724c-48ad-b747-2559aef96b3c tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:46.577867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:46.580427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:46.580969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:46.582096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains/9b3409d1ce304fe79e7388f7ab869e70` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:46.584070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9b3409d1ce304fe79e7388f7ab869e70)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:46.587485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:46.622450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.623601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.659116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.660106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.664045 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1979/3933] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:46 2022] PATCH /identity/v3/domains/9b3409d1ce304fe79e7388f7ab869e70 => generated 278 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:46.668038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:46.670111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:46.685749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d38556-98bc-49ca-9e5c-2dd4cea7c7b5 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:46.764030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:46.765148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:46.766258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:46.766568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains/9b3409d1ce304fe79e7388f7ab869e70` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:46.779778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9b3409d1ce304fe79e7388f7ab869e70)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:46.781815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:46.816550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.823172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.955046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70', 'request_id': 'req-2498c550-1d91-4dc8-a43e-201c6218a4c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.969019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70', 'request_id': 'req-2498c550-1d91-4dc8-a43e-201c6218a4c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:46.991546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70', 'request_id': 'req-2498c550-1d91-4dc8-a43e-201c6218a4c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.018962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project 9b3409d1ce304fe79e7388f7ab869e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:47.020046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.022883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.045857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70', 'request_id': 'req-2498c550-1d91-4dc8-a43e-201c6218a4c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.046668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70', 'request_id': 'req-2498c550-1d91-4dc8-a43e-201c6218a4c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.054249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9b3409d1ce304fe79e7388f7ab869e70', 'request_id': 'req-2498c550-1d91-4dc8-a43e-201c6218a4c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.061580 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1955/3934] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:46 2022] DELETE /identity/v3/domains/9b3409d1ce304fe79e7388f7ab869e70 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:47.066956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:47.069271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:47.101107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdc796-efac-46a3-beb3-18725160df00 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:47.317240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:47.317462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:47.317585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:47.317863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:47.318686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:47.320478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:47.409400 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1980/3935] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:47 2022] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:47.413535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:47.415195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:47.428835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498c550-1d91-4dc8-a43e-201c6218a4c8 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:47.526245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:47.529204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:47.529651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:47.530007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/1694af16414848158a33b934a557d04e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:47.533689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=1694af16414848158a33b934a557d04e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:47.536176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:47.540037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1956/3936] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:47 2022] GET /identity/v3/projects/1694af16414848158a33b934a557d04e => generated 377 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:47.543740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:47.554831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692ea4-cc6a-436c-a0a8-e30376bd7fb0 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:47.560628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:47.561288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:47.561938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:47.561938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:47.562611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:47.566064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:47.589487 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1981/3937] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 21:56:47 2022] GET /identity/v3/projects => generated 7374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:47.594190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:47.607121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84b48f-b980-423e-8320-f7207de8d2fb tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:47.614076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:47.615375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:47.615859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:47.616523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/1694af16414848158a33b934a557d04e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:47.618353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1694af16414848158a33b934a557d04e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:47.620860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:47.720987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1694af16414848158a33b934a557d04e', 'request_id': 'req-ed588917-259b-4860-8177-028e2e144214'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.729605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1694af16414848158a33b934a557d04e', 'request_id': 'req-ed588917-259b-4860-8177-028e2e144214'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.748984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1694af16414848158a33b934a557d04e', 'request_id': 'req-ed588917-259b-4860-8177-028e2e144214'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.781787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project 1694af16414848158a33b934a557d04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:47.782104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.785952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:47.793959 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1957/3938] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:47 2022] DELETE /identity/v3/projects/1694af16414848158a33b934a557d04e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:47.795458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:47.797515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:47.822209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1b073-5c99-4c33-b893-105b4978184e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:47.925454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:47.926281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:47.926908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:47.927170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:47.928579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:47.931610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.005068 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1982/3939] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:56:47 2022] POST /identity/v3/projects => generated 347 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:48.009023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.025906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed588917-259b-4860-8177-028e2e144214 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:48.194258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:48.196259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:48.196888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:48.197514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/213a25b284154d8e9a1cf0398386f2f7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:48.199119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:update_project(project_id=213a25b284154d8e9a1cf0398386f2f7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:48.200510 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:48.200510 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:48.200510 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:48.202820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.242550 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1958/3940] 10.222.0.32 () {60 vars in 1251 bytes} [Sat May 7 21:56:48 2022] PATCH /identity/v3/projects/213a25b284154d8e9a1cf0398386f2f7 => generated 360 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:48.246641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.263079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b410b09-0955-40fe-b08a-7dad3e65df22 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:48.268979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:48.269929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:48.270350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:48.270632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/213a25b284154d8e9a1cf0398386f2f7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:48.305630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=213a25b284154d8e9a1cf0398386f2f7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:48.308054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.314693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.322083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1983/3941] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:48 2022] GET /identity/v3/projects/213a25b284154d8e9a1cf0398386f2f7 => generated 347 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:48.327395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506ec49-c549-4509-8632-8983a66811f3 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:48.338258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:48.340341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:48.340341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:48.340341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/213a25b284154d8e9a1cf0398386f2f7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:48.341487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=213a25b284154d8e9a1cf0398386f2f7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:48.345961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.416144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213a25b284154d8e9a1cf0398386f2f7', 'request_id': 'req-a313f531-381b-496f-b290-325d8d8d9df7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.425626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213a25b284154d8e9a1cf0398386f2f7', 'request_id': 'req-a313f531-381b-496f-b290-325d8d8d9df7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.440747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213a25b284154d8e9a1cf0398386f2f7', 'request_id': 'req-a313f531-381b-496f-b290-325d8d8d9df7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.456231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project 213a25b284154d8e9a1cf0398386f2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:48.456693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.457357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.459749 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1959/3942] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:48 2022] DELETE /identity/v3/projects/213a25b284154d8e9a1cf0398386f2f7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:48.467346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.471092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:48.488370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de444d3b-ed33-428b-863d-0aa4c47cf707 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:48.574667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:48.576109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:48.576684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:48.577122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:48.577999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:48.582837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.618256 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1984/3943] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:48 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:48.622169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.632548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313f531-381b-496f-b290-325d8d8d9df7 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:48.696525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:48.697586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:48.697995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:48.698343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/ffc7a81a287d4a5b9397cf9dadfe13ee` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:48.699881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:update_project(project_id=ffc7a81a287d4a5b9397cf9dadfe13ee)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:48.702052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.759553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1960/3944] 10.222.0.32 () {60 vars in 1251 bytes} [Sat May 7 21:56:48 2022] PATCH /identity/v3/projects/ffc7a81a287d4a5b9397cf9dadfe13ee => generated 373 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:48.765142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.782094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374088b-994e-4ef5-8bab-669d5015419e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:48.790627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:48.791529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:48.792049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:48.792049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/ffc7a81a287d4a5b9397cf9dadfe13ee` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:48.805590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=ffc7a81a287d4a5b9397cf9dadfe13ee)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:48.808112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.811480 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1985/3945] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:48 2022] GET /identity/v3/projects/ffc7a81a287d4a5b9397cf9dadfe13ee => generated 360 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:48.816008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.837316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087aef7-d617-4d0b-9ec2-0bdaf83f99ac tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:48.842551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:48.843498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:48.843780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:48.844052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/ffc7a81a287d4a5b9397cf9dadfe13ee` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:48.845938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffc7a81a287d4a5b9397cf9dadfe13ee)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:48.847904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:48.928243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc7a81a287d4a5b9397cf9dadfe13ee', 'request_id': 'req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.937867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc7a81a287d4a5b9397cf9dadfe13ee', 'request_id': 'req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.951146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc7a81a287d4a5b9397cf9dadfe13ee', 'request_id': 'req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.966480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project ffc7a81a287d4a5b9397cf9dadfe13ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:48.966864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.967612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:48.974900 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1961/3946] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:48 2022] DELETE /identity/v3/projects/ffc7a81a287d4a5b9397cf9dadfe13ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:48.975771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:48.978023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:48.992819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d76992-d8d3-407c-9b77-b389c89d6aaa tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.084288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.085480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.085826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.086111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.088131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:49.090370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:49.142604 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1986/3947] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:48 2022] POST /identity/v3/projects => generated 354 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:49.148906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:49.167272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcb9c9-1010-4a1e-9cdd-23f9d3133fd4 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.257420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.258392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.258997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.259577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/e97ce5db6fe0477d8900d53fdd6b90a2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.261199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:update_project(project_id=e97ce5db6fe0477d8900d53fdd6b90a2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:49.265054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:49.307093 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1962/3948] 10.222.0.32 () {60 vars in 1251 bytes} [Sat May 7 21:56:49 2022] PATCH /identity/v3/projects/e97ce5db6fe0477d8900d53fdd6b90a2 => generated 369 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:49.311401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:49.325801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd349-f14f-4a15-bf03-464a8ace245a tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.337128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.338862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.339164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.339640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/e97ce5db6fe0477d8900d53fdd6b90a2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.357840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:get_project(project_id=e97ce5db6fe0477d8900d53fdd6b90a2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:49.364585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:49.370812 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1987/3949] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:56:49 2022] GET /identity/v3/projects/e97ce5db6fe0477d8900d53fdd6b90a2 => generated 356 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:49.374919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:49.388311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279866c5-474b-4b6e-8a66-54521596900b tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.395290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.396465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.396752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.397031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/projects/e97ce5db6fe0477d8900d53fdd6b90a2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.399569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e97ce5db6fe0477d8900d53fdd6b90a2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:49.401586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:49.464519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97ce5db6fe0477d8900d53fdd6b90a2', 'request_id': 'req-21e70b78-3180-49bd-9d59-e27eac89ec86'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.474475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97ce5db6fe0477d8900d53fdd6b90a2', 'request_id': 'req-21e70b78-3180-49bd-9d59-e27eac89ec86'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.484661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97ce5db6fe0477d8900d53fdd6b90a2', 'request_id': 'req-21e70b78-3180-49bd-9d59-e27eac89ec86'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.499390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] The token cache is being invalidate because project e97ce5db6fe0477d8900d53fdd6b90a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:49.499841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.500671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.503014 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1963/3950] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:49 2022] DELETE /identity/v3/projects/e97ce5db6fe0477d8900d53fdd6b90a2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:49.508355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:49.511802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:49.531056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065f9c4-c556-4139-b03a-368165589c0f tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.606820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.608896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.609181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.609501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains/9b3409d1ce304fe79e7388f7ab869e70` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.619279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Could not find domain: 9b3409d1ce304fe79e7388f7ab869e70.: keystone.exception.DomainNotFound: Could not find domain: 9b3409d1ce304fe79e7388f7ab869e70. May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9b3409d1ce304fe79e7388f7ab869e70. May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:49.634020 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:49.635723 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9b3409d1ce304fe79e7388f7ab869e70. May 07 21:56:49.637097 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:49.640024 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1988/3951] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:49 2022] PATCH /identity/v3/domains/9b3409d1ce304fe79e7388f7ab869e70 => generated 112 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:49.644760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:49.658900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70b78-3180-49bd-9d59-e27eac89ec86 tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.665908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67fe59db3864663907e4825f20e2fe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dd2a10b4e994f7d90bf34945ab90be8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.667308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.667591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.668211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] PATH_INFO: `/v3/domains/15e4f9ef84e041c8b56e5339f047c037` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.678183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Could not find domain: 15e4f9ef84e041c8b56e5339f047c037.: keystone.exception.DomainNotFound: Could not find domain: 15e4f9ef84e041c8b56e5339f047c037. May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 15e4f9ef84e041c8b56e5339f047c037. May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:49.695826 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:49.697055 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 15e4f9ef84e041c8b56e5339f047c037. May 07 21:56:49.698150 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:56:49.699324 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1964/3952] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:56:49 2022] PATCH /identity/v3/domains/15e4f9ef84e041c8b56e5339f047c037 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:56:49.702664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:49.705124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:49.778666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:49.780694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:49.781966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92818c2-9c16-426f-9205-96ffb6b4ec2e tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.788534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.790087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.792141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.793041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] PATH_INFO: `/v3/users/a83cf3e8b9fe4939b4bb5eda1d1a0e1e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.794660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83cf3e8b9fe4939b4bb5eda1d1a0e1e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:49.796500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33dae6-097f-4a85-bd08-e4e6146096fd tempest-ProjectsTestJSON-1384152939 tempest-ProjectsTestJSON-1384152939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:49.797640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:49.803554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:49.804644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.804916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.805198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] PATH_INFO: `/v3/users/2574be3d704f4f46942a5cfa852ff392` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.807041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2574be3d704f4f46942a5cfa852ff392)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:49.809029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:49.867002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2574be3d704f4f46942a5cfa852ff392'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.873105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83cf3e8b9fe4939b4bb5eda1d1a0e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.873909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83cf3e8b9fe4939b4bb5eda1d1a0e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.877818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2574be3d704f4f46942a5cfa852ff392'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.878501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2574be3d704f4f46942a5cfa852ff392'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.880050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2574be3d704f4f46942a5cfa852ff392'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.888200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83cf3e8b9fe4939b4bb5eda1d1a0e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.889176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83cf3e8b9fe4939b4bb5eda1d1a0e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.893625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07c61ed9-a006-4333-80fb-1c285e60c619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2574be3d704f4f46942a5cfa852ff392'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.901036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83cf3e8b9fe4939b4bb5eda1d1a0e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:49.922344 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1965/3953] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:49 2022] DELETE /identity/v3/users/2574be3d704f4f46942a5cfa852ff392 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:49.925847 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1989/3954] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:49 2022] DELETE /identity/v3/users/a83cf3e8b9fe4939b4bb5eda1d1a0e1e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:49.930392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:49.930692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:49.931052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:49.962033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:49.964340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.072987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1966/3955] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:50.088076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.089728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.176676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e1df6-0412-48f4-b703-bf26d12ddc06 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.185082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a1975-379e-4cf3-bc2d-80419ee54ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.186009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a1975-379e-4cf3-bc2d-80419ee54ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.186653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a1975-379e-4cf3-bc2d-80419ee54ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.187796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a1975-379e-4cf3-bc2d-80419ee54ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.205529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a1975-379e-4cf3-bc2d-80419ee54ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.207452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a1975-379e-4cf3-bc2d-80419ee54ce7 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:50.220101 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1990/3956] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:56:50.230117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.232317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.251624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018edca-0d41-4b84-9bdb-8e0432ae21d1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.256610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.257646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.257994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.258332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] PATH_INFO: `/v3/projects/a017d4c58fe640c5bf85d1d055b3da11` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.260465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a017d4c58fe640c5bf85d1d055b3da11)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.262523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:50.344252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a017d4c58fe640c5bf85d1d055b3da11', 'request_id': 'req-0f2c589d-877f-4287-b003-7735176e29e1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.355427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a017d4c58fe640c5bf85d1d055b3da11', 'request_id': 'req-0f2c589d-877f-4287-b003-7735176e29e1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.373076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a017d4c58fe640c5bf85d1d055b3da11', 'request_id': 'req-0f2c589d-877f-4287-b003-7735176e29e1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.394274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] The token cache is being invalidate because project a017d4c58fe640c5bf85d1d055b3da11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:50.394818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.398491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f2c589d-877f-4287-b003-7735176e29e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.407658 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1967/3957] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:50 2022] DELETE /identity/v3/projects/a017d4c58fe640c5bf85d1d055b3da11 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:50.417262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3b8e-03ec-45d7-bfab-e8f85016f7b1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.417822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3b8e-03ec-45d7-bfab-e8f85016f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.418363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca3b8e-03ec-45d7-bfab-e8f85016f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.441133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-baca3b8e-03ec-45d7-bfab-e8f85016f7b1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:50.442433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-baca3b8e-03ec-45d7-bfab-e8f85016f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.530295 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1991/3958] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:50.539226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7c2e-82d6-42e4-8a86-37c4b9c2afa9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.539653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7c2e-82d6-42e4-8a86-37c4b9c2afa9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.540039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e7c2e-82d6-42e4-8a86-37c4b9c2afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.561546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-239e7c2e-82d6-42e4-8a86-37c4b9c2afa9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:50.563235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-239e7c2e-82d6-42e4-8a86-37c4b9c2afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.575841 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1968/3959] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:50.580293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3b8e-03ec-45d7-bfab-e8f85016f7b1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.594439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca3b8e-03ec-45d7-bfab-e8f85016f7b1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.602486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.603801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.604192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.604819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.606063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:50.606422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.608890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:50.625973 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1992/3960] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:50.631015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e7c2e-82d6-42e4-8a86-37c4b9c2afa9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.640924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e7c2e-82d6-42e4-8a86-37c4b9c2afa9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.652858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.654346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.655478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.656560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.658101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.661989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:50.662825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.665090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.685742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e30282-023e-4091-852d-4376ab9c6089 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.697129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.698266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.702181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.702482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] PATH_INFO: `/v3/projects/5220099ecd6e49c7aa9ad20145e27495` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.704848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5220099ecd6e49c7aa9ad20145e27495)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.708894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:50.713476 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1969/3961] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:50 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:50.714407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.784447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5220099ecd6e49c7aa9ad20145e27495', 'request_id': 'req-74c00098-2017-4adb-b59c-64e3889221c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.793500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5220099ecd6e49c7aa9ad20145e27495', 'request_id': 'req-74c00098-2017-4adb-b59c-64e3889221c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.803673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5220099ecd6e49c7aa9ad20145e27495', 'request_id': 'req-74c00098-2017-4adb-b59c-64e3889221c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.827322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] The token cache is being invalidate because project 5220099ecd6e49c7aa9ad20145e27495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:50.827627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.828369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:50.832584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8565-fb61-4827-a08a-32dddb31f8d3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.834261 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1993/3962] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:50 2022] DELETE /identity/v3/projects/5220099ecd6e49c7aa9ad20145e27495 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:50.838815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.841321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.922016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.922710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.923069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.923355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.924053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.926007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:50.930492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00098-2017-4adb-b59c-64e3889221c3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.936958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.938172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.938850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.939182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] PATH_INFO: `/v3/users/a67fe59db3864663907e4825f20e2fe0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.940841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67fe59db3864663907e4825f20e2fe0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.943217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:50.958844 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1970/3963] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:50 2022] POST /identity/v3/users => generated 286 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:50.962277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:50.971185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:50.988289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeff5b0-fe19-461f-9b44-5e3578d43b6a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:50.993429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:50.994128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:50.994408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:50.994681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:50.995651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:50.997423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.011921 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1971/3964] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:51.016014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.026576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67fe59db3864663907e4825f20e2fe0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:51.027035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddad91d-24f7-4c49-bbdb-47eff508aa9c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.027493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67fe59db3864663907e4825f20e2fe0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:51.032829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.033569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.033959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.034331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.038243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.038243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.040306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67fe59db3864663907e4825f20e2fe0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:51.045708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67fe59db3864663907e4825f20e2fe0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:51.057297 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1972/3965] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:51.066534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.067428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35282e89-876b-4981-b0fa-92268a3febca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67fe59db3864663907e4825f20e2fe0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:51.070199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:51.099159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a13055-6406-46e6-a6a4-677e6c4d9d1e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.105331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.106466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.107212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.107662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] PATH_INFO: `/v3/projects/399660ada5af4d70a032e2e23d0c563d/users/bcbd34555bc34f4296a290ea120b03e4/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.109429 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1994/3966] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:50 2022] DELETE /identity/v3/users/a67fe59db3864663907e4825f20e2fe0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:51.133069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399660ada5af4d70a032e2e23d0c563d, user_id=bcbd34555bc34f4296a290ea120b03e4, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.134186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.151817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1973/3967] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:51 2022] PUT /identity/v3/projects/399660ada5af4d70a032e2e23d0c563d/users/bcbd34555bc34f4296a290ea120b03e4/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:51.163206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d56b-31fe-4110-a507-580647b1cc97 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.163876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d56b-31fe-4110-a507-580647b1cc97 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.164344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0d56b-31fe-4110-a507-580647b1cc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.206797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dbb0d56b-31fe-4110-a507-580647b1cc97 None None] MFA Rules not processed for user `bcbd34555bc34f4296a290ea120b03e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:51.208129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dbb0d56b-31fe-4110-a507-580647b1cc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:51.295516 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1995/3968] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:51.300064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.371328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94106-af83-4205-b42a-d7056a0efb41 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.378049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.379122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.379904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.379904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.380361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.382920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.415737 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1974/3969] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:51 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:51.419720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0d56b-31fe-4110-a507-580647b1cc97 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.434217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0d56b-31fe-4110-a507-580647b1cc97 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.503091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.503852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.504235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.504590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.505331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.507372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.533264 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1996/3970] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:51 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:51.537045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.548381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5cefc-e546-49d4-b91e-44d429c579f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.554281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.555322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.555776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.556199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.557246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.559035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.574018 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1975/3971] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:51.578876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.590711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450909b-e4da-4d60-8a69-eb58c45b458c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.597575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.598646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.598962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.599238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] PATH_INFO: `/v3/projects/a72e0a4b5530435b83d667a443e8d6b3/users/3b6a5099a35f46248f2dc4f3e7148582/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.619112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72e0a4b5530435b83d667a443e8d6b3, user_id=3b6a5099a35f46248f2dc4f3e7148582, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.622534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.644117 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1997/3972] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:51 2022] PUT /identity/v3/projects/a72e0a4b5530435b83d667a443e8d6b3/users/3b6a5099a35f46248f2dc4f3e7148582/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:51.646273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.658492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05975f-fd25-473b-bd7f-17e257d2f30d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.725112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.725897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.726183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.726509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.727489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.729247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.742675 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1976/3973] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:51.746636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.758955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea0618-2fb2-4864-b473-132d958b53e0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.765989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da2154-f094-4483-abc0-0527d964aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.767356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da2154-f094-4483-abc0-0527d964aeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.767854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da2154-f094-4483-abc0-0527d964aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.768542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da2154-f094-4483-abc0-0527d964aeb9 admin admin] PATH_INFO: `/v3/projects/a72e0a4b5530435b83d667a443e8d6b3/users/3b6a5099a35f46248f2dc4f3e7148582/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.770913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da2154-f094-4483-abc0-0527d964aeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72e0a4b5530435b83d667a443e8d6b3, user_id=3b6a5099a35f46248f2dc4f3e7148582, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.774090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da2154-f094-4483-abc0-0527d964aeb9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.782397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.785474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:51.796852 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1998/3974] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:51 2022] PUT /identity/v3/projects/a72e0a4b5530435b83d667a443e8d6b3/users/3b6a5099a35f46248f2dc4f3e7148582/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:51.798933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c13cb-919d-48eb-821a-aced8b25d087 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.806949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c13cb-919d-48eb-821a-aced8b25d087 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.807269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c13cb-919d-48eb-821a-aced8b25d087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.817332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc404b63-084e-489f-848a-045fa0be147b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.842286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-120c13cb-919d-48eb-821a-aced8b25d087 None None] MFA Rules not processed for user `3b6a5099a35f46248f2dc4f3e7148582`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:51.843838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-120c13cb-919d-48eb-821a-aced8b25d087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:51.918674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.919589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.919876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.920161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] PATH_INFO: `/v3/projects/3dd2a10b4e994f7d90bf34945ab90be8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.921492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd2a10b4e994f7d90bf34945ab90be8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.926233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:51.934833 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 1999/3975] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:51.943996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c13cb-919d-48eb-821a-aced8b25d087 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:51.970755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c13cb-919d-48eb-821a-aced8b25d087 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:51.982809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:51.983497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:51.983784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:51.984071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:51.992507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:51.994179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.000111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd2a10b4e994f7d90bf34945ab90be8', 'request_id': 'req-86037516-0983-4344-8f17-5ff187beab63'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:52.008358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd2a10b4e994f7d90bf34945ab90be8', 'request_id': 'req-86037516-0983-4344-8f17-5ff187beab63'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:52.021683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd2a10b4e994f7d90bf34945ab90be8', 'request_id': 'req-86037516-0983-4344-8f17-5ff187beab63'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:52.030022 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2000/3976] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:56:51 2022] POST /identity/v3/domains => generated 276 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:52.034348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.040107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] The token cache is being invalidate because project 3dd2a10b4e994f7d90bf34945ab90be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:52.040482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:52.041178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-86037516-0983-4344-8f17-5ff187beab63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:52.043544 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1977/3977] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:51 2022] DELETE /identity/v3/projects/3dd2a10b4e994f7d90bf34945ab90be8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:52.049293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f297d8-85e2-4cc0-b35e-6026be84673e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.049715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f297d8-85e2-4cc0-b35e-6026be84673e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.050228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f297d8-85e2-4cc0-b35e-6026be84673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.076927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b3f297d8-85e2-4cc0-b35e-6026be84673e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:52.078575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b3f297d8-85e2-4cc0-b35e-6026be84673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:52.108275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0494f6-0982-4edd-8324-18bb250938e2 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.114174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.115000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.115358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.115708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.116707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.120602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.174646 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2001/3978] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/projects => generated 401 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:52.179423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.181524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:52.202150 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1978/3979] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:52.209879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fe30-9b78-4461-baa0-eac98ae2416f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.210221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fe30-9b78-4461-baa0-eac98ae2416f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.210548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54fe30-9b78-4461-baa0-eac98ae2416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.245634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bc54fe30-9b78-4461-baa0-eac98ae2416f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:52.247420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bc54fe30-9b78-4461-baa0-eac98ae2416f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:52.304737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25629fe7-e306-43d3-b9d4-974819751082 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.313864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.315002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.315408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.316072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/groups` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.317738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.320000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.342794 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2002/3980] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/groups => generated 301 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:52.350169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.371268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79b1ba-98cb-472d-8c7c-8a8c645bbec3 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.380736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.381579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.381932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.382571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.393371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.395874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.415922 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1979/3981] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:52.419595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54fe30-9b78-4461-baa0-eac98ae2416f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.428461 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2003/3982] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/users => generated 442 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:52.433288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.456004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bfd10-32c4-459c-ab1c-52c55703baa0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.461173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54fe30-9b78-4461-baa0-eac98ae2416f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.464361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.465217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.465574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.465915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.466748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.467883 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:52.467883 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:52.467883 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:52.470367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.471797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.472610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.472895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.473187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.474086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:52.474410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.481277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.500042 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2004/3983] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/roles => generated 239 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:52.508873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.514736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1980/3984] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:52.519436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.537877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851cd0-a0ab-4b1d-974e-f0ae24aeeb95 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.540605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560b8dd-e8d5-4523-acae-ae8c6c9f8b2d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.550993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.553400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.553696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.553980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/groups/c4f311aa976d4c509e4afa7938a7e003/roles/bb60ca53f8034c3eac2ee9eab7044c02/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.561018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.561691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.561979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.562260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.562987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.564241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_grant(project_id=774a127ac16748d4943745b26cc6c9f7, group_id=c4f311aa976d4c509e4afa7938a7e003, role_id=bb60ca53f8034c3eac2ee9eab7044c02)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.564973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.567400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.589933 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2005/3985] 10.222.0.32 () {60 vars in 1584 bytes} [Sat May 7 21:56:52 2022] PUT /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/groups/c4f311aa976d4c509e4afa7938a7e003/roles/bb60ca53f8034c3eac2ee9eab7044c02/inherited_to_projects => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:52.602382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.630276 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1981/3986] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:52.634349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.797462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0228caf-53b3-4560-b348-071d9a1e3dce admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.814400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.815154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.815687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.815975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.816682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.820275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.824018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a297e-9bde-4029-85de-75f90742f185 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.854667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1982/3987] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:52 2022] POST /identity/v3/users => generated 285 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:52.858677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.871481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc658e-85d1-4032-ab45-9edc54855d05 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.878297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.880113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.880516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.880848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.881769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.885035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.902279 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1983/3988] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:52 2022] GET /identity/v3/roles => generated 1650 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:52.905745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.934228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f87402-a6ba-4929-8b11-d555d845dcfd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:52.951322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.952118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.952482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.952836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.953849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.955647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.968818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:52.970594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:52.971061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:52.971521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/groups/c4f311aa976d4c509e4afa7938a7e003/roles/bb60ca53f8034c3eac2ee9eab7044c02/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:52.975304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:check_grant(project_id=774a127ac16748d4943745b26cc6c9f7, group_id=c4f311aa976d4c509e4afa7938a7e003, role_id=bb60ca53f8034c3eac2ee9eab7044c02)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:52.976959 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:52.976959 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:52.976959 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:52.979695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:52.992780 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1984/3990] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:52 2022] GET /identity/v3/roles => generated 1650 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:52.993199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:52.994187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2006/3990] 10.222.0.32 () {58 vars in 1566 bytes} [Sat May 7 21:56:52 2022] HEAD /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/groups/c4f311aa976d4c509e4afa7938a7e003/roles/bb60ca53f8034c3eac2ee9eab7044c02/inherited_to_projects => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:52.996427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:53.009255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3e92c-bbc0-4340-87a9-594b82ed37f8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.017569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:53.017800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f31aa-0649-4320-9d84-3bacb87b3f49 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.019181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.019788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.020368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/groups/c4f311aa976d4c509e4afa7938a7e003/roles/bb60ca53f8034c3eac2ee9eab7044c02/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:53.025441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=774a127ac16748d4943745b26cc6c9f7, group_id=c4f311aa976d4c509e4afa7938a7e003, role_id=bb60ca53f8034c3eac2ee9eab7044c02)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:53.026667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d951d-60f1-4859-8404-15502d96967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:53.027261 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:53.027261 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:53.027261 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:53.027656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d951d-60f1-4859-8404-15502d96967b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.027899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d951d-60f1-4859-8404-15502d96967b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.028176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d951d-60f1-4859-8404-15502d96967b admin admin] PATH_INFO: `/v3/projects/e421113a17bc462d89b7471547fdb772/users/c5fb1e26138348a981a7a7db5a7ffbf9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:53.031360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:53.040872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role bb60ca53f8034c3eac2ee9eab7044c02 was removed from group c4f311aa976d4c509e4afa7938a7e003 on project 774a127ac16748d4943745b26cc6c9f7. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:53.042098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:53.048948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:53.063877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d951d-60f1-4859-8404-15502d96967b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e421113a17bc462d89b7471547fdb772, user_id=c5fb1e26138348a981a7a7db5a7ffbf9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:53.066905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d951d-60f1-4859-8404-15502d96967b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:53.100123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1985/3991] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:52 2022] PUT /identity/v3/projects/e421113a17bc462d89b7471547fdb772/users/c5fb1e26138348a981a7a7db5a7ffbf9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:53.115170 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2007/3992] 10.222.0.32 () {58 vars in 1568 bytes} [Sat May 7 21:56:52 2022] DELETE /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/groups/c4f311aa976d4c509e4afa7938a7e003/roles/bb60ca53f8034c3eac2ee9eab7044c02/inherited_to_projects => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:53.120929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.123687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:53.125753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.126065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:53.128877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:53.219617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] MFA Rules not processed for user `c5fb1e26138348a981a7a7db5a7ffbf9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:53.222438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:53.364869 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1986/3993] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:53.367186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f11db-1e63-4c17-9f8c-00464dcc1425 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.369532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:53.370930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:53.379522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:53.381785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.382362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.383152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles/bb60ca53f8034c3eac2ee9eab7044c02` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:53.385152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bb60ca53f8034c3eac2ee9eab7044c02)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:53.386863 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:53.386863 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:53.386863 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:53.388268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:53.461995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role bb60ca53f8034c3eac2ee9eab7044c02 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:53.462197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:53.463524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:53.465852 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2008/3994] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:53 2022] DELETE /identity/v3/roles/bb60ca53f8034c3eac2ee9eab7044c02 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:53.471706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:53.474392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:53.518937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c87b94-52a9-4924-916b-14cb0f5ad55c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.665029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:53.665850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.666298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.666684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:53.668526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:53.672073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:53.692175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f96b8-501c-4a84-9e34-8fa9f3f326af tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.698102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:53.698886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.699181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.699816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:53.700573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:53.703183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:53.729140 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2009/3995] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:53 2022] POST /identity/v3/roles => generated 239 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:53.730337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:53.748242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840e81d-43a5-4d5b-9093-9af3c8c92d3c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.761031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:53.762622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.765403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.766114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/2e10aeaeced743a28ed1312fbd2a16c9/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:53.773004 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1987/3996] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:53 2022] POST /identity/v3/projects => generated 369 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:53.775320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:53.784576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:53.818801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_grant(project_id=774a127ac16748d4943745b26cc6c9f7, user_id=01b18f2290d04612b08027b780ff0403, role_id=2e10aeaeced743a28ed1312fbd2a16c9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:53.821873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:53.856141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2010/3997] 10.222.0.32 () {60 vars in 1581 bytes} [Sat May 7 21:56:53 2022] PUT /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/2e10aeaeced743a28ed1312fbd2a16c9/inherited_to_projects => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:53.859343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:53.981694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2e8ab-6d95-49d9-92d7-837c0a038e68 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.988545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:53.989948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895ddbc-1747-47f6-81f5-30b62637b6c0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:53.990861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:53.991727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:53.992984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/2e10aeaeced743a28ed1312fbd2a16c9/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.003111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:check_grant(project_id=774a127ac16748d4943745b26cc6c9f7, user_id=01b18f2290d04612b08027b780ff0403, role_id=2e10aeaeced743a28ed1312fbd2a16c9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.005906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.013394 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2011/3998] 10.222.0.32 () {58 vars in 1563 bytes} [Sat May 7 21:56:53 2022] HEAD /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/2e10aeaeced743a28ed1312fbd2a16c9/inherited_to_projects => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:54.029716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.057890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c770e7-9d4b-4ecf-b45e-a1cdfc5ef4dc tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.064795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.065931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.066307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.066496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/2e10aeaeced743a28ed1312fbd2a16c9/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.069004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=774a127ac16748d4943745b26cc6c9f7, user_id=01b18f2290d04612b08027b780ff0403, role_id=2e10aeaeced743a28ed1312fbd2a16c9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.071786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.078201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role 2e10aeaeced743a28ed1312fbd2a16c9 was removed from user 01b18f2290d04612b08027b780ff0403 on project 774a127ac16748d4943745b26cc6c9f7. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:54.079006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:54.082699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:54.097864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.098635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.099097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.099416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.100170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.103140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.103391 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2012/3999] 10.222.0.32 () {58 vars in 1565 bytes} [Sat May 7 21:56:54 2022] DELETE /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/2e10aeaeced743a28ed1312fbd2a16c9/inherited_to_projects => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:54.107882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.109356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:54.133873 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1988/4000] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:53 2022] POST /identity/v3/users => generated 291 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:54.138144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.140230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:54.156246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c885bc-1da8-4707-8387-529a30c472a1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.251297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.252033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.252458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.252815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.253679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.260281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.267715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eeac0-826d-4962-98e1-41bb841875ff tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.274421 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1989/4001] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:54 2022] GET /identity/v3/roles => generated 1650 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:54.284081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.287378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.287762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.288217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.289326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles/2e10aeaeced743a28ed1312fbd2a16c9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.294195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2e10aeaeced743a28ed1312fbd2a16c9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.296943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.306213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b079bfd-c8a7-4e0d-9fae-02209ec08d2d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.312802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.314729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.315232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.315868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] PATH_INFO: `/v3/projects/0b11a4cbd98d43d08962b6409c937292/users/b83840364aae4c148bda4e78836c798f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.336727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b11a4cbd98d43d08962b6409c937292, user_id=b83840364aae4c148bda4e78836c798f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.340134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.387838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1990/4002] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:54 2022] PUT /identity/v3/projects/0b11a4cbd98d43d08962b6409c937292/users/b83840364aae4c148bda4e78836c798f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:54.396915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.415675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role 2e10aeaeced743a28ed1312fbd2a16c9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:54.415991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:54.416757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:54.420243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2013/4003] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:54 2022] DELETE /identity/v3/roles/2e10aeaeced743a28ed1312fbd2a16c9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:54.426712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.429518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:54.527364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70503021-e0be-442f-b2f1-675999d9a075 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.564381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409beaa6-b196-4809-ad94-075ab7d2ff38 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.570093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.570869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.571278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.572386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.573124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.574933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.600898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2014/4004] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:54 2022] POST /identity/v3/roles => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:54.602023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.607437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.608221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.608578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.608930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.609787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.611812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.615577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004670d-3cae-43a5-bb6d-2b81c670453c tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.621395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.622367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.622653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.622962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/6901f3d94d7f4689a0b61bedcc445736/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.625680 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1991/4005] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:54 2022] GET /identity/v3/roles => generated 1651 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:54.630027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, group_id=c4f311aa976d4c509e4afa7938a7e003, role_id=6901f3d94d7f4689a0b61bedcc445736)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.630891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.632931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:54.633760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.651689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2849b-42b9-493c-93b0-7a9cd87fa0c3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.661933 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2015/4006] 10.222.0.32 () {60 vars in 1581 bytes} [Sat May 7 21:56:54 2022] PUT /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/6901f3d94d7f4689a0b61bedcc445736/inherited_to_projects => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:54.667777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.779233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40ab22-62af-4ee3-a6f9-16445d875d26 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.785373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.786214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.786505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.786816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.788676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=edc5b6670f5348439f43a3ff39081d17, group_id=c4f311aa976d4c509e4afa7938a7e003)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.789881 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:54.789881 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:54.789881 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:54.791736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.798925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70f0d0-9b1d-4e69-b008-faa0d7597a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.802721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70f0d0-9b1d-4e69-b008-faa0d7597a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.803793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70f0d0-9b1d-4e69-b008-faa0d7597a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.805456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70f0d0-9b1d-4e69-b008-faa0d7597a25 admin admin] PATH_INFO: `/v3/projects/0b11a4cbd98d43d08962b6409c937292/users/b83840364aae4c148bda4e78836c798f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.811250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70f0d0-9b1d-4e69-b008-faa0d7597a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b11a4cbd98d43d08962b6409c937292, user_id=b83840364aae4c148bda4e78836c798f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.816424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70f0d0-9b1d-4e69-b008-faa0d7597a25 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.820332 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2016/4007] 10.222.0.32 () {58 vars in 1463 bytes} [Sat May 7 21:56:54 2022] GET /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/inherited_to_projects => generated 448 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:54.821559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:54.843813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019c90e-9247-496b-8071-cdcca75c3dc4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:54.854884 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1992/4008] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:54 2022] PUT /identity/v3/projects/0b11a4cbd98d43d08962b6409c937292/users/b83840364aae4c148bda4e78836c798f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:54.862615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3763b-2351-4f6a-a611-2d0efd902d3c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.863135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3763b-2351-4f6a-a611-2d0efd902d3c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.863589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3763b-2351-4f6a-a611-2d0efd902d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.904156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-00b3763b-2351-4f6a-a611-2d0efd902d3c None None] MFA Rules not processed for user `b83840364aae4c148bda4e78836c798f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:54.905439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00b3763b-2351-4f6a-a611-2d0efd902d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:54.958257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:54.959001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:54.959289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:54.962951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/6901f3d94d7f4689a0b61bedcc445736/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:54.968957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, group_id=c4f311aa976d4c509e4afa7938a7e003, role_id=6901f3d94d7f4689a0b61bedcc445736)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:54.973401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:54.986241 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2017/4009] 10.222.0.32 () {58 vars in 1563 bytes} [Sat May 7 21:56:54 2022] HEAD /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/6901f3d94d7f4689a0b61bedcc445736/inherited_to_projects => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:54.991892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.008438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9a7d-36a1-4353-8ffc-9157c99e619b tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.014660 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1993/4010] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:55.016171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3763b-2351-4f6a-a611-2d0efd902d3c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.022194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.023222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.023554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.026379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/6901f3d94d7f4689a0b61bedcc445736/inherited_to_projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.029311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, group_id=c4f311aa976d4c509e4afa7938a7e003, role_id=6901f3d94d7f4689a0b61bedcc445736)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.029998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3763b-2351-4f6a-a611-2d0efd902d3c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.031987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.034906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.035579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.036020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.036315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.037004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.037559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role 6901f3d94d7f4689a0b61bedcc445736 was removed from group c4f311aa976d4c509e4afa7938a7e003 on domain edc5b6670f5348439f43a3ff39081d17. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:55.037906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:55.038627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:55.039205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.056529 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2018/4011] 10.222.0.32 () {58 vars in 1565 bytes} [Sat May 7 21:56:54 2022] DELETE /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/groups/c4f311aa976d4c509e4afa7938a7e003/roles/6901f3d94d7f4689a0b61bedcc445736/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:55.061463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.065931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:55.097049 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1994/4012] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:56:55 2022] POST /identity/v3/projects => generated 328 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:55.100878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.103023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:55.193010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d63c-50f0-4940-90e7-425e84c4c9eb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.208750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb7b05-731f-4b7d-a17b-302ba1ed92d0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.225707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df90a6-76b0-4c8e-aa06-a8e56250ccf1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.228141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df90a6-76b0-4c8e-aa06-a8e56250ccf1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.228683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df90a6-76b0-4c8e-aa06-a8e56250ccf1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.229697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df90a6-76b0-4c8e-aa06-a8e56250ccf1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.230901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df90a6-76b0-4c8e-aa06-a8e56250ccf1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.234182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df90a6-76b0-4c8e-aa06-a8e56250ccf1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.268863 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1995/4013] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:55 2022] POST /identity/v3/users => generated 416 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:55.268863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9091882-4027-4639-ba38-6111d085e289 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.268863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9091882-4027-4639-ba38-6111d085e289 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.268863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9091882-4027-4639-ba38-6111d085e289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.290912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f9091882-4027-4639-ba38-6111d085e289 None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:55.292531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f9091882-4027-4639-ba38-6111d085e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:55.299810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.301145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.301629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.302055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles/6901f3d94d7f4689a0b61bedcc445736` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.307038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6901f3d94d7f4689a0b61bedcc445736)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.309043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.362177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role 6901f3d94d7f4689a0b61bedcc445736 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:55.362435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:55.363704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:55.375654 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2019/4014] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:55 2022] DELETE /identity/v3/roles/6901f3d94d7f4689a0b61bedcc445736 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:55.377632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.379219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:55.397833 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1996/4015] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:55.397833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9091882-4027-4639-ba38-6111d085e289 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.397833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f9091882-4027-4639-ba38-6111d085e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:55.434575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9091882-4027-4639-ba38-6111d085e289 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.544647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa44551-08ba-4380-9a5b-ca6684e98223 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.566539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.567016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.567754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.568012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.568132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.568301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.568711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.569180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.569653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.570562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.570695 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:55.570695 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:55.570695 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:55.572521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.572868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.594235 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1997/4016] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:55 2022] POST /identity/v3/roles => generated 240 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:55.598503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.615381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3a1ac-19d9-4bd5-94a8-7f93983bee08 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.622163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.623098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2020/4017] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:55 2022] POST /identity/v3/roles => generated 244 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:55.623233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.623501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.623787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/f7ce91f1443e4c7c8df07b1ca738812b/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.626611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.627480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, user_id=01b18f2290d04612b08027b780ff0403, role_id=f7ce91f1443e4c7c8df07b1ca738812b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.631992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.647252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ee5b0-789b-45aa-b998-a615a3073870 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.661288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1998/4018] 10.222.0.32 () {60 vars in 1578 bytes} [Sat May 7 21:56:55 2022] PUT /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/f7ce91f1443e4c7c8df07b1ca738812b/inherited_to_projects => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:55.664386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.768486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43e481-a507-454e-bb53-f57322d8fdc5 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.769983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.770994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.772466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.772810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.773630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.775992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.776896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.777352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.777989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.778474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.781462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=edc5b6670f5348439f43a3ff39081d17, user_id=01b18f2290d04612b08027b780ff0403)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.783889 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:55.783889 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:55.783889 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:55.787065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.819525 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2021/4019] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:55 2022] POST /identity/v3/roles => generated 247 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:55.820860 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 1999/4020] 10.222.0.32 () {58 vars in 1460 bytes} [Sat May 7 21:56:55 2022] GET /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/inherited_to_projects => generated 447 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:55.826469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.832768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.857086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da666ace-4cb8-4b0e-a1f5-f5cb8d193a8d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.870395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.872668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def33d-e631-4bad-a65b-314f61047d34 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:55.876767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.877304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.878010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/f761f0e1d44c431f880392e967abc47b/users/1d2f4385e5d9444cb14f4a8e1b896087/roles/862b11ee87dc49a1a446221e7198e269` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.884701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:55.895549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:55.900996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:55.902320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/f7ce91f1443e4c7c8df07b1ca738812b/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:55.904472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f761f0e1d44c431f880392e967abc47b, user_id=1d2f4385e5d9444cb14f4a8e1b896087, role_id=862b11ee87dc49a1a446221e7198e269)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.909984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, user_id=01b18f2290d04612b08027b780ff0403, role_id=f7ce91f1443e4c7c8df07b1ca738812b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:55.911108 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:55.911108 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:55.911108 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:55.914335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.919617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:55.933200 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2000/4021] 10.222.0.32 () {58 vars in 1560 bytes} [Sat May 7 21:56:55 2022] HEAD /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/f7ce91f1443e4c7c8df07b1ca738812b/inherited_to_projects => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:55.939296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.956062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2022/4022] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:55 2022] PUT /identity/v3/projects/f761f0e1d44c431f880392e967abc47b/users/1d2f4385e5d9444cb14f4a8e1b896087/roles/862b11ee87dc49a1a446221e7198e269 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:55.959391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:55.963185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e50e9-be32-4d47-bef4-4cc9825dc1b0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.066908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42361-2d19-424f-bc3f-c94a42d17dd9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.066908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.067329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.067608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.067888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/f761f0e1d44c431f880392e967abc47b/users/1d2f4385e5d9444cb14f4a8e1b896087/roles/21301790c2fb4260899f9746142bbefc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.070237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f761f0e1d44c431f880392e967abc47b, user_id=1d2f4385e5d9444cb14f4a8e1b896087, role_id=21301790c2fb4260899f9746142bbefc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:56.073034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:56.099220 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2023/4023] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:55 2022] PUT /identity/v3/projects/f761f0e1d44c431f880392e967abc47b/users/1d2f4385e5d9444cb14f4a8e1b896087/roles/21301790c2fb4260899f9746142bbefc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:56.104536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:56.117168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.118040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.118342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.118714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/f7ce91f1443e4c7c8df07b1ca738812b/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.131486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, user_id=01b18f2290d04612b08027b780ff0403, role_id=f7ce91f1443e4c7c8df07b1ca738812b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:56.132540 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:56.132540 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:56.132540 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:56.134484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:56.152682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role f7ce91f1443e4c7c8df07b1ca738812b was removed from user 01b18f2290d04612b08027b780ff0403 on domain edc5b6670f5348439f43a3ff39081d17. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:56.153095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:56.153968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:56.181425 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2001/4024] 10.222.0.32 () {58 vars in 1562 bytes} [Sat May 7 21:56:55 2022] DELETE /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/f7ce91f1443e4c7c8df07b1ca738812b/inherited_to_projects => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:56.185875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:56.187516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:56.237815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0eb12-1e55-401b-9620-5cd5e81435a4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.334986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffaa01-f4f0-434b-8265-526164e52b9d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.347960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.351171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.353400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.354349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles/f7ce91f1443e4c7c8df07b1ca738812b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.356856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f7ce91f1443e4c7c8df07b1ca738812b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:56.361764 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:56.361764 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:56.361764 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:56.363610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:56.384986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf67c8-a74f-49cd-a9be-d783d4140e56 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.385697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf67c8-a74f-49cd-a9be-d783d4140e56 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.385995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf67c8-a74f-49cd-a9be-d783d4140e56 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.386288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf67c8-a74f-49cd-a9be-d783d4140e56 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.392463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf67c8-a74f-49cd-a9be-d783d4140e56 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:56.393531 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-72bf67c8-a74f-49cd-a9be-d783d4140e56 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:56.393531 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:56.393531 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:56.394696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf67c8-a74f-49cd-a9be-d783d4140e56 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:56.467249 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2024/4025] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:56 2022] GET /identity/v3/users => generated 9658 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:56:56.472465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8960a9-26c6-41f8-a5bd-78e6a010775b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.474923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8960a9-26c6-41f8-a5bd-78e6a010775b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.475763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8960a9-26c6-41f8-a5bd-78e6a010775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.476623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role f7ce91f1443e4c7c8df07b1ca738812b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:56.477252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:56.478297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:56.488007 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2002/4026] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:56 2022] DELETE /identity/v3/roles/f7ce91f1443e4c7c8df07b1ca738812b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:56.489108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:56.492712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:56.561367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2c8960a9-26c6-41f8-a5bd-78e6a010775b None None] MFA Rules not processed for user `1d2f4385e5d9444cb14f4a8e1b896087`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:56.564590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2c8960a9-26c6-41f8-a5bd-78e6a010775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:56.623506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f006-4c63-443e-a0fe-5fd639bb5bcb tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.631380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.632161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.632455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.632738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.633535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:56.635860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:56.656757 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2003/4027] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:56 2022] POST /identity/v3/roles => generated 239 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:56.660329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:56.673887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3593c-1f0d-426b-b9c5-1725277bf129 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.682157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.683381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.684134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.685091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.686130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:56.690324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:56.732560 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2025/4028] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:56.745623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0705bf-c0ff-486d-bda4-603b21d35f2b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.745925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0705bf-c0ff-486d-bda4-603b21d35f2b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.746208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0705bf-c0ff-486d-bda4-603b21d35f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.750129 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2004/4029] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:56 2022] POST /identity/v3/projects => generated 409 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:56.753411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:56.772174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7f0705bf-c0ff-486d-bda4-603b21d35f2b None None] MFA Rules not processed for user `1d2f4385e5d9444cb14f4a8e1b896087`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:56.773693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7f0705bf-c0ff-486d-bda4-603b21d35f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:56.839003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6202897-f1af-44f7-872e-f24e63c48431 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.845875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.847644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.848221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.848892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/60bfb531a635412d99159a58d2cd513d/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.854304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, user_id=01b18f2290d04612b08027b780ff0403, role_id=60bfb531a635412d99159a58d2cd513d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:56.862442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:56.886238 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2005/4030] 10.222.0.32 () {60 vars in 1578 bytes} [Sat May 7 21:56:56 2022] PUT /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/60bfb531a635412d99159a58d2cd513d/inherited_to_projects => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:56.892614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:56.903592 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2026/4031] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:56.907685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0705bf-c0ff-486d-bda4-603b21d35f2b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:56.917126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0705bf-c0ff-486d-bda4-603b21d35f2b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:56.996738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d2f4385e5d9444cb14f4a8e1b896087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f761f0e1d44c431f880392e967abc47b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1873407875', 'tempest-NotDelegatedRole-1854114426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:56.998263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:56.998623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:56.998970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:56.999812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] RBAC: Authorizing `identity:create_trust()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.001841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.029320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3270601-53f3-42e7-b476-e1bef59aa118 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.041244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.042097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.042697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.043702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.044644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Adding query filter params (scope.project.id=774a127ac16748d4943745b26cc6c9f7, user.id=01b18f2290d04612b08027b780ff0403) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:57.045903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.050854 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:57.050854 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:57.050854 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:57.052051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.155987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2006/4032] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 21:56:56 2022] GET /identity/v3/role_assignments?scope.project.id=774a127ac16748d4943745b26cc6c9f7&user.id=01b18f2290d04612b08027b780ff0403&effective => generated 648 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:57.158418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.170871 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2027/4033] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:56:56 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:57.171244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ff001-540b-47ac-853f-3603a455461e tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.172117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.174699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:57.178304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.179161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.179573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.179764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.180714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Adding query filter params (scope.project.id=8924b6a7c26e425d98e91f79c74f043a, user.id=01b18f2290d04612b08027b780ff0403) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:57.182045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.183436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.304062 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2007/4034] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 21:56:57 2022] GET /identity/v3/role_assignments?scope.project.id=8924b6a7c26e425d98e91f79c74f043a&user.id=01b18f2290d04612b08027b780ff0403&effective => generated 648 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:57.304638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61fca1-557d-4a47-9dce-c9127e999ea3 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.308569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.310205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.311058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.311349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.311635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.312354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.314350 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:57.314350 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 21:56:57.314350 ncdv-master-1 devstack@keystone.service[91076]: May 07 21:56:57.315357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.326964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad4f5d-28a9-4780-88c5-8591fb03df25 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.340436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.343959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.344377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.345331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/60bfb531a635412d99159a58d2cd513d/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.346971 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2028/4035] 10.222.0.32 () {58 vars in 1154 bytes} [Sat May 7 21:56:57 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:57.350192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.353324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=edc5b6670f5348439f43a3ff39081d17, user_id=01b18f2290d04612b08027b780ff0403, role_id=60bfb531a635412d99159a58d2cd513d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.355862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.370173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role 60bfb531a635412d99159a58d2cd513d was removed from user 01b18f2290d04612b08027b780ff0403 on domain edc5b6670f5348439f43a3ff39081d17. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:57.370404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.373120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.374241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eef417-ce58-4362-8ce9-4ecd5d0cafec tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.393180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d2f4385e5d9444cb14f4a8e1b896087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f761f0e1d44c431f880392e967abc47b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1873407875', 'tempest-NotDelegatedRole-1854114426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.393180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.393180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.393696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] PATH_INFO: `/v3/OS-TRUST/trusts/e7f5a3ab946846dbb9787b98fd7491dd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.409161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] RBAC: Authorizing `identity:delete_trust(trust_id=e7f5a3ab946846dbb9787b98fd7491dd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.410135 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2008/4036] 10.222.0.32 () {58 vars in 1562 bytes} [Sat May 7 21:56:57 2022] DELETE /identity/v3/OS-INHERIT/domains/edc5b6670f5348439f43a3ff39081d17/users/01b18f2290d04612b08027b780ff0403/roles/60bfb531a635412d99159a58d2cd513d/inherited_to_projects => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:57.410857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.415458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.417517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:57.446623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e7f5a3ab946846dbb9787b98fd7491dd', 'request_id': 'req-c7e0b6ad-3ecb-45fe-8846-decaef493c77'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.472140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e7f5a3ab946846dbb9787b98fd7491dd', 'request_id': 'req-c7e0b6ad-3ecb-45fe-8846-decaef493c77'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.473099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e7f5a3ab946846dbb9787b98fd7491dd', 'request_id': 'req-c7e0b6ad-3ecb-45fe-8846-decaef493c77'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.515402 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2029/4037] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 21:56:57 2022] DELETE /identity/v3/OS-TRUST/trusts/e7f5a3ab946846dbb9787b98fd7491dd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:57.520669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.522117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:57.537202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0b6ad-3ecb-45fe-8846-decaef493c77 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.576170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382df4-cc67-4251-8fd1-8dac9bd3b41d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.584121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.585772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.586057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.586381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.587323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Adding query filter params (scope.project.id=774a127ac16748d4943745b26cc6c9f7, user.id=01b18f2290d04612b08027b780ff0403) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:57.587834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.590729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.613338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d2f4385e5d9444cb14f4a8e1b896087', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f761f0e1d44c431f880392e967abc47b', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1873407875', 'tempest-NotDelegatedRole-1854114426'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.614404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.614691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.615004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] PATH_INFO: `/v3/OS-TRUST/trusts/e7f5a3ab946846dbb9787b98fd7491dd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.641944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2009/4038] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 21:56:57 2022] GET /identity/v3/role_assignments?scope.project.id=774a127ac16748d4943745b26cc6c9f7&user.id=01b18f2290d04612b08027b780ff0403&effective => generated 228 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Could not find trust: e7f5a3ab946846dbb9787b98fd7491dd.: keystone.exception.TrustNotFound: Could not find trust: e7f5a3ab946846dbb9787b98fd7491dd. May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 07 21:56:57.643785 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e7f5a3ab946846dbb9787b98fd7491dd. May 07 21:56:57.644722 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:56:57.646218 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2030/4039] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:56:57 2022] GET /identity/v3/OS-TRUST/trusts/e7f5a3ab946846dbb9787b98fd7491dd => generated 111 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 21:56:57.647309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.649460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:57.649688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.651308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:57.663889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cfdc9-d1b3-441e-87fb-8d074cafe921 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.669066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.669783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.670081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.670348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.671272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Adding query filter params (scope.project.id=8924b6a7c26e425d98e91f79c74f043a, user.id=01b18f2290d04612b08027b780ff0403) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:57.671583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.673498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.733214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97473a4a-0846-4715-87fc-26d20154f1b6 tempest-TrustsV3TestJSON-611159316 tempest-user-1390193415] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.745003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.745885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.746173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.746618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/21301790c2fb4260899f9746142bbefc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.752903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=21301790c2fb4260899f9746142bbefc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.754630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.774198 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2010/4040] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 21:56:57 2022] GET /identity/v3/role_assignments?scope.project.id=8924b6a7c26e425d98e91f79c74f043a&user.id=01b18f2290d04612b08027b780ff0403&effective => generated 228 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:56:57.775555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.794165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709ff8d-5f49-4f51-8c66-55eb428f4107 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.809589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:57.811814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:57.812683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:57.813836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/projects/8924b6a7c26e425d98e91f79c74f043a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:57.816120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8924b6a7c26e425d98e91f79c74f043a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:57.820621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:57.848436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 21301790c2fb4260899f9746142bbefc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:57.848675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.853178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.858974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2031/4041] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:57 2022] DELETE /identity/v3/roles/21301790c2fb4260899f9746142bbefc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:57.862893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.867066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:57.940612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8924b6a7c26e425d98e91f79c74f043a', 'request_id': 'req-9561bc75-9717-4f9c-81e5-ba0535a79da0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.962697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8924b6a7c26e425d98e91f79c74f043a', 'request_id': 'req-9561bc75-9717-4f9c-81e5-ba0535a79da0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.962933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b27711-e7ca-4648-be6b-dd90e3b7c510 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:57.973827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8924b6a7c26e425d98e91f79c74f043a', 'request_id': 'req-9561bc75-9717-4f9c-81e5-ba0535a79da0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.987042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] The token cache is being invalidate because project 8924b6a7c26e425d98e91f79c74f043a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:57.987432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.988226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:57.993171 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2011/4042] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:57 2022] DELETE /identity/v3/projects/8924b6a7c26e425d98e91f79c74f043a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:57.994167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:57.996928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:58.058092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.062333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.062731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.063136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/862b11ee87dc49a1a446221e7198e269` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.066690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=862b11ee87dc49a1a446221e7198e269)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.068989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.104863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561bc75-9717-4f9c-81e5-ba0535a79da0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.117525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.119036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.119334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.119887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles/60bfb531a635412d99159a58d2cd513d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.123414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_role(role_id=60bfb531a635412d99159a58d2cd513d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.125602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.128360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 862b11ee87dc49a1a446221e7198e269 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:58.128665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.129640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.132270 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2032/4043] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:57 2022] DELETE /identity/v3/roles/862b11ee87dc49a1a446221e7198e269 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:58.140501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.143571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:58.181632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role 60bfb531a635412d99159a58d2cd513d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:58.182232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.182915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.185730 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2012/4044] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:57 2022] DELETE /identity/v3/roles/60bfb531a635412d99159a58d2cd513d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:58.195645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.197859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:58.257312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21bc5c-ac2e-421e-bde3-48cdbca939f6 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.314598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0b13f-10be-4f7d-8f03-8dfc4c75eef0 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.320116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.321117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.321117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.322004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.322464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.324323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.347449 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2013/4045] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:58 2022] POST /identity/v3/roles => generated 238 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:58.353537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.369016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48887f33-de21-4f0c-8104-9bc43873c160 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.381625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.383155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.383726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.384613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.384757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.384944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.385111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.385214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users/1d2f4385e5d9444cb14f4a8e1b896087` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.386635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1d2f4385e5d9444cb14f4a8e1b896087)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.388638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.392820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.398351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.452465 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2014/4046] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:56:58 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:58.456999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.476334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2f4385e5d9444cb14f4a8e1b896087'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.478456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2f4385e5d9444cb14f4a8e1b896087'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.494394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2f4385e5d9444cb14f4a8e1b896087'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.496407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2f4385e5d9444cb14f4a8e1b896087'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.514189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2f4385e5d9444cb14f4a8e1b896087'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.559353 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2033/4047] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:58 2022] DELETE /identity/v3/users/1d2f4385e5d9444cb14f4a8e1b896087 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:58.561979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.564529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083f37-ef12-46b7-8a3c-26a8e8989d66 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.566558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:58.642971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.643823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.644111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.644397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/d2a77999c82c4adc8077ec1185775196/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.646684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:create_grant(project_id=774a127ac16748d4943745b26cc6c9f7, user_id=01b18f2290d04612b08027b780ff0403, role_id=d2a77999c82c4adc8077ec1185775196)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.649661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.667423 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2015/4048] 10.222.0.32 () {60 vars in 1581 bytes} [Sat May 7 21:56:58 2022] PUT /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/d2a77999c82c4adc8077ec1185775196/inherited_to_projects => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:58.671667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.673681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:58.680344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59fb1d-4d4d-4a67-b995-30878d931c06 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.745772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.747615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.747748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c789-e9da-49e0-9580-76dac114f309 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.747881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.747881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/f761f0e1d44c431f880392e967abc47b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.749620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f761f0e1d44c431f880392e967abc47b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.752656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.754823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.755923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.756841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.756841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.757517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Adding query filter params (scope.project.id=192d5d7dfa9041dd970488accefc2ce9, user.id=01b18f2290d04612b08027b780ff0403) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:58.757833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.759775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.815040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f761f0e1d44c431f880392e967abc47b', 'request_id': 'req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.823166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f761f0e1d44c431f880392e967abc47b', 'request_id': 'req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.828711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2016/4049] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 21:56:58 2022] GET /identity/v3/role_assignments?scope.project.id=192d5d7dfa9041dd970488accefc2ce9&user.id=01b18f2290d04612b08027b780ff0403&effective => generated 649 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:58.840139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f761f0e1d44c431f880392e967abc47b', 'request_id': 'req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.840363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.853483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed344b-a08d-41c7-84dc-b51223a88940 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.855704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] The token cache is being invalidate because project f761f0e1d44c431f880392e967abc47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:58.855981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.856712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.859156 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2034/4050] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:58 2022] DELETE /identity/v3/projects/f761f0e1d44c431f880392e967abc47b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:58.864468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.868221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:58.919703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.920775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.920925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.921210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/d2a77999c82c4adc8077ec1185775196/inherited_to_projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.923570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=774a127ac16748d4943745b26cc6c9f7, user_id=01b18f2290d04612b08027b780ff0403, role_id=d2a77999c82c4adc8077ec1185775196)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.926295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.932378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role d2a77999c82c4adc8077ec1185775196 was removed from user 01b18f2290d04612b08027b780ff0403 on project 774a127ac16748d4943745b26cc6c9f7. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:58.932661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.933361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:58.941480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72b93b-82cd-4e0f-9fdb-886d132cb28e tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:58.947560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:58.948234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:58.948624 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2017/4051] 10.222.0.32 () {58 vars in 1565 bytes} [Sat May 7 21:56:58 2022] DELETE /identity/v3/OS-INHERIT/projects/774a127ac16748d4943745b26cc6c9f7/users/01b18f2290d04612b08027b780ff0403/roles/d2a77999c82c4adc8077ec1185775196/inherited_to_projects => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:58.950949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:58.951629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:58.952333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:58.952594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:58.954505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:58.954964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:58.998925 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2035/4052] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:56:58 2022] POST /identity/v3/projects => generated 329 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:59.002307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.005790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:59.065020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b9a1-387f-4a3b-b2de-8795208567d9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.121858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74139-3c71-4255-ab94-ee00fb50da7c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.129015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.129737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.130025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.130307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.131892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.134345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.148990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.150339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.150339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.151034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.151881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Adding query filter params (scope.project.id=192d5d7dfa9041dd970488accefc2ce9, user.id=01b18f2290d04612b08027b780ff0403) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:56:59.152354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.154357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.157020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2036/4053] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:56:58 2022] POST /identity/v3/users => generated 416 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:59.160931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.171458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e805f0-cac9-42b0-bb72-54b33ec9f019 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.177823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.178487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.178798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.179126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.179822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.182018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.207783 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2037/4054] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:59 2022] POST /identity/v3/roles => generated 244 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:56:59.213071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.226266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cf0a6-da19-43bd-a253-f699a784ece2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.231477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.232148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.232455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.233395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.234150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.236828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.244870 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2018/4055] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 21:56:58 2022] GET /identity/v3/role_assignments?scope.project.id=192d5d7dfa9041dd970488accefc2ce9&user.id=01b18f2290d04612b08027b780ff0403&effective => generated 228 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:56:59.248456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.255417 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2038/4056] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:56:59 2022] POST /identity/v3/roles => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:56:59.259331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.260577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccaa115-ff05-4ba2-9766-31cf55a4c401 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.266544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.267679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.267972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.268248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/projects/192d5d7dfa9041dd970488accefc2ce9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.269472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=192d5d7dfa9041dd970488accefc2ce9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.271593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.271840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9272dd-e1e9-478f-b89e-ec3c83287bfe tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.276661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.277530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.277809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.278129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/7442d2c368e34de7845426e874084d49/users/4ee804b430f04e68922a752c41d04f30/roles/2a0827440e034cccb9dfc5fec6247b7e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.295143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7442d2c368e34de7845426e874084d49, user_id=4ee804b430f04e68922a752c41d04f30, role_id=2a0827440e034cccb9dfc5fec6247b7e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.298415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.315268 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2039/4057] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:59 2022] PUT /identity/v3/projects/7442d2c368e34de7845426e874084d49/users/4ee804b430f04e68922a752c41d04f30/roles/2a0827440e034cccb9dfc5fec6247b7e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:59.319383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.327538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192d5d7dfa9041dd970488accefc2ce9', 'request_id': 'req-b365060d-fdf4-4f3e-9400-290e144edfa8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.333934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192d5d7dfa9041dd970488accefc2ce9', 'request_id': 'req-b365060d-fdf4-4f3e-9400-290e144edfa8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.342631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192d5d7dfa9041dd970488accefc2ce9', 'request_id': 'req-b365060d-fdf4-4f3e-9400-290e144edfa8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.353879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] The token cache is being invalidate because project 192d5d7dfa9041dd970488accefc2ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:59.354189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.354884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.357160 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2019/4058] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:59 2022] DELETE /identity/v3/projects/192d5d7dfa9041dd970488accefc2ce9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:59.361766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.363467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:59.393970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802aa1b-d648-4618-b790-70e7d761e6bf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.442064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365060d-fdf4-4f3e-9400-290e144edfa8 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.447810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.448684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.448973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.449253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/roles/d2a77999c82c4adc8077ec1185775196` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.450821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d2a77999c82c4adc8077ec1185775196)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.452775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.464540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.465468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.465710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.466029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/7442d2c368e34de7845426e874084d49/users/4ee804b430f04e68922a752c41d04f30/roles/c10ebcbb29474da6b64427d3f6172d5b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.468485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7442d2c368e34de7845426e874084d49, user_id=4ee804b430f04e68922a752c41d04f30, role_id=c10ebcbb29474da6b64427d3f6172d5b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.471755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.489909 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2040/4059] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:56:59 2022] PUT /identity/v3/projects/7442d2c368e34de7845426e874084d49/users/4ee804b430f04e68922a752c41d04f30/roles/c10ebcbb29474da6b64427d3f6172d5b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:59.493725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.495508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:59.498461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invalidating the token cache because role d2a77999c82c4adc8077ec1185775196 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:56:59.498757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.499440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.502737 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2020/4060] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:59 2022] DELETE /identity/v3/roles/d2a77999c82c4adc8077ec1185775196 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:56:59.507213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.508723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:59.585193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc7907-7d2c-4313-9161-c32ff942bf20 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.616535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adc154-293f-46b5-9d2e-3dbd5ac3eed9 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.624980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.626203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.626727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.627241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/users/01b18f2290d04612b08027b780ff0403` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.629112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_user(user_id=01b18f2290d04612b08027b780ff0403)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.631507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.674395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cdf121-1b19-4831-9ef2-bd6e78c31953 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.675895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdf121-1b19-4831-9ef2-bd6e78c31953 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.676326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdf121-1b19-4831-9ef2-bd6e78c31953 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.676605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cdf121-1b19-4831-9ef2-bd6e78c31953 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.677471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdf121-1b19-4831-9ef2-bd6e78c31953 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.679881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cdf121-1b19-4831-9ef2-bd6e78c31953 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.725280 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2041/4061] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:56:59 2022] GET /identity/v3/users => generated 9658 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:56:59.727718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e1128-e18f-4360-be52-b21dcc272ded None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.728015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e1128-e18f-4360-be52-b21dcc272ded None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.728341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e1128-e18f-4360-be52-b21dcc272ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.757843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b18f2290d04612b08027b780ff0403'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.767825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b18f2290d04612b08027b780ff0403'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.768575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b18f2290d04612b08027b780ff0403'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.769207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b18f2290d04612b08027b780ff0403'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.775045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ff2e1128-e18f-4360-be52-b21dcc272ded None None] MFA Rules not processed for user `4ee804b430f04e68922a752c41d04f30`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:59.776277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ff2e1128-e18f-4360-be52-b21dcc272ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:59.779955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b18f2290d04612b08027b780ff0403'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:56:59.802327 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2021/4062] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:56:59 2022] DELETE /identity/v3/users/01b18f2290d04612b08027b780ff0403 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:59.806162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.807706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:59.867002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2042/4063] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:56:59.868519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3ea6a-4903-4e77-b2ce-50b98cdf2563 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.868805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3ea6a-4903-4e77-b2ce-50b98cdf2563 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.869081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3ea6a-4903-4e77-b2ce-50b98cdf2563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.889287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-49e3ea6a-4903-4e77-b2ce-50b98cdf2563 None None] MFA Rules not processed for user `4ee804b430f04e68922a752c41d04f30`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:56:59.891099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-49e3ea6a-4903-4e77-b2ce-50b98cdf2563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:56:59.896282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c652407-fe2b-4a13-aa4d-ddb8e6e8aa0d tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:56:59.903181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:56:59.905067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:56:59.905353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:56:59.905635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/groups/c4f311aa976d4c509e4afa7938a7e003` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:56:59.907036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c4f311aa976d4c509e4afa7938a7e003)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:56:59.908355 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:56:59.908355 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:56:59.908355 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:56:59.909575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:56:59.976834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2043/4064] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:56:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:56:59.980266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3ea6a-4903-4e77-b2ce-50b98cdf2563 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.986798 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2022/4065] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 21:56:59 2022] DELETE /identity/v3/groups/c4f311aa976d4c509e4afa7938a7e003 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:56:59.992989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:56:59.996366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3ea6a-4903-4e77-b2ce-50b98cdf2563 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:00.114619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee804b430f04e68922a752c41d04f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7442d2c368e34de7845426e874084d49', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1356587403', 'tempest-NotDelegatedRole-250122321'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:00.115318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:00.115603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:00.116243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:00.116992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: Authorizing `identity:create_trust()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:00.118306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:00.135802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580f2ce-66aa-43f2-abb3-249bcd4331c4 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:00.146443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:00.148102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:00.149593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:00.150038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/projects/774a127ac16748d4943745b26cc6c9f7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:00.153093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=774a127ac16748d4943745b26cc6c9f7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:00.158050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:00.246326 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2044/4066] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:56:59 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:00.250527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:00.262554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774a127ac16748d4943745b26cc6c9f7', 'request_id': 'req-911b9d41-9fd5-40be-98a9-f7d93b44f258'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.273269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774a127ac16748d4943745b26cc6c9f7', 'request_id': 'req-911b9d41-9fd5-40be-98a9-f7d93b44f258'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.288519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50913000-7125-46c7-b8c4-f4e83148e67d tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:00.288735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774a127ac16748d4943745b26cc6c9f7', 'request_id': 'req-911b9d41-9fd5-40be-98a9-f7d93b44f258'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.307852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] The token cache is being invalidate because project 774a127ac16748d4943745b26cc6c9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:00.308106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.310266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.329033 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2023/4067] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:56:59 2022] DELETE /identity/v3/projects/774a127ac16748d4943745b26cc6c9f7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:00.330116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:00.332054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:00.430414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee804b430f04e68922a752c41d04f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7442d2c368e34de7845426e874084d49', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1356587403', 'tempest-NotDelegatedRole-250122321'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:00.431216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:00.431600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:00.432434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:00.432771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:00.434262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:00.451711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2045/4068] 10.222.0.32 () {58 vars in 1251 bytes} [Sat May 7 21:57:00 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=4ee804b430f04e68922a752c41d04f30 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:00.454568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:00.459610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:00.486392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf85549-057c-4a95-b97e-83ecded2f0e4 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:00.499019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee804b430f04e68922a752c41d04f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7442d2c368e34de7845426e874084d49', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1356587403', 'tempest-NotDelegatedRole-250122321'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:00.500017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:00.501312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:00.501312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] PATH_INFO: `/v3/OS-TRUST/trusts/41366f908daf4bd0bbffbaa83830d9b2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:00.511899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b9d41-9fd5-40be-98a9-f7d93b44f258 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:00.514306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: Authorizing `identity:delete_trust(trust_id=41366f908daf4bd0bbffbaa83830d9b2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:00.516097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:00.521140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:00.523272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:00.523727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:00.524587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/domains/edc5b6670f5348439f43a3ff39081d17` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:00.528140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=edc5b6670f5348439f43a3ff39081d17)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:00.531799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:00.560796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '41366f908daf4bd0bbffbaa83830d9b2', 'request_id': 'req-f79beb9c-184c-43de-8823-8d6b94f83f79'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.581607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '41366f908daf4bd0bbffbaa83830d9b2', 'request_id': 'req-f79beb9c-184c-43de-8823-8d6b94f83f79'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.582397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '41366f908daf4bd0bbffbaa83830d9b2', 'request_id': 'req-f79beb9c-184c-43de-8823-8d6b94f83f79'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.590225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2046/4069] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 21:57:00 2022] DELETE /identity/v3/OS-TRUST/trusts/41366f908daf4bd0bbffbaa83830d9b2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:00.593873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.594792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:00.599730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:00.603251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.644252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79beb9c-184c-43de-8823-8d6b94f83f79 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:00.648148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.649772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.653477 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2024/4070] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:57:00 2022] PATCH /identity/v3/domains/edc5b6670f5348439f43a3ff39081d17 => generated 277 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:00.658494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:00.660538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:00.782683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ee804b430f04e68922a752c41d04f30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7442d2c368e34de7845426e874084d49', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1356587403', 'tempest-NotDelegatedRole-250122321'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:00.783612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:00.783906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:00.784187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] PATH_INFO: `/v3/OS-TRUST/trusts/41366f908daf4bd0bbffbaa83830d9b2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Could not find trust: 41366f908daf4bd0bbffbaa83830d9b2.: keystone.exception.TrustNotFound: Could not find trust: 41366f908daf4bd0bbffbaa83830d9b2. May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 07 21:57:00.809180 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 41366f908daf4bd0bbffbaa83830d9b2. May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:57:00.811439 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2047/4071] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:57:00 2022] GET /identity/v3/OS-TRUST/trusts/41366f908daf4bd0bbffbaa83830d9b2 => generated 111 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:57:00.824506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:00.832423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:00.865028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291303ca-7156-4517-b1b9-8c4281c50b57 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:00.885550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6a5099a35f46248f2dc4f3e7148582', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e0a4b5530435b83d667a443e8d6b3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:00.886630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:00.887069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:00.887454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] PATH_INFO: `/v3/domains/edc5b6670f5348439f43a3ff39081d17` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:00.900873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=edc5b6670f5348439f43a3ff39081d17)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:00.903236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:00.933840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:00.937885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.033557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17', 'request_id': 'req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.057191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc7b7b-e67f-47e4-b95e-6cf594560692 tempest-TrustsV3TestJSON-1290193062 tempest-user-1073181145] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:01.066319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17', 'request_id': 'req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.088075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17', 'request_id': 'req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.115049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] The token cache is being invalidate because project edc5b6670f5348439f43a3ff39081d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:01.115384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.122195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.145769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17', 'request_id': 'req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.147377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17', 'request_id': 'req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.155189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'edc5b6670f5348439f43a3ff39081d17', 'request_id': 'req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.179984 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2025/4072] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:57:00 2022] DELETE /identity/v3/domains/edc5b6670f5348439f43a3ff39081d17 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:01.182266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:01.187868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:01.259215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:01.261230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:01.261955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:01.262532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/c10ebcbb29474da6b64427d3f6172d5b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:01.265968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c10ebcbb29474da6b64427d3f6172d5b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:01.269844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:01.294803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5b54a-0365-4a00-bd8e-ccf63a270c56 tempest-InheritsV3TestJSON-1510718452 tempest-InheritsV3TestJSON-1510718452-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:01.302743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:01.303684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:01.303971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:01.304246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] PATH_INFO: `/v3/users/bcbd34555bc34f4296a290ea120b03e4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:01.306804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbd34555bc34f4296a290ea120b03e4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:01.310788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:01.340908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role c10ebcbb29474da6b64427d3f6172d5b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:01.341609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.342550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.348651 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2048/4073] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:00 2022] DELETE /identity/v3/roles/c10ebcbb29474da6b64427d3f6172d5b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:01.350627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:01.352477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:01.398555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbd34555bc34f4296a290ea120b03e4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.418865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbd34555bc34f4296a290ea120b03e4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.420847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbd34555bc34f4296a290ea120b03e4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.423660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbd34555bc34f4296a290ea120b03e4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.450801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00a00c8d-a429-4e0f-a244-9e181f24a2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbd34555bc34f4296a290ea120b03e4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.482994 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2026/4074] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:01 2022] DELETE /identity/v3/users/bcbd34555bc34f4296a290ea120b03e4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:01.488395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:01.488846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:01.489282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:01.525307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6da72-b74c-45f3-9cc3-e41de90f8e69 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:01.535158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:01.537880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:01.641773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2027/4075] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:01.667657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:01.672072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:01.714256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:01.717865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:01.718722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:01.719035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/2a0827440e034cccb9dfc5fec6247b7e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:01.723275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2a0827440e034cccb9dfc5fec6247b7e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:01.728142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:01.786180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701c6d5-d493-430a-983d-926f931a4435 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:01.790465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:01.791162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:01.791537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:01.791815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:01.804334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:01.806134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:01.818259 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2028/4076] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:01.818765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 2a0827440e034cccb9dfc5fec6247b7e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:01.819258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.823667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c2d43e97-1df4-49c9-9c4b-9c56d0a17c1c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:01.830940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:01.831299 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2049/4077] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:01 2022] DELETE /identity/v3/roles/2a0827440e034cccb9dfc5fec6247b7e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:01.835697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:01.860947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070dd5-d972-49e5-8eaf-4d5fa32b8a1e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:01.986386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:01.986856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:01.987191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.005956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.008025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.008325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.008641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users/4ee804b430f04e68922a752c41d04f30` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.011143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4ee804b430f04e68922a752c41d04f30)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.014036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] MFA Rules not processed for user `bdc18dc6c5214fbb9c1fa61eeb514cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:02.014344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.017567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.106193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2050/4078] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:02.115449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee804b430f04e68922a752c41d04f30'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.133836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee804b430f04e68922a752c41d04f30'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.135075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee804b430f04e68922a752c41d04f30'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.136063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee804b430f04e68922a752c41d04f30'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.147790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee804b430f04e68922a752c41d04f30'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.172575 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2029/4079] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:01 2022] DELETE /identity/v3/users/4ee804b430f04e68922a752c41d04f30 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:02.176528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.178229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.221650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1ea73-33af-4d77-9a47-86f1f7e3c277 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.347554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.348426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.349002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.349002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/7442d2c368e34de7845426e874084d49` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.351590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7442d2c368e34de7845426e874084d49)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.354467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.366513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.368540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.465018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7442d2c368e34de7845426e874084d49', 'request_id': 'req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.474919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7442d2c368e34de7845426e874084d49', 'request_id': 'req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.491322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7442d2c368e34de7845426e874084d49', 'request_id': 'req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.509948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] The token cache is being invalidate because project 7442d2c368e34de7845426e874084d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:02.510315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.511134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.518694 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2051/4080] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:02 2022] DELETE /identity/v3/projects/7442d2c368e34de7845426e874084d49 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:02.518885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.521063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.523270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f5d48-68a9-4992-abc7-998147283fb7 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.610795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ce5fa-afcc-4783-88ef-8929cd6d0b4f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.616877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.618858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.619492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.619860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] PATH_INFO: `/v3/projects/399660ada5af4d70a032e2e23d0c563d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.621230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.621704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399660ada5af4d70a032e2e23d0c563d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.622668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.623305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.623738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.624138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.624902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.627971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.680443 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2052/4081] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:57:02 2022] POST /identity/v3/projects => generated 329 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:02.684691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.705602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399660ada5af4d70a032e2e23d0c563d', 'request_id': 'req-764d2554-6d14-4441-a78d-f722f451fb87'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.713825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399660ada5af4d70a032e2e23d0c563d', 'request_id': 'req-764d2554-6d14-4441-a78d-f722f451fb87'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.727304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399660ada5af4d70a032e2e23d0c563d', 'request_id': 'req-764d2554-6d14-4441-a78d-f722f451fb87'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.743022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] The token cache is being invalidate because project 399660ada5af4d70a032e2e23d0c563d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:02.743527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.744449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.748061 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2030/4082] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:02 2022] DELETE /identity/v3/projects/399660ada5af4d70a032e2e23d0c563d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:02.751795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.751795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.764944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c5fb0-329d-4f79-a733-0d2aace1aaa2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.770798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.771544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.772012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.772616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.773220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.775388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.803039 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2053/4083] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:02 2022] POST /identity/v3/users => generated 416 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:02.805615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.807772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.824707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d2554-6d14-4441-a78d-f722f451fb87 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.880748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.881516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.881809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.882264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.884286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.885024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2b7bc-9f82-4912-8ed2-14a1609b3291 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.892878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.894244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.894716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.894857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.895285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] PATH_INFO: `/v3/users/3b6a5099a35f46248f2dc4f3e7148582` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.896247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.898376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6a5099a35f46248f2dc4f3e7148582)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.902359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.905237 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2031/4084] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:02.906290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.907781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:02.923695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec286113-6d88-4ee5-8002-f7c3655de3ea service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.930285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.931246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.931543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.931825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.932574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.934203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:02.960595 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2032/4085] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:02 2022] POST /identity/v3/roles => generated 243 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:02.966161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:02.975801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6a5099a35f46248f2dc4f3e7148582'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.978287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6a5099a35f46248f2dc4f3e7148582'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.981261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620bd25b-2d94-42a1-bd93-1eee075301b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:02.988037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:02.988921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:02.989223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:02.989558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:02.990380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6a5099a35f46248f2dc4f3e7148582'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.990504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:02.991480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6a5099a35f46248f2dc4f3e7148582'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:02.992249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:03.008034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6a5099a35f46248f2dc4f3e7148582'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:03.029292 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2033/4086] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:02 2022] POST /identity/v3/roles => generated 246 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:03.034717 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2054/4087] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:02 2022] DELETE /identity/v3/users/3b6a5099a35f46248f2dc4f3e7148582 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:03.037273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:03.040549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:03.060003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6b2c-f6f5-4210-a854-d03f324fe5eb tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:03.143927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:03.145837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:03.146154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:03.146471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/97c4b13f7c2448e38167942ca7f346a6/users/075ae78137da4282b154de465180018d/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:03.167759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=97c4b13f7c2448e38167942ca7f346a6, user_id=075ae78137da4282b154de465180018d, role_id=6d0b7a7b7b4f42fc9142f1ae4924dcfc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:03.170692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:03.189569 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2034/4088] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:03 2022] PUT /identity/v3/projects/97c4b13f7c2448e38167942ca7f346a6/users/075ae78137da4282b154de465180018d/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:03.195140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:03.216227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5bf95-ac99-4091-a731-3db9190789a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:03.321020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2a39f-7be9-473b-a4fa-7ad372e5eb83 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:03.322635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2a39f-7be9-473b-a4fa-7ad372e5eb83 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:03.322635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2a39f-7be9-473b-a4fa-7ad372e5eb83 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:03.322893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2a39f-7be9-473b-a4fa-7ad372e5eb83 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/97c4b13f7c2448e38167942ca7f346a6/users/075ae78137da4282b154de465180018d/roles/409f97a64e66428f82d75cbfd7cf31f7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:03.325473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2a39f-7be9-473b-a4fa-7ad372e5eb83 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=97c4b13f7c2448e38167942ca7f346a6, user_id=075ae78137da4282b154de465180018d, role_id=409f97a64e66428f82d75cbfd7cf31f7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:03.328586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2a39f-7be9-473b-a4fa-7ad372e5eb83 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:03.349861 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2055/4089] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:03 2022] PUT /identity/v3/projects/97c4b13f7c2448e38167942ca7f346a6/users/075ae78137da4282b154de465180018d/roles/409f97a64e66428f82d75cbfd7cf31f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:03.354467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:03.395323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575c9b5-0945-45bb-91fe-fb9481efc3f4 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:03.513297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c22a0-0dae-4da4-b5cc-e274c089f195 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:03.513984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c22a0-0dae-4da4-b5cc-e274c089f195 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:03.514262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c22a0-0dae-4da4-b5cc-e274c089f195 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:03.515862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c22a0-0dae-4da4-b5cc-e274c089f195 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:03.515862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c22a0-0dae-4da4-b5cc-e274c089f195 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:03.517082 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-cc1c22a0-0dae-4da4-b5cc-e274c089f195 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 21:57:03.517082 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 21:57:03.517082 ncdv-master-1 devstack@keystone.service[91075]: May 07 21:57:03.518007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c22a0-0dae-4da4-b5cc-e274c089f195 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:03.566313 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2035/4090] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:03 2022] GET /identity/v3/users => generated 8664 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:03.571178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:03.571775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:03.571775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:03.647899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] MFA Rules not processed for user `075ae78137da4282b154de465180018d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:03.649995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:03.776488 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2056/4091] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:03 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:03.778437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c8b7a-b749-454f-a74b-5e73a28ddd9f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:03.779130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c8b7a-b749-454f-a74b-5e73a28ddd9f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:03.779521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c8b7a-b749-454f-a74b-5e73a28ddd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:03.792914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:03.811379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:03.832507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-547c8b7a-b749-454f-a74b-5e73a28ddd9f None None] MFA Rules not processed for user `075ae78137da4282b154de465180018d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:03.837530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-547c8b7a-b749-454f-a74b-5e73a28ddd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:03.862439 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2036/4092] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:03 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:03.863887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c8b7a-b749-454f-a74b-5e73a28ddd9f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:03.879874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c8b7a-b749-454f-a74b-5e73a28ddd9f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:03.884732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:03.885853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:03.885853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:03.886035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:03.886708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:create_trust()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:03.888114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:03.965261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81601d-bc1d-4407-9929-f69b6f973398 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:03.973280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:03.974544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:03.975227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:03.975787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] PATH_INFO: `/v3/projects/a72e0a4b5530435b83d667a443e8d6b3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:03.977435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72e0a4b5530435b83d667a443e8d6b3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:03.979585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:03.987258 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2037/4093] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:57:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:03.991461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.003076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f4922-3b82-4cd3-9fcf-f4fc0a7f82b6 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.011539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.012487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.012965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.014095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.028580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:get_trust(trust_id=7e2f641c9ebb41939e1b1b9f5d83a2fb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.030719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.044138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2038/4094] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:57:03 2022] GET /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb => generated 858 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:04.057370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.075674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a3535-1b03-4cfd-a081-5e51314e9a20 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.083416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72e0a4b5530435b83d667a443e8d6b3', 'request_id': 'req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.100965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72e0a4b5530435b83d667a443e8d6b3', 'request_id': 'req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.113403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72e0a4b5530435b83d667a443e8d6b3', 'request_id': 'req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.138215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] The token cache is being invalidate because project a72e0a4b5530435b83d667a443e8d6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:04.138428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.139240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-93ac340c-7e9a-4684-bd7e-d730bbb8bb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.142796 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2057/4095] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:03 2022] DELETE /identity/v3/projects/a72e0a4b5530435b83d667a443e8d6b3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:04.148131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055672d-5d28-42f3-a2d4-df3dc331e473 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.148402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055672d-5d28-42f3-a2d4-df3dc331e473 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.148832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055672d-5d28-42f3-a2d4-df3dc331e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.175543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4055672d-5d28-42f3-a2d4-df3dc331e473 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:04.176758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4055672d-5d28-42f3-a2d4-df3dc331e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:04.198060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.198388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.198910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.199028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.214924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7e2f641c9ebb41939e1b1b9f5d83a2fb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.218266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.229152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2039/4096] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:57:04 2022] GET /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:04.233695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.235954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:04.257316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f8809-dcf3-405f-b252-c2bfdf4ddb40 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.263906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.264931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.265223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.265502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.275587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e2f641c9ebb41939e1b1b9f5d83a2fb, role_id=6d0b7a7b7b4f42fc9142f1ae4924dcfc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.277537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.290036 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2040/4097] 10.222.0.32 () {58 vars in 1367 bytes} [Sat May 7 21:57:04 2022] GET /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc => generated 243 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:04.291450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.299091 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2058/4098] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:04.308606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff6c45-2640-43c8-9cc8-8ad6738729da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.309541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce95e14-4827-4be8-a29a-b7e9b0ef7f5f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.309844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce95e14-4827-4be8-a29a-b7e9b0ef7f5f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.310131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce95e14-4827-4be8-a29a-b7e9b0ef7f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.314249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.315643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.316169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.316471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.336808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e2f641c9ebb41939e1b1b9f5d83a2fb, role_id=6d0b7a7b7b4f42fc9142f1ae4924dcfc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.337144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bce95e14-4827-4be8-a29a-b7e9b0ef7f5f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:04.338052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.338518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bce95e14-4827-4be8-a29a-b7e9b0ef7f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:04.350911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2041/4099] 10.222.0.32 () {58 vars in 1368 bytes} [Sat May 7 21:57:04 2022] HEAD /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc => generated 0 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:04.351138 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2059/4100] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:04.353709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.353958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce95e14-4827-4be8-a29a-b7e9b0ef7f5f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.366747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce95e14-4827-4be8-a29a-b7e9b0ef7f5f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.373727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.374676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.374958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.376261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.376941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:04.377418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.379299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.387155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37393aa2-be4b-4198-ad8b-024c47090a93 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.395274 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2060/4101] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:04.396020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.398142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.398821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.398821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/409f97a64e66428f82d75cbfd7cf31f7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.402222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.407713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e2f641c9ebb41939e1b1b9f5d83a2fb, role_id=409f97a64e66428f82d75cbfd7cf31f7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.409687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.421381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1932-11db-4895-b660-8806889138d1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Could not find role: 409f97a64e66428f82d75cbfd7cf31f7.: keystone.exception.RoleNotFound: Could not find role: 409f97a64e66428f82d75cbfd7cf31f7. May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 07 21:57:04.429562 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:57:04.430983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 409f97a64e66428f82d75cbfd7cf31f7. May 07 21:57:04.430983 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:04.432857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.433456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.433746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.434023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.435175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.435434 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2042/4102] 10.222.0.32 () {58 vars in 1367 bytes} [Sat May 7 21:57:04 2022] GET /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/409f97a64e66428f82d75cbfd7cf31f7 => generated 110 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 21:57:04.436341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.437028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.447939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78cba-876c-4107-baa9-fda5af843e60 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.453282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.455729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.455729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.455729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/409f97a64e66428f82d75cbfd7cf31f7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.463236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7e2f641c9ebb41939e1b1b9f5d83a2fb, role_id=409f97a64e66428f82d75cbfd7cf31f7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.465022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Could not find role: 409f97a64e66428f82d75cbfd7cf31f7.: keystone.exception.RoleNotFound: Could not find role: 409f97a64e66428f82d75cbfd7cf31f7. May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 07 21:57:04.489973 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:57:04.490864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 409f97a64e66428f82d75cbfd7cf31f7. May 07 21:57:04.490864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:04.493724 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2043/4103] 10.222.0.32 () {58 vars in 1368 bytes} [Sat May 7 21:57:04 2022] HEAD /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb/roles/409f97a64e66428f82d75cbfd7cf31f7 => generated 0 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) May 07 21:57:04.496943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.519040 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2061/4104] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:04 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:04.525183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.532090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe61944-b02c-4b63-a63f-a7163ee790da tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.639659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.641079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.641258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe10781-49b4-44d3-9136-5596fdaa1c32 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.641375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.641375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.652995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorizing `identity:delete_trust(trust_id=7e2f641c9ebb41939e1b1b9f5d83a2fb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.654699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.655631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.658648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.661170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.661803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.663648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.667033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.687217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7e2f641c9ebb41939e1b1b9f5d83a2fb', 'request_id': 'req-a952dd64-be37-411e-9288-e782485b187b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.703361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7e2f641c9ebb41939e1b1b9f5d83a2fb', 'request_id': 'req-a952dd64-be37-411e-9288-e782485b187b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.704303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7e2f641c9ebb41939e1b1b9f5d83a2fb', 'request_id': 'req-a952dd64-be37-411e-9288-e782485b187b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:04.723336 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2062/4105] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:04 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:04.727449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.730910 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2044/4106] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 21:57:04 2022] DELETE /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:04.731066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:04.732482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.739087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:04.746377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999815c0-b2a1-4c7b-b793-fbfa2edccd0b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.758189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.758479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.759131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.759418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.761591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.763941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.764983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a952dd64-be37-411e-9288-e782485b187b tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.776676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '075ae78137da4282b154de465180018d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '97c4b13f7c2448e38167942ca7f346a6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-562113226', 'tempest-NotDelegatedRole-381202713'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.780055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.780676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.781163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] PATH_INFO: `/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.781488 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2063/4107] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:04 2022] GET /identity/v3/roles => generated 1891 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:04.786201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Could not find trust: 7e2f641c9ebb41939e1b1b9f5d83a2fb.: keystone.exception.TrustNotFound: Could not find trust: 7e2f641c9ebb41939e1b1b9f5d83a2fb. May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 07 21:57:04.802962 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7e2f641c9ebb41939e1b1b9f5d83a2fb. May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:04.804331 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2045/4108] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:57:04 2022] GET /identity/v3/OS-TRUST/trusts/7e2f641c9ebb41939e1b1b9f5d83a2fb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:57:04.807707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac39e7-95c6-47c0-9860-5030add8428a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.811045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.814469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:04.819963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.823351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.823919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.824817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.825949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.827764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.849595 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2064/4109] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:04 2022] GET /identity/v3/roles => generated 1891 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:04.862662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:04.906434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c73e2f-38dd-4fba-ac41-6f23faf3dd24 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.916104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe199694-ea9b-4643-ae61-3479739503d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.919350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199694-ea9b-4643-ae61-3479739503d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.924700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199694-ea9b-4643-ae61-3479739503d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.926154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe199694-ea9b-4643-ae61-3479739503d6 admin admin] PATH_INFO: `/v3/projects/90177783152c4dc4a2e6f648c21653cb/users/a67155b4c41d44958a9202de82230946/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.933915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60c276-8f85-4e9f-966b-c9a6afb327f2 tempest-TrustsV3TestJSON-1150526291 tempest-user-1296367692] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:04.944012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:04.945849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:04.946529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:04.947165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/409f97a64e66428f82d75cbfd7cf31f7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:04.949734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=409f97a64e66428f82d75cbfd7cf31f7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.953331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:04.976542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe199694-ea9b-4643-ae61-3479739503d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90177783152c4dc4a2e6f648c21653cb, user_id=a67155b4c41d44958a9202de82230946, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:04.981242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe199694-ea9b-4643-ae61-3479739503d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:05.012485 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2065/4110] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:04 2022] PUT /identity/v3/projects/90177783152c4dc4a2e6f648c21653cb/users/a67155b4c41d44958a9202de82230946/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:05.017904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:05.018187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:05.019198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:05.025742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 409f97a64e66428f82d75cbfd7cf31f7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:05.026102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.027593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.037632 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2046/4111] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:04 2022] DELETE /identity/v3/roles/409f97a64e66428f82d75cbfd7cf31f7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:05.038934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:05.040774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:05.070499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] MFA Rules not processed for user `a67155b4c41d44958a9202de82230946`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:05.072260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:05.196277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fd9a7-7358-4d06-a139-ea11965ddbb1 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:05.197524 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2066/4112] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:05.205371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:05.207316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:05.217351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:05.218922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:05.220670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:05.220969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:05.224831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6d0b7a7b7b4f42fc9142f1ae4924dcfc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:05.230045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:05.312697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 6d0b7a7b7b4f42fc9142f1ae4924dcfc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:05.313209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.314424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.319254 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2047/4113] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:05 2022] DELETE /identity/v3/roles/6d0b7a7b7b4f42fc9142f1ae4924dcfc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:05.325114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:05.328295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:05.343309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80b71f-b92f-4039-aa48-749476da9463 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:05.457056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e336d-6e53-4ca6-b17d-1f8791bec05f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:05.472547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:05.474296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:05.474798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:05.475445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:05.475797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:05.476133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:05.476295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users/075ae78137da4282b154de465180018d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:05.476711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:05.479661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_user(user_id=075ae78137da4282b154de465180018d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:05.480781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:05.482080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:05.483300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:05.543755 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2067/4114] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:05 2022] POST /identity/v3/projects => generated 365 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:05.547221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:05.550207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:05.591219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075ae78137da4282b154de465180018d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.603111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075ae78137da4282b154de465180018d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.604513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075ae78137da4282b154de465180018d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.618347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075ae78137da4282b154de465180018d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.634427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075ae78137da4282b154de465180018d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:05.677369 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2048/4115] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:05 2022] DELETE /identity/v3/users/075ae78137da4282b154de465180018d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:05.680079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:05.682696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:05.714224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d4197-4854-45cd-a25f-5ff295e188cc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:05.881562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52efda-cf63-4c9a-968d-5ad12510cce2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:05.882429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:05.884382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:05.884382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:05.885415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:05.886221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:05.893567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:05.893860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:05.894534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:05.895928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:05.896382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/97c4b13f7c2448e38167942ca7f346a6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:05.898006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=97c4b13f7c2448e38167942ca7f346a6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:05.901810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:05.949829 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2068/4116] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:05 2022] POST /identity/v3/users => generated 289 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:05.955705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:05.965394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:06.004986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f1ded-1670-47d3-8f95-63f273ed198d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.024546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.025904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.026433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.027118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.028063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.030127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.045085 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2069/4117] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:06.051858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.065823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d27db4-f679-414d-858e-7ce6bbade697 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.082761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c4b13f7c2448e38167942ca7f346a6', 'request_id': 'req-62cf0732-045c-4931-851a-e7d8148d633a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:06.104210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c4b13f7c2448e38167942ca7f346a6', 'request_id': 'req-62cf0732-045c-4931-851a-e7d8148d633a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:06.127883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c4b13f7c2448e38167942ca7f346a6', 'request_id': 'req-62cf0732-045c-4931-851a-e7d8148d633a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:06.169518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] The token cache is being invalidate because project 97c4b13f7c2448e38167942ca7f346a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:06.171708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:06.172924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:06.183275 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2049/4118] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:05 2022] DELETE /identity/v3/projects/97c4b13f7c2448e38167942ca7f346a6 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:06.185920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.189499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:06.195673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.196856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.198080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.198370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] PATH_INFO: `/v3/projects/6b38ca9e91234b1cba5b04a824cace7d/users/6da0b9d59688411a9b5e47336dba6c70/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.243855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b38ca9e91234b1cba5b04a824cace7d, user_id=6da0b9d59688411a9b5e47336dba6c70, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.250416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.291738 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2070/4119] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:06 2022] PUT /identity/v3/projects/6b38ca9e91234b1cba5b04a824cace7d/users/6da0b9d59688411a9b5e47336dba6c70/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:06.295460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.305722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:06.402280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0732-045c-4931-851a-e7d8148d633a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.493842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f86d6-97b7-4d7f-bb71-cc3a4a815099 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.506927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.507243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.507512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.508327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.509196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.510196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.538258 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2071/4120] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:06.539684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.558697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b876d24-adbb-4e27-88c3-9b567f3356a9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.567686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582385a-b284-4e4f-9282-7f0de11d2f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.569403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582385a-b284-4e4f-9282-7f0de11d2f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.569880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582385a-b284-4e4f-9282-7f0de11d2f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.570675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582385a-b284-4e4f-9282-7f0de11d2f6d admin admin] PATH_INFO: `/v3/projects/6b38ca9e91234b1cba5b04a824cace7d/users/6da0b9d59688411a9b5e47336dba6c70/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.575994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582385a-b284-4e4f-9282-7f0de11d2f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b38ca9e91234b1cba5b04a824cace7d, user_id=6da0b9d59688411a9b5e47336dba6c70, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.581405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582385a-b284-4e4f-9282-7f0de11d2f6d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.582438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.584005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.584450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.584944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.587107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.591288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.609727 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2072/4121] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:06 2022] PUT /identity/v3/projects/6b38ca9e91234b1cba5b04a824cace7d/users/6da0b9d59688411a9b5e47336dba6c70/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:06.613011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a60ed-4df0-4279-bd1a-06e60950e203 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.613677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a60ed-4df0-4279-bd1a-06e60950e203 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.614136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a60ed-4df0-4279-bd1a-06e60950e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.648329 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2050/4122] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:57:06 2022] POST /identity/v3/projects => generated 329 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:06.649848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.676963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-310a60ed-4df0-4279-bd1a-06e60950e203 None None] MFA Rules not processed for user `6da0b9d59688411a9b5e47336dba6c70`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:06.682079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-310a60ed-4df0-4279-bd1a-06e60950e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:06.826121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ac998-68c1-46fb-8640-2a5a7b270043 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.838279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.839149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.839489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.840095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.842382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.850001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.884137 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2073/4123] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:06.893185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a60ed-4df0-4279-bd1a-06e60950e203 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.900418 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2051/4124] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:06 2022] POST /identity/v3/users => generated 413 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:06.901384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.914391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28014535-ae6d-4052-8a74-29dc5ba3203c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.919654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.920612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.920908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.921189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.921936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.924664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.925471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a60ed-4df0-4279-bd1a-06e60950e203 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.943922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:06.944621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:06.944908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:06.945306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:06.946064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:06.950437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:06.952616 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2052/4125] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:06 2022] POST /identity/v3/roles => generated 243 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:06.956946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:06.979588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d4d52-6b4d-4940-b474-04c27610a072 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:06.981562 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2074/4126] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 21:57:06 2022] POST /identity/v3/domains => generated 276 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:06.986583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.109423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.110621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.111065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.111504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.114083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.116036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.128305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2d4b-6627-47c9-a03c-0fca4a510b91 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.141154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.142265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.142898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.143700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.144900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.148076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.157463 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2053/4127] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:06 2022] POST /identity/v3/roles => generated 247 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:07.161769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.194236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a671a6a-5378-4a78-bba9-b2a17de3ba63 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.207888 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2075/4128] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:06 2022] POST /identity/v3/users => generated 348 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:07.213993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.217356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.218406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.218800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.220283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/fd86e3c9f1f640feb5611b82be171a39/users/d6cdd1c0336d45a8b8ea970e5ba749b5/roles/8fd4cd8a709e466182d92cb42bce2749` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.232919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ce71-2ecd-4c34-80aa-345a28984a8a tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.244478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.245335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.245644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.245970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.246813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.249095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd86e3c9f1f640feb5611b82be171a39, user_id=d6cdd1c0336d45a8b8ea970e5ba749b5, role_id=8fd4cd8a709e466182d92cb42bce2749)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.249644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.253050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.273020 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2054/4129] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:07 2022] PUT /identity/v3/projects/fd86e3c9f1f640feb5611b82be171a39/users/d6cdd1c0336d45a8b8ea970e5ba749b5/roles/8fd4cd8a709e466182d92cb42bce2749 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:07.278416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.286446 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2076/4130] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:07 2022] POST /identity/v3/users => generated 323 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:07.291100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.306733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6381be-3181-4abd-85be-520060ee6253 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.383438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285eb92-7c5a-4af3-9541-015186c1b8cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.394073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.395695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.396510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.397105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/fd86e3c9f1f640feb5611b82be171a39/users/d6cdd1c0336d45a8b8ea970e5ba749b5/roles/f552bdf0713246a18801ec944a6b3509` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.403239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd86e3c9f1f640feb5611b82be171a39, user_id=d6cdd1c0336d45a8b8ea970e5ba749b5, role_id=f552bdf0713246a18801ec944a6b3509)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.407954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.418488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.420746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.422853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.423542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users/9ce57a68b2c44d4baf8c1d068086c115` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.437837 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2055/4131] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:07 2022] PUT /identity/v3/projects/fd86e3c9f1f640feb5611b82be171a39/users/d6cdd1c0336d45a8b8ea970e5ba749b5/roles/f552bdf0713246a18801ec944a6b3509 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:07.441937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.450027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:get_user(user_id=9ce57a68b2c44d4baf8c1d068086c115)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.454915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.457823 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2077/4132] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 21:57:07 2022] GET /identity/v3/users/9ce57a68b2c44d4baf8c1d068086c115 => generated 348 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:07.464052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.481623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404a3a9-8fa7-416d-a4d9-bf621e2b9b95 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.580064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc5f15-ed69-4301-b404-c3949dd78aad tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.583525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.585635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.585943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.586290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.587369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Adding query filter params (domain_id=e378012dcd364196a8beaa34a7ee6bd4) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:07.587816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.592618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.595725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630c409-2dfe-48ed-a75e-e5a63a318cbf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.597805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c409-2dfe-48ed-a75e-e5a63a318cbf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.598251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c409-2dfe-48ed-a75e-e5a63a318cbf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.598688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c409-2dfe-48ed-a75e-e5a63a318cbf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.599799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630c409-2dfe-48ed-a75e-e5a63a318cbf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.601852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630c409-2dfe-48ed-a75e-e5a63a318cbf tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.620551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2078/4133] 10.222.0.32 () {58 vars in 1206 bytes} [Sat May 7 21:57:07 2022] GET /identity/v3/users?domain_id=e378012dcd364196a8beaa34a7ee6bd4 => generated 485 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:07.625201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.637134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d95f4-f0f6-41b2-9980-d1a97a01dd21 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.643980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.644940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.645233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.645516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.646427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.649524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.694012 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2079/4134] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:07 2022] GET /identity/v3/users => generated 9869 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:07.701690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.708805 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2056/4135] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:07 2022] GET /identity/v3/users => generated 9869 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:07.712669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029615b-96aa-4140-9d68-0e09b41b6b69 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.713076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029615b-96aa-4140-9d68-0e09b41b6b69 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.714986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029615b-96aa-4140-9d68-0e09b41b6b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.723452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4f530-522d-47ed-b066-afc7fbf3dd48 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.732877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.733847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.734224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.734638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.736158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1830839573) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:07.736448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.739319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.769263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2080/4136] 10.222.0.32 () {58 vars in 1188 bytes} [Sat May 7 21:57:07 2022] GET /identity/v3/users?name=tempest-test_user-1830839573 => generated 476 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:07.776223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.798822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4029615b-96aa-4140-9d68-0e09b41b6b69 None None] MFA Rules not processed for user `d6cdd1c0336d45a8b8ea970e5ba749b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:07.801442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce617e1-1050-4825-aa88-0e5f53b0453b tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.802599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4029615b-96aa-4140-9d68-0e09b41b6b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:07.833841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.834745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.835260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.836065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.836974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:07.837359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.839660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.888465 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2081/4137] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 21:57:07 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:07.889849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:07.920217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d91917-1dfc-44e7-bb67-a898e6bfab82 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:07.935111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:07.936545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.936992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.937388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users/0915c2dd76294b299b8800aa8fdaabde` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.948282 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2057/4138] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:07 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:07.950118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd307f-6ae7-4eef-94f0-d7866be17872 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:07.950118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd307f-6ae7-4eef-94f0-d7866be17872 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:07.950435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd307f-6ae7-4eef-94f0-d7866be17872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:07.968395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0915c2dd76294b299b8800aa8fdaabde)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:07.971170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:07.974563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b1cd307f-6ae7-4eef-94f0-d7866be17872 None None] MFA Rules not processed for user `d6cdd1c0336d45a8b8ea970e5ba749b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:07.976599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b1cd307f-6ae7-4eef-94f0-d7866be17872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:07.995381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2058/4139] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:07 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:07.996461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd307f-6ae7-4eef-94f0-d7866be17872 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:08.012479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd307f-6ae7-4eef-94f0-d7866be17872 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:08.021585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6cdd1c0336d45a8b8ea970e5ba749b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd86e3c9f1f640feb5611b82be171a39', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1537542214', 'tempest-DelegatedRole-513378942'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:08.022114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:08.022475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:08.022723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:08.023543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] RBAC: Authorizing `identity:create_trust()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:08.025746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:08.056792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0915c2dd76294b299b8800aa8fdaabde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.057627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0915c2dd76294b299b8800aa8fdaabde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.071740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0915c2dd76294b299b8800aa8fdaabde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.073952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0915c2dd76294b299b8800aa8fdaabde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.093056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0915c2dd76294b299b8800aa8fdaabde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.154270 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2082/4140] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:07 2022] DELETE /identity/v3/users/0915c2dd76294b299b8800aa8fdaabde => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:08.158100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:08.160076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 67, in parse_isotime May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) May 07 21:57:08.180950 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 69, in parse_isotime May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise ValueError(str(e)) May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post May 07 21:57:08.181964 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( May 07 21:57:08.183002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date May 07 21:57:08.183002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) May 07 21:57:08.183002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date May 07 21:57:08.183002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() May 07 21:57:08.183002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. May 07 21:57:08.183002 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:08.183002 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2059/4141] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:57:07 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 187 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 21:57:08.189220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:08.191786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:08.253734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea0a6d-2678-40cd-8066-9e4835af161c tempest-TrustsV3TestJSON-2127816412 tempest-user-350515504] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:08.346424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:08.348091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:08.348382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:08.348811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/f552bdf0713246a18801ec944a6b3509` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:08.351804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f552bdf0713246a18801ec944a6b3509)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:08.355130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:08.356200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0456f-20c1-4f0b-b60d-dd974714aeb4 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:08.370310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:08.374673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:08.376348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:08.376801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/users/9ce57a68b2c44d4baf8c1d068086c115` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:08.381737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9ce57a68b2c44d4baf8c1d068086c115)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:08.387726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:08.435876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role f552bdf0713246a18801ec944a6b3509 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:08.436215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.437253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.443520 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2060/4142] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:08 2022] DELETE /identity/v3/roles/f552bdf0713246a18801ec944a6b3509 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:08.449018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:08.451393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:08.492694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce57a68b2c44d4baf8c1d068086c115'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.493436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce57a68b2c44d4baf8c1d068086c115'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.515029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce57a68b2c44d4baf8c1d068086c115'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.518054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce57a68b2c44d4baf8c1d068086c115'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.540860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce57a68b2c44d4baf8c1d068086c115'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.581734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2083/4143] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:08 2022] DELETE /identity/v3/users/9ce57a68b2c44d4baf8c1d068086c115 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:08.587863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:08.595506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:08.598738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeee1bc-12a9-47d5-b6be-8d0a4e07ee8f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:08.741423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514034-c637-43b3-9d53-bccdb19661da tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:08.747746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:08.748841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:08.749221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:08.749651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/domains/e378012dcd364196a8beaa34a7ee6bd4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:08.751331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e378012dcd364196a8beaa34a7ee6bd4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:08.753072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:08.755733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:08.761520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:08.761819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:08.762605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/8fd4cd8a709e466182d92cb42bce2749` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:08.764751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8fd4cd8a709e466182d92cb42bce2749)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:08.769236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:08.792793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.794991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.849117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 8fd4cd8a709e466182d92cb42bce2749 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:08.849452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.849967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.851896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.858038 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2084/4144] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 21:57:08 2022] PATCH /identity/v3/domains/e378012dcd364196a8beaa34a7ee6bd4 => generated 277 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:08.862249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:08.867390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:08.875296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:08.885040 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2061/4145] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:08 2022] DELETE /identity/v3/roles/8fd4cd8a709e466182d92cb42bce2749 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:08.886184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:08.892611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:09.057954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feb05b-c438-48fa-b43e-63c684e7e4bc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:09.067350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:09.068875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:09.069293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:09.069891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users/d6cdd1c0336d45a8b8ea970e5ba749b5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:09.071323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d6cdd1c0336d45a8b8ea970e5ba749b5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:09.080945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:09.084067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6b49f-ee1d-4f1a-8db2-c93de9666058 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:09.153054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cdd1c0336d45a8b8ea970e5ba749b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.162565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cdd1c0336d45a8b8ea970e5ba749b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.163452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cdd1c0336d45a8b8ea970e5ba749b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.164898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cdd1c0336d45a8b8ea970e5ba749b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.176946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cdd1c0336d45a8b8ea970e5ba749b5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.226042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da0b9d59688411a9b5e47336dba6c70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b38ca9e91234b1cba5b04a824cace7d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:09.227851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:09.228254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:09.228676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] PATH_INFO: `/v3/domains/e378012dcd364196a8beaa34a7ee6bd4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:09.231283 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2062/4146] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:08 2022] DELETE /identity/v3/users/d6cdd1c0336d45a8b8ea970e5ba749b5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:09.236154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:09.239589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:09.257555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e378012dcd364196a8beaa34a7ee6bd4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:09.261852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:09.310505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.317373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.356623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeaa69-73ff-47f5-9e92-118947c01fa9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:09.371248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:09.372423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:09.372423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:09.373470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/fd86e3c9f1f640feb5611b82be171a39` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:09.376359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd86e3c9f1f640feb5611b82be171a39)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:09.381050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:09.414988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4', 'request_id': 'req-8f5245c8-22ef-4290-a016-d937a5844a24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.433134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4', 'request_id': 'req-8f5245c8-22ef-4290-a016-d937a5844a24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.462128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4', 'request_id': 'req-8f5245c8-22ef-4290-a016-d937a5844a24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.489176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] The token cache is being invalidate because project e378012dcd364196a8beaa34a7ee6bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:09.489545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.491661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd86e3c9f1f640feb5611b82be171a39', 'request_id': 'req-52b3740c-e45e-4c6c-9939-5111b3a96173'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.493699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.508439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd86e3c9f1f640feb5611b82be171a39', 'request_id': 'req-52b3740c-e45e-4c6c-9939-5111b3a96173'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.513553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4', 'request_id': 'req-8f5245c8-22ef-4290-a016-d937a5844a24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.520491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4', 'request_id': 'req-8f5245c8-22ef-4290-a016-d937a5844a24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.521387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e378012dcd364196a8beaa34a7ee6bd4', 'request_id': 'req-8f5245c8-22ef-4290-a016-d937a5844a24'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.533099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd86e3c9f1f640feb5611b82be171a39', 'request_id': 'req-52b3740c-e45e-4c6c-9939-5111b3a96173'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.539006 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2085/4147] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 21:57:08 2022] DELETE /identity/v3/domains/e378012dcd364196a8beaa34a7ee6bd4 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:09.543352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:09.550604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:09.564084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] The token cache is being invalidate because project fd86e3c9f1f640feb5611b82be171a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:09.564422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.565629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.577989 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2063/4148] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:09 2022] DELETE /identity/v3/projects/fd86e3c9f1f640feb5611b82be171a39 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:09.579293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:09.582836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:09.752150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5245c8-22ef-4290-a016-d937a5844a24 tempest-UsersV3TestJSON-677722037 tempest-UsersV3TestJSON-677722037-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:09.775777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3740c-e45e-4c6c-9939-5111b3a96173 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:09.789861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:09.790555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:09.791331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:09.791660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:09.792422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:09.795787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:09.833533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:09.841822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:09.841955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:09.842368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] PATH_INFO: `/v3/users/a67155b4c41d44958a9202de82230946` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:09.845194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67155b4c41d44958a9202de82230946)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:09.848066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:09.862015 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2064/4149] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:57:09 2022] POST /identity/v3/projects => generated 328 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:09.866866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:09.943370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67155b4c41d44958a9202de82230946'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.944672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67155b4c41d44958a9202de82230946'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.956883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67155b4c41d44958a9202de82230946'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.964399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67155b4c41d44958a9202de82230946'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.974244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2fdc5-efa5-4c03-82a9-dbd4330ce45c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:09.981625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:09.982362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:09.982948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:09.983238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:09.983964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:09.986138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4fb09135-6506-4aa3-9a1b-359cf032b4fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67155b4c41d44958a9202de82230946'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:09.987550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:10.021983 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2065/4150] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:09 2022] POST /identity/v3/users => generated 416 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:10.023186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:10.025583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:10.033683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2086/4151] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:09 2022] DELETE /identity/v3/users/a67155b4c41d44958a9202de82230946 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:10.039197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.039799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.040190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.049325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8a410-5789-481b-a0f0-480dea192b33 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:10.068703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:10.071140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:10.166592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:10.168038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.168481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.168913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.169807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:10.172069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:10.210471 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2066/4152] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:10 2022] POST /identity/v3/roles => generated 244 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:10.214400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:10.224029 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2087/4153] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:10.241187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:10.242628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:10.243589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408fefc-25ca-4848-9d66-aa4128004cb8 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:10.253431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:10.254636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.255315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.255967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.257693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:10.272895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:10.308343 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2067/4154] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:10 2022] POST /identity/v3/roles => generated 246 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:10.318019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:10.331618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0247-2e3f-49cc-bfcf-84e9c5cee588 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:10.335268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac012eed-adce-4e7b-9eae-97432ad13f52 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:10.335711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:10.336980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.336980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.336980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.343612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:10.345578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.346115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.346669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/518214b0e1924065a36a82fd7d803323/users/49d61d5db68e409495794bb95dbdf7bf/roles/06892247ab44463eaa45c3d8cf32a052` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.350205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:10.352361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:10.362939 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2088/4155] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:10.371902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=518214b0e1924065a36a82fd7d803323, user_id=49d61d5db68e409495794bb95dbdf7bf, role_id=06892247ab44463eaa45c3d8cf32a052)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:10.376392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:10.404272 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2068/4156] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:10 2022] PUT /identity/v3/projects/518214b0e1924065a36a82fd7d803323/users/49d61d5db68e409495794bb95dbdf7bf/roles/06892247ab44463eaa45c3d8cf32a052 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:10.407369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:10.425011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22353fd-0512-42c2-b0b8-563da4b578f4 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:10.527909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb009f0-b2bb-4041-ad62-60980908f048 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:10.528774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb009f0-b2bb-4041-ad62-60980908f048 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.529012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb009f0-b2bb-4041-ad62-60980908f048 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.529293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb009f0-b2bb-4041-ad62-60980908f048 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/518214b0e1924065a36a82fd7d803323/users/49d61d5db68e409495794bb95dbdf7bf/roles/37477d6df4734c27aa78865e07e34ca6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.532882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb009f0-b2bb-4041-ad62-60980908f048 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=518214b0e1924065a36a82fd7d803323, user_id=49d61d5db68e409495794bb95dbdf7bf, role_id=37477d6df4734c27aa78865e07e34ca6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:10.535834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb009f0-b2bb-4041-ad62-60980908f048 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:10.561198 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2089/4157] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:10 2022] PUT /identity/v3/projects/518214b0e1924065a36a82fd7d803323/users/49d61d5db68e409495794bb95dbdf7bf/roles/37477d6df4734c27aa78865e07e34ca6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:10.562032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:10.576997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d969fa-2d0c-49ac-854e-0d9c528f1a8b tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:10.722693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6cde07-09cd-4c3e-bfb3-fa4a3efa0e59 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:10.723679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cde07-09cd-4c3e-bfb3-fa4a3efa0e59 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.726667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cde07-09cd-4c3e-bfb3-fa4a3efa0e59 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.728577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6cde07-09cd-4c3e-bfb3-fa4a3efa0e59 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.729388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cde07-09cd-4c3e-bfb3-fa4a3efa0e59 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:10.731368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6cde07-09cd-4c3e-bfb3-fa4a3efa0e59 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:10.826304 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2069/4158] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:10 2022] GET /identity/v3/users => generated 8944 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:10.828012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee1ac-1605-4eae-9ef3-7077e4cf3cfc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:10.828407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee1ac-1605-4eae-9ef3-7077e4cf3cfc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:10.828864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee1ac-1605-4eae-9ef3-7077e4cf3cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:10.959104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d33ee1ac-1605-4eae-9ef3-7077e4cf3cfc None None] MFA Rules not processed for user `49d61d5db68e409495794bb95dbdf7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:10.961369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d33ee1ac-1605-4eae-9ef3-7077e4cf3cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:11.152889 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2090/4159] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:10 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:11.162930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784d916-6f0e-4012-938f-397f5df65e71 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.165575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784d916-6f0e-4012-938f-397f5df65e71 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.165995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784d916-6f0e-4012-938f-397f5df65e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.204827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a784d916-6f0e-4012-938f-397f5df65e71 None None] MFA Rules not processed for user `49d61d5db68e409495794bb95dbdf7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:11.208498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a784d916-6f0e-4012-938f-397f5df65e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:11.233402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2070/4160] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:11 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:11.238361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ee1ac-1605-4eae-9ef3-7077e4cf3cfc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.267038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ee1ac-1605-4eae-9ef3-7077e4cf3cfc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.279157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.287190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.287772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.290374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.292761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:create_trust()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.299646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.446071 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2091/4161] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:57:11 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:11.450254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784d916-6f0e-4012-938f-397f5df65e71 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.459134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784d916-6f0e-4012-938f-397f5df65e71 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.465080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.466709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.467315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.467782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.481792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:get_trust(trust_id=e85e9e2c03444e6480d73feb57e46c2d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.484855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.496288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2071/4162] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:57:11 2022] GET /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d => generated 834 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:11.500694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.512813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f1e74-bd90-4ec5-8594-d945c1b325b3 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.519500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.521243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.522231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.522689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.530914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=e85e9e2c03444e6480d73feb57e46c2d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.533760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.552473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.553373 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2092/4163] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:57:11 2022] GET /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles => generated 371 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:11.564738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb53a9b-e5ae-45c5-a0d1-356447a1d4bf tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.570359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.571711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.572140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.572549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/06892247ab44463eaa45c3d8cf32a052` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.584275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e85e9e2c03444e6480d73feb57e46c2d, role_id=06892247ab44463eaa45c3d8cf32a052)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.586229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.625274 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2072/4164] 10.222.0.32 () {58 vars in 1367 bytes} [Sat May 7 21:57:11 2022] GET /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/06892247ab44463eaa45c3d8cf32a052 => generated 244 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:11.627011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.639483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5e7ff-73fd-48f1-8b2d-d435e3db627d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.655700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.658957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.659263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.659619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/06892247ab44463eaa45c3d8cf32a052` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.667622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e85e9e2c03444e6480d73feb57e46c2d, role_id=06892247ab44463eaa45c3d8cf32a052)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.669293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.683772 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2093/4165] 10.222.0.32 () {58 vars in 1368 bytes} [Sat May 7 21:57:11 2022] HEAD /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/06892247ab44463eaa45c3d8cf32a052 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 07 21:57:11.686236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.699266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc276db-597e-4c7f-aeb2-ee947970399d tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.709725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.712655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.713173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.713598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/37477d6df4734c27aa78865e07e34ca6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.721299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e85e9e2c03444e6480d73feb57e46c2d, role_id=37477d6df4734c27aa78865e07e34ca6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.723223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Could not find role: 37477d6df4734c27aa78865e07e34ca6.: keystone.exception.RoleNotFound: Could not find role: 37477d6df4734c27aa78865e07e34ca6. May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 07 21:57:11.740762 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:57:11.742633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 37477d6df4734c27aa78865e07e34ca6. May 07 21:57:11.742633 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:11.746448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2073/4166] 10.222.0.32 () {58 vars in 1367 bytes} [Sat May 7 21:57:11 2022] GET /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/37477d6df4734c27aa78865e07e34ca6 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:57:11.748361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.773543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d5b58-4b14-4dd6-9e24-260e1166f9ba tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.782705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.783708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.783852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.784287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/37477d6df4734c27aa78865e07e34ca6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.795494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:get_role_for_trust(trust_id=e85e9e2c03444e6480d73feb57e46c2d, role_id=37477d6df4734c27aa78865e07e34ca6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.797158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Could not find role: 37477d6df4734c27aa78865e07e34ca6.: keystone.exception.RoleNotFound: Could not find role: 37477d6df4734c27aa78865e07e34ca6. May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 07 21:57:11.817698 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:57:11.818989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 37477d6df4734c27aa78865e07e34ca6. May 07 21:57:11.818989 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:57:11.822273 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2094/4167] 10.222.0.32 () {58 vars in 1368 bytes} [Sat May 7 21:57:11 2022] HEAD /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d/roles/37477d6df4734c27aa78865e07e34ca6 => generated 0 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) May 07 21:57:11.823499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.836980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b8ca1-291b-4d9e-9eb2-3059a5ada494 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.842143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.843094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.843373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.847418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.855227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorizing `identity:delete_trust(trust_id=e85e9e2c03444e6480d73feb57e46c2d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:11.857197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:11.878195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e85e9e2c03444e6480d73feb57e46c2d', 'request_id': 'req-91da0f47-1a51-43fe-9a86-755e1a7045e6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:11.885876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e85e9e2c03444e6480d73feb57e46c2d', 'request_id': 'req-91da0f47-1a51-43fe-9a86-755e1a7045e6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:11.886907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e85e9e2c03444e6480d73feb57e46c2d', 'request_id': 'req-91da0f47-1a51-43fe-9a86-755e1a7045e6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:11.897825 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2074/4168] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 21:57:11 2022] DELETE /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:11.899185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.901412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:11.915617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71f30c-2a99-4b7f-beb8-b80dc63525db tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.921167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d61d5db68e409495794bb95dbdf7bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '518214b0e1924065a36a82fd7d803323', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-454141133', 'tempest-DelegatedRole-1873344282'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.922482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.922855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.923051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] PATH_INFO: `/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Could not find trust: e85e9e2c03444e6480d73feb57e46c2d.: keystone.exception.TrustNotFound: Could not find trust: e85e9e2c03444e6480d73feb57e46c2d. May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 07 21:57:11.937016 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e85e9e2c03444e6480d73feb57e46c2d. May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:57:11.939251 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2095/4169] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:57:11 2022] GET /identity/v3/OS-TRUST/trusts/e85e9e2c03444e6480d73feb57e46c2d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 21:57:11.942905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:11.944376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:11.978106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0f47-1a51-43fe-9a86-755e1a7045e6 tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:11.986387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:11.987882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:11.988398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:11.988944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/37477d6df4734c27aa78865e07e34ca6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:12.010263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=37477d6df4734c27aa78865e07e34ca6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:12.022933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:12.072121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:12.074165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:12.105387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 37477d6df4734c27aa78865e07e34ca6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:12.105690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.106671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.114124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2075/4170] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:11 2022] DELETE /identity/v3/roles/37477d6df4734c27aa78865e07e34ca6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:12.115557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:12.117209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:12.236963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd8e4-87f0-4ae3-9099-a88755eff7e0 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:12.247512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:12.248433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:12.248908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:12.249205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/06892247ab44463eaa45c3d8cf32a052` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:12.252833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=06892247ab44463eaa45c3d8cf32a052)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:12.255016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:12.305841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec3ce8-07a9-411f-ade3-1f526073611e tempest-TrustsV3TestJSON-904847776 tempest-user-1230146839] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:12.360752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 06892247ab44463eaa45c3d8cf32a052 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:12.361116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.361884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.364288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2076/4171] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:12 2022] DELETE /identity/v3/roles/06892247ab44463eaa45c3d8cf32a052 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:12.369553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:12.373476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:12.470929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:12.472157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:12.472459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:12.472721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] PATH_INFO: `/v3/projects/90177783152c4dc4a2e6f648c21653cb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:12.474594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] RBAC: Authorizing `identity:delete_project(project_id=90177783152c4dc4a2e6f648c21653cb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:12.477115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:12.507714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c444c-cd9d-463a-af3b-1c9523b9e94f tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:12.513254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:12.514389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:12.514748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:12.515139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users/49d61d5db68e409495794bb95dbdf7bf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:12.517722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49d61d5db68e409495794bb95dbdf7bf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:12.519885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:12.547719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90177783152c4dc4a2e6f648c21653cb', 'request_id': 'req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.555801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90177783152c4dc4a2e6f648c21653cb', 'request_id': 'req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.569487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90177783152c4dc4a2e6f648c21653cb', 'request_id': 'req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.590260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] The token cache is being invalidate because project 90177783152c4dc4a2e6f648c21653cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:12.590465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.591330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.597053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2096/4172] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:12 2022] DELETE /identity/v3/projects/90177783152c4dc4a2e6f648c21653cb => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:12.597346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d61d5db68e409495794bb95dbdf7bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.601436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:12.604531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:12.615587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d61d5db68e409495794bb95dbdf7bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.617221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d61d5db68e409495794bb95dbdf7bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.618456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d61d5db68e409495794bb95dbdf7bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.643700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d61d5db68e409495794bb95dbdf7bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.680507 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2077/4173] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:12 2022] DELETE /identity/v3/users/49d61d5db68e409495794bb95dbdf7bf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:12.685945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:12.688809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:12.759683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc40b3f-1bea-4b4c-831f-0c3e396ee3de admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:12.824516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497338d-f293-4185-b5f4-bf72d08c39f2 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:12.832881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:12.835875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:12.836398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:12.837065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/518214b0e1924065a36a82fd7d803323` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:12.839805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=518214b0e1924065a36a82fd7d803323)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:12.842754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:12.897759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:12.898681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:12.898681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:12.899050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] PATH_INFO: `/v3/users/6da0b9d59688411a9b5e47336dba6c70` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:12.900382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da0b9d59688411a9b5e47336dba6c70)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:12.902432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:12.913714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518214b0e1924065a36a82fd7d803323', 'request_id': 'req-28b3e6d8-0baa-490e-8ffb-df7430080e7d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.923051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518214b0e1924065a36a82fd7d803323', 'request_id': 'req-28b3e6d8-0baa-490e-8ffb-df7430080e7d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.933577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518214b0e1924065a36a82fd7d803323', 'request_id': 'req-28b3e6d8-0baa-490e-8ffb-df7430080e7d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.947633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] The token cache is being invalidate because project 518214b0e1924065a36a82fd7d803323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:12.947944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.949329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.954163 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2078/4174] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:12 2022] DELETE /identity/v3/projects/518214b0e1924065a36a82fd7d803323 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:12.966515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:12.968373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:12.974099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da0b9d59688411a9b5e47336dba6c70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.975369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da0b9d59688411a9b5e47336dba6c70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.985708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da0b9d59688411a9b5e47336dba6c70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:12.986554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da0b9d59688411a9b5e47336dba6c70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:13.031874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da0b9d59688411a9b5e47336dba6c70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:13.053888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e6d8-0baa-490e-8ffb-df7430080e7d tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.065500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.067183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.068759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.069337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.071015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.073295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.076129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2097/4175] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:12 2022] DELETE /identity/v3/users/6da0b9d59688411a9b5e47336dba6c70 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:13.118871 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2079/4176] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 21:57:12 2022] POST /identity/v3/projects => generated 328 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:13.120338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.122850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:13.131810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.136840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:13.210198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662fd41-387a-4fb9-b563-4ea7b2f1603a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.237744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0ea01-0d96-416b-a746-3fb975ff4f8c tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.247101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.248758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.249058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.249304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.249930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.252528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.288042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2080/4177] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:13 2022] POST /identity/v3/users => generated 413 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:13.292891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.324771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.325724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.326071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.326596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] PATH_INFO: `/v3/users/2c615ca825f6488fbdddff03a048b94b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.328214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c615ca825f6488fbdddff03a048b94b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.330482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.331347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ba4f-d3a9-4069-93df-3c8c3eb6e0b9 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.339449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.340321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.340674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.340933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.341944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.344015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.366213 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2081/4178] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:13 2022] POST /identity/v3/roles => generated 244 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:13.371812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.395869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c615ca825f6488fbdddff03a048b94b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:13.396632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c615ca825f6488fbdddff03a048b94b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:13.407455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c615ca825f6488fbdddff03a048b94b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:13.408567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c615ca825f6488fbdddff03a048b94b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:13.412058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58895aa-2226-4363-aa2f-123322345d85 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.422120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.424790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.425250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.425782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.426564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c615ca825f6488fbdddff03a048b94b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:13.427188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.429255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.457661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2082/4179] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 21:57:13 2022] POST /identity/v3/roles => generated 247 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:13.462529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.464364 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2098/4180] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:13 2022] DELETE /identity/v3/users/2c615ca825f6488fbdddff03a048b94b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:13.467149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:13.510173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cc1aa-b73c-4fcf-8d74-62fe771a4018 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.635851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.637700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.637700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.637961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/9b7b85985b5b45ac89b26aff6b5648bc/users/09c5235ebcbc4f91bc6bf6854686d812/roles/7daa0c4791a240a08799ecd15f87b2be` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.667703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9b7b85985b5b45ac89b26aff6b5648bc, user_id=09c5235ebcbc4f91bc6bf6854686d812, role_id=7daa0c4791a240a08799ecd15f87b2be)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.674694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.674971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.676346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:13.707046 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2083/4181] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:13 2022] PUT /identity/v3/projects/9b7b85985b5b45ac89b26aff6b5648bc/users/09c5235ebcbc4f91bc6bf6854686d812/roles/7daa0c4791a240a08799ecd15f87b2be => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:13.713004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.764011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5749b-bbec-4943-85ae-30b87f842216 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.864569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286087b8-12cc-4714-9c32-6d0ce37c9045 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:13.881146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.882371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.884404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.884947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/9b7b85985b5b45ac89b26aff6b5648bc/users/09c5235ebcbc4f91bc6bf6854686d812/roles/6b95c0f1c4ef470ab69bf622b7344b85` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.890493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9b7b85985b5b45ac89b26aff6b5648bc, user_id=09c5235ebcbc4f91bc6bf6854686d812, role_id=6b95c0f1c4ef470ab69bf622b7344b85)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.898495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.902613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:13.905134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:13.905583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:13.905873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] PATH_INFO: `/v3/projects/6b38ca9e91234b1cba5b04a824cace7d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:13.910025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b38ca9e91234b1cba5b04a824cace7d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:13.914043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:13.932682 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2084/4182] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:13 2022] PUT /identity/v3/projects/9b7b85985b5b45ac89b26aff6b5648bc/users/09c5235ebcbc4f91bc6bf6854686d812/roles/6b95c0f1c4ef470ab69bf622b7344b85 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:13.934499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:13.936757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.009745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b38ca9e91234b1cba5b04a824cace7d', 'request_id': 'req-eb43e449-4808-4752-bfcb-9d3159865d1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.019660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b38ca9e91234b1cba5b04a824cace7d', 'request_id': 'req-eb43e449-4808-4752-bfcb-9d3159865d1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.031430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b38ca9e91234b1cba5b04a824cace7d', 'request_id': 'req-eb43e449-4808-4752-bfcb-9d3159865d1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.035195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5473ba-dcbe-4adf-b6dd-4ea2750032cd tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.050672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] The token cache is being invalidate because project 6b38ca9e91234b1cba5b04a824cace7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:14.050832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.052150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.058079 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2099/4183] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:13 2022] DELETE /identity/v3/projects/6b38ca9e91234b1cba5b04a824cace7d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:14.058079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.059890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.107027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.108319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.109281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.109770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] PATH_INFO: `/v3/projects/bdb8a8a58b5b4b9b95ac9d6a782df6af` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.111313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb8a8a58b5b4b9b95ac9d6a782df6af)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.113945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.169685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e449-4808-4752-bfcb-9d3159865d1e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.175165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'request_id': 'req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.188909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'request_id': 'req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.215593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb8a8a58b5b4b9b95ac9d6a782df6af', 'request_id': 'req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.230244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] The token cache is being invalidate because project bdb8a8a58b5b4b9b95ac9d6a782df6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:14.230559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.231353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d7b2373d-bf72-4ea5-ac1e-44b524cfd6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:14.236441 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2085/4184] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:13 2022] DELETE /identity/v3/projects/bdb8a8a58b5b4b9b95ac9d6a782df6af => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:14.236441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1422d-dc7b-4353-81c4-e0d79e73b521 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.236441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1422d-dc7b-4353-81c4-e0d79e73b521 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.236441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1422d-dc7b-4353-81c4-e0d79e73b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.254803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8b844-f2dc-4aa0-8232-a82cb3141ede tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.259422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5fa1422d-dc7b-4353-81c4-e0d79e73b521 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:14.259619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b844-f2dc-4aa0-8232-a82cb3141ede tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.260099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b844-f2dc-4aa0-8232-a82cb3141ede tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.260409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8b844-f2dc-4aa0-8232-a82cb3141ede tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.261185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5fa1422d-dc7b-4353-81c4-e0d79e73b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.261397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8b844-f2dc-4aa0-8232-a82cb3141ede tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.263742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8b844-f2dc-4aa0-8232-a82cb3141ede tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.298600 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2100/4185] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/users => generated 8363 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:14.304309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711976-a5ed-4ea6-9117-67daa77ba065 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.304309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711976-a5ed-4ea6-9117-67daa77ba065 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.304309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711976-a5ed-4ea6-9117-67daa77ba065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.323486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e7711976-a5ed-4ea6-9117-67daa77ba065 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:14.324567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e7711976-a5ed-4ea6-9117-67daa77ba065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.350381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2086/4186] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:14.350381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f147a0-02ce-49f6-8c1a-bc41f371d79d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.350381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f147a0-02ce-49f6-8c1a-bc41f371d79d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.350381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f147a0-02ce-49f6-8c1a-bc41f371d79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.350845 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2101/4187] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:14.352204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362931-b71e-46e2-b9f1-c65e1015e1b7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.352636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362931-b71e-46e2-b9f1-c65e1015e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.352990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362931-b71e-46e2-b9f1-c65e1015e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.377611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a5362931-b71e-46e2-b9f1-c65e1015e1b7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:14.379342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a5362931-b71e-46e2-b9f1-c65e1015e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.395442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2102/4188] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:14.395442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25396d-fd12-4f68-9a03-0acec287714b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.395442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25396d-fd12-4f68-9a03-0acec287714b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.395442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25396d-fd12-4f68-9a03-0acec287714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.397064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-09f147a0-02ce-49f6-8c1a-bc41f371d79d None None] MFA Rules not processed for user `09c5235ebcbc4f91bc6bf6854686d812`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:14.398315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-09f147a0-02ce-49f6-8c1a-bc41f371d79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.413707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6d25396d-fd12-4f68-9a03-0acec287714b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:14.414973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6d25396d-fd12-4f68-9a03-0acec287714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.425082 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2103/4189] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:14.429522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25396d-fd12-4f68-9a03-0acec287714b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.441162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25396d-fd12-4f68-9a03-0acec287714b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.447545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.448226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.448513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.448949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.449940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:14.450272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.454545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.475855 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2104/4190] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:14.476747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.497289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b2443-3457-4f2d-b321-16231b9f41fe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.506261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.507079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.507371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.507657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.509242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:14.509555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.511978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.523868 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2087/4191] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:14.525312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f147a0-02ce-49f6-8c1a-bc41f371d79d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.531222 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2105/4192] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:14.532203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.547063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f147a0-02ce-49f6-8c1a-bc41f371d79d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.554173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caef661-5f3a-4baf-8bdf-86d28380019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.554999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caef661-5f3a-4baf-8bdf-86d28380019d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.555508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caef661-5f3a-4baf-8bdf-86d28380019d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.555508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caef661-5f3a-4baf-8bdf-86d28380019d admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.556349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caef661-5f3a-4baf-8bdf-86d28380019d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.558764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caef661-5f3a-4baf-8bdf-86d28380019d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.559985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67a611-eac8-4180-b2b0-ab23b3423bac admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.569290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.569963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.570251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.570566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.571326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.573423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.590754 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2088/4193] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:14.593067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e79d9-b956-43ac-9259-95cfb3b1c4d3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.593067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e79d9-b956-43ac-9259-95cfb3b1c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.593316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e79d9-b956-43ac-9259-95cfb3b1c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.611361 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2106/4194] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/projects => generated 399 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:14.612419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.615706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-255e79d9-b956-43ac-9259-95cfb3b1c4d3 None None] MFA Rules not processed for user `09c5235ebcbc4f91bc6bf6854686d812`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:14.617257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-255e79d9-b956-43ac-9259-95cfb3b1c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:14.687323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2089/4195] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:14.688492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305e7b8-8b98-4fb3-90da-ddb5eef73a8f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.688612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e79d9-b956-43ac-9259-95cfb3b1c4d3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.695400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.696073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.696359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.696643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.697338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.699400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.702059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e79d9-b956-43ac-9259-95cfb3b1c4d3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.707203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.707881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.708169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.708447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.709186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.711714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.723429 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2107/4196] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:14.723429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.731627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c22799-5e92-4dbd-a952-af90da5accac admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.737969 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2090/4197] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/users => generated 300 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:14.737969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.738912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.739667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.740001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.740233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.740962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:create_trust()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.742215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.748057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197b3d8-5bb4-4a61-b345-3f0de6094fc2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.753796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.754578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.755173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.755499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.756292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.758085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.773355 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2091/4198] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/roles => generated 1893 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:14.774540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.785213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a68f9e-5ab7-45a3-bbd6-9866d52ce7f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.791736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.792489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.792777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.793079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.793800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.795461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.807659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2092/4199] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/roles => generated 1893 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:14.808586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.819832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b78edc-3dac-4c16-aaa5-b41fd8ffa5c6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.824500 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2108/4200] 10.222.0.32 () {60 vars in 1173 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:14.824893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.825322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.825497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.825604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.825874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.826586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.828516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.839530 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2093/4201] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/roles => generated 1893 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:14.840414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.842063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0c407-d3f2-47ee-b19c-2ab4247a45ec tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.848211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.848905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.849215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.849470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.850243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.852010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.852438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f6f69-28f2-4f66-b88f-f8549805beae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.859158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.861606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.861886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.862162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.868160 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2109/4202] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/roles => generated 1893 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:14.868160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.869822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:get_trust(trust_id=30610f8ef9f840a3a05f3582763d39cc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.871364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.877618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f6c95-ffa1-49f0-b92b-b54215c9237a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.879830 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2094/4203] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc => generated 835 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:14.880664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.885234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.886344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.886591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.887016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] PATH_INFO: `/v3/projects/052f0094370f47d18b9cc63699ce2c8b/users/7b0bcdf2fd6f409b8f8ea2cbe591a225/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.894601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1b78b-401e-48e2-9e91-0b95a4e0305c tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:14.899685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306329-139c-45ed-8289-8431915b82f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:14.900567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306329-139c-45ed-8289-8431915b82f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.900849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306329-139c-45ed-8289-8431915b82f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.901128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306329-139c-45ed-8289-8431915b82f0 admin admin] PATH_INFO: `/v3/projects/5b718fc4c73641a28b46218d8905b4bb/users/4053e69846a7440f8d7978a5a4b7eec5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.904215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=052f0094370f47d18b9cc63699ce2c8b, user_id=7b0bcdf2fd6f409b8f8ea2cbe591a225, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.907531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.917066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306329-139c-45ed-8289-8431915b82f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b718fc4c73641a28b46218d8905b4bb, user_id=4053e69846a7440f8d7978a5a4b7eec5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:14.920221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306329-139c-45ed-8289-8431915b82f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:14.921312 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2110/4204] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:14 2022] PUT /identity/v3/projects/052f0094370f47d18b9cc63699ce2c8b/users/7b0bcdf2fd6f409b8f8ea2cbe591a225/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:14.922927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:14.947386 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2095/4205] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:14 2022] PUT /identity/v3/projects/5b718fc4c73641a28b46218d8905b4bb/users/4053e69846a7440f8d7978a5a4b7eec5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:14.947386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b542-122c-414e-b836-96a0e53668e8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:14.947386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b542-122c-414e-b836-96a0e53668e8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:14.947386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08b542-122c-414e-b836-96a0e53668e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:14.972528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ec08b542-122c-414e-b836-96a0e53668e8 None None] MFA Rules not processed for user `7b0bcdf2fd6f409b8f8ea2cbe591a225`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:14.973866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ec08b542-122c-414e-b836-96a0e53668e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:15.001608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae1794-e2d3-4cb3-bd5c-078f465f21bd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.049342 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2096/4206] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:15.050928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800d21-0ddf-4b52-a23e-610fd155a1c5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.051223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800d21-0ddf-4b52-a23e-610fd155a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.051503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de800d21-0ddf-4b52-a23e-610fd155a1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.059774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.060600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.061070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.061638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.069912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=30610f8ef9f840a3a05f3582763d39cc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.071622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.071738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-de800d21-0ddf-4b52-a23e-610fd155a1c5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:15.072966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-de800d21-0ddf-4b52-a23e-610fd155a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:15.082796 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2111/4207] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 21:57:14 2022] GET /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles => generated 371 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:15.082796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.107917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923ddd9-9534-4f1a-a1bc-0bf0d5651644 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.113502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b0bcdf2fd6f409b8f8ea2cbe591a225', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052f0094370f47d18b9cc63699ce2c8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.114725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.115073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.115378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] PATH_INFO: `/v3/domains/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.116666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.119013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.124238 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2112/4208] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 21:57:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:15.126221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.143416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb4962-01e4-4900-985f-7732e2b5f54a tempest-DefaultDomainTestJSON-1948604217 tempest-DefaultDomainTestJSON-1948604217-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.147811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2097/4209] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:15.152311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.152547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800d21-0ddf-4b52-a23e-610fd155a1c5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.153563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.153885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.154347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/7daa0c4791a240a08799ecd15f87b2be` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.162602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:get_role_for_trust(trust_id=30610f8ef9f840a3a05f3582763d39cc, role_id=7daa0c4791a240a08799ecd15f87b2be)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.164124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.164551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de800d21-0ddf-4b52-a23e-610fd155a1c5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.173319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.175091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.175374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.175653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] PATH_INFO: `/v3/users/7b0bcdf2fd6f409b8f8ea2cbe591a225` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.180018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b0bcdf2fd6f409b8f8ea2cbe591a225)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.182411 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2113/4210] 10.222.0.32 () {58 vars in 1367 bytes} [Sat May 7 21:57:15 2022] GET /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/7daa0c4791a240a08799ecd15f87b2be => generated 244 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:15.183680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.185505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:15.186186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.282745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b0bcdf2fd6f409b8f8ea2cbe591a225'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.283482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57473-6218-4900-a291-37e4aed7e9ad tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.289135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.290054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.290452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.290747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.295067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b0bcdf2fd6f409b8f8ea2cbe591a225'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.296698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b0bcdf2fd6f409b8f8ea2cbe591a225'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.305187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.306512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b0bcdf2fd6f409b8f8ea2cbe591a225'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.307356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.320534 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2114/4211] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:15.321534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.323796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-debc1e1d-5973-494c-9199-c8c07faf4d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b0bcdf2fd6f409b8f8ea2cbe591a225'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.334696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09df187-61f8-4426-8e53-d70c29046fb3 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.340343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.341228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.341450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.341730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/7daa0c4791a240a08799ecd15f87b2be` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.349965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:get_role_for_trust(trust_id=30610f8ef9f840a3a05f3582763d39cc, role_id=7daa0c4791a240a08799ecd15f87b2be)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.352937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.364211 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2115/4212] 10.222.0.32 () {58 vars in 1368 bytes} [Sat May 7 21:57:15 2022] HEAD /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/7daa0c4791a240a08799ecd15f87b2be => generated 0 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 07 21:57:15.369010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.372244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:15.373051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2098/4213] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:15 2022] DELETE /identity/v3/users/7b0bcdf2fd6f409b8f8ea2cbe591a225 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:15.377663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.378066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.378506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.392527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ea3ca-c631-416e-8b75-84eb9f4aa281 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.401557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:15.403298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:15.498493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.501408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.501986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.503115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/6b95c0f1c4ef470ab69bf622b7344b85` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.511214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:get_role_for_trust(trust_id=30610f8ef9f840a3a05f3582763d39cc, role_id=6b95c0f1c4ef470ab69bf622b7344b85)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.513397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.517340 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2099/4214] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:15.524856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.527785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Could not find role: 6b95c0f1c4ef470ab69bf622b7344b85.: keystone.exception.RoleNotFound: Could not find role: 6b95c0f1c4ef470ab69bf622b7344b85. May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 07 21:57:15.532843 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:57:15.538132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 6b95c0f1c4ef470ab69bf622b7344b85. May 07 21:57:15.538132 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:57:15.538132 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2116/4215] 10.222.0.32 () {58 vars in 1367 bytes} [Sat May 7 21:57:15 2022] GET /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/6b95c0f1c4ef470ab69bf622b7344b85 => generated 110 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:57:15.542699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.557174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d440d-3f3c-4b72-bba8-9749c6834fb5 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.568758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.570880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.570880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.570880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/6b95c0f1c4ef470ab69bf622b7344b85` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.577291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:get_role_for_trust(trust_id=30610f8ef9f840a3a05f3582763d39cc, role_id=6b95c0f1c4ef470ab69bf622b7344b85)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.579453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Could not find role: 6b95c0f1c4ef470ab69bf622b7344b85.: keystone.exception.RoleNotFound: Could not find role: 6b95c0f1c4ef470ab69bf622b7344b85. May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get May 07 21:57:15.599585 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 21:57:15.600484 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 6b95c0f1c4ef470ab69bf622b7344b85. May 07 21:57:15.600484 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 21:57:15.602156 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2117/4216] 10.222.0.32 () {58 vars in 1368 bytes} [Sat May 7 21:57:15 2022] HEAD /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc/roles/6b95c0f1c4ef470ab69bf622b7344b85 => generated 0 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:57:15.607084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.626355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bb243-df40-4daa-9cfe-a2d921dcd195 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.637312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.638154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.638435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.638712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.655680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorizing `identity:delete_trust(trust_id=30610f8ef9f840a3a05f3582763d39cc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.659843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.683873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec575b9-147c-4393-bdb2-33d0331534bd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.689259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.691634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.692009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.692393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.705540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '30610f8ef9f840a3a05f3582763d39cc', 'request_id': 'req-7d6c3960-bc82-4132-a3c0-7df1106d78b6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.706335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.708585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:15.722715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '30610f8ef9f840a3a05f3582763d39cc', 'request_id': 'req-7d6c3960-bc82-4132-a3c0-7df1106d78b6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.724762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '30610f8ef9f840a3a05f3582763d39cc', 'request_id': 'req-7d6c3960-bc82-4132-a3c0-7df1106d78b6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:15.726698 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2100/4217] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:15.739733 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2118/4218] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 21:57:15 2022] DELETE /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:15.744474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.758699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6302d-3727-414d-bb5c-6dd654dd2b45 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.765648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09c5235ebcbc4f91bc6bf6854686d812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b7b85985b5b45ac89b26aff6b5648bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1468505185', 'tempest-NotDelegatedRole-1986572951'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.767985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.768279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.769215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] PATH_INFO: `/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Could not find trust: 30610f8ef9f840a3a05f3582763d39cc.: keystone.exception.TrustNotFound: Could not find trust: 30610f8ef9f840a3a05f3582763d39cc. May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) May 07 21:57:15.788552 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 30610f8ef9f840a3a05f3582763d39cc. May 07 21:57:15.790478 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:15.793626 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2101/4219] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 21:57:15 2022] GET /identity/v3/OS-TRUST/trusts/30610f8ef9f840a3a05f3582763d39cc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 21:57:15.795637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:15.798253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:15.931723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c3960-bc82-4132-a3c0-7df1106d78b6 tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:15.947604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:15.948514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:15.948848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:15.949132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/6b95c0f1c4ef470ab69bf622b7344b85` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:15.950901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6b95c0f1c4ef470ab69bf622b7344b85)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:15.952556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:16.026842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 6b95c0f1c4ef470ab69bf622b7344b85 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:16.027768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.029993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.043797 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2119/4220] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:15 2022] DELETE /identity/v3/roles/6b95c0f1c4ef470ab69bf622b7344b85 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:16.049235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:16.052818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:16.089242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2419625-e40d-4f9c-8dc3-b00c3ee54d3e tempest-TrustsV3TestJSON-357005778 tempest-user-406317663] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:16.207626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:16.208495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:16.208896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:16.209262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/roles/7daa0c4791a240a08799ecd15f87b2be` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:16.212575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7daa0c4791a240a08799ecd15f87b2be)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:16.215261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:16.291324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invalidating the token cache because role 7daa0c4791a240a08799ecd15f87b2be has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:16.291545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.292134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.298424 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2102/4221] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:16 2022] DELETE /identity/v3/roles/7daa0c4791a240a08799ecd15f87b2be => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:16.300386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:16.321665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493ed9e-aacd-40c7-8a75-a37068e15556 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:16.432714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:16.434392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:16.434693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:16.435007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/users/09c5235ebcbc4f91bc6bf6854686d812` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:16.439696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_user(user_id=09c5235ebcbc4f91bc6bf6854686d812)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:16.439696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:16.441208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:16.442637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:16.581292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74baeb-8cda-412b-ad44-38ef3a055690 tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:16.592113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c5235ebcbc4f91bc6bf6854686d812'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.594980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c5235ebcbc4f91bc6bf6854686d812'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.609839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c5235ebcbc4f91bc6bf6854686d812'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.610454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:16.611721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:16.612076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:16.612711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] PATH_INFO: `/v3/projects/052f0094370f47d18b9cc63699ce2c8b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:16.612850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c5235ebcbc4f91bc6bf6854686d812'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.615210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052f0094370f47d18b9cc63699ce2c8b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:16.622933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:16.628222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52caeb19-abbf-4bae-bd86-def0aa195ffc tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c5235ebcbc4f91bc6bf6854686d812'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.667916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2120/4222] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:16 2022] DELETE /identity/v3/users/09c5235ebcbc4f91bc6bf6854686d812 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:16.673040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33890b02-323d-458d-8773-2e2ab04a3880 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:16.673328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33890b02-323d-458d-8773-2e2ab04a3880 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:16.673611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33890b02-323d-458d-8773-2e2ab04a3880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:16.708495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052f0094370f47d18b9cc63699ce2c8b', 'request_id': 'req-db73a71f-3c32-4395-97cb-15f4fbf178d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.716748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052f0094370f47d18b9cc63699ce2c8b', 'request_id': 'req-db73a71f-3c32-4395-97cb-15f4fbf178d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.727853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-33890b02-323d-458d-8773-2e2ab04a3880 None None] MFA Rules not processed for user `4053e69846a7440f8d7978a5a4b7eec5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:16.728267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052f0094370f47d18b9cc63699ce2c8b', 'request_id': 'req-db73a71f-3c32-4395-97cb-15f4fbf178d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.729397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33890b02-323d-458d-8773-2e2ab04a3880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:16.749162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] The token cache is being invalidate because project 052f0094370f47d18b9cc63699ce2c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:16.749667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.750152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.752553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2103/4223] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:16 2022] DELETE /identity/v3/projects/052f0094370f47d18b9cc63699ce2c8b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:16.753708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:16.755245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:16.808920 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2121/4224] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:16.810566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372d144-9b6b-4055-a323-1190e6182c92 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:16.810878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372d144-9b6b-4055-a323-1190e6182c92 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:16.811157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372d144-9b6b-4055-a323-1190e6182c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:16.841332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d372d144-9b6b-4055-a323-1190e6182c92 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:16.843918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d372d144-9b6b-4055-a323-1190e6182c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:16.860344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73a71f-3c32-4395-97cb-15f4fbf178d9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:16.868657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83840364aae4c148bda4e78836c798f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b11a4cbd98d43d08962b6409c937292', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:16.869952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:16.870419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:16.870726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] PATH_INFO: `/v3/projects/9b7b85985b5b45ac89b26aff6b5648bc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:16.874269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b7b85985b5b45ac89b26aff6b5648bc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:16.877586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:16.911347 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2122/4225] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:16.913042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607327-397d-4f6d-a12a-2dad801db654 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:16.913350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607327-397d-4f6d-a12a-2dad801db654 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:16.913762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa607327-397d-4f6d-a12a-2dad801db654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:16.935388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-aa607327-397d-4f6d-a12a-2dad801db654 None None] MFA Rules not processed for user `4053e69846a7440f8d7978a5a4b7eec5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:16.936107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7b85985b5b45ac89b26aff6b5648bc', 'request_id': 'req-f886679d-790a-4910-ba9e-558956398b9a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.938882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aa607327-397d-4f6d-a12a-2dad801db654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:16.946653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7b85985b5b45ac89b26aff6b5648bc', 'request_id': 'req-f886679d-790a-4910-ba9e-558956398b9a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.957945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7b85985b5b45ac89b26aff6b5648bc', 'request_id': 'req-f886679d-790a-4910-ba9e-558956398b9a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.976429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] The token cache is being invalidate because project 9b7b85985b5b45ac89b26aff6b5648bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:16.976831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.978354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:16.981178 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2104/4226] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:16 2022] DELETE /identity/v3/projects/9b7b85985b5b45ac89b26aff6b5648bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:16.988484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:16.990353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.014290 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2123/4227] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:17.015704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.016615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.016958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.036155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:17.037481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.072104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886679d-790a-4910-ba9e-558956398b9a tempest-TrustsV3TestJSON-1538282423 tempest-TrustsV3TestJSON-1538282423-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.077282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.078160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.078553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.078914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] PATH_INFO: `/v3/users/c5fb1e26138348a981a7a7db5a7ffbf9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.080145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fb1e26138348a981a7a7db5a7ffbf9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.082179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.105216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2124/4228] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:17.106128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.107504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.139975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fb1e26138348a981a7a7db5a7ffbf9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.148558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fb1e26138348a981a7a7db5a7ffbf9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.149797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fb1e26138348a981a7a7db5a7ffbf9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.150600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fb1e26138348a981a7a7db5a7ffbf9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.160802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fb1e26138348a981a7a7db5a7ffbf9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.183618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2105/4229] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:16 2022] DELETE /identity/v3/users/c5fb1e26138348a981a7a7db5a7ffbf9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:17.184597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.186185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.225449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cb5c4-cc27-4bd2-b57d-6f08bbe51471 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.269724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b936f4-42c7-45d1-a78b-a3cc605a1d94 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.275761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b8213-8c73-4388-b56e-48283130d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.276438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b8213-8c73-4388-b56e-48283130d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.276722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b8213-8c73-4388-b56e-48283130d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.277017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b8213-8c73-4388-b56e-48283130d2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.277775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b8213-8c73-4388-b56e-48283130d2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:17.278093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b8213-8c73-4388-b56e-48283130d2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.279758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b8213-8c73-4388-b56e-48283130d2bd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.292436 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2106/4230] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:17.293858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605186e-1f45-4663-8c4c-bd775965d452 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.294193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605186e-1f45-4663-8c4c-bd775965d452 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.294555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605186e-1f45-4663-8c4c-bd775965d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.299032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.299734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.300022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.300345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.302304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.313890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c605186e-1f45-4663-8c4c-bd775965d452 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:17.315074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c605186e-1f45-4663-8c4c-bd775965d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.323401 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2107/4231] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:17.324262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605186e-1f45-4663-8c4c-bd775965d452 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.336338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605186e-1f45-4663-8c4c-bd775965d452 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.341077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.341733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.342063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.342443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.343236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.345338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.379005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.379228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2108/4232] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:17 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:17.379228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.379377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.379784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.388281 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2125/4233] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:17.389816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.404009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb886e1-3964-4585-a288-b8926c45a830 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.461009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079f7e9-cf62-4c11-86db-cb26cc5b7fb0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.464740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.465388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.465670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.465944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.481747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.482429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.482724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.483687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.483781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.486631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.533449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2126/4234] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:17 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:17.535730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.555062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca63cb-c468-44a1-a4ea-2d343a3ffd6f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.558078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.559963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.565483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.566260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.566680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.566992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.567944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.571243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.573448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2109/4235] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:17.587542 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2127/4236] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:17.592569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.607095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5da08-d428-4a7d-b581-ab8d15f8c9e9 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.625378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.626341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.626735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.627178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.628664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.629864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.644472 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2110/4237] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:17.648673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.661565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fe298-bb80-478a-9599-c333cc215e3a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.662520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.664849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.667892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df5fe4-a279-4127-a656-40f986ec50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.669078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df5fe4-a279-4127-a656-40f986ec50b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.669196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df5fe4-a279-4127-a656-40f986ec50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.669542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df5fe4-a279-4127-a656-40f986ec50b5 admin admin] PATH_INFO: `/v3/projects/e64baa9e7ce443849496765bec96a0da/users/164452b7018c472a97b67c7a567edfbb/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.682658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b7164-0780-4319-969b-02df4fc07390 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.689997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.691480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.691597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.692009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] PATH_INFO: `/v3/users/7262be0d7db141e69bdf493bd7a5505a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.693128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7262be0d7db141e69bdf493bd7a5505a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.694970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df5fe4-a279-4127-a656-40f986ec50b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64baa9e7ce443849496765bec96a0da, user_id=164452b7018c472a97b67c7a567edfbb, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.695199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.698568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df5fe4-a279-4127-a656-40f986ec50b5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.721353 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2128/4238] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:17 2022] PUT /identity/v3/projects/e64baa9e7ce443849496765bec96a0da/users/164452b7018c472a97b67c7a567edfbb/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:17.732785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea179-6bd4-4796-8e1b-630ccef709e4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.733080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea179-6bd4-4796-8e1b-630ccef709e4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.733359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea179-6bd4-4796-8e1b-630ccef709e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.765533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7262be0d7db141e69bdf493bd7a5505a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.765745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a36ea179-6bd4-4796-8e1b-630ccef709e4 None None] MFA Rules not processed for user `164452b7018c472a97b67c7a567edfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:17.767387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a36ea179-6bd4-4796-8e1b-630ccef709e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.774453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7262be0d7db141e69bdf493bd7a5505a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.775190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7262be0d7db141e69bdf493bd7a5505a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.775819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7262be0d7db141e69bdf493bd7a5505a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.788830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0258c95b-cbb7-4e23-a511-ad8504b22a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7262be0d7db141e69bdf493bd7a5505a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:17.819274 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2111/4239] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:17 2022] DELETE /identity/v3/users/7262be0d7db141e69bdf493bd7a5505a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:17.824814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.825109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.825810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.853460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:17.855589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:17.863586 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2129/4240] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:17.870025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ea179-6bd4-4796-8e1b-630ccef709e4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.881846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ea179-6bd4-4796-8e1b-630ccef709e4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:17.967571 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2112/4241] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:17.973846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:17.974627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:17.975063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:17.975533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:17.976357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=164452b7018c472a97b67c7a567edfbb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:17.978375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:17.989542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:17.992419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.033683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2130/4242] 10.222.0.32 () {60 vars in 1298 bytes} [Sat May 7 21:57:17 2022] POST /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2 => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:18.034754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.053338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa374309-317d-4702-ba48-8a5f0bf51c43 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.058711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.059706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.060058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.060359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/4655e5cf629e4d448a4e19205fabaf71` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.062653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=164452b7018c472a97b67c7a567edfbb, credential_id=4655e5cf629e4d448a4e19205fabaf71)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.068018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.091068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf9a1-c8ad-4efa-86f6-c7e030c0f6b2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.096614 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2131/4243] 10.222.0.32 () {58 vars in 1379 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/4655e5cf629e4d448a4e19205fabaf71 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:18.097000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.097792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.098079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.098358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.104197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.111328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.113092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.116603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54c17f-052f-469b-887d-8e0ae0db8244 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.124264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.125702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.127232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.127625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.129309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=164452b7018c472a97b67c7a567edfbb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.131863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.137091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2113/4244] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:18.152507 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2132/4245] 10.222.0.32 () {60 vars in 1298 bytes} [Sat May 7 21:57:18 2022] POST /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2 => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:18.158520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.171689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d15721-0a1c-492d-93e8-ba84fc36f7de service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.174817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.176821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.185969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.187442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.188779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.189172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/33ae8d448ccb4a4980c5c2d9107f7ee6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.192457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=164452b7018c472a97b67c7a567edfbb, credential_id=33ae8d448ccb4a4980c5c2d9107f7ee6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.194530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.212513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f5c22-ecaa-4ccd-add7-200754eadaf0 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.220377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.222699 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2114/4246] 10.222.0.32 () {58 vars in 1379 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/33ae8d448ccb4a4980c5c2d9107f7ee6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:18.228050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.231030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.231351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.231641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] PATH_INFO: `/v3/projects/e421113a17bc462d89b7471547fdb772` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.232978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e421113a17bc462d89b7471547fdb772)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.235758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.244348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbc3cf-aa43-482c-b3dd-737a8d9077b3 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.252818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55faa5-59b2-4b90-99e4-cb4c5eda0fb7 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.253804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55faa5-59b2-4b90-99e4-cb4c5eda0fb7 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.254089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55faa5-59b2-4b90-99e4-cb4c5eda0fb7 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.254445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55faa5-59b2-4b90-99e4-cb4c5eda0fb7 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/33ae8d448ccb4a4980c5c2d9107f7ee6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-dc55faa5-59b2-4b90-99e4-cb4c5eda0fb7 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Could not find credential: f7fcd3121918d53d33ccd7530cf3207ab08f8636efd5265ecd7d1142df61ae77.: keystone.exception.CredentialNotFound: Could not find credential: f7fcd3121918d53d33ccd7530cf3207ab08f8636efd5265ecd7d1142df61ae77. May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get May 07 21:57:18.282302 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 21:57:18.283483 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: f7fcd3121918d53d33ccd7530cf3207ab08f8636efd5265ecd7d1142df61ae77. May 07 21:57:18.284475 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:18.287332 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2115/4247] 10.222.0.32 () {58 vars in 1376 bytes} [Sat May 7 21:57:18 2022] GET /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/33ae8d448ccb4a4980c5c2d9107f7ee6 => generated 148 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 21:57:18.291504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55faa5-59b2-4b90-99e4-cb4c5eda0fb7 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.309766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e421113a17bc462d89b7471547fdb772', 'request_id': 'req-b02531c8-821d-4572-ba95-532e6f1d7ca6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.317542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55faa5-59b2-4b90-99e4-cb4c5eda0fb7 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.320328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e421113a17bc462d89b7471547fdb772', 'request_id': 'req-b02531c8-821d-4572-ba95-532e6f1d7ca6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.332470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e421113a17bc462d89b7471547fdb772', 'request_id': 'req-b02531c8-821d-4572-ba95-532e6f1d7ca6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.369450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] The token cache is being invalidate because project e421113a17bc462d89b7471547fdb772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:18.369803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.370599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.372564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2133/4248] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/projects/e421113a17bc462d89b7471547fdb772 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:18.376683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.379982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.406322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.407840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.408144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.408422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.409100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=164452b7018c472a97b67c7a567edfbb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.410966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.443029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2116/4249] 10.222.0.32 () {60 vars in 1298 bytes} [Sat May 7 21:57:18 2022] POST /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2 => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:18.447015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.451865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.471896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3cff4-2173-4ce5-ac8a-5e3569c5b96a tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.478262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.480216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.480606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.480937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.481746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=164452b7018c472a97b67c7a567edfbb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.484448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.508374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02531c8-821d-4572-ba95-532e6f1d7ca6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.513050 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2117/4250] 10.222.0.32 () {60 vars in 1298 bytes} [Sat May 7 21:57:18 2022] POST /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2 => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:18.517627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.519093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.520482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.520482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.520853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] PATH_INFO: `/v3/users/b83840364aae4c148bda4e78836c798f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.524988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83840364aae4c148bda4e78836c798f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.527201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.546359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a13d62-fd0e-407d-9166-99fe5f9d949e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.565024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.566347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.566467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.566872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.567664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=164452b7018c472a97b67c7a567edfbb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.569362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.583685 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2118/4251] 10.222.0.32 () {58 vars in 1277 bytes} [Sat May 7 21:57:18 2022] GET /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2 => generated 865 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:18.584736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.589308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.607606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f73d3-0067-486b-84e2-25be5ef51748 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.613528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.614445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.614731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.615042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] PATH_INFO: `/v3/projects/a24cf19532e0484fabd6dc4e6b66fe30` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.616240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24cf19532e0484fabd6dc4e6b66fe30)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.617023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83840364aae4c148bda4e78836c798f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.617968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83840364aae4c148bda4e78836c798f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.619132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.628011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83840364aae4c148bda4e78836c798f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.628788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83840364aae4c148bda4e78836c798f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.639530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83840364aae4c148bda4e78836c798f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.667518 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2134/4252] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/users/b83840364aae4c148bda4e78836c798f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:18.669211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.671240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.707149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24cf19532e0484fabd6dc4e6b66fe30', 'request_id': 'req-1265d27b-d010-4368-82d8-f10083b9808b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.717310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24cf19532e0484fabd6dc4e6b66fe30', 'request_id': 'req-1265d27b-d010-4368-82d8-f10083b9808b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.733177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24cf19532e0484fabd6dc4e6b66fe30', 'request_id': 'req-1265d27b-d010-4368-82d8-f10083b9808b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.753790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] The token cache is being invalidate because project a24cf19532e0484fabd6dc4e6b66fe30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:18.754115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.754915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:18.759229 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2119/4253] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/projects/a24cf19532e0484fabd6dc4e6b66fe30 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:18.761949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.768655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.799599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606c6d7-4107-4752-ba4c-7a560970f48b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.870108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.871287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.871520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.872379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/a8117a36950e4309870155f6c2f3fe1a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.874233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=164452b7018c472a97b67c7a567edfbb, credential_id=a8117a36950e4309870155f6c2f3fe1a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.876131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.885066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265d27b-d010-4368-82d8-f10083b9808b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.894088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.894619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.894997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.895301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] PATH_INFO: `/v3/users/659e06b5db2a42f8be5a2810ddb9a55b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.896752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=659e06b5db2a42f8be5a2810ddb9a55b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.899064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.905465 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2135/4254] 10.222.0.32 () {58 vars in 1379 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/a8117a36950e4309870155f6c2f3fe1a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:18.911500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:18.913947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:18.931124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3febe-7fca-46c7-ad92-a6a859702c9e tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:18.940123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:18.941425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:18.941776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:18.942238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/9be3096e20034dfc8a7602d3cec96ca6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:18.944749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=164452b7018c472a97b67c7a567edfbb, credential_id=9be3096e20034dfc8a7602d3cec96ca6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:18.947860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:18.990865 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2136/4255] 10.222.0.32 () {58 vars in 1379 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/9be3096e20034dfc8a7602d3cec96ca6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:18.996632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.019524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eaac0-d7c2-4c9a-b23e-abc27c8eff28 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:19.030090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659e06b5db2a42f8be5a2810ddb9a55b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.046487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:19.049018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.050148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.050472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.052646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=164452b7018c472a97b67c7a567edfbb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:19.059989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:19.060551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659e06b5db2a42f8be5a2810ddb9a55b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.065572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659e06b5db2a42f8be5a2810ddb9a55b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.067108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659e06b5db2a42f8be5a2810ddb9a55b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.087302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659e06b5db2a42f8be5a2810ddb9a55b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.101163 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2137/4256] 10.222.0.32 () {60 vars in 1298 bytes} [Sat May 7 21:57:18 2022] POST /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2 => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:19.102260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.104477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.123923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ed66b-134b-4ab1-b578-bef4434401dc tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:19.140414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:19.142538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.145565 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2120/4257] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:18 2022] DELETE /identity/v3/users/659e06b5db2a42f8be5a2810ddb9a55b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:19.146079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.146079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/aa7ce0f04e5e4ab08ed316d6b9df7f67` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.148619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=164452b7018c472a97b67c7a567edfbb, credential_id=aa7ce0f04e5e4ab08ed316d6b9df7f67)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:19.150543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:19.154817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2138/4258] 10.222.0.32 () {58 vars in 1376 bytes} [Sat May 7 21:57:19 2022] GET /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/aa7ce0f04e5e4ab08ed316d6b9df7f67 => generated 367 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:19.159375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.264627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4a00b-28fe-445c-aab9-9f5cae19fb02 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:19.272142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164452b7018c472a97b67c7a567edfbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e64baa9e7ce443849496765bec96a0da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:19.275071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.275368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.275668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/aa7ce0f04e5e4ab08ed316d6b9df7f67` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.285560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.288352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.293049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=164452b7018c472a97b67c7a567edfbb, credential_id=aa7ce0f04e5e4ab08ed316d6b9df7f67)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:19.298184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:19.308322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaaf8e-2d2f-4a06-affa-bde49eb20a54 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:19.326451 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2121/4259] 10.222.0.32 () {58 vars in 1379 bytes} [Sat May 7 21:57:19 2022] DELETE /identity/v3/users/164452b7018c472a97b67c7a567edfbb/credentials/OS-EC2/aa7ce0f04e5e4ab08ed316d6b9df7f67 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:19.332420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.335099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.396460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:19.398531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.398943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.401014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] PATH_INFO: `/v3/projects/0b11a4cbd98d43d08962b6409c937292` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.403261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b11a4cbd98d43d08962b6409c937292)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:19.407940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:19.429718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3a226-4170-4167-8ccb-4cefa5e0d010 tempest-EC2CredentialsTest-1332085176 tempest-EC2CredentialsTest-1332085176-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:19.436399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:19.437405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.437785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.438029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] PATH_INFO: `/v3/users/164452b7018c472a97b67c7a567edfbb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.441007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=164452b7018c472a97b67c7a567edfbb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:19.443876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:19.528504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b11a4cbd98d43d08962b6409c937292', 'request_id': 'req-436bb2b5-4db7-414c-a191-e208ca1207c1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.540130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b11a4cbd98d43d08962b6409c937292', 'request_id': 'req-436bb2b5-4db7-414c-a191-e208ca1207c1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.550526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b11a4cbd98d43d08962b6409c937292', 'request_id': 'req-436bb2b5-4db7-414c-a191-e208ca1207c1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.562183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164452b7018c472a97b67c7a567edfbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.575987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] The token cache is being invalidate because project 0b11a4cbd98d43d08962b6409c937292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:19.576889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.579376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-436bb2b5-4db7-414c-a191-e208ca1207c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.582250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164452b7018c472a97b67c7a567edfbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.583363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164452b7018c472a97b67c7a567edfbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.584408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164452b7018c472a97b67c7a567edfbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.590952 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2139/4260] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:19 2022] DELETE /identity/v3/projects/0b11a4cbd98d43d08962b6409c937292 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:19.592723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378236-1eee-46bf-8b60-e6e92e07c221 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.593056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378236-1eee-46bf-8b60-e6e92e07c221 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.593366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40378236-1eee-46bf-8b60-e6e92e07c221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.604145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-654ff205-18e6-4fa9-938b-6b6245ad0981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164452b7018c472a97b67c7a567edfbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.624470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-40378236-1eee-46bf-8b60-e6e92e07c221 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:19.627103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-40378236-1eee-46bf-8b60-e6e92e07c221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.631080 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2122/4261] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:19 2022] DELETE /identity/v3/users/164452b7018c472a97b67c7a567edfbb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:19.638347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.640126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.640415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.687262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:19.692579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.751864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2140/4262] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:19.760346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.760982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.761363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.798419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:19.799896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.811232 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2123/4263] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:19.812304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.814449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.821088 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2141/4264] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:19.825327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.827056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.838605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc2ecd-0050-4af4-b781-28f77d2f6d3c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:19.849058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:19.850128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.850438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.850712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] PATH_INFO: `/v3/projects/b29b13d7780245b19aae37562ce848cb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.852222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29b13d7780245b19aae37562ce848cb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:19.855066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:19.920517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e19257-f7ec-4281-9625-bdb974650c5d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:19.923867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29b13d7780245b19aae37562ce848cb', 'request_id': 'req-9575a4dc-22af-4d4f-b207-075929d24f44'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.931603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29b13d7780245b19aae37562ce848cb', 'request_id': 'req-9575a4dc-22af-4d4f-b207-075929d24f44'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.942092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29b13d7780245b19aae37562ce848cb', 'request_id': 'req-9575a4dc-22af-4d4f-b207-075929d24f44'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.957494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] The token cache is being invalidate because project b29b13d7780245b19aae37562ce848cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:19.958398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.959490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:19.961245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2124/4265] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:19 2022] DELETE /identity/v3/projects/b29b13d7780245b19aae37562ce848cb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:19.965365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:19.966879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:19.981402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:19.982197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:19.982555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:19.982909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:19.984991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:20.046122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575a4dc-22af-4d4f-b207-075929d24f44 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.052053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6ff9b-2d85-4ad1-94d1-34785d65c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.052778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ff9b-2d85-4ad1-94d1-34785d65c216 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.053106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ff9b-2d85-4ad1-94d1-34785d65c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.053389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6ff9b-2d85-4ad1-94d1-34785d65c216 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.054295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6ff9b-2d85-4ad1-94d1-34785d65c216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:20.054407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6ff9b-2d85-4ad1-94d1-34785d65c216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.055994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6ff9b-2d85-4ad1-94d1-34785d65c216 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.068133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.070026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.076468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2125/4266] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:20.078000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c458a0-a0dd-4c3c-86c7-542076371341 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.078369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c458a0-a0dd-4c3c-86c7-542076371341 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.078650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c458a0-a0dd-4c3c-86c7-542076371341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.088254 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2142/4267] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:20.088916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.099775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b5a76-c362-41e5-bcc4-89cc5bbead43 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.100126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a1c458a0-a0dd-4c3c-86c7-542076371341 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:20.101563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a1c458a0-a0dd-4c3c-86c7-542076371341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:20.105661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.106346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.106631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.107028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.107826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.110601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.112695 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2126/4268] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:20.121368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f7d57-ea73-4b37-b2d1-7f98e9548402 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.123357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f7d57-ea73-4b37-b2d1-7f98e9548402 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.123885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f7d57-ea73-4b37-b2d1-7f98e9548402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.145344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a86f7d57-ea73-4b37-b2d1-7f98e9548402 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:20.147711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a86f7d57-ea73-4b37-b2d1-7f98e9548402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:20.151328 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2143/4269] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:20.158024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.269059 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2127/4270] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:20.270646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f7d57-ea73-4b37-b2d1-7f98e9548402 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.283182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f7d57-ea73-4b37-b2d1-7f98e9548402 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.290489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.290963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f697b-13f9-4ded-80e4-6f7a51112824 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.291947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.292497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.292997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.294372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:20.295074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.297926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.302704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.303439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.303777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.304067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.305403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.308472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.319729 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2128/4271] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:20.321437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.335444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5f3f1-cf0b-4eb6-a9c2-0f8e59ed0c9c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.344321 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2144/4272] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:20.345773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.345930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.346909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.347427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.347930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.349094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.351555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.358759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189d82e-2882-4cf2-93a3-0ee6929d9735 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.366696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.367722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.368012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.368395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.369563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.371588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.386655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2145/4273] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:20.391513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.404147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5ddc2-fe07-45a0-bdfe-91fad4b3614e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.408392 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2129/4274] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:20.409436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.497936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.499768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.499768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.501589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.501799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.503527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.517996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86bb5e-3517-4eee-bacb-5639e9c11f7e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.528607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.529664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.529664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.529831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.530493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.533498 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2146/4275] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:20.533798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.534710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.546631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c094d-8380-4b29-9987-374b8daf6913 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.553631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.554631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.556376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.556376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] PATH_INFO: `/v3/projects/712dac3bee11461d9dc916a597736279/users/b35a7aebfcde4cd5b345abb79670d1a5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.573651 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2130/4276] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:20.575567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.590255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677fb48-9e99-46cc-b5c8-35961cb43fb3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.599572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712dac3bee11461d9dc916a597736279, user_id=b35a7aebfcde4cd5b345abb79670d1a5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.601197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.602396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.603959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.603959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.604387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.606831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.609005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.622062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2147/4277] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:20 2022] PUT /identity/v3/projects/712dac3bee11461d9dc916a597736279/users/b35a7aebfcde4cd5b345abb79670d1a5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:20.625957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.630859 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2131/4278] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:20.635709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:20.652817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.676746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06475ce-b849-4e60-9bfb-528a28ef73b0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.761633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e22938-f838-4afc-9de3-5fc3f33f20d6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.771782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.772657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.772859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575615b0-df8d-413d-8e52-c6eb19333796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.772999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.773215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] PATH_INFO: `/v3/projects/e64baa9e7ce443849496765bec96a0da` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.773844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575615b0-df8d-413d-8e52-c6eb19333796 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.774088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575615b0-df8d-413d-8e52-c6eb19333796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.774343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575615b0-df8d-413d-8e52-c6eb19333796 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.774678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64baa9e7ce443849496765bec96a0da)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.775201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575615b0-df8d-413d-8e52-c6eb19333796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:20.776934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575615b0-df8d-413d-8e52-c6eb19333796 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.777059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:20.790845 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2132/4279] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:20.792389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400d6b-5059-4570-af21-5ea674a69cec None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.792763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400d6b-5059-4570-af21-5ea674a69cec None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.793183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400d6b-5059-4570-af21-5ea674a69cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.840029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e2400d6b-5059-4570-af21-5ea674a69cec None None] MFA Rules not processed for user `b35a7aebfcde4cd5b345abb79670d1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:20.841362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e2400d6b-5059-4570-af21-5ea674a69cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:20.853484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64baa9e7ce443849496765bec96a0da', 'request_id': 'req-b472ca05-6957-408f-932b-06f30420c29c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:20.862110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64baa9e7ce443849496765bec96a0da', 'request_id': 'req-b472ca05-6957-408f-932b-06f30420c29c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:20.872214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64baa9e7ce443849496765bec96a0da', 'request_id': 'req-b472ca05-6957-408f-932b-06f30420c29c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:20.888201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] The token cache is being invalidate because project e64baa9e7ce443849496765bec96a0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:20.888547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:20.889572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:20.892366 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2148/4280] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:20 2022] DELETE /identity/v3/projects/e64baa9e7ce443849496765bec96a0da => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:20.893024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:20.896824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:20.929426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2133/4281] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:20.930926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36061f7-6cb2-41a2-87ae-1a5582cbe4b3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.931631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36061f7-6cb2-41a2-87ae-1a5582cbe4b3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:20.932079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36061f7-6cb2-41a2-87ae-1a5582cbe4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:20.955697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d36061f7-6cb2-41a2-87ae-1a5582cbe4b3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:20.957180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d36061f7-6cb2-41a2-87ae-1a5582cbe4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:20.991669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472ca05-6957-408f-932b-06f30420c29c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:20.997875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:20.999536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:20.999823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.000146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] PATH_INFO: `/v3/projects/f62f599384054f23bddfbc3b3d1abf3d/users/e412ac7281b34df69be98088aec5fd99/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.020072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62f599384054f23bddfbc3b3d1abf3d, user_id=e412ac7281b34df69be98088aec5fd99, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.023759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.040327 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2149/4282] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:20 2022] PUT /identity/v3/projects/f62f599384054f23bddfbc3b3d1abf3d/users/e412ac7281b34df69be98088aec5fd99/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:21.049290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2134/4283] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:21.050488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.052302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e6514-b0cc-4934-bfa1-70fdf40a46a1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.052676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e6514-b0cc-4934-bfa1-70fdf40a46a1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.052950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e6514-b0cc-4934-bfa1-70fdf40a46a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.079020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7d1e6514-b0cc-4934-bfa1-70fdf40a46a1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:21.080474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7d1e6514-b0cc-4934-bfa1-70fdf40a46a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:21.122424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4275e1-d3ed-47e1-8056-3660aaea1067 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.128088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61625666-9aa9-4a8b-8f3f-e9bd1d30742d tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.129045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625666-9aa9-4a8b-8f3f-e9bd1d30742d tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.129897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625666-9aa9-4a8b-8f3f-e9bd1d30742d tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.129897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61625666-9aa9-4a8b-8f3f-e9bd1d30742d tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.130661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61625666-9aa9-4a8b-8f3f-e9bd1d30742d tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:create_application_credential(user_id=b35a7aebfcde4cd5b345abb79670d1a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.131994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61625666-9aa9-4a8b-8f3f-e9bd1d30742d tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.272426 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2150/4284] 10.222.0.32 () {60 vars in 1314 bytes} [Sat May 7 21:57:21 2022] POST /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials => generated 920 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:21.274051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e14c4c-7e57-428a-85da-4fb43bd706a0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.274483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e14c4c-7e57-428a-85da-4fb43bd706a0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.274890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e14c4c-7e57-428a-85da-4fb43bd706a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.323441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e4e14c4c-7e57-428a-85da-4fb43bd706a0 None None] MFA Rules not processed for user `e412ac7281b34df69be98088aec5fd99`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:21.325772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4e14c4c-7e57-428a-85da-4fb43bd706a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:21.373368 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2135/4285] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:21.376380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e6514-b0cc-4934-bfa1-70fdf40a46a1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.407791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e6514-b0cc-4934-bfa1-70fdf40a46a1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.417194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.418871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.419320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.419806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules/420f47e4c39944d9a234d9533b79ca42` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.421318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:delete_access_rule(user_id=b35a7aebfcde4cd5b345abb79670d1a5, access_rule_id=420f47e4c39944d9a234d9533b79ca42)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.423500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.436263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2151/4286] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:21.438520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e14c4c-7e57-428a-85da-4fb43bd706a0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.452928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e14c4c-7e57-428a-85da-4fb43bd706a0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.459006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.459674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.459785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.460065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.461047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:21.461270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.465918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application session.delete(ref) May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application next(self.gen) May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application yield resource May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application next(self.gen) May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.session.rollback() May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.force_reraise() May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 07 21:57:21.479864 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise self.value May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application session.commit() May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._prepare_impl() May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.session.flush() May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._flush(objects) May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 07 21:57:21.481184 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application compat.raise_( May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application flush_context.execute() May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rec.execute(self) May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._synchronize( May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise AssertionError( May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' May 07 21:57:21.482944 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 21:57:21.487189 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2136/4287] 10.222.0.32 () {58 vars in 1361 bytes} [Sat May 7 21:57:21 2022] DELETE /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules/420f47e4c39944d9a234d9533b79ca42 => generated 89 bytes in 110 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) May 07 21:57:21.488568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.492253 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2152/4288] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:21.497259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.503949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed75154-b07e-4bf7-b43a-53a861ed6704 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.510324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.511109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.511375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.511648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.512803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.514724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.519965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc38a9a4-0a2e-4cff-b667-593ef7ff9947 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.527477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.528613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.529078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.529520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials/35eefb5807164e8eb112190131e4570f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.550916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b35a7aebfcde4cd5b345abb79670d1a5, application_credential_id=35eefb5807164e8eb112190131e4570f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.553123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.563341 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2137/4289] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:21 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:21.564529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.595148 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2153/4290] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:21 2022] DELETE /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials/35eefb5807164e8eb112190131e4570f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:21.597130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.614742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fdc6e-ed1d-49f6-8816-dfb0df9cf409 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.670752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9fe6-00a8-4d05-a0a0-b823ce2211b6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.681883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.683407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.683866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.684307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.685942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.690978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.712211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.713190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.713686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.713978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.714797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.720039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.747690 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2138/4291] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:21 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:21.748624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.760074 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2154/4292] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:21 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:21.761074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.774369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5bcfd-7d56-4fbd-bc9c-24815da50623 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.847148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e21f6e-07c9-4d88-a3c6-fb68de8499c2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.851073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.852251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.852687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.853114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.853955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.856884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.857052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.857906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.858361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.861073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.863948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:list_access_rules(user_id=b35a7aebfcde4cd5b345abb79670d1a5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.865590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.879266 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2139/4293] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:57:21 2022] GET /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules => generated 369 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:21.884987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.891217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2155/4294] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:21 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:21.892386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.907500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d03d-8992-4e66-8137-2bd91e1231b5 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.909179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674743a-effa-4851-bfa7-95818261f644 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.917524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.917839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.919175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.919462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.919686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.920050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.920154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.920247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules/420f47e4c39944d9a234d9533b79ca42` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.921112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.921918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:delete_access_rule(user_id=b35a7aebfcde4cd5b345abb79670d1a5, access_rule_id=420f47e4c39944d9a234d9533b79ca42)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.923911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.925444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.939564 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2140/4295] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:21.941408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.954729 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2156/4296] 10.222.0.32 () {58 vars in 1361 bytes} [Sat May 7 21:57:21 2022] DELETE /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules/420f47e4c39944d9a234d9533b79ca42 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:21.954729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:21.955265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62cb26-c4b4-436b-8957-533485e4da5d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.960772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.961701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.961997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.962388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.964505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:21.966424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:21.973321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f183d1-9e25-4409-9199-ed042a0f21a3 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:21.983506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:21.983506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:21.983506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:21.983506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] PATH_INFO: `/v3/projects/63a7b47ae563401ea101cae6c9c17797/users/4a7eefc77d6f45c4a1478d0af8be0ccd/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:21.986979 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2141/4297] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:21.987586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.001416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1def6-d528-4229-8d9d-85e16cc83bdd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.008395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a7b47ae563401ea101cae6c9c17797, user_id=4a7eefc77d6f45c4a1478d0af8be0ccd, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.008720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.009881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.010151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.010427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.015286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.016731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:list_access_rules(user_id=b35a7aebfcde4cd5b345abb79670d1a5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.019455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.032941 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2142/4298] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:57:21 2022] GET /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules => generated 158 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:22.032941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.048674 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2157/4299] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:21 2022] PUT /identity/v3/projects/63a7b47ae563401ea101cae6c9c17797/users/4a7eefc77d6f45c4a1478d0af8be0ccd/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:22.049401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f120153-70fa-4f0f-9a04-b3e747b15bc4 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.049903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.131096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.132294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.132630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.132852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] PATH_INFO: `/v3/projects/d435158d1ce445ce9f5644d04d7d50a2/users/9201997239fd4b528a6726cabf132be2/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.159627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d435158d1ce445ce9f5644d04d7d50a2, user_id=9201997239fd4b528a6726cabf132be2, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.163180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.169777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3ebb7-8c12-4077-bfad-2387eef4ec11 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.177728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.178691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.179133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.179417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.180170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:create_application_credential(user_id=b35a7aebfcde4cd5b345abb79670d1a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.181560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.188532 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2143/4300] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:22 2022] PUT /identity/v3/projects/d435158d1ce445ce9f5644d04d7d50a2/users/9201997239fd4b528a6726cabf132be2/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:22.189922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.300609 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2158/4301] 10.222.0.32 () {60 vars in 1314 bytes} [Sat May 7 21:57:22 2022] POST /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials => generated 921 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:22.301811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.323108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83cc1d-fecf-48f7-947c-7478e0252a99 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.327247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409adeb-6d8d-438f-8fbd-7874fe2c99c5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.331085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.333440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.333842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.334044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.334230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.334949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.335247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.335738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.335882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.336581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.338219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.338350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.356150 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2159/4302] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:22.357134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.358216 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2144/4303] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:22.360257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.374535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e302a-b586-4588-8407-b09cb3de83e8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.381568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.383027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.383319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.383627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] PATH_INFO: `/v3/projects/d435158d1ce445ce9f5644d04d7d50a2/users/9201997239fd4b528a6726cabf132be2/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.387480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d435158d1ce445ce9f5644d04d7d50a2, user_id=9201997239fd4b528a6726cabf132be2, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.393068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.429680 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2145/4304] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:22 2022] PUT /identity/v3/projects/d435158d1ce445ce9f5644d04d7d50a2/users/9201997239fd4b528a6726cabf132be2/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:22.429680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.465571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8f19d-8f09-4264-8c52-3f34ab4a353f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.527030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207be05-2163-4145-a8e5-fbaa281f9e4e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.533896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870563a-793a-43c9-8a8c-b1406d64a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.534968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870563a-793a-43c9-8a8c-b1406d64a3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.535157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870563a-793a-43c9-8a8c-b1406d64a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.535437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870563a-793a-43c9-8a8c-b1406d64a3bd admin admin] PATH_INFO: `/v3/projects/63a7b47ae563401ea101cae6c9c17797/users/4a7eefc77d6f45c4a1478d0af8be0ccd/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.537837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870563a-793a-43c9-8a8c-b1406d64a3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a7b47ae563401ea101cae6c9c17797, user_id=4a7eefc77d6f45c4a1478d0af8be0ccd, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.540716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870563a-793a-43c9-8a8c-b1406d64a3bd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.545047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20788f4-3f52-40c8-81c7-732b216294fd tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.546907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20788f4-3f52-40c8-81c7-732b216294fd tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.547681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20788f4-3f52-40c8-81c7-732b216294fd tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.548199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20788f4-3f52-40c8-81c7-732b216294fd tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.550150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20788f4-3f52-40c8-81c7-732b216294fd tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:list_access_rules(user_id=b35a7aebfcde4cd5b345abb79670d1a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.552498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20788f4-3f52-40c8-81c7-732b216294fd tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.554865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2146/4305] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:22 2022] PUT /identity/v3/projects/63a7b47ae563401ea101cae6c9c17797/users/4a7eefc77d6f45c4a1478d0af8be0ccd/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:22.557396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817db01-b85c-45ae-8476-7d5a4f09fbed None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.557685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817db01-b85c-45ae-8476-7d5a4f09fbed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.557956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817db01-b85c-45ae-8476-7d5a4f09fbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.566959 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2160/4306] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 21:57:22 2022] GET /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules => generated 369 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:22.566959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4dd40-bb90-41df-814b-bde4e0190f8f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.566959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4dd40-bb90-41df-814b-bde4e0190f8f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.566959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4dd40-bb90-41df-814b-bde4e0190f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.599125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-14b4dd40-bb90-41df-814b-bde4e0190f8f None None] MFA Rules not processed for user `4a7eefc77d6f45c4a1478d0af8be0ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:22.600129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c817db01-b85c-45ae-8476-7d5a4f09fbed None None] MFA Rules not processed for user `9201997239fd4b528a6726cabf132be2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:22.600609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-14b4dd40-bb90-41df-814b-bde4e0190f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:22.601024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c817db01-b85c-45ae-8476-7d5a4f09fbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:22.695173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2147/4307] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:22.696279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817db01-b85c-45ae-8476-7d5a4f09fbed None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.718883 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2161/4308] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:22.720089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4dd40-bb90-41df-814b-bde4e0190f8f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.797714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817db01-b85c-45ae-8476-7d5a4f09fbed None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.803039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.803953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.804244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.804588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.805395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:create_application_credential(user_id=b35a7aebfcde4cd5b345abb79670d1a5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.806687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.818399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4dd40-bb90-41df-814b-bde4e0190f8f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:22.830141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b9604-906b-4eaa-aedc-7fec1d4c50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:22.830948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b9604-906b-4eaa-aedc-7fec1d4c50c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.831419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b9604-906b-4eaa-aedc-7fec1d4c50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.832340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b9604-906b-4eaa-aedc-7fec1d4c50c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.833148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b9604-906b-4eaa-aedc-7fec1d4c50c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:22.835724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b9604-906b-4eaa-aedc-7fec1d4c50c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:22.883160 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2162/4309] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:22 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:22.885937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23eec4-b487-4ae3-8595-bd618044f132 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:22.886462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23eec4-b487-4ae3-8595-bd618044f132 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:22.887011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23eec4-b487-4ae3-8595-bd618044f132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:22.927875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8b23eec4-b487-4ae3-8595-bd618044f132 None None] MFA Rules not processed for user `e412ac7281b34df69be98088aec5fd99`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:22.929120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8b23eec4-b487-4ae3-8595-bd618044f132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:22.965156 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2148/4310] 10.222.0.32 () {60 vars in 1314 bytes} [Sat May 7 21:57:22 2022] POST /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/application_credentials => generated 920 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:22.965156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:22.979194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a555e8-7412-4e69-a188-8b87530ed5d8 tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.029196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2163/4311] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:23.030184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23eec4-b487-4ae3-8595-bd618044f132 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.061790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.063477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.064396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.064888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.066282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.068946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.098911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2149/4312] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:22 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:23.100198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.102354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:23.119486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23eec4-b487-4ae3-8595-bd618044f132 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.127720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35a7aebfcde4cd5b345abb79670d1a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '712dac3bee11461d9dc916a597736279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.128757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.129118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.129407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules/1f95554a14ca4db79c3fea6511a98502` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.131006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorizing `identity:get_access_rule(user_id=b35a7aebfcde4cd5b345abb79670d1a5, access_rule_id=1f95554a14ca4db79c3fea6511a98502)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.133342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.142351 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2164/4313] 10.222.0.32 () {58 vars in 1358 bytes} [Sat May 7 21:57:23 2022] GET /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5/access_rules/1f95554a14ca4db79c3fea6511a98502 => generated 229 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:23.145486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.167531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88952a1b-3e56-40b1-95a0-3d5d3efcfb5c tempest-AccessRulesV3Test-1933809889 tempest-AccessRulesV3Test-1933809889-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.176882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.177583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.177836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.178241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.179241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.181212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.200056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2165/4314] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:23.200839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.202643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:23.222751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd84435-7bc6-41e2-ad5f-b4e7cc54faec admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.223394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1a036-ff85-410e-bc06-6f1bbf2e99ea admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.230185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.230457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.231388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.231770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.232056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.232208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.232318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] PATH_INFO: `/v3/users/b35a7aebfcde4cd5b345abb79670d1a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.232744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.233957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35a7aebfcde4cd5b345abb79670d1a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.236849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.243519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.248014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.260325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2150/4315] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:23.260920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.273291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f04353-3d5e-41b2-8ff5-aef97817b648 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.279965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.280219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.280639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.280979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.282207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.283954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.300950 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2151/4316] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:23.301764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.323574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177d147-42bb-46e7-9d3c-af450229a8c6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.329567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b85dfb-b5d0-48c9-a31e-2b145bd97491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.330533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85dfb-b5d0-48c9-a31e-2b145bd97491 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.330943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85dfb-b5d0-48c9-a31e-2b145bd97491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.331278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b85dfb-b5d0-48c9-a31e-2b145bd97491 admin admin] PATH_INFO: `/v3/projects/80b939d0b75b40e4afa12a3d14e4ef26/users/5d0cfe72b0974eae8c41721e2f66ba17/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.342085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35a7aebfcde4cd5b345abb79670d1a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:23.343044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35a7aebfcde4cd5b345abb79670d1a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:23.353844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35a7aebfcde4cd5b345abb79670d1a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:23.355193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35a7aebfcde4cd5b345abb79670d1a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:23.358300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85dfb-b5d0-48c9-a31e-2b145bd97491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b939d0b75b40e4afa12a3d14e4ef26, user_id=5d0cfe72b0974eae8c41721e2f66ba17, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.361556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b85dfb-b5d0-48c9-a31e-2b145bd97491 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.371443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-58d4ee55-497b-4821-9aa7-fb19fe49992b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35a7aebfcde4cd5b345abb79670d1a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:23.395973 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2152/4317] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:23 2022] PUT /identity/v3/projects/80b939d0b75b40e4afa12a3d14e4ef26/users/5d0cfe72b0974eae8c41721e2f66ba17/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:23.407017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.407550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.407877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.442834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2166/4318] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:23 2022] DELETE /identity/v3/users/b35a7aebfcde4cd5b345abb79670d1a5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:23.447978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] MFA Rules not processed for user `5d0cfe72b0974eae8c41721e2f66ba17`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:23.448971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.448971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.449239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.450101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:23.470755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:23.472023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:23.569609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2153/4319] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:23.584642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.586943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:23.598421 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2167/4320] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:23.618746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:23.620353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:23.685720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff8553-3d68-4a10-8dd6-3fda7db52e35 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.699292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c944f8-ba4d-4b09-9d49-19b697398c57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.700432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c944f8-ba4d-4b09-9d49-19b697398c57 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.700976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c944f8-ba4d-4b09-9d49-19b697398c57 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.701743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c944f8-ba4d-4b09-9d49-19b697398c57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.705034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54c944f8-ba4d-4b09-9d49-19b697398c57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:23.717195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306bceb-5727-459f-a494-8a1a21e427f2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:23.725982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:23.727561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:23.728289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:23.728781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:23.752604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.755378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.769188 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2168/4321] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:23.859196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c944f8-ba4d-4b09-9d49-19b697398c57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:23.861401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c944f8-ba4d-4b09-9d49-19b697398c57 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:23.879519 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2154/4322] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:24.216274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.225213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:24.255260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36015e-3e42-4aa1-8c7a-1aff3a868569 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.263250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.264246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.264659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.265115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] PATH_INFO: `/v3/projects/712dac3bee11461d9dc916a597736279` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.266454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=712dac3bee11461d9dc916a597736279)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.268542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.332639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712dac3bee11461d9dc916a597736279', 'request_id': 'req-ad945830-3594-45b4-bb87-7402768919fc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.348845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712dac3bee11461d9dc916a597736279', 'request_id': 'req-ad945830-3594-45b4-bb87-7402768919fc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.358968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712dac3bee11461d9dc916a597736279', 'request_id': 'req-ad945830-3594-45b4-bb87-7402768919fc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.370359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] The token cache is being invalidate because project 712dac3bee11461d9dc916a597736279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:24.370653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.371340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ad945830-3594-45b4-bb87-7402768919fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.373196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2169/4323] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:24 2022] DELETE /identity/v3/projects/712dac3bee11461d9dc916a597736279 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:24.378141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271088d-8849-43f8-b3fe-25e722040f36 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.378433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271088d-8849-43f8-b3fe-25e722040f36 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.378839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271088d-8849-43f8-b3fe-25e722040f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.400558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b271088d-8849-43f8-b3fe-25e722040f36 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:24.402339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b271088d-8849-43f8-b3fe-25e722040f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:24.478820 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2155/4324] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:24.488452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f706f8-afe5-4dd9-a2ff-2a750abc5bab None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.488829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f706f8-afe5-4dd9-a2ff-2a750abc5bab None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.489169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f706f8-afe5-4dd9-a2ff-2a750abc5bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.515074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-97f706f8-afe5-4dd9-a2ff-2a750abc5bab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:24.516772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-97f706f8-afe5-4dd9-a2ff-2a750abc5bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:24.530455 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2170/4325] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:24.531914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271088d-8849-43f8-b3fe-25e722040f36 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.543729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271088d-8849-43f8-b3fe-25e722040f36 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.551319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.552301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.552663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.553080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.554176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:24.554414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.560386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.584285 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2156/4326] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:24.589114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f706f8-afe5-4dd9-a2ff-2a750abc5bab None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.601167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f706f8-afe5-4dd9-a2ff-2a750abc5bab None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.606600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.607304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.607591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.607868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.608567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.610485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.639655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2171/4327] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:24 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:24.644848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.661913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.663574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4975e-e0c0-4bfb-bd9b-758f444711e3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.669199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:24.730557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.731529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.731975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.732352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.733506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.735655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.762817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2157/4328] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:24 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:24.768260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.778091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5bc0-7918-4627-9d90-fa7289e88e13 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.786073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.786288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbced-7b0f-452d-82a9-337c876b1d86 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.787018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.787317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.787582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] PATH_INFO: `/v3/users/9201997239fd4b528a6726cabf132be2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.789913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9201997239fd4b528a6726cabf132be2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.791815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.792206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.792679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.792966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.793242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.794189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.796072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.808167 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2158/4329] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:24.812426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.824271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bf44-0e69-4f13-9cef-6354f8457dc5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.830530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.831537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.831905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.832432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.833231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.835091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.854681 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2159/4330] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:24.859879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:24.861423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9201997239fd4b528a6726cabf132be2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.862099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9201997239fd4b528a6726cabf132be2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.871021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9201997239fd4b528a6726cabf132be2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.871877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9201997239fd4b528a6726cabf132be2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.877478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df581cc1-88c2-4d87-8503-e636466e1aff admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:24.882158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7f6f75-2aba-4555-90e2-37a542b02819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9201997239fd4b528a6726cabf132be2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:24.884047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379490f1-bc6b-408e-9b16-3d04b00a7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:24.885150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379490f1-bc6b-408e-9b16-3d04b00a7208 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.885424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379490f1-bc6b-408e-9b16-3d04b00a7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.885764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379490f1-bc6b-408e-9b16-3d04b00a7208 admin admin] PATH_INFO: `/v3/projects/66de868e5b154759bc7e0aaf2b515a09/users/e73a03f36bb2456987da33f3eedd76c6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.912498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379490f1-bc6b-408e-9b16-3d04b00a7208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66de868e5b154759bc7e0aaf2b515a09, user_id=e73a03f36bb2456987da33f3eedd76c6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:24.916108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379490f1-bc6b-408e-9b16-3d04b00a7208 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:24.934983 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2172/4331] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:24 2022] DELETE /identity/v3/users/9201997239fd4b528a6726cabf132be2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:24.940997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.941402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.941832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:24.967036 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2160/4332] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:24 2022] PUT /identity/v3/projects/66de868e5b154759bc7e0aaf2b515a09/users/e73a03f36bb2456987da33f3eedd76c6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:24.971927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea13e-d331-4f05-b882-1115be97f8e2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:24.972211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea13e-d331-4f05-b882-1115be97f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:24.972495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eea13e-d331-4f05-b882-1115be97f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.003536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:25.009253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:25.016313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a3eea13e-d331-4f05-b882-1115be97f8e2 None None] MFA Rules not processed for user `e73a03f36bb2456987da33f3eedd76c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:25.017580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a3eea13e-d331-4f05-b882-1115be97f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:25.102436 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2173/4333] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:25.135332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:25.137098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:25.218291 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2161/4334] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:25.224502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea13e-d331-4f05-b882-1115be97f8e2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:25.229671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339335f2-4b1b-4d31-9c9a-a0a5bccc5228 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:25.236316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eea13e-d331-4f05-b882-1115be97f8e2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:25.236613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d10f-dd95-4e32-bcac-b076b3d87883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:25.237936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d10f-dd95-4e32-bcac-b076b3d87883 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.238554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d10f-dd95-4e32-bcac-b076b3d87883 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.239917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d10f-dd95-4e32-bcac-b076b3d87883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.241565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a832c-f0f4-48f4-8642-e1e452e1511f tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73a03f36bb2456987da33f3eedd76c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de868e5b154759bc7e0aaf2b515a09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:25.242411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a832c-f0f4-48f4-8642-e1e452e1511f tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.242836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a832c-f0f4-48f4-8642-e1e452e1511f tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.243222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a832c-f0f4-48f4-8642-e1e452e1511f tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] PATH_INFO: `/v3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.249173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2162/4335] 10.222.0.32 () {58 vars in 1103 bytes} [Sat May 7 21:57:25 2022] GET /identity/v3 => generated 255 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:25.250908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a832c-f0f4-48f4-8642-e1e452e1511f tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:25.253871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d10f-dd95-4e32-bcac-b076b3d87883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:25.255774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d10f-dd95-4e32-bcac-b076b3d87883 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:25.262123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a832c-f0f4-48f4-8642-e1e452e1511f tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:25.268642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a0653-1151-440e-8e7c-07dd5c55541c tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73a03f36bb2456987da33f3eedd76c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de868e5b154759bc7e0aaf2b515a09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:25.269531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0653-1151-440e-8e7c-07dd5c55541c tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.269931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0653-1151-440e-8e7c-07dd5c55541c tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.270335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a0653-1151-440e-8e7c-07dd5c55541c tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] PATH_INFO: `/v3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.276558 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2163/4336] 10.222.0.32 () {58 vars in 1103 bytes} [Sat May 7 21:57:25 2022] GET /identity/v3 => generated 255 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:25.280557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a0653-1151-440e-8e7c-07dd5c55541c tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:25.281743 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2174/4337] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:25.291750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a0653-1151-440e-8e7c-07dd5c55541c tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:25.299146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1de8-d446-474a-9ab2-6f38d226c080 tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e73a03f36bb2456987da33f3eedd76c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de868e5b154759bc7e0aaf2b515a09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:25.300388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1de8-d446-474a-9ab2-6f38d226c080 tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.300771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1de8-d446-474a-9ab2-6f38d226c080 tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.301226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1de8-d446-474a-9ab2-6f38d226c080 tempest-TestApiDiscovery-1533022615 tempest-TestApiDiscovery-1533022615-project] PATH_INFO: `/v3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.303162 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2164/4338] 10.222.0.32 () {58 vars in 1103 bytes} [Sat May 7 21:57:25 2022] GET /identity/v3 => generated 255 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:25.308901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47b1a-f7fe-482f-bf40-4b9bf1f0ae15 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.309444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47b1a-f7fe-482f-bf40-4b9bf1f0ae15 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.309772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a47b1a-f7fe-482f-bf40-4b9bf1f0ae15 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.316479 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2175/4339] 10.222.0.32 () {56 vars in 894 bytes} [Sat May 7 21:57:25 2022] GET /identity/ => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:57:25.319292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b25437-a2b5-46c5-b027-14f5f009c7b1 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.319808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b25437-a2b5-46c5-b027-14f5f009c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.320392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b25437-a2b5-46c5-b027-14f5f009c7b1 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.322830 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2165/4340] 10.222.0.32 () {56 vars in 894 bytes} [Sat May 7 21:57:25 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 21:57:25.327622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47b1a-f7fe-482f-bf40-4b9bf1f0ae15 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:25.332616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d7a47b1a-f7fe-482f-bf40-4b9bf1f0ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:25.360451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a47b1a-f7fe-482f-bf40-4b9bf1f0ae15 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:25.370499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:25.374499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.374499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.374499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] PATH_INFO: `/v3/users/e73a03f36bb2456987da33f3eedd76c6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.376777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73a03f36bb2456987da33f3eedd76c6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:25.381051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:25.474764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73a03f36bb2456987da33f3eedd76c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:25.475708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73a03f36bb2456987da33f3eedd76c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:25.488289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73a03f36bb2456987da33f3eedd76c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:25.489402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73a03f36bb2456987da33f3eedd76c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:25.499355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73a03f36bb2456987da33f3eedd76c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:25.525136 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2176/4341] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:25 2022] DELETE /identity/v3/users/e73a03f36bb2456987da33f3eedd76c6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:25.530388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.531609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.531609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.555458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:25.556901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:25.642807 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2166/4342] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:25.654368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:25.656485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:25.766414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047598c-0435-4635-b1e6-efec29fd8eee admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:25.771220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:25.771938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.772285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.772588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.788063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:25.790300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:25.804312 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2177/4343] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:25.911800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:25.913675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:25.941371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ee972-d030-4e32-a7a4-8480ef2b806f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:25.957323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:25.958485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:25.958903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:25.959310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] PATH_INFO: `/v3/projects/d435158d1ce445ce9f5644d04d7d50a2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:25.961162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d435158d1ce445ce9f5644d04d7d50a2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:25.965111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.069338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd435158d1ce445ce9f5644d04d7d50a2', 'request_id': 'req-bf108f4c-b64e-4782-abbc-022f9754874d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.084628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd435158d1ce445ce9f5644d04d7d50a2', 'request_id': 'req-bf108f4c-b64e-4782-abbc-022f9754874d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.097510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd435158d1ce445ce9f5644d04d7d50a2', 'request_id': 'req-bf108f4c-b64e-4782-abbc-022f9754874d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.111896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] The token cache is being invalidate because project d435158d1ce445ce9f5644d04d7d50a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:26.112743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.113438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.118640 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2167/4344] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:25 2022] DELETE /identity/v3/projects/d435158d1ce445ce9f5644d04d7d50a2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:26.120056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.133134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad79c50-791b-4f7d-9926-21eabd922459 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.211651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.213340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:26.231237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.232131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.241141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.242519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] PATH_INFO: `/v3/users/5d0cfe72b0974eae8c41721e2f66ba17` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.246995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0cfe72b0974eae8c41721e2f66ba17)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.249316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.348318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108f4c-b64e-4782-abbc-022f9754874d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.358618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.360068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.360360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.361304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] PATH_INFO: `/v3/projects/66de868e5b154759bc7e0aaf2b515a09` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.362635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66de868e5b154759bc7e0aaf2b515a09)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.369091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.381280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0cfe72b0974eae8c41721e2f66ba17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.383519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0cfe72b0974eae8c41721e2f66ba17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.391688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0cfe72b0974eae8c41721e2f66ba17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.392471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0cfe72b0974eae8c41721e2f66ba17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.405499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9bced7a8-099d-4e39-b506-ecd37a3e8355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0cfe72b0974eae8c41721e2f66ba17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.428121 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2178/4345] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:26 2022] DELETE /identity/v3/users/5d0cfe72b0974eae8c41721e2f66ba17 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:26.436473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66de868e5b154759bc7e0aaf2b515a09', 'request_id': 'req-0031ef86-3a78-41cc-98e6-8683b2715b77'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.445499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66de868e5b154759bc7e0aaf2b515a09', 'request_id': 'req-0031ef86-3a78-41cc-98e6-8683b2715b77'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.454381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66de868e5b154759bc7e0aaf2b515a09', 'request_id': 'req-0031ef86-3a78-41cc-98e6-8683b2715b77'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.471754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] The token cache is being invalidate because project 66de868e5b154759bc7e0aaf2b515a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:26.472117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.472918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0031ef86-3a78-41cc-98e6-8683b2715b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:26.478362 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2168/4346] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:26 2022] DELETE /identity/v3/projects/66de868e5b154759bc7e0aaf2b515a09 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:26.480276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d811-9996-4cac-85bd-57d4052ea2a4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.480585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d811-9996-4cac-85bd-57d4052ea2a4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.481146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d811-9996-4cac-85bd-57d4052ea2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.504200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5805d811-9996-4cac-85bd-57d4052ea2a4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:26.508774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5805d811-9996-4cac-85bd-57d4052ea2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:26.593650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2179/4347] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:26.602444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bc0c4-ea66-493b-b9a1-a600927cca94 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.603053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bc0c4-ea66-493b-b9a1-a600927cca94 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.603053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bc0c4-ea66-493b-b9a1-a600927cca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.623128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-781bc0c4-ea66-493b-b9a1-a600927cca94 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:26.624458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-781bc0c4-ea66-493b-b9a1-a600927cca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:26.635902 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2169/4348] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:26.640339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805d811-9996-4cac-85bd-57d4052ea2a4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.651645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805d811-9996-4cac-85bd-57d4052ea2a4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.660231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.660999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.661359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.661851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.662894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:26.663280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.665784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.680550 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2180/4349] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:26.686205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bc0c4-ea66-493b-b9a1-a600927cca94 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.697765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bc0c4-ea66-493b-b9a1-a600927cca94 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.702861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.704130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.704410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.704683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.705416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.707424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.738464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2170/4350] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:26 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:26.742733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.756250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140291c-2f15-463e-bf8e-124ab4dc5cd7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.833953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.834643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.834976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.835259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.836001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.837940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.862481 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2181/4351] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:26 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:26.863845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.874639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c4fd1-0d63-4323-a4d2-dd72f9aff6ab admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.880073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.880741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.881032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.881337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.882072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.884452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.896916 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2171/4352] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:26.900879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.911321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb7a2-5eb0-4015-9446-6377c3223349 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.916108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf770760-30ed-4cf4-97b3-9025c3d179a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.916784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770760-30ed-4cf4-97b3-9025c3d179a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.917073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770760-30ed-4cf4-97b3-9025c3d179a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.917354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770760-30ed-4cf4-97b3-9025c3d179a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.918087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770760-30ed-4cf4-97b3-9025c3d179a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.919748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770760-30ed-4cf4-97b3-9025c3d179a2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.930671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2182/4353] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:26.935073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:26.946340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa710df-a258-4f5f-b16e-03d8fc19525f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:26.951129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:26.951955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.952238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.952516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] PATH_INFO: `/v3/projects/5bfce301d11a48098c6011fc39511150/users/811259c7e41445838fb00449ea9a384a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:26.968326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfce301d11a48098c6011fc39511150, user_id=811259c7e41445838fb00449ea9a384a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:26.971121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:26.985491 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2172/4354] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:26 2022] PUT /identity/v3/projects/5bfce301d11a48098c6011fc39511150/users/811259c7e41445838fb00449ea9a384a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:26.996386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b53f-fd44-4371-a281-0c851282b434 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:26.996734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b53f-fd44-4371-a281-0c851282b434 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:26.997021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07b53f-fd44-4371-a281-0c851282b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.024423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2b07b53f-fd44-4371-a281-0c851282b434 None None] MFA Rules not processed for user `811259c7e41445838fb00449ea9a384a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:27.025678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b07b53f-fd44-4371-a281-0c851282b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:27.097365 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2183/4355] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:27.102532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.116064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0531-fc33-4438-bce5-4747c8731fc9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.120805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596790d2-9b76-4f5a-904b-97d6580ccfbd tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.121714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596790d2-9b76-4f5a-904b-97d6580ccfbd tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.121999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596790d2-9b76-4f5a-904b-97d6580ccfbd tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.122273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596790d2-9b76-4f5a-904b-97d6580ccfbd tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.123059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596790d2-9b76-4f5a-904b-97d6580ccfbd tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:create_application_credential(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.124214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596790d2-9b76-4f5a-904b-97d6580ccfbd tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.208816 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2173/4356] 10.222.0.32 () {60 vars in 1313 bytes} [Sat May 7 21:57:27 2022] POST /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 789 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:27.215580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07b53f-fd44-4371-a281-0c851282b434 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.225124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07b53f-fd44-4371-a281-0c851282b434 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.229441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.230437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.230727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.231054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/c91097f27837471786f453d9be771001` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.240472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:get_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=c91097f27837471786f453d9be771001)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.242134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.243867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2184/4357] 10.222.0.32 () {58 vars in 1391 bytes} [Sat May 7 21:57:27 2022] GET /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/c91097f27837471786f453d9be771001 => generated 689 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:27.248599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.248599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.248829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.264511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] MFA Rules not processed for user `811259c7e41445838fb00449ea9a384a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:27.265783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:27.375461 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2174/4358] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:27 2022] POST /identity/v3/auth/tokens => generated 3417 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) May 07 21:57:27.379811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.390345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8b53a-53b2-4a21-92a1-f264aa3a90d8 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.414620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.415686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.416025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.416319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/c91097f27837471786f453d9be771001` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.418208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:delete_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=c91097f27837471786f453d9be771001)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.419498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.433885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.435451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:27.446936 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2185/4359] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:27 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/c91097f27837471786f453d9be771001 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:27.455427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.469643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca7657-6416-4c92-81c0-f890a4a215bf tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.480479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.481885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.482087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.482368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.483160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:create_application_credential(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.485634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.539154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f4825-b679-4b2c-9908-fb802b6bcee6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.546651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.554323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.554864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.555335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] PATH_INFO: `/v3/projects/80b939d0b75b40e4afa12a3d14e4ef26` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.557607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b939d0b75b40e4afa12a3d14e4ef26)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.560834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.604683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2186/4360] 10.222.0.32 () {60 vars in 1314 bytes} [Sat May 7 21:57:27 2022] POST /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 920 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:27.606934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.621618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95799f10-2434-44bc-aaf1-536d432c9f9b tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.636706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.638463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.638747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.639051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/ed4edb09f1704454a5d57b00892d7fbf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.658137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b939d0b75b40e4afa12a3d14e4ef26', 'request_id': 'req-0a09d6bd-9f11-4991-979f-e972592b7026'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:27.665241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:delete_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=ed4edb09f1704454a5d57b00892d7fbf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.668538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.670267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b939d0b75b40e4afa12a3d14e4ef26', 'request_id': 'req-0a09d6bd-9f11-4991-979f-e972592b7026'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:27.686443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b939d0b75b40e4afa12a3d14e4ef26', 'request_id': 'req-0a09d6bd-9f11-4991-979f-e972592b7026'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:27.700768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] The token cache is being invalidate because project 80b939d0b75b40e4afa12a3d14e4ef26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:27.701314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:27.702224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a09d6bd-9f11-4991-979f-e972592b7026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:27.704885 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2175/4361] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:27 2022] DELETE /identity/v3/projects/80b939d0b75b40e4afa12a3d14e4ef26 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:27.711539 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2187/4362] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:27 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/ed4edb09f1704454a5d57b00892d7fbf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:27.712673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.714467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:27.717313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d7e19-0e15-475c-b979-79c9a5fa8cfd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.717776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d7e19-0e15-475c-b979-79c9a5fa8cfd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.719668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d7e19-0e15-475c-b979-79c9a5fa8cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.731728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774dcf2-d11f-4929-88d8-a09451c1390d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.768575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7b0d7e19-0e15-475c-b979-79c9a5fa8cfd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:27.769922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b0d7e19-0e15-475c-b979-79c9a5fa8cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:27.822588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.823268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.823559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.823899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.825368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:create_application_credential(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.826652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.892523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2176/4363] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:27.899890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b06a-cbd0-4bb5-884f-a32a22f1e17e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.900184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b06a-cbd0-4bb5-884f-a32a22f1e17e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.900469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24b06a-cbd0-4bb5-884f-a32a22f1e17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.934070 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2188/4364] 10.222.0.32 () {60 vars in 1314 bytes} [Sat May 7 21:57:27 2022] POST /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 812 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:27.939529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9d24b06a-cbd0-4bb5-884f-a32a22f1e17e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:27.939965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.942664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9d24b06a-cbd0-4bb5-884f-a32a22f1e17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:27.952590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad980a-5019-404a-9b97-826a4a0ebd84 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.958604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.959353 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2177/4365] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:27.960130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.960427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.960712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/850a53e6af114a579ff64c154fb11aca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.966403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b06a-cbd0-4bb5-884f-a32a22f1e17e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:27.978363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:delete_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=850a53e6af114a579ff64c154fb11aca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:27.980294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:27.981299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24b06a-cbd0-4bb5-884f-a32a22f1e17e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:27.989500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:27.993100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:27.993623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:27.994233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:27.995419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:27.996176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.000929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.022974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2189/4366] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:27 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/850a53e6af114a579ff64c154fb11aca => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:28.030555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.042473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b89de-5aa7-48fc-9a07-dccdeafbd99d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.050592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.051957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.052292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.052587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.053345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:create_application_credential(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.055414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.055523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2178/4367] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:28.068783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.101936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e6764-ec07-485a-9bf4-c6dc0c65a966 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.117331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.118082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.118296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.118576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.119313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.122391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.189378 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2179/4368] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:28.193361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.199192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2190/4369] 10.222.0.32 () {60 vars in 1313 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 789 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:28.200213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.221444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3ca45-4120-41e2-98ea-1a8de831b073 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.336650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.337455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.337741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.338022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.338753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:create_application_credential(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.340104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.357353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5174-f49f-49ad-8a5d-1e0fc2d05a0e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.364266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.365087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.365473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.365848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.367374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.369580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.398577 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2180/4370] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:28.402573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.419243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea17eeb-c6db-4ed6-ac81-8b581e52d196 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.426574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.427164 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2191/4371] 10.222.0.32 () {60 vars in 1313 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 788 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:28.430361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.430906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.431290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.431584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.432741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.434559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.444529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893cf-2180-4c69-81f3-76c67f16b314 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.447693 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2181/4372] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:28.453662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.460782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.463664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.464436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.465742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.467172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:list_application_credentials(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.470035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.477285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccd0a6-bb68-4f3a-8f6a-ed0a6eda2f63 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.491795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.492785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.495499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.495902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.496756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.498492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.499334 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2192/4373] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 21:57:28 2022] GET /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 1501 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:28.504409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.516557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b5bcf-8a17-4462-9c95-069e76d9d640 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.520492 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2182/4374] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:28.521813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.522752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.523080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.523404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/76fc7c5878ec417091228b3ee0016e4b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.527003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.538362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:delete_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=76fc7c5878ec417091228b3ee0016e4b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.539164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de853-7e59-4b43-a926-b2865d9a3859 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.539969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.546410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c12d53-5f40-4b21-9fa2-4fe38df302f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.548177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12d53-5f40-4b21-9fa2-4fe38df302f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.548627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12d53-5f40-4b21-9fa2-4fe38df302f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.549049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c12d53-5f40-4b21-9fa2-4fe38df302f8 admin admin] PATH_INFO: `/v3/projects/10925c7353274b0bb3de5d59f1826849/users/3fd3b31a22944961bfc869f012459ab8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.568078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12d53-5f40-4b21-9fa2-4fe38df302f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10925c7353274b0bb3de5d59f1826849, user_id=3fd3b31a22944961bfc869f012459ab8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.570863 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2193/4375] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:28 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/76fc7c5878ec417091228b3ee0016e4b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:28.572084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c12d53-5f40-4b21-9fa2-4fe38df302f8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.572904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.584470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a32b-a2a0-454d-ab8a-39e0c445173a tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.596849 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2183/4376] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:28 2022] PUT /identity/v3/projects/10925c7353274b0bb3de5d59f1826849/users/3fd3b31a22944961bfc869f012459ab8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:28.599021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c643323-afa9-41bc-9cba-0885ca957925 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.599307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c643323-afa9-41bc-9cba-0885ca957925 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.599656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c643323-afa9-41bc-9cba-0885ca957925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.630446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2c643323-afa9-41bc-9cba-0885ca957925 None None] MFA Rules not processed for user `3fd3b31a22944961bfc869f012459ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:28.631725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2c643323-afa9-41bc-9cba-0885ca957925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:28.645521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.646466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.646744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.647042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/8a21910419944af0b3bf800180a534c0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.655786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:delete_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=8a21910419944af0b3bf800180a534c0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.658614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.678483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2194/4377] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:28 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/8a21910419944af0b3bf800180a534c0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:28.684246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.694317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565ea90-157d-45b6-be6b-2e392411bc46 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.699024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.699803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.700339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.700462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.701129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:create_application_credential(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.702312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.707877 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2184/4378] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:28.712036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c643323-afa9-41bc-9cba-0885ca957925 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.784715 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2195/4379] 10.222.0.32 () {60 vars in 1313 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 788 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:28.785600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.787407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c643323-afa9-41bc-9cba-0885ca957925 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.792587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.793507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.793857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.794206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.794983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.795225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f89824-63f6-4801-8787-81acfc90c86c tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.797253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.799817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.800683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.801039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.801391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.802334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:create_application_credential(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.803604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.829792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2185/4380] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:28.833335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.892013 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2196/4381] 10.222.0.32 () {60 vars in 1313 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials => generated 789 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:28.896264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.905781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc71825-a880-485b-948a-7996a3345719 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.907007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f7e19-9755-4c0f-ad28-2d1dfb9f61b9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.913288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.914204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.915025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.915487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.916312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.918524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.941847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2186/4382] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:28 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:28.946351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.961757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c7d4d-5401-401a-8273-2ddeedff78ae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.965281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.966234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.966532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.966848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.967264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:28.967634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Adding query filter params (name=tempest-application_credential-1574477279) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:28.967940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:28.968059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:list_application_credentials(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.968227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:28.968506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:28.969401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:28.969757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.971036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:28.982096 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2187/4383] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:28.986235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:28.993383 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2197/4384] 10.222.0.32 () {58 vars in 1385 bytes} [Sat May 7 21:57:28 2022] GET /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials?name=tempest-application_credential-1574477279 => generated 887 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:28.996520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f72c5-21fe-4611-9938-fa29b5205367 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:28.997844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:29.001871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.002533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.002848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.003253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.003974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.005583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.010107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2f9b7-5a74-4f2e-a8d3-04773d56946d tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:29.014837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.016442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.017413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.017778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/11d7d857061442f2b0e50044dcb6bcd3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.020200 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2188/4385] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:29.024208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:29.027485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:delete_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=11d7d857061442f2b0e50044dcb6bcd3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.029113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.034666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbcd76-fb40-4da0-a486-4c61fe5d0b78 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:29.039749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461e2f9-1124-487f-ac0b-643ef92b65e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.040696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e2f9-1124-487f-ac0b-643ef92b65e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.040927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e2f9-1124-487f-ac0b-643ef92b65e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.041242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461e2f9-1124-487f-ac0b-643ef92b65e3 admin admin] PATH_INFO: `/v3/projects/7af151564f0b4c1aaa7b16a9a7ed314a/users/ff1a05ad64d3452f9bfdf91f289a3b03/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.054037 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2198/4386] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:28 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/11d7d857061442f2b0e50044dcb6bcd3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:29.058377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:29.058863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461e2f9-1124-487f-ac0b-643ef92b65e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af151564f0b4c1aaa7b16a9a7ed314a, user_id=ff1a05ad64d3452f9bfdf91f289a3b03, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.061544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461e2f9-1124-487f-ac0b-643ef92b65e3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.069924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04cf1f-af1f-4214-91a1-5f8639434549 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:29.076851 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2189/4387] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:29 2022] PUT /identity/v3/projects/7af151564f0b4c1aaa7b16a9a7ed314a/users/ff1a05ad64d3452f9bfdf91f289a3b03/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:29.087539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.087834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.088112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.114001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] MFA Rules not processed for user `ff1a05ad64d3452f9bfdf91f289a3b03`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:29.115246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:29.126015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '811259c7e41445838fb00449ea9a384a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfce301d11a48098c6011fc39511150', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.126979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.127292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.127570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/b9447591ced34258a463b32dcb627da1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.135994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorizing `identity:delete_application_credential(user_id=811259c7e41445838fb00449ea9a384a, application_credential_id=b9447591ced34258a463b32dcb627da1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.137564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.156210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2199/4388] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 21:57:29 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a/application_credentials/b9447591ced34258a463b32dcb627da1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:29.161169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:29.162966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:29.185038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2190/4389] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:29.197722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:29.199167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:29.232898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31337df9-28d2-4c0b-a9d4-e42e4252b043 tempest-ApplicationCredentialsV3Test-1259016784 tempest-ApplicationCredentialsV3Test-1259016784-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:29.238129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.239029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.239311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.239592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] PATH_INFO: `/v3/users/811259c7e41445838fb00449ea9a384a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.240796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] RBAC: Authorizing `identity:delete_user(user_id=811259c7e41445838fb00449ea9a384a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.242738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.261873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf70af-70a9-494b-bf3a-b2d463279f15 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:29.265446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.266108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.266383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.266661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.289402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '811259c7e41445838fb00449ea9a384a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:29.289989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '811259c7e41445838fb00449ea9a384a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:29.296664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '811259c7e41445838fb00449ea9a384a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:29.297833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '811259c7e41445838fb00449ea9a384a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:29.305211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6249896-ac83-4320-911f-b12d0d2fc07a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '811259c7e41445838fb00449ea9a384a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:29.325413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.327086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.334330 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2200/4390] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:29 2022] DELETE /identity/v3/users/811259c7e41445838fb00449ea9a384a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:29.336879 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2191/4391] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:29.338908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.339367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.339742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.358753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:29.360023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:29.418754 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2201/4392] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:29.428760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:29.430318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:29.447914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:29.449312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:29.488667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751107f3-94e9-47df-9105-02a691ba1140 service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:29.508681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25c4c-575d-483d-9986-e58497b41977 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:29.512443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd61b0-c328-480b-b2be-4df82a44e346 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.513110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd61b0-c328-480b-b2be-4df82a44e346 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.513396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd61b0-c328-480b-b2be-4df82a44e346 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.513673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd61b0-c328-480b-b2be-4df82a44e346 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.516099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-65bd61b0-c328-480b-b2be-4df82a44e346 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:29.544384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:29.545331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:29.545791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:29.547227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:29.561888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.564355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.581655 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2192/4393] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:29.597568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd61b0-c328-480b-b2be-4df82a44e346 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:29.599056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd61b0-c328-480b-b2be-4df82a44e346 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:29.608107 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2202/4394] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:30.004402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.010414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:30.029376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e566668-0cd7-4907-bf28-734cf4f4b8b2 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.040705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.042399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.043109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.043109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] PATH_INFO: `/v3/users/3fd3b31a22944961bfc869f012459ab8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.045253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd3b31a22944961bfc869f012459ab8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.048949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.144390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd3b31a22944961bfc869f012459ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.163834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd3b31a22944961bfc869f012459ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.164796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd3b31a22944961bfc869f012459ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.165825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd3b31a22944961bfc869f012459ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.181951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd3b31a22944961bfc869f012459ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.225149 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2193/4395] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:29 2022] DELETE /identity/v3/users/3fd3b31a22944961bfc869f012459ab8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:30.230948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.231247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.231550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.254134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:30.256651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:30.356850 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2203/4396] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:30.373291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.378043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:30.400150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.401585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:30.423257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0275512-1e45-4b03-95c2-625acbbcbc8f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.432516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.433710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.434191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.435012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] PATH_INFO: `/v3/projects/5bfce301d11a48098c6011fc39511150` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.436610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfce301d11a48098c6011fc39511150)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.439118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.483897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a7960-abbf-4a33-83d5-80d8d39951be admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.488851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e23ab-a160-446b-8de3-3f47caa2f51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.489599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e23ab-a160-446b-8de3-3f47caa2f51e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.490124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e23ab-a160-446b-8de3-3f47caa2f51e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.490423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e23ab-a160-446b-8de3-3f47caa2f51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.504840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e23ab-a160-446b-8de3-3f47caa2f51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.506280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfce301d11a48098c6011fc39511150', 'request_id': 'req-b40620ef-2ec0-491a-84dd-dda30212d303'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.508260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e23ab-a160-446b-8de3-3f47caa2f51e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.512709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfce301d11a48098c6011fc39511150', 'request_id': 'req-b40620ef-2ec0-491a-84dd-dda30212d303'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.520352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2194/4397] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:30.525379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfce301d11a48098c6011fc39511150', 'request_id': 'req-b40620ef-2ec0-491a-84dd-dda30212d303'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.540147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] The token cache is being invalidate because project 5bfce301d11a48098c6011fc39511150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:30.540385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.541465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b40620ef-2ec0-491a-84dd-dda30212d303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:30.543586 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2204/4398] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:30 2022] DELETE /identity/v3/projects/5bfce301d11a48098c6011fc39511150 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:30.550618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90d8b-c6db-4f41-899b-91ffe4f7cbc2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.551616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90d8b-c6db-4f41-899b-91ffe4f7cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.551907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90d8b-c6db-4f41-899b-91ffe4f7cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.583009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eac90d8b-c6db-4f41-899b-91ffe4f7cbc2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:30.584828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eac90d8b-c6db-4f41-899b-91ffe4f7cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:30.655028 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2195/4399] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:30.663403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff735-f002-4ec2-9ed8-4b81d411edf2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.663695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff735-f002-4ec2-9ed8-4b81d411edf2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.664040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abff735-f002-4ec2-9ed8-4b81d411edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.686026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2abff735-f002-4ec2-9ed8-4b81d411edf2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:30.692507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2abff735-f002-4ec2-9ed8-4b81d411edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:30.703942 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2205/4400] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:30.708834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac90d8b-c6db-4f41-899b-91ffe4f7cbc2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.722532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac90d8b-c6db-4f41-899b-91ffe4f7cbc2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.728784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.729624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.729985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.730320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.731253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:30.731598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.733468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.747399 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2196/4401] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:30.751868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff735-f002-4ec2-9ed8-4b81d411edf2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.762650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abff735-f002-4ec2-9ed8-4b81d411edf2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.770046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.771408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.771408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.771408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.772156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.774114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.808761 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2206/4402] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:30 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:30.813231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.827454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a401f-e3e6-4fa0-8776-e2b657172eb8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.854129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.855618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:30.906142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.907584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.907870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.908141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.908844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.910819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.936251 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2197/4403] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:30 2022] POST /identity/v3/users => generated 306 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:30.941167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.943988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e597d-f3ae-46c0-a482-3b8bc84c31a3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.949903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.951290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.951984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.952283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] PATH_INFO: `/v3/projects/10925c7353274b0bb3de5d59f1826849` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.954756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10925c7353274b0bb3de5d59f1826849)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.957235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204a000-aaa9-40bf-a89a-3b72622a83f2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:30.957473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.963440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:30.964389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:30.964979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:30.965269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:30.966208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:30.968068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:30.981870 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2198/4404] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:30.983281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:30.995377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75576a7-596c-45f8-9925-8ac93dbf3d4a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.002130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.005079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.005777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.005878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] PATH_INFO: `/v3/projects/137c1489ab284ba784268db2f9f5ad07/users/8a000d2f15ae4c0796125391a7ebc380/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.021391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10925c7353274b0bb3de5d59f1826849', 'request_id': 'req-b7116cac-b74b-4f6a-9a15-98e876aa049d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.026371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=137c1489ab284ba784268db2f9f5ad07, user_id=8a000d2f15ae4c0796125391a7ebc380, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.029163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10925c7353274b0bb3de5d59f1826849', 'request_id': 'req-b7116cac-b74b-4f6a-9a15-98e876aa049d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.029364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.039591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10925c7353274b0bb3de5d59f1826849', 'request_id': 'req-b7116cac-b74b-4f6a-9a15-98e876aa049d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.045734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2199/4405] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:30 2022] PUT /identity/v3/projects/137c1489ab284ba784268db2f9f5ad07/users/8a000d2f15ae4c0796125391a7ebc380/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:31.051269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.054028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] The token cache is being invalidate because project 10925c7353274b0bb3de5d59f1826849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:31.054515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.055410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.056966 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2207/4406] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:30 2022] DELETE /identity/v3/projects/10925c7353274b0bb3de5d59f1826849 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:31.061887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.064399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.139032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc45f59-0ea8-46dc-89e6-ea6b1c970e4a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.144676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.145142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7116cac-b74b-4f6a-9a15-98e876aa049d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.145387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.145667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.145939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.146906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.148521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.150852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.151744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.152450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.152450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] PATH_INFO: `/v3/users/ff1a05ad64d3452f9bfdf91f289a3b03` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.153777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1a05ad64d3452f9bfdf91f289a3b03)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.155915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.162395 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2200/4407] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:31.163568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.165980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.180211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f350c-3bbf-47c0-b7fd-40ae18e697e0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.186198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90bdb8-d203-4bd0-9879-35f291af172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.187138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bdb8-d203-4bd0-9879-35f291af172d admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.188181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bdb8-d203-4bd0-9879-35f291af172d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.188404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90bdb8-d203-4bd0-9879-35f291af172d admin admin] PATH_INFO: `/v3/projects/137c1489ab284ba784268db2f9f5ad07/users/8a000d2f15ae4c0796125391a7ebc380/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.190876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90bdb8-d203-4bd0-9879-35f291af172d admin admin] RBAC: Authorizing `identity:create_grant(project_id=137c1489ab284ba784268db2f9f5ad07, user_id=8a000d2f15ae4c0796125391a7ebc380, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.194012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90bdb8-d203-4bd0-9879-35f291af172d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.206792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2201/4408] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:31 2022] PUT /identity/v3/projects/137c1489ab284ba784268db2f9f5ad07/users/8a000d2f15ae4c0796125391a7ebc380/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:31.219359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d6851-c064-4538-b799-4561eab96a71 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.219806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d6851-c064-4538-b799-4561eab96a71 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.220360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d6851-c064-4538-b799-4561eab96a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.222072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1a05ad64d3452f9bfdf91f289a3b03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.222870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1a05ad64d3452f9bfdf91f289a3b03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.230616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1a05ad64d3452f9bfdf91f289a3b03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.231599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1a05ad64d3452f9bfdf91f289a3b03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.240618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1a05ad64d3452f9bfdf91f289a3b03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.250818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-421d6851-c064-4538-b799-4561eab96a71 None None] MFA Rules not processed for user `8a000d2f15ae4c0796125391a7ebc380`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:31.252089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-421d6851-c064-4538-b799-4561eab96a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.261377 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2208/4409] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:31 2022] DELETE /identity/v3/users/ff1a05ad64d3452f9bfdf91f289a3b03 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:31.327774 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2202/4410] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:31.333442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.335082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.408888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e2f8d-2418-4dd4-b6ae-3c97cb1280f1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.413923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.414634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.415148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.416114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.416114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.418387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.451564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2209/4411] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:31 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:31.452897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d6851-c064-4538-b799-4561eab96a71 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.540140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d6851-c064-4538-b799-4561eab96a71 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.641026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.643603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.654411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.655531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.656012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.656962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.660101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.663296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.666931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bb3b5-126c-4fc3-9990-100eb817188d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.679817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.683350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.685556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.685870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] PATH_INFO: `/v3/projects/7af151564f0b4c1aaa7b16a9a7ed314a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.688943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af151564f0b4c1aaa7b16a9a7ed314a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.692326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.710065 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2203/4412] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:31 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:31.711222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.725814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92a48-7e55-43da-9a1e-726db5ceb900 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.734626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.735625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.735955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.736233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.737432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.738685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.767234 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2204/4413] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:31.771254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.786138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b125-8cee-4c1a-8477-4616f4507416 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.794397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af151564f0b4c1aaa7b16a9a7ed314a', 'request_id': 'req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.817059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af151564f0b4c1aaa7b16a9a7ed314a', 'request_id': 'req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.848620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af151564f0b4c1aaa7b16a9a7ed314a', 'request_id': 'req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.870976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] The token cache is being invalidate because project 7af151564f0b4c1aaa7b16a9a7ed314a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:31.870976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.872473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9bfac29-bd89-4ff3-9b59-cc9026eaf2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:31.876901 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2210/4414] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:31 2022] DELETE /identity/v3/projects/7af151564f0b4c1aaa7b16a9a7ed314a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:31.883618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ac86-6f8a-45a8-9d60-666f858a1dde None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.883916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ac86-6f8a-45a8-9d60-666f858a1dde None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.884587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ac86-6f8a-45a8-9d60-666f858a1dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.888797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.889711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.890107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.891150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.892373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.894210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.907569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9079ac86-6f8a-45a8-9d60-666f858a1dde None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:31.909302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9079ac86-6f8a-45a8-9d60-666f858a1dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.912048 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2205/4415] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:31.916470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.918433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.920391 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2211/4416] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:31.930179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9b75c-4e29-43f1-aa77-b625cd2c16c3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.930544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9b75c-4e29-43f1-aa77-b625cd2c16c3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.931065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9b75c-4e29-43f1-aa77-b625cd2c16c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.934602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a80b8-8267-4bac-aaf5-95ac81fa8079 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.941931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50652e4-0c5f-48b0-b5fb-9dc7cdc7b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:31.943125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50652e4-0c5f-48b0-b5fb-9dc7cdc7b0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.943414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50652e4-0c5f-48b0-b5fb-9dc7cdc7b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.943728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50652e4-0c5f-48b0-b5fb-9dc7cdc7b0c5 admin admin] PATH_INFO: `/v3/projects/d953d3710f5d44b68d1ff52f167ef27c/users/92cd3af60f6f4bd89c223059e5a4cde5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:31.954480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-44d9b75c-4e29-43f1-aa77-b625cd2c16c3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:31.955856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-44d9b75c-4e29-43f1-aa77-b625cd2c16c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:31.964525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50652e4-0c5f-48b0-b5fb-9dc7cdc7b0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d953d3710f5d44b68d1ff52f167ef27c, user_id=92cd3af60f6f4bd89c223059e5a4cde5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:31.967646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50652e4-0c5f-48b0-b5fb-9dc7cdc7b0c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:31.968653 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2212/4417] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:31.969543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9b75c-4e29-43f1-aa77-b625cd2c16c3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:31.981078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9b75c-4e29-43f1-aa77-b625cd2c16c3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:31.985010 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2206/4418] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:31 2022] PUT /identity/v3/projects/d953d3710f5d44b68d1ff52f167ef27c/users/92cd3af60f6f4bd89c223059e5a4cde5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:31.995230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f6de-53e2-40f1-b2b5-ce8fadc44a3d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:31.995788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f6de-53e2-40f1-b2b5-ce8fadc44a3d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:31.995911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7f6de-53e2-40f1-b2b5-ce8fadc44a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.028402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-60f7f6de-53e2-40f1-b2b5-ce8fadc44a3d None None] MFA Rules not processed for user `92cd3af60f6f4bd89c223059e5a4cde5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:32.029847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60f7f6de-53e2-40f1-b2b5-ce8fadc44a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:32.040047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.040809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.041085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.041360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.042093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:32.042406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.044068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.056592 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2213/4419] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:32.061144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.071732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f657de-b69d-42ff-a17c-d824241a139a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.076735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.077402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.077689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.078747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.079796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.081530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.111190 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2207/4420] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:32.117991 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2214/4421] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:32 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:32.120961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f6de-53e2-40f1-b2b5-ce8fadc44a3d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.130303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.132071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:32.134401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7f6de-53e2-40f1-b2b5-ce8fadc44a3d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.247583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62939c27-f8de-4d81-a176-da6a8a560ad4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.249583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.250219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.250653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.251033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.251779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.253106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.253919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.254052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.254395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.255692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.258622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:32.295905 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2208/4422] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:32 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:32.298352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.311989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf8f99-5e41-4d7f-93e8-d3ae7e3a3453 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.319498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.320336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.320602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.320883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.321759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.324129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.339627 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2209/4423] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:32.343224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.349202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.349723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.356442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d3e2b-5ac7-4a6e-8ce6-2738647c0a34 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.362835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d92296-dd00-4a5d-8125-7af392aeef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.363715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92296-dd00-4a5d-8125-7af392aeef84 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.364148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92296-dd00-4a5d-8125-7af392aeef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.364323 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2215/4424] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:32.364577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d92296-dd00-4a5d-8125-7af392aeef84 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.365859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92296-dd00-4a5d-8125-7af392aeef84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.368427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d92296-dd00-4a5d-8125-7af392aeef84 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.383126 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2210/4425] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:32.388389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.400973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d231a-af80-4c80-bd55-1a577439ec75 service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.409181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.410393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.410763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.411422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] PATH_INFO: `/v3/projects/49d7fe14e8d9426e89ffe442543bcaa8/users/3089366c11af45198953fcb4c9a2a9fd/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.430979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d7fe14e8d9426e89ffe442543bcaa8, user_id=3089366c11af45198953fcb4c9a2a9fd, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.433535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.468984 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2216/4426] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:32 2022] PUT /identity/v3/projects/49d7fe14e8d9426e89ffe442543bcaa8/users/3089366c11af45198953fcb4c9a2a9fd/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:32.479628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059e66-0aaa-43ed-aaf0-462943c7e705 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.479917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059e66-0aaa-43ed-aaf0-462943c7e705 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.480197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6059e66-0aaa-43ed-aaf0-462943c7e705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.526905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d6059e66-0aaa-43ed-aaf0-462943c7e705 None None] MFA Rules not processed for user `3089366c11af45198953fcb4c9a2a9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:32.528152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d6059e66-0aaa-43ed-aaf0-462943c7e705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:32.649787 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2211/4427] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:32.664219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.666742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:32.792679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549a5b2-ac5e-4304-aab0-8a1d17f7ede5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.799078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3012987-083b-40a2-9c80-719a959cd451 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.799827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3012987-083b-40a2-9c80-719a959cd451 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.800117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3012987-083b-40a2-9c80-719a959cd451 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.800400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3012987-083b-40a2-9c80-719a959cd451 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.823897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3012987-083b-40a2-9c80-719a959cd451 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.825616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3012987-083b-40a2-9c80-719a959cd451 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:32.840478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6059e66-0aaa-43ed-aaf0-462943c7e705 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:32.855381 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2217/4428] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:32.960132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6059e66-0aaa-43ed-aaf0-462943c7e705 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:32.966350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:32.967658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:32.967940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:32.968213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] PATH_INFO: `/v3/users/8a000d2f15ae4c0796125391a7ebc380` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:32.969460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a000d2f15ae4c0796125391a7ebc380)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:32.971507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:33.038121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a000d2f15ae4c0796125391a7ebc380'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.047794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a000d2f15ae4c0796125391a7ebc380'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.048675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a000d2f15ae4c0796125391a7ebc380'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.049327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a000d2f15ae4c0796125391a7ebc380'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.058721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a000d2f15ae4c0796125391a7ebc380'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.085371 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2212/4429] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:32 2022] DELETE /identity/v3/users/8a000d2f15ae4c0796125391a7ebc380 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:33.090377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:33.090694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:33.091066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:33.127882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:33.129356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:33.140760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:33.142223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:33.234240 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2218/4430] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:33.247490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:33.249392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:33.260290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f80219-bdfa-4468-a50c-3ebd7a7c300f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:33.266415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:33.272395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:33.272750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:33.273305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] PATH_INFO: `/v3/users/3089366c11af45198953fcb4c9a2a9fd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:33.275292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3089366c11af45198953fcb4c9a2a9fd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:33.278007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:33.325814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110357a5-3a25-4b77-969a-2cffb8b55172 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:33.331501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3a9c-a491-4a3e-8d80-068b37359ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:33.332346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3a9c-a491-4a3e-8d80-068b37359ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:33.332872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3a9c-a491-4a3e-8d80-068b37359ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:33.333049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3a9c-a491-4a3e-8d80-068b37359ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:33.344880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3a9c-a491-4a3e-8d80-068b37359ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:33.346508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3a9c-a491-4a3e-8d80-068b37359ff6 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:33.348739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3089366c11af45198953fcb4c9a2a9fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.360335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3089366c11af45198953fcb4c9a2a9fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.361181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3089366c11af45198953fcb4c9a2a9fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.361707 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2219/4431] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:33.362027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3089366c11af45198953fcb4c9a2a9fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.371740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3089366c11af45198953fcb4c9a2a9fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.400349 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2213/4432] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:33 2022] DELETE /identity/v3/users/3089366c11af45198953fcb4c9a2a9fd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:33.405307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:33.405817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:33.406806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:33.426877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:33.428115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:33.508716 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2220/4433] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:33.523553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:33.526243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:33.637165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d28b7-b870-46e6-8c67-eb8aa9109af1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:33.645733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:33.646440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:33.646843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:33.647432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:33.660771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:33.662759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:33.675106 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2214/4434] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:33.737343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:33.739165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:33.758891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cabcf-4997-4592-8e2f-20f84931ea60 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:33.766268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:33.767331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:33.768136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:33.768520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] PATH_INFO: `/v3/projects/137c1489ab284ba784268db2f9f5ad07` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:33.769899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] RBAC: Authorizing `identity:delete_project(project_id=137c1489ab284ba784268db2f9f5ad07)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:33.772155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:33.841541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137c1489ab284ba784268db2f9f5ad07', 'request_id': 'req-8eb74126-68bf-4741-b4cf-738dac00176d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.850249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137c1489ab284ba784268db2f9f5ad07', 'request_id': 'req-8eb74126-68bf-4741-b4cf-738dac00176d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.861089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137c1489ab284ba784268db2f9f5ad07', 'request_id': 'req-8eb74126-68bf-4741-b4cf-738dac00176d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.888869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] The token cache is being invalidate because project 137c1489ab284ba784268db2f9f5ad07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:33.889234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.892074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:33.896644 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2221/4435] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:33 2022] DELETE /identity/v3/projects/137c1489ab284ba784268db2f9f5ad07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:33.898515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:33.913165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21dde1-6e1d-474d-8371-8d15ca15ba4f service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.001959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.003503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.003899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.004410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] PATH_INFO: `/v3/users/92cd3af60f6f4bd89c223059e5a4cde5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.005929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92cd3af60f6f4bd89c223059e5a4cde5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.008476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.077886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.080345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:34.100032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb74126-68bf-4741-b4cf-738dac00176d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.108532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.109087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92cd3af60f6f4bd89c223059e5a4cde5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.109807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.110171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.110536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] PATH_INFO: `/v3/projects/49d7fe14e8d9426e89ffe442543bcaa8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.112486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d7fe14e8d9426e89ffe442543bcaa8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.114864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.124703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92cd3af60f6f4bd89c223059e5a4cde5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.127444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92cd3af60f6f4bd89c223059e5a4cde5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.128129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92cd3af60f6f4bd89c223059e5a4cde5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.139694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f74840e-ea46-4670-89f8-865403fd2df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92cd3af60f6f4bd89c223059e5a4cde5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.172262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2215/4436] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:33 2022] DELETE /identity/v3/users/92cd3af60f6f4bd89c223059e5a4cde5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:34.181898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d7fe14e8d9426e89ffe442543bcaa8', 'request_id': 'req-284a1ebb-8849-4082-ab64-9b2787ec960d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.193066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d7fe14e8d9426e89ffe442543bcaa8', 'request_id': 'req-284a1ebb-8849-4082-ab64-9b2787ec960d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.205397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d7fe14e8d9426e89ffe442543bcaa8', 'request_id': 'req-284a1ebb-8849-4082-ab64-9b2787ec960d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.222137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] The token cache is being invalidate because project 49d7fe14e8d9426e89ffe442543bcaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:34.222926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.223565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-284a1ebb-8849-4082-ab64-9b2787ec960d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.225470 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2222/4437] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:34 2022] DELETE /identity/v3/projects/49d7fe14e8d9426e89ffe442543bcaa8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:34.231954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e02a2-b943-4c62-ae2d-65bfcae9d1ad None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.232290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e02a2-b943-4c62-ae2d-65bfcae9d1ad None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.232530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e02a2-b943-4c62-ae2d-65bfcae9d1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.259394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ea8e02a2-b943-4c62-ae2d-65bfcae9d1ad None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:34.260802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ea8e02a2-b943-4c62-ae2d-65bfcae9d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:34.335614 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2216/4438] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:34.343766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18beec-cf61-457a-afb0-68e39f2e020c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.344088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18beec-cf61-457a-afb0-68e39f2e020c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.344367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18beec-cf61-457a-afb0-68e39f2e020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.381157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4a18beec-cf61-457a-afb0-68e39f2e020c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:34.383719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a18beec-cf61-457a-afb0-68e39f2e020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:34.399640 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2223/4439] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:34.403915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e02a2-b943-4c62-ae2d-65bfcae9d1ad None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.417312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e02a2-b943-4c62-ae2d-65bfcae9d1ad None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.426299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.426843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.427438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.427746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.429052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:34.429583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.431863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.449291 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2217/4440] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:34.454351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18beec-cf61-457a-afb0-68e39f2e020c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.471751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18beec-cf61-457a-afb0-68e39f2e020c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.479473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.481817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.484621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.484621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.484621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.487407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.524107 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2224/4441] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:34 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:34.530315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.542272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb493b-a6ca-4d96-8129-c77d818942ad admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.635146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.636449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.636803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.637023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.637726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.643417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.675139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2218/4442] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:34 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:34.679266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.693855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92d230-d060-4932-be26-b55b3c779647 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.700680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.701692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.702080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.702470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.703942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.705522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.732057 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2225/4443] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:34.733260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.742682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.749488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:34.750365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf6a95-1eca-41de-81c6-15ee995368b7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.761278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.761987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.762268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.765094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.766579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.769912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.778999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2380a46-8061-42b0-88c2-943d1c39341a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.780920 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2219/4444] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:34.785258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:34.790561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.791943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.792404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.792826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] PATH_INFO: `/v3/projects/d953d3710f5d44b68d1ff52f167ef27c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.794225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d953d3710f5d44b68d1ff52f167ef27c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.796765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.802104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879b73-07c8-4286-8c57-95234a3945a3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:34.809706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea31e5-5f28-4cb4-9143-e78216facb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:34.810933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea31e5-5f28-4cb4-9143-e78216facb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.811256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea31e5-5f28-4cb4-9143-e78216facb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.811546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea31e5-5f28-4cb4-9143-e78216facb15 admin admin] PATH_INFO: `/v3/projects/c1a8e41a97544b71897f42d89e04854f/users/d8b75424e0c442b1bee0a4a9fcdf5265/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.849970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea31e5-5f28-4cb4-9143-e78216facb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a8e41a97544b71897f42d89e04854f, user_id=d8b75424e0c442b1bee0a4a9fcdf5265, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:34.854735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea31e5-5f28-4cb4-9143-e78216facb15 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:34.869538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd953d3710f5d44b68d1ff52f167ef27c', 'request_id': 'req-f134f3f0-0426-4297-b874-8420d82d7bca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.879684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd953d3710f5d44b68d1ff52f167ef27c', 'request_id': 'req-f134f3f0-0426-4297-b874-8420d82d7bca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.879903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2220/4445] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:34 2022] PUT /identity/v3/projects/c1a8e41a97544b71897f42d89e04854f/users/d8b75424e0c442b1bee0a4a9fcdf5265/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:34.891643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd953d3710f5d44b68d1ff52f167ef27c', 'request_id': 'req-f134f3f0-0426-4297-b874-8420d82d7bca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.892338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.892659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.892899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.912308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] The token cache is being invalidate because project d953d3710f5d44b68d1ff52f167ef27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:34.912663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.913609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f134f3f0-0426-4297-b874-8420d82d7bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:34.916512 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2226/4446] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:34 2022] DELETE /identity/v3/projects/d953d3710f5d44b68d1ff52f167ef27c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:34.922931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:34.923255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:34.925120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:34.947038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] MFA Rules not processed for user `d8b75424e0c442b1bee0a4a9fcdf5265`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:34.948275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:34.963580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:34.965115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.033134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2221/4447] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:35.038120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.040192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.055697 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2227/4448] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:35.056561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.058021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.072795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967ccd0-85a6-4fbc-a9d7-abd627adb6b7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.078826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.080293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.080758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.081295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] PATH_INFO: `/v3/users/4053e69846a7440f8d7978a5a4b7eec5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.082933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4053e69846a7440f8d7978a5a4b7eec5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.085151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.124420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd99b6-cb0a-46b9-b47f-af23c00ad569 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.132649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23bcd-2954-4f47-93ee-55cbe0b8a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.133343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23bcd-2954-4f47-93ee-55cbe0b8a8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.133651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23bcd-2954-4f47-93ee-55cbe0b8a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.133904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23bcd-2954-4f47-93ee-55cbe0b8a8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.134599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23bcd-2954-4f47-93ee-55cbe0b8a8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.137073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23bcd-2954-4f47-93ee-55cbe0b8a8f3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.144586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4053e69846a7440f8d7978a5a4b7eec5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.145463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4053e69846a7440f8d7978a5a4b7eec5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.153769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4053e69846a7440f8d7978a5a4b7eec5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.154630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4053e69846a7440f8d7978a5a4b7eec5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.163918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4053e69846a7440f8d7978a5a4b7eec5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.166954 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2222/4449] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:35 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:35.168383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1471-2b35-4396-ba53-91e8ee438152 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.168671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1471-2b35-4396-ba53-91e8ee438152 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.168948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b1471-2b35-4396-ba53-91e8ee438152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.195129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-983b1471-2b35-4396-ba53-91e8ee438152 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:35.195431 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2228/4450] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:35 2022] DELETE /identity/v3/users/4053e69846a7440f8d7978a5a4b7eec5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:35.196344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.196798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-983b1471-2b35-4396-ba53-91e8ee438152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.197730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.298141 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2223/4451] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:35.302131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1471-2b35-4396-ba53-91e8ee438152 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.305215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a2ce-7b3b-48a4-a7d0-9d2736ffc3d2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.321192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b1471-2b35-4396-ba53-91e8ee438152 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.328438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.329427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.329847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.330154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.331137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:35.331489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.333595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.334855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.336684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.338174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.338584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.340823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.345326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.352329 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2224/4452] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:35.358340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.372409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631d20d-24f9-4123-97d4-338290b4c092 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.383729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.385072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.385612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.386123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.390020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2229/4453] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:35 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:35.390179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.390873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.391811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.404376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d432eb-c689-456a-ae46-1b05ddacd4da admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.411666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.412345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.412786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.413186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.413915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.415816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.428977 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2225/4454] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:35 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:35.431633 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2230/4455] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:35.432849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.433532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.448163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6404f-0be4-49f9-9c16-0a1faeb0242d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.518796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523725d-a33a-4ff7-9d07-b5d8db6a7664 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.525606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.526434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.526719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.527035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] PATH_INFO: `/v3/projects/f644866fa00e4d82ab644fb0aba8d14d/users/960a52f0e55440eb9e432c7c8315d12f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.533012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.534294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.534584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.535033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.550343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.553940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.560841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f644866fa00e4d82ab644fb0aba8d14d, user_id=960a52f0e55440eb9e432c7c8315d12f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.565698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.576588 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2231/4456] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:35 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:35.577628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.582413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.595780 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2226/4457] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:35 2022] PUT /identity/v3/projects/f644866fa00e4d82ab644fb0aba8d14d/users/960a52f0e55440eb9e432c7c8315d12f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:35.596946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.601897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ddc4-9007-403f-a154-cf4331233eca admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.674267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.675923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.676403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.676633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] PATH_INFO: `/v3/projects/5b718fc4c73641a28b46218d8905b4bb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.678401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b718fc4c73641a28b46218d8905b4bb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.681040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.681199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b175dd-27e2-4918-99d7-e64e61c69c91 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.686725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.687494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.688067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.688067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.688918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.691081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.702478 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2227/4458] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:35.703384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.715131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855b4f-bf3b-4add-9689-681e45353fc6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.722048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.722944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.723355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.723921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.724570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.726670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.736715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b718fc4c73641a28b46218d8905b4bb', 'request_id': 'req-b24afc26-5d50-49ee-9722-58f1390e7800'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.738630 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2228/4459] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:35.739645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.745580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b718fc4c73641a28b46218d8905b4bb', 'request_id': 'req-b24afc26-5d50-49ee-9722-58f1390e7800'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.751348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8290b-c50a-4699-82de-7c0efffda4b9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.755126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b718fc4c73641a28b46218d8905b4bb', 'request_id': 'req-b24afc26-5d50-49ee-9722-58f1390e7800'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.770759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] The token cache is being invalidate because project 5b718fc4c73641a28b46218d8905b4bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:35.771097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.771841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:35.773892 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2232/4460] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:35 2022] DELETE /identity/v3/projects/5b718fc4c73641a28b46218d8905b4bb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:35.774903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.776459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.817319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cb79c-3177-428f-9447-2ddbbe29affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.818041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb79c-3177-428f-9447-2ddbbe29affe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.818488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb79c-3177-428f-9447-2ddbbe29affe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.819043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cb79c-3177-428f-9447-2ddbbe29affe admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.819842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cb79c-3177-428f-9447-2ddbbe29affe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.821897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cb79c-3177-428f-9447-2ddbbe29affe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.835325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2229/4461] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:35.836486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.836889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.837174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.859336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:35.860582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.863744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24afc26-5d50-49ee-9722-58f1390e7800 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.875149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57ee2e-86c3-4a2a-a501-7e34dfd49e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.875995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ee2e-86c3-4a2a-a501-7e34dfd49e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.876324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ee2e-86c3-4a2a-a501-7e34dfd49e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.876694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ee2e-86c3-4a2a-a501-7e34dfd49e55 admin admin] PATH_INFO: `/v3/projects/f644866fa00e4d82ab644fb0aba8d14d/users/960a52f0e55440eb9e432c7c8315d12f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.878833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57ee2e-86c3-4a2a-a501-7e34dfd49e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f644866fa00e4d82ab644fb0aba8d14d, user_id=960a52f0e55440eb9e432c7c8315d12f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.882672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57ee2e-86c3-4a2a-a501-7e34dfd49e55 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:35.887675 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2230/4462] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:35.888359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:35.889948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.898014 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2233/4463] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:35 2022] PUT /identity/v3/projects/f644866fa00e4d82ab644fb0aba8d14d/users/960a52f0e55440eb9e432c7c8315d12f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:35.902856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6ff46-ab8a-434d-8bff-74c6793c8673 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.902856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6ff46-ab8a-434d-8bff-74c6793c8673 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.902856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6ff46-ab8a-434d-8bff-74c6793c8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.905185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41b56d-6a70-4d5e-978a-c1b91907f722 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:35.922995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dce6ff46-ab8a-434d-8bff-74c6793c8673 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:35.924568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dce6ff46-ab8a-434d-8bff-74c6793c8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:35.977593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:35.979205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:35.979491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:35.979819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] PATH_INFO: `/v3/projects/cc15ada6c123417ea9015e19345f4ef7/users/9a2b71d513884244902723d25eaea646/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:35.996789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc15ada6c123417ea9015e19345f4ef7, user_id=9a2b71d513884244902723d25eaea646, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:35.999484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.006298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2234/4464] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:36.006298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee180f5b-003f-4ce3-a794-6d33e37ca132 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.006298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee180f5b-003f-4ce3-a794-6d33e37ca132 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.006679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee180f5b-003f-4ce3-a794-6d33e37ca132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.021630 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2231/4465] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:35 2022] PUT /identity/v3/projects/cc15ada6c123417ea9015e19345f4ef7/users/9a2b71d513884244902723d25eaea646/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:36.022369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.048790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ee180f5b-003f-4ce3-a794-6d33e37ca132 None None] MFA Rules not processed for user `960a52f0e55440eb9e432c7c8315d12f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:36.050201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee180f5b-003f-4ce3-a794-6d33e37ca132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:36.105296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a129ba-7ef8-4d52-a83e-371a300dc268 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.110963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c9f15-e07e-4798-a4ff-8b4232b869e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.112220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9f15-e07e-4798-a4ff-8b4232b869e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.112475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9f15-e07e-4798-a4ff-8b4232b869e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.112759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c9f15-e07e-4798-a4ff-8b4232b869e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.113526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9f15-e07e-4798-a4ff-8b4232b869e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:36.113856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9f15-e07e-4798-a4ff-8b4232b869e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.115901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c9f15-e07e-4798-a4ff-8b4232b869e0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.130288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2232/4466] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:36.131766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123722-bf60-4dc6-95ae-a4e1332063b6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.132056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123722-bf60-4dc6-95ae-a4e1332063b6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.132352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24123722-bf60-4dc6-95ae-a4e1332063b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.157246 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2235/4467] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:36.157809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee180f5b-003f-4ce3-a794-6d33e37ca132 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.168635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-24123722-bf60-4dc6-95ae-a4e1332063b6 None None] MFA Rules not processed for user `9a2b71d513884244902723d25eaea646`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:36.169924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-24123722-bf60-4dc6-95ae-a4e1332063b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:36.171108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee180f5b-003f-4ce3-a794-6d33e37ca132 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.180198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.181720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.182367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.182522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.183166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.186722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.239844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2236/4468] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:36 2022] POST /identity/v3/projects => generated 389 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:36.241365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.245226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:36.287696 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2233/4469] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:36.290964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24123722-bf60-4dc6-95ae-a4e1332063b6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.315670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24123722-bf60-4dc6-95ae-a4e1332063b6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.333807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf6151-0f14-4952-9ee2-19bcd66dc8a5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.337927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.338587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.338911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.339269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.398790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.399315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.399669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.400507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.401356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.403693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.432074 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2234/4470] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:36 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:36.433002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.436245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.438369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.438557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:36.450366 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2237/4471] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:36.451633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.454407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:36.580782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dc303-9fda-40f8-aaca-90267170ed44 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.587062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ec17a-7081-41db-9692-133217c2d708 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.593468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.595653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.596940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.597478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.597935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.598839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.599306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.599605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.604175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:36.689677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.695886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.709199 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2238/4472] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:36.710403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.723455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac00a30-5a69-49f7-93f0-e46e038ecb3d service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.732857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.733545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.733829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.734668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.735646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.737761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.742483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.744311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.761225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2239/4473] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:36.762359 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2235/4474] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:36.764971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.781990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3798f-0ede-4c24-ad25-42a24adee071 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.790646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca77ca-6fcb-4b70-b874-600207a106be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.792498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca77ca-6fcb-4b70-b874-600207a106be admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.792699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca77ca-6fcb-4b70-b874-600207a106be admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.792962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca77ca-6fcb-4b70-b874-600207a106be admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.793754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca77ca-6fcb-4b70-b874-600207a106be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.796080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca77ca-6fcb-4b70-b874-600207a106be admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.819228 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2240/4475] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:36.823865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:36.848400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308192b-1edc-4661-b8dc-b0df42a5d6d1 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:36.863055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:36.864161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.864711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.865084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] PATH_INFO: `/v3/projects/1a49ba5398834c43baabd7435e85d81b/users/a8cd93dbf4db4d899a3c6148183be9f2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:36.917111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a49ba5398834c43baabd7435e85d81b, user_id=a8cd93dbf4db4d899a3c6148183be9f2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:36.919984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:36.954186 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2236/4476] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:36 2022] PUT /identity/v3/projects/1a49ba5398834c43baabd7435e85d81b/users/a8cd93dbf4db4d899a3c6148183be9f2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:36.970690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b817-3521-4690-93c4-1914029685f2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:36.974901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b817-3521-4690-93c4-1914029685f2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:36.974901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89b817-3521-4690-93c4-1914029685f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:37.000576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7f89b817-3521-4690-93c4-1914029685f2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:37.001836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7f89b817-3521-4690-93c4-1914029685f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:37.119882 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2241/4477] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:37.184855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:37.309525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac6f2e-aac9-46d5-81c1-e14b0c74857f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:37.315871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced60f48-5724-4032-9011-0bda9e331e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:37.317702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced60f48-5724-4032-9011-0bda9e331e53 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:37.318067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced60f48-5724-4032-9011-0bda9e331e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:37.318936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced60f48-5724-4032-9011-0bda9e331e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:37.345901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced60f48-5724-4032-9011-0bda9e331e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:37.347560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced60f48-5724-4032-9011-0bda9e331e53 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:37.365898 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2237/4478] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:37.667425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b817-3521-4690-93c4-1914029685f2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:37.691953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89b817-3521-4690-93c4-1914029685f2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:37.706715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:37.707733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:37.708184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:37.708413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] PATH_INFO: `/v3/users/9a2b71d513884244902723d25eaea646` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:37.709843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2b71d513884244902723d25eaea646)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:37.711905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:37.830278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2b71d513884244902723d25eaea646'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:37.831839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2b71d513884244902723d25eaea646'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:37.847695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2b71d513884244902723d25eaea646'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:37.848963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2b71d513884244902723d25eaea646'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:37.863601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2b71d513884244902723d25eaea646'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:37.900905 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2242/4479] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:37 2022] DELETE /identity/v3/users/9a2b71d513884244902723d25eaea646 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:37.907018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f89c0-a95c-4eed-89b3-27202202fe08 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:37.907314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f89c0-a95c-4eed-89b3-27202202fe08 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:37.907594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f89c0-a95c-4eed-89b3-27202202fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:37.934270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2a9f89c0-a95c-4eed-89b3-27202202fe08 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:37.936810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2a9f89c0-a95c-4eed-89b3-27202202fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:38.066593 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2238/4480] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:38.128596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:38.130185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:38.230842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe794e1-9ea8-49cc-b48a-b58c37f8f6e8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:38.237837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:38.238561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:38.238898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:38.239184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:38.256517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:38.258564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:38.272166 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2243/4481] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:38.707414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c227-e2d8-47fe-b44c-063b57d61b9c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:38.708079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c227-e2d8-47fe-b44c-063b57d61b9c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:38.708079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c227-e2d8-47fe-b44c-063b57d61b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:38.756744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6d26c227-e2d8-47fe-b44c-063b57d61b9c None None] MFA Rules not processed for user `a8cd93dbf4db4d899a3c6148183be9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:38.759400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d26c227-e2d8-47fe-b44c-063b57d61b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:38.833093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:38.834729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:38.860281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72797d96-6321-43aa-b188-c5cb8701dff5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:38.872827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:38.873884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:38.874159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:38.874432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] PATH_INFO: `/v3/projects/cc15ada6c123417ea9015e19345f4ef7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:38.877886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc15ada6c123417ea9015e19345f4ef7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:38.880144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:38.971589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc15ada6c123417ea9015e19345f4ef7', 'request_id': 'req-7b8d4719-f614-47cf-83ce-d05c259e8666'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:38.976113 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2239/4482] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:38.980429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc15ada6c123417ea9015e19345f4ef7', 'request_id': 'req-7b8d4719-f614-47cf-83ce-d05c259e8666'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:38.988240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:38.988524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:38.988637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.002238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc15ada6c123417ea9015e19345f4ef7', 'request_id': 'req-7b8d4719-f614-47cf-83ce-d05c259e8666'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:39.019802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] The token cache is being invalidate because project cc15ada6c123417ea9015e19345f4ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:39.020306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:39.021758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7b8d4719-f614-47cf-83ce-d05c259e8666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:39.028446 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2244/4483] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:38 2022] DELETE /identity/v3/projects/cc15ada6c123417ea9015e19345f4ef7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:39.031637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86e00-0833-44ac-a137-ea97e5512825 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.033169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86e00-0833-44ac-a137-ea97e5512825 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.033646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd86e00-0833-44ac-a137-ea97e5512825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.038472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] MFA Rules not processed for user `a8cd93dbf4db4d899a3c6148183be9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:39.041731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:39.058999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-abd86e00-0833-44ac-a137-ea97e5512825 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:39.061322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-abd86e00-0833-44ac-a137-ea97e5512825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:39.113142 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2240/4484] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:39.134973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:39.137067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:39.181679 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2245/4485] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:39.191591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3e67-4e71-45f3-81af-7f5339971585 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.191820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3e67-4e71-45f3-81af-7f5339971585 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.192206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa3e67-4e71-45f3-81af-7f5339971585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.226192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4bfa3e67-4e71-45f3-81af-7f5339971585 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:39.228346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4bfa3e67-4e71-45f3-81af-7f5339971585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:39.256239 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2246/4486] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:39.260427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3e67-4e71-45f3-81af-7f5339971585 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:39.275679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79920af9-a455-4367-b04d-bf4fcf1a746d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:39.278639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa3e67-4e71-45f3-81af-7f5339971585 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:39.284627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:39.285762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.286209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.286345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:39.286903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.287407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.287807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.288278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.289452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:39.290005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:39.291101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:39.293284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:39.306550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:39.308524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:39.314544 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2247/4487] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:57:39.317786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:39.328384 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2241/4488] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:39.335339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e91e9c-64e6-4088-bcc5-ffa9c44722cb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:39.344656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:39.345438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.345724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.346149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.346882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:39.348985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:39.400490 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2248/4489] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:39 2022] POST /identity/v3/projects => generated 407 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:39.407341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:39.427396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f38e-13c5-4e12-a33d-d8e8ceb58d58 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:39.513906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:39.515211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.516395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.516711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.517995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:39.520326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:39.557094 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2242/4490] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:39 2022] POST /identity/v3/users => generated 304 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:39.563425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:39.587710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33fa1f-a896-4b5b-93d0-6c9de01d3c37 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:39.601257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:39.602107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.602492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.602923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.603764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:39.605789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:39.621581 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2249/4491] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:39.627623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:39.639650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd91be7-c15d-402f-8cff-1b509e36fd95 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:39.654490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fbcd0-c143-4436-a3af-ec69ec246ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:39.655489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fbcd0-c143-4436-a3af-ec69ec246ddd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.655785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fbcd0-c143-4436-a3af-ec69ec246ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.656335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fbcd0-c143-4436-a3af-ec69ec246ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.657506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fbcd0-c143-4436-a3af-ec69ec246ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:39.659538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fbcd0-c143-4436-a3af-ec69ec246ddd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:39.679200 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2243/4492] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:39.681658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:39.695201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7151-6793-4085-9490-579e62c2dd53 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:39.702549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:39.703990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.704411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.704694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] PATH_INFO: `/v3/projects/2e3eb0983fa54d34bc80a4d5eb3149e4/users/ee5f415e64e34f68b8c6b7d4d0d4c1c2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.727916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3eb0983fa54d34bc80a4d5eb3149e4, user_id=ee5f415e64e34f68b8c6b7d4d0d4c1c2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:39.730998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:39.751693 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2250/4493] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:39 2022] PUT /identity/v3/projects/2e3eb0983fa54d34bc80a4d5eb3149e4/users/ee5f415e64e34f68b8c6b7d4d0d4c1c2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:39.763313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112c21-5b2f-4d4b-8e01-a4b160626723 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:39.763893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112c21-5b2f-4d4b-8e01-a4b160626723 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:39.763893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f112c21-5b2f-4d4b-8e01-a4b160626723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:39.799892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0f112c21-5b2f-4d4b-8e01-a4b160626723 None None] MFA Rules not processed for user `ee5f415e64e34f68b8c6b7d4d0d4c1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:39.801872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0f112c21-5b2f-4d4b-8e01-a4b160626723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:39.914824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2244/4494] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:39.918302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.005596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f20a2a-3552-413e-afbf-b1edb4f16dd7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.011321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:40.012140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.012585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.013308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.013765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:40.016950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:40.053590 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2251/4495] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:39 2022] POST /identity/v3/projects => generated 407 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:40.055854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112c21-5b2f-4d4b-8e01-a4b160626723 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.080987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f112c21-5b2f-4d4b-8e01-a4b160626723 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.166336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:40.167229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.167518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.168000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.169573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:40.172379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:40.208609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2245/4496] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:40 2022] POST /identity/v3/users => generated 310 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:40.213121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.231329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db35bc-4789-4739-bb53-845e7f76fb1e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.257647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:40.258439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.258804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.259175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.259980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:40.260893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.263573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:40.264153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:40.285482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2252/4497] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:40.289892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.292197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4f165-0ff9-4779-b90c-27ed21adc791 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.301884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:40.304302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.305933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.306470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] PATH_INFO: `/v3/users/d8b75424e0c442b1bee0a4a9fcdf5265` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.308307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e66e69-f316-4529-93e9-8091a335556d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.310117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b75424e0c442b1bee0a4a9fcdf5265)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:40.315689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:40.315833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:40.316729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.317016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.317294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] PATH_INFO: `/v3/projects/b3c1b2d986034e3f99a315208c373aa8/users/a269e6e7ff674477a3de2d615a11f5df/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.348054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c1b2d986034e3f99a315208c373aa8, user_id=a269e6e7ff674477a3de2d615a11f5df, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:40.351174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:40.374099 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2253/4498] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:40 2022] PUT /identity/v3/projects/b3c1b2d986034e3f99a315208c373aa8/users/a269e6e7ff674477a3de2d615a11f5df/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:57:40.380478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.401290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b75424e0c442b1bee0a4a9fcdf5265'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:40.419000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b75424e0c442b1bee0a4a9fcdf5265'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:40.420181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b75424e0c442b1bee0a4a9fcdf5265'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:40.422281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b75424e0c442b1bee0a4a9fcdf5265'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:40.440199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab71fbcb-a7f9-464a-94af-ead66b3cfb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b75424e0c442b1bee0a4a9fcdf5265'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:40.471939 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2246/4499] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:40 2022] DELETE /identity/v3/users/d8b75424e0c442b1bee0a4a9fcdf5265 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:40.474148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.474578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.475346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.479706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919ec53-f389-4f53-b21a-0d400cf287fc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.499506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:40.502209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:40.574371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:40.575818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.576287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.576640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.577851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:40.580243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:40.616095 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2254/4500] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:40.619229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.623939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:40.632168 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2247/4501] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:40.656619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2bd4d-7c5b-4545-b900-eb90d12c0ca4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.669722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1ecb9-b916-45a6-9088-86dc9f000caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:40.672872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ecb9-b916-45a6-9088-86dc9f000caf admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.673242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ecb9-b916-45a6-9088-86dc9f000caf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.673983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ecb9-b916-45a6-9088-86dc9f000caf admin admin] PATH_INFO: `/v3/projects/b3c1b2d986034e3f99a315208c373aa8/users/a269e6e7ff674477a3de2d615a11f5df/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.676283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1ecb9-b916-45a6-9088-86dc9f000caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c1b2d986034e3f99a315208c373aa8, user_id=a269e6e7ff674477a3de2d615a11f5df, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:40.680556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1ecb9-b916-45a6-9088-86dc9f000caf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:40.692086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:40.695330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:40.716145 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2255/4502] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:40 2022] PUT /identity/v3/projects/b3c1b2d986034e3f99a315208c373aa8/users/a269e6e7ff674477a3de2d615a11f5df/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:40.721378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d35479-d825-4486-9201-d80dc352be46 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:40.723338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d35479-d825-4486-9201-d80dc352be46 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:40.723338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d35479-d825-4486-9201-d80dc352be46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:40.794288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-26d35479-d825-4486-9201-d80dc352be46 None None] MFA Rules not processed for user `a269e6e7ff674477a3de2d615a11f5df`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:40.808430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-26d35479-d825-4486-9201-d80dc352be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:40.889475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c21a3f-f06d-4aac-ac2a-af4fdb91648a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:40.947396 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2256/4503] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:40 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:40.959956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d35479-d825-4486-9201-d80dc352be46 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:41.016449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:41.017333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:41.017751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:41.018035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:41.091647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d35479-d825-4486-9201-d80dc352be46 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:41.097773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:41.098821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:41.099166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:41.099928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:41.102787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:41.117154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:41.120477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:41.138852 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2248/4504] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:41.240967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:41.246881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:41.274287 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2257/4505] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:41.824768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:41.826257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:41.841975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebcd44-8f87-4fc6-bda0-13f1be111d66 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:41.848878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:41.849749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:41.850302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:41.850743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] PATH_INFO: `/v3/users/e412ac7281b34df69be98088aec5fd99` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:41.852652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e412ac7281b34df69be98088aec5fd99)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:41.855074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:41.941030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e412ac7281b34df69be98088aec5fd99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:41.954723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e412ac7281b34df69be98088aec5fd99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:41.956978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e412ac7281b34df69be98088aec5fd99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:41.958830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e412ac7281b34df69be98088aec5fd99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:41.968109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:41.975138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:41.979179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e412ac7281b34df69be98088aec5fd99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.010864 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2249/4506] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:41 2022] DELETE /identity/v3/users/e412ac7281b34df69be98088aec5fd99 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:42.015723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:42.017431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:42.020662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59775fea-1e4a-4f22-82e7-5fc8d1312b2f service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:42.110812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:42.111733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:42.112018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:42.112262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] PATH_INFO: `/v3/projects/c1a8e41a97544b71897f42d89e04854f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:42.113509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a8e41a97544b71897f42d89e04854f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:42.115473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:42.163761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c27d46-2b0c-4aba-b364-76cbef02fa5a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:42.174601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:42.176012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:42.176374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:42.177735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:42.181038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:42.221996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a8e41a97544b71897f42d89e04854f', 'request_id': 'req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.229898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a8e41a97544b71897f42d89e04854f', 'request_id': 'req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.239817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a8e41a97544b71897f42d89e04854f', 'request_id': 'req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.254869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] The token cache is being invalidate because project c1a8e41a97544b71897f42d89e04854f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:42.255166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.256733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb77ab64-04d8-4900-9b4c-0c88bf79c8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.258671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2258/4507] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:41 2022] DELETE /identity/v3/projects/c1a8e41a97544b71897f42d89e04854f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:42.260047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:42.260362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:42.260641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:42.281921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:42.283559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:42.314425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:42.317766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:42.350447 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2250/4508] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:42 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:42.351972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:42.352343 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2259/4509] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:42.357555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:42.365842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:42.369518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:42.389662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e076e8-de17-488e-89e1-5c09f257f2fd service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:42.404999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:42.408678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:42.408984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:42.409634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] PATH_INFO: `/v3/users/960a52f0e55440eb9e432c7c8315d12f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:42.413791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=960a52f0e55440eb9e432c7c8315d12f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:42.423322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:42.447218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb39f5-7cc0-43a8-b677-1c83d5b51678 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:42.451830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6058f5a-cee6-459a-a3e4-0d514320734e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:42.453138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058f5a-cee6-459a-a3e4-0d514320734e service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:42.453637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058f5a-cee6-459a-a3e4-0d514320734e service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:42.453933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6058f5a-cee6-459a-a3e4-0d514320734e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:42.481129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6058f5a-cee6-459a-a3e4-0d514320734e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:42.483068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6058f5a-cee6-459a-a3e4-0d514320734e service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:42.497086 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2260/4510] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:42.539871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960a52f0e55440eb9e432c7c8315d12f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.563027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960a52f0e55440eb9e432c7c8315d12f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.563989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960a52f0e55440eb9e432c7c8315d12f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.564778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960a52f0e55440eb9e432c7c8315d12f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.583796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960a52f0e55440eb9e432c7c8315d12f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:42.614101 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2251/4511] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:42 2022] DELETE /identity/v3/users/960a52f0e55440eb9e432c7c8315d12f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:42.813663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:42.814392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:42.815123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:42.881840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:42.883205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:43.041627 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2261/4512] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:57:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:43.063567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:43.066158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:43.139552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:43.141539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:43.252459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41daffd-600f-47d6-b174-42b348faec6d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:43.291870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:43.292973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:43.296032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:43.297587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] PATH_INFO: `/v3/projects/f62f599384054f23bddfbc3b3d1abf3d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:43.303186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62f599384054f23bddfbc3b3d1abf3d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:43.307336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:43.346894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22687cb-e0da-4d40-9d2a-a211dcc6f11f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:43.354496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:43.355587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:43.355956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:43.356450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:43.375833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:43.377997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:43.389755 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2262/4513] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:57:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 21:57:43.391390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:43.393812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:43.420523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62f599384054f23bddfbc3b3d1abf3d', 'request_id': 'req-cffa573b-d277-4855-8216-24306c897cc1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.422608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fd09d-5c2a-432d-886e-31d5577af525 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:43.431088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62f599384054f23bddfbc3b3d1abf3d', 'request_id': 'req-cffa573b-d277-4855-8216-24306c897cc1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.445126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62f599384054f23bddfbc3b3d1abf3d', 'request_id': 'req-cffa573b-d277-4855-8216-24306c897cc1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.464601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] The token cache is being invalidate because project f62f599384054f23bddfbc3b3d1abf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:43.464912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.465584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.469784 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2252/4514] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:43 2022] DELETE /identity/v3/projects/f62f599384054f23bddfbc3b3d1abf3d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:43.475974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:43.478068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:43.538428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:43.540214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:43.542454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:43.543795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] PATH_INFO: `/v3/projects/f644866fa00e4d82ab644fb0aba8d14d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:43.546435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f644866fa00e4d82ab644fb0aba8d14d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:43.550380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:43.668567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa573b-d277-4855-8216-24306c897cc1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:43.706008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f644866fa00e4d82ab644fb0aba8d14d', 'request_id': 'req-87fd2468-a21f-430b-a6c7-283929ba6e37'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.726634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f644866fa00e4d82ab644fb0aba8d14d', 'request_id': 'req-87fd2468-a21f-430b-a6c7-283929ba6e37'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.754878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f644866fa00e4d82ab644fb0aba8d14d', 'request_id': 'req-87fd2468-a21f-430b-a6c7-283929ba6e37'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.776720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] The token cache is being invalidate because project f644866fa00e4d82ab644fb0aba8d14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:43.778452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.782210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87fd2468-a21f-430b-a6c7-283929ba6e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:43.786440 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2263/4515] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:43 2022] DELETE /identity/v3/projects/f644866fa00e4d82ab644fb0aba8d14d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:43.795057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d98a9-dbb7-4b40-8eb7-451076e44bb3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:43.799208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d98a9-dbb7-4b40-8eb7-451076e44bb3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:43.799208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d98a9-dbb7-4b40-8eb7-451076e44bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:43.866351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-514d98a9-dbb7-4b40-8eb7-451076e44bb3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:43.871490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-514d98a9-dbb7-4b40-8eb7-451076e44bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:43.920639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:43.922030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:43.922574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:43.922986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] PATH_INFO: `/v3/users/4a7eefc77d6f45c4a1478d0af8be0ccd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:43.935484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7eefc77d6f45c4a1478d0af8be0ccd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:43.938535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:44.037245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7eefc77d6f45c4a1478d0af8be0ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:44.055197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7eefc77d6f45c4a1478d0af8be0ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:44.056622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7eefc77d6f45c4a1478d0af8be0ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:44.058009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7eefc77d6f45c4a1478d0af8be0ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:44.069262 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2264/4516] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:44.078153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7eefc77d6f45c4a1478d0af8be0ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:44.080653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6dae5-3fac-4a57-8742-96c2c97314b6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.081350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6dae5-3fac-4a57-8742-96c2c97314b6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.081350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6dae5-3fac-4a57-8742-96c2c97314b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.135741 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2253/4517] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:43 2022] DELETE /identity/v3/users/4a7eefc77d6f45c4a1478d0af8be0ccd => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:44.186043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cad6dae5-3fac-4a57-8742-96c2c97314b6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:44.190557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cad6dae5-3fac-4a57-8742-96c2c97314b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:44.409973 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2265/4518] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:44.414073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:44.439180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63bd8f-2242-4cc5-a678-8e39ae6092b4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:44.456170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:44.457482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.459309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.459800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.462859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:44.463391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:44.467763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:44.522711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2254/4519] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:44.525404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6dae5-3fac-4a57-8742-96c2c97314b6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:44.539941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6dae5-3fac-4a57-8742-96c2c97314b6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:44.553531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a948aab-c72c-43cf-bc4c-d8abce55a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:44.554210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948aab-c72c-43cf-bc4c-d8abce55a56b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.554492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948aab-c72c-43cf-bc4c-d8abce55a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.554765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a948aab-c72c-43cf-bc4c-d8abce55a56b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.555477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948aab-c72c-43cf-bc4c-d8abce55a56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:44.557402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a948aab-c72c-43cf-bc4c-d8abce55a56b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:44.616641 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2266/4520] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:44 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:44.621182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:44.637234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad27da-0d3c-4cf2-acf7-4f5675eae8b9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:44.644241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bada7-5abb-48d3-8a8c-9f8f9ef968e9 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.644764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bada7-5abb-48d3-8a8c-9f8f9ef968e9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.645203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412bada7-5abb-48d3-8a8c-9f8f9ef968e9 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.646853 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2267/4521] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 21:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 21:57:44.663326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.663697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.663980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.708143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:44.716810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:44.839707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:44.841006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.841301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.841579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.842275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:44.851634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:44.875718 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2268/4522] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:57:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:44.892823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:44.899956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:44.912729 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2255/4523] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:44 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:44.916478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:44.929496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2c1ff-292d-465b-852f-4f4e4ba9dbd8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:44.931213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348d58a-8d7f-4b82-a4c7-672781f8aec5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:44.943732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:44.945364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.946381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.947413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.948024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:44.950108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:44.952322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:44.953810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:44.955786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:44.959604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:44.965853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:44.971107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:44.989670 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2256/4524] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:44.992271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:44.996558 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2269/4525] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:57:45.005016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f2fe4-a206-4926-9967-ab906aca29bc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:45.011756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ec4b4-9180-47f2-8ebe-ee9fd18091e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:45.013468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ec4b4-9180-47f2-8ebe-ee9fd18091e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:45.013769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ec4b4-9180-47f2-8ebe-ee9fd18091e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:45.014107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ec4b4-9180-47f2-8ebe-ee9fd18091e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:45.019420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ec4b4-9180-47f2-8ebe-ee9fd18091e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:45.019420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ec4b4-9180-47f2-8ebe-ee9fd18091e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:45.029920 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2257/4526] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:45.034521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:45.049614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43876d-6f7f-4ef3-969e-8db61d8e9f14 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:45.055764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:45.056682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:45.056963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:45.057239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] PATH_INFO: `/v3/projects/b4e1fd3f6746425193dfb613e612b3f5/users/08ddd697d0d5446fbdb689d763a62bc0/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:45.077136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e1fd3f6746425193dfb613e612b3f5, user_id=08ddd697d0d5446fbdb689d763a62bc0, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:45.081913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:45.103548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2270/4527] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:45 2022] PUT /identity/v3/projects/b4e1fd3f6746425193dfb613e612b3f5/users/08ddd697d0d5446fbdb689d763a62bc0/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:45.114969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:45.115336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:45.115574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:45.170047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] MFA Rules not processed for user `08ddd697d0d5446fbdb689d763a62bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:45.173711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:45.454682 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2258/4528] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:45.530815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:45.533074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:45.724285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc963-ec50-41b2-963a-498a571a8619 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:45.737332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ef46b-a8bd-43c2-a98c-38dc0030fc33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:45.740279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ef46b-a8bd-43c2-a98c-38dc0030fc33 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:45.741107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ef46b-a8bd-43c2-a98c-38dc0030fc33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:45.742976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ef46b-a8bd-43c2-a98c-38dc0030fc33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:45.765890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ef46b-a8bd-43c2-a98c-38dc0030fc33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:45.769377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ef46b-a8bd-43c2-a98c-38dc0030fc33 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:45.784798 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2271/4529] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:46.125603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:46.127651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:46.272637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e57c57-9004-4c1e-8838-7fbe1b9f988f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:46.283228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:46.284197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:46.291988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:46.292392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] PATH_INFO: `/v3/projects/63a7b47ae563401ea101cae6c9c17797` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:46.294096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a7b47ae563401ea101cae6c9c17797)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:46.296166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:46.389428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a7b47ae563401ea101cae6c9c17797', 'request_id': 'req-25442f3e-c304-4c9c-8f79-543eb5be7a53'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:46.400408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a7b47ae563401ea101cae6c9c17797', 'request_id': 'req-25442f3e-c304-4c9c-8f79-543eb5be7a53'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:46.419364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a7b47ae563401ea101cae6c9c17797', 'request_id': 'req-25442f3e-c304-4c9c-8f79-543eb5be7a53'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:46.440098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] The token cache is being invalidate because project 63a7b47ae563401ea101cae6c9c17797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:46.440098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:46.445408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25442f3e-c304-4c9c-8f79-543eb5be7a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:46.449735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2259/4530] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:46 2022] DELETE /identity/v3/projects/63a7b47ae563401ea101cae6c9c17797 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:46.457377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a136f-4f55-44c0-a9c8-1391e71887f7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:46.458385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a136f-4f55-44c0-a9c8-1391e71887f7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:46.458928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a136f-4f55-44c0-a9c8-1391e71887f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:46.495863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fa2a136f-4f55-44c0-a9c8-1391e71887f7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:46.498058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fa2a136f-4f55-44c0-a9c8-1391e71887f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:46.636368 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2272/4531] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:46.644831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06faa7-4372-4348-a552-137987050bda None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:46.645124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06faa7-4372-4348-a552-137987050bda None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:46.645569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06faa7-4372-4348-a552-137987050bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:46.684673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bb06faa7-4372-4348-a552-137987050bda None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:46.690194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bb06faa7-4372-4348-a552-137987050bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:46.710924 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2260/4532] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:46.715398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a136f-4f55-44c0-a9c8-1391e71887f7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:46.740569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a136f-4f55-44c0-a9c8-1391e71887f7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:46.771903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:46.772790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:46.773317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:46.773752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:46.777874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:46.779196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:46.782639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:46.825210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2273/4533] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:46.830665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06faa7-4372-4348-a552-137987050bda None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:46.848999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06faa7-4372-4348-a552-137987050bda None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:46.863231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:46.863958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:46.864887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:46.867125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:46.880835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:46.892634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:46.968393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2261/4534] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:46 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:46.968870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:46.979521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811c45b-a81a-4508-a060-d56df0ccb437 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:47.113182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:47.114011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:47.114394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:47.114782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:47.115576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:47.119023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:47.164793 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2274/4535] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:46 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:57:47.169087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:47.185489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777879de-77eb-4d0c-a51c-1f3629306758 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:47.194365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:47.195436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:47.195930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:47.196571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:47.197486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:47.199913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:47.219479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:47.226175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2262/4536] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:47.244134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a2715-4cea-45fa-bb3c-504f1ab4e641 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:47.252691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5f9bf-27f2-466c-9ac6-4b4d7282fb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:47.253977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5f9bf-27f2-466c-9ac6-4b4d7282fb24 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:47.254490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5f9bf-27f2-466c-9ac6-4b4d7282fb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:47.255149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5f9bf-27f2-466c-9ac6-4b4d7282fb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:47.256079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5f9bf-27f2-466c-9ac6-4b4d7282fb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:47.257892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5f9bf-27f2-466c-9ac6-4b4d7282fb24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:47.285534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:47.298590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab793-0f33-4ca1-b13c-bdb325c0fc3a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:47.299288 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2275/4537] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:47.308471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:47.310182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:47.310699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:47.311731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] PATH_INFO: `/v3/projects/1edfc7f56d744382b1bb265c49f95f9a/users/e8d05fb1a0414dce94a28d7080bab8a8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:47.334971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1edfc7f56d744382b1bb265c49f95f9a, user_id=e8d05fb1a0414dce94a28d7080bab8a8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:47.338969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:47.369599 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2263/4538] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:47 2022] PUT /identity/v3/projects/1edfc7f56d744382b1bb265c49f95f9a/users/e8d05fb1a0414dce94a28d7080bab8a8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:47.384313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51b3f-fe7f-4503-9f6a-e26f085a4a30 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:47.385030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51b3f-fe7f-4503-9f6a-e26f085a4a30 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:47.385804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e51b3f-fe7f-4503-9f6a-e26f085a4a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:47.456383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a9e51b3f-fe7f-4503-9f6a-e26f085a4a30 None None] MFA Rules not processed for user `e8d05fb1a0414dce94a28d7080bab8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:47.458528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9e51b3f-fe7f-4503-9f6a-e26f085a4a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:47.598557 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2276/4539] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:47.605919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:47.608183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:47.749717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87a07-59d9-4c0f-8b61-f7840e4a5bac admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:47.760128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c49f1f-820d-4975-87cf-e150f9ec0657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:47.761508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49f1f-820d-4975-87cf-e150f9ec0657 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:47.762068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49f1f-820d-4975-87cf-e150f9ec0657 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:47.762613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c49f1f-820d-4975-87cf-e150f9ec0657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:47.773785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c49f1f-820d-4975-87cf-e150f9ec0657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:47.776767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c49f1f-820d-4975-87cf-e150f9ec0657 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:47.788977 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2264/4540] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:48.699796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e51b3f-fe7f-4503-9f6a-e26f085a4a30 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:48.833653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e51b3f-fe7f-4503-9f6a-e26f085a4a30 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:48.847964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:48.849383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:48.852380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:48.867566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] PATH_INFO: `/v3/users/e8d05fb1a0414dce94a28d7080bab8a8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:48.872904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d05fb1a0414dce94a28d7080bab8a8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:48.884167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:49.003481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d05fb1a0414dce94a28d7080bab8a8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:49.008340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d05fb1a0414dce94a28d7080bab8a8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:49.026936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d05fb1a0414dce94a28d7080bab8a8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:49.027821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d05fb1a0414dce94a28d7080bab8a8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:49.049286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d05fb1a0414dce94a28d7080bab8a8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:49.083951 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2277/4541] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:57:48 2022] DELETE /identity/v3/users/e8d05fb1a0414dce94a28d7080bab8a8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:49.091111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:49.093070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:49.094339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:49.150036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:49.153194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:49.324236 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2265/4542] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:49.391555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:49.394002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:49.642601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d315b2-828a-44e1-9d83-8f7b61403f89 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:49.680837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fd398-e1f8-4773-abe2-c3c84d98d202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:49.681563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd398-e1f8-4773-abe2-c3c84d98d202 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:49.682133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd398-e1f8-4773-abe2-c3c84d98d202 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:49.682609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fd398-e1f8-4773-abe2-c3c84d98d202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:49.705539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fd398-e1f8-4773-abe2-c3c84d98d202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:49.707908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fd398-e1f8-4773-abe2-c3c84d98d202 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:49.723613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2278/4543] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:57:52.057699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:52.060642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:52.083067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d629d8-8441-47ba-aedf-6fb5fcd27171 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:52.099637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:52.102113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:52.104784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:52.105308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] PATH_INFO: `/v3/projects/1edfc7f56d744382b1bb265c49f95f9a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:52.108532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1edfc7f56d744382b1bb265c49f95f9a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:52.114313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:52.234463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1edfc7f56d744382b1bb265c49f95f9a', 'request_id': 'req-34959db5-909c-451a-81d1-5f9163a1e856'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:52.262050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1edfc7f56d744382b1bb265c49f95f9a', 'request_id': 'req-34959db5-909c-451a-81d1-5f9163a1e856'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:52.295298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1edfc7f56d744382b1bb265c49f95f9a', 'request_id': 'req-34959db5-909c-451a-81d1-5f9163a1e856'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:52.326684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] The token cache is being invalidate because project 1edfc7f56d744382b1bb265c49f95f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:57:52.327482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:52.329994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-34959db5-909c-451a-81d1-5f9163a1e856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:57:52.332464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2266/4544] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:57:52 2022] DELETE /identity/v3/projects/1edfc7f56d744382b1bb265c49f95f9a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:52.341827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0e62-6c88-456b-930a-26ee9ddf8d5a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:52.342439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0e62-6c88-456b-930a-26ee9ddf8d5a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:52.342817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f0e62-6c88-456b-930a-26ee9ddf8d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:52.375668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e60f0e62-6c88-456b-930a-26ee9ddf8d5a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:52.377531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e60f0e62-6c88-456b-930a-26ee9ddf8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:52.473655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2279/4545] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:57:52.481718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e002a3-d2af-4853-866b-c8a7bf25f8ca None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:52.482261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e002a3-d2af-4853-866b-c8a7bf25f8ca None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:52.482656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e002a3-d2af-4853-866b-c8a7bf25f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:52.518165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-68e002a3-d2af-4853-866b-c8a7bf25f8ca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:52.520118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68e002a3-d2af-4853-866b-c8a7bf25f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:52.553778 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2267/4546] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:52.558727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f0e62-6c88-456b-930a-26ee9ddf8d5a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:52.586763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f0e62-6c88-456b-930a-26ee9ddf8d5a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:52.601596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:52.603287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:52.603576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:52.604273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:52.605187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:57:52.606361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:52.608072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:52.642857 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2280/4547] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:57:52.644823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e002a3-d2af-4853-866b-c8a7bf25f8ca None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:52.661025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e002a3-d2af-4853-866b-c8a7bf25f8ca None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:52.673344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:52.674037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:52.674319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:52.674599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:52.675365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:52.677597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:52.736182 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2268/4548] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:57:52 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:52.740951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:52.759051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057e1e4-00ca-4096-87ce-a2fed0ebc9e8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:52.910172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:52.911627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:52.915094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:52.915571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:52.917116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:52.923196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:52.979120 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2281/4549] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:57:52 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:57:52.983205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:53.006433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93121dde-9334-4b94-845b-78597279b6de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:53.027239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:53.031995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:53.032287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:53.032617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:53.033378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:53.040679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:53.078092 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2269/4550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:57:53.079652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:53.101361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf7057-a88d-4b86-9063-d6f362744d72 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:53.131454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da9314-2d72-4cbf-9c5a-8f7cd2391f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:53.132329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da9314-2d72-4cbf-9c5a-8f7cd2391f13 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:53.132689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da9314-2d72-4cbf-9c5a-8f7cd2391f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:53.132956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da9314-2d72-4cbf-9c5a-8f7cd2391f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:53.138281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da9314-2d72-4cbf-9c5a-8f7cd2391f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:53.141537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da9314-2d72-4cbf-9c5a-8f7cd2391f13 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:53.184500 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2282/4551] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:57:53.189321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:53.214444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7c5c4-a96c-4d39-bf7e-50aabdefc772 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:53.248655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:53.249711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:53.249999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:53.250282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] PATH_INFO: `/v3/projects/150a87722b1c4b659e8a918d6a22c739/users/fcebb1ddd0bd4445aa0070c0b66bd259/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:53.304525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=150a87722b1c4b659e8a918d6a22c739, user_id=fcebb1ddd0bd4445aa0070c0b66bd259, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:53.307591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:53.347356 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2270/4552] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:57:53 2022] PUT /identity/v3/projects/150a87722b1c4b659e8a918d6a22c739/users/fcebb1ddd0bd4445aa0070c0b66bd259/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:57:53.353830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:53.354325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:53.354456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:53.408577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:57:53.409839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:53.575541 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2283/4553] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:57:53.602314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:57:53.605000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:57:53.750480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776af57-6cc5-4a9b-af3a-dc59c72d8721 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:57:53.758975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:57:53.759648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:57:53.759927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:57:53.760971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:57:53.804862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:57:53.808058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:57:53.826642 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2271/4554] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:01.583317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:01.585757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:01.616126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b8c78-e9ff-438f-b8da-3dc93b764821 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:01.633940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:01.635239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:01.635711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:01.636381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] PATH_INFO: `/v3/users/08ddd697d0d5446fbdb689d763a62bc0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:01.638069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ddd697d0d5446fbdb689d763a62bc0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:01.640955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:01.696813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:01.698276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:01.735491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ddd697d0d5446fbdb689d763a62bc0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.736388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ddd697d0d5446fbdb689d763a62bc0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.741736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1f41a-64dc-48ee-8b77-5327344fe930 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:01.745258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ddd697d0d5446fbdb689d763a62bc0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.752362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:01.752787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ddd697d0d5446fbdb689d763a62bc0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.754736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:01.755433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:01.756340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] PATH_INFO: `/v3/users/ee5f415e64e34f68b8c6b7d4d0d4c1c2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:01.758162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5f415e64e34f68b8c6b7d4d0d4c1c2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:01.760375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:01.798394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c8683cca-25c2-4cbe-b1b8-a15144b161f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ddd697d0d5446fbdb689d763a62bc0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.839210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2284/4555] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:01 2022] DELETE /identity/v3/users/08ddd697d0d5446fbdb689d763a62bc0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:01.840152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5f415e64e34f68b8c6b7d4d0d4c1c2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.840627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:01.841177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:01.841735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:01.855848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5f415e64e34f68b8c6b7d4d0d4c1c2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.856802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5f415e64e34f68b8c6b7d4d0d4c1c2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.859583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5f415e64e34f68b8c6b7d4d0d4c1c2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.870487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:01.871896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:01.872780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-356d487e-1fb4-499d-985f-77449b4ec8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5f415e64e34f68b8c6b7d4d0d4c1c2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:01.908881 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2272/4556] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:01 2022] DELETE /identity/v3/users/ee5f415e64e34f68b8c6b7d4d0d4c1c2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:01.916545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb1362-2d01-4873-8146-26731c6d2425 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:01.917158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb1362-2d01-4873-8146-26731c6d2425 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:01.917677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb1362-2d01-4873-8146-26731c6d2425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:01.959459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c8eb1362-2d01-4873-8146-26731c6d2425 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:01.963859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c8eb1362-2d01-4873-8146-26731c6d2425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:01.975317 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2285/4557] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:01.986326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:01.991219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:02.113553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442f389-253a-4734-9a82-5e47df3cd040 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:02.136365 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2273/4558] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:58:02.148641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb1362-2d01-4873-8146-26731c6d2425 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:02.209622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:02.210400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:02.210906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:02.211285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:02.225195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:02.228424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:02.242862 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2286/4559] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:02.246028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb1362-2d01-4873-8146-26731c6d2425 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:02.250515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:02.251435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:02.251875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:02.252176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:02.262162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:02.263649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:02.276618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2274/4560] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:02.548921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:02.551852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:02.581264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fad6f2-41ef-462a-a29a-00cbdc1bddbe service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:02.592245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:02.593426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:02.593647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:02.593926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] PATH_INFO: `/v3/projects/2e3eb0983fa54d34bc80a4d5eb3149e4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:02.595783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3eb0983fa54d34bc80a4d5eb3149e4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:02.602060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:02.705275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3eb0983fa54d34bc80a4d5eb3149e4', 'request_id': 'req-47244e82-6b67-4860-aa64-00d40fe3dd73'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:02.714799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3eb0983fa54d34bc80a4d5eb3149e4', 'request_id': 'req-47244e82-6b67-4860-aa64-00d40fe3dd73'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:02.734114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3eb0983fa54d34bc80a4d5eb3149e4', 'request_id': 'req-47244e82-6b67-4860-aa64-00d40fe3dd73'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:02.765394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] The token cache is being invalidate because project 2e3eb0983fa54d34bc80a4d5eb3149e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:02.765812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:02.766919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:02.769291 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2287/4561] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:02 2022] DELETE /identity/v3/projects/2e3eb0983fa54d34bc80a4d5eb3149e4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:02.773095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:02.785630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:02.788465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba87f0-f84b-4986-9dc0-7db895ca1fcd service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:02.790035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:02.918601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:02.919514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:02.919800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:02.920080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] PATH_INFO: `/v3/users/a269e6e7ff674477a3de2d615a11f5df` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:02.924200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a269e6e7ff674477a3de2d615a11f5df)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:02.926422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:02.945924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47244e82-6b67-4860-aa64-00d40fe3dd73 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:02.964154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:02.966538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:02.968340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:02.968859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] PATH_INFO: `/v3/projects/b4e1fd3f6746425193dfb613e612b3f5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:02.972511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e1fd3f6746425193dfb613e612b3f5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:02.979370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.040755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a269e6e7ff674477a3de2d615a11f5df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.066733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a269e6e7ff674477a3de2d615a11f5df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.068992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a269e6e7ff674477a3de2d615a11f5df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.069922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a269e6e7ff674477a3de2d615a11f5df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.095108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-571f2920-06b5-4d72-96e0-3228fb81a673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a269e6e7ff674477a3de2d615a11f5df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.133889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e1fd3f6746425193dfb613e612b3f5', 'request_id': 'req-885ac14b-a221-4b3e-8c72-d6695511cb5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.141645 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2275/4562] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:02 2022] DELETE /identity/v3/users/a269e6e7ff674477a3de2d615a11f5df => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:58:03.145900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e1fd3f6746425193dfb613e612b3f5', 'request_id': 'req-885ac14b-a221-4b3e-8c72-d6695511cb5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.168235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e1fd3f6746425193dfb613e612b3f5', 'request_id': 'req-885ac14b-a221-4b3e-8c72-d6695511cb5b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.232199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] The token cache is being invalidate because project b4e1fd3f6746425193dfb613e612b3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:03.232740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.234622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-885ac14b-a221-4b3e-8c72-d6695511cb5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.239020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2288/4563] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:02 2022] DELETE /identity/v3/projects/b4e1fd3f6746425193dfb613e612b3f5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:03.244403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa8177-8c41-4882-8281-27748cf238f8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.244691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa8177-8c41-4882-8281-27748cf238f8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.244972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa8177-8c41-4882-8281-27748cf238f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.289841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-20fa8177-8c41-4882-8281-27748cf238f8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:03.291296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-20fa8177-8c41-4882-8281-27748cf238f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:03.435866 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2276/4564] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:03.438520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.439057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.439947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.485728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:03.489454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:03.511059 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2289/4565] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:03.512227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa8177-8c41-4882-8281-27748cf238f8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.524266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa8177-8c41-4882-8281-27748cf238f8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.547315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.559434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.559872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.560186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.561030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:58:03.561545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.563305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.566166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.567878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:03.582871 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2277/4566] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:58:03.584343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.589802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f3d99-8dc4-4a4b-a676-87a0b13302a4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.597702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb843ba5-ded7-4a7d-be3b-3fb3febfd13c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.603487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.604238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.604595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.604951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.605704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.606718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.607682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.607987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.608116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.608450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] PATH_INFO: `/v3/projects/b3c1b2d986034e3f99a315208c373aa8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.611700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c1b2d986034e3f99a315208c373aa8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.617151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.647773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2278/4567] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:03 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:58:03.648935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.695039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c1b2d986034e3f99a315208c373aa8', 'request_id': 'req-f5b4d42b-0e42-4102-8d82-1b6245a2d093'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.702692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c1b2d986034e3f99a315208c373aa8', 'request_id': 'req-f5b4d42b-0e42-4102-8d82-1b6245a2d093'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.711724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c1b2d986034e3f99a315208c373aa8', 'request_id': 'req-f5b4d42b-0e42-4102-8d82-1b6245a2d093'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.738367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] The token cache is being invalidate because project b3c1b2d986034e3f99a315208c373aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:03.738666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.740699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5b4d42b-0e42-4102-8d82-1b6245a2d093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:03.745975 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2290/4568] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:03 2022] DELETE /identity/v3/projects/b3c1b2d986034e3f99a315208c373aa8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:58:03.747735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3f09-2d9e-435c-a7b9-87e6eee171b2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.748167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3f09-2d9e-435c-a7b9-87e6eee171b2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.748593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c3f09-2d9e-435c-a7b9-87e6eee171b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.749226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72e0ff-3246-4fcd-ab2b-9828a415b61f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.771555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a67c3f09-2d9e-435c-a7b9-87e6eee171b2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:03.772970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a67c3f09-2d9e-435c-a7b9-87e6eee171b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:03.822044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.824075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.824557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.824938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.825762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.828826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.860553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2279/4569] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:03 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:03.862547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.865022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:03.871443 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2291/4570] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:03.878888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd817-c255-448d-92e9-bd6a9a7dd9b5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.879182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd817-c255-448d-92e9-bd6a9a7dd9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.879465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd817-c255-448d-92e9-bd6a9a7dd9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.880262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8a2d1-f342-4287-95af-685121ebe856 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.885658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.888025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.888511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.888974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.890477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.892600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.904499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f7dfd817-c255-448d-92e9-bd6a9a7dd9b5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:03.906694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f7dfd817-c255-448d-92e9-bd6a9a7dd9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:03.907579 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2280/4571] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:03.911497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.916400 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2292/4572] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:03.921138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfd817-c255-448d-92e9-bd6a9a7dd9b5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.923813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40e7d1-71a0-4cd2-bd7e-1bf10e52c043 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.930821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.931822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.932418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.932863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.933404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfd817-c255-448d-92e9-bd6a9a7dd9b5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.933943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.936307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.940962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.941841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.942393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.942794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.943756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:58:03.944166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.946658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:03.953468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2281/4573] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:58:03.958063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.961089 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2293/4574] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:58:03.965175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:03.972581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85fd9c-69d5-4859-bc86-c3995d14099c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.976019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13cc1-89b2-40ee-983b-618902017811 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:03.979317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae8e7b-8db8-4891-a204-efd3ad2c0dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.980422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae8e7b-8db8-4891-a204-efd3ad2c0dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.981031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae8e7b-8db8-4891-a204-efd3ad2c0dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.981520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae8e7b-8db8-4891-a204-efd3ad2c0dd8 admin admin] PATH_INFO: `/v3/projects/4295ac4ae3494ccd8aee1a736cf9f6bc/users/cd2d1719f99840248a4fd9404ecf13a5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.983875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:03.984671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:03.985056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:03.985969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:03.987647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:03.989468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.002755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae8e7b-8db8-4891-a204-efd3ad2c0dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4295ac4ae3494ccd8aee1a736cf9f6bc, user_id=cd2d1719f99840248a4fd9404ecf13a5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.007251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae8e7b-8db8-4891-a204-efd3ad2c0dd8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.029066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2294/4575] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:03 2022] POST /identity/v3/projects => generated 393 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:04.033800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.041600 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2282/4576] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:03 2022] PUT /identity/v3/projects/4295ac4ae3494ccd8aee1a736cf9f6bc/users/cd2d1719f99840248a4fd9404ecf13a5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:04.043849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a02a-7de0-4b9f-8502-be7993af9c2a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.044255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a02a-7de0-4b9f-8502-be7993af9c2a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.044770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a02a-7de0-4b9f-8502-be7993af9c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.075113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eea6a02a-7de0-4b9f-8502-be7993af9c2a None None] MFA Rules not processed for user `cd2d1719f99840248a4fd9404ecf13a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:04.077262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eea6a02a-7de0-4b9f-8502-be7993af9c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:04.130083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90396943-0270-4e63-aa0c-11c64a377a95 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.135853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.136533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.137177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.137458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.139616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.142756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.161509 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2283/4577] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:04.171517 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2295/4578] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:04 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:04.175850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6a02a-7de0-4b9f-8502-be7993af9c2a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.198919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6a02a-7de0-4b9f-8502-be7993af9c2a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.200996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.208435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:04.217161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.219645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.220116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.221051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.223575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.225839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.242245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2284/4579] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:04.244021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.255334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f12cdd-883c-486c-a373-6bb5916df7f4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.260691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.261362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.261643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.261915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.262630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.264328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.278584 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2285/4580] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:04.279361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.289388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb030e-5901-4401-9017-f3c7003ba542 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.295164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.296604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.296895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.298014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] PATH_INFO: `/v3/projects/2190f20198fd43458f1834b1233e5587/users/63b37e2805824e84afc24b155578549a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.299571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc7630-1e8b-46b0-8b64-6107d8cb44f4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.303597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8167f-16b1-47e2-8ab4-dda61be1fb38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.304497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8167f-16b1-47e2-8ab4-dda61be1fb38 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.304865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8167f-16b1-47e2-8ab4-dda61be1fb38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.305218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8167f-16b1-47e2-8ab4-dda61be1fb38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.316715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8167f-16b1-47e2-8ab4-dda61be1fb38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.317968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2190f20198fd43458f1834b1233e5587, user_id=63b37e2805824e84afc24b155578549a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.318279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8167f-16b1-47e2-8ab4-dda61be1fb38 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.322001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.332785 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2296/4581] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:04.339658 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2286/4582] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:04 2022] PUT /identity/v3/projects/2190f20198fd43458f1834b1233e5587/users/63b37e2805824e84afc24b155578549a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:04.351170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f3ad3-ada2-4260-af74-1ea49a2ef5bf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.352218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f3ad3-ada2-4260-af74-1ea49a2ef5bf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.352218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f3ad3-ada2-4260-af74-1ea49a2ef5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.427706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e42f3ad3-ada2-4260-af74-1ea49a2ef5bf None None] MFA Rules not processed for user `63b37e2805824e84afc24b155578549a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:04.429214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e42f3ad3-ada2-4260-af74-1ea49a2ef5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:04.584831 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2297/4583] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:04.590839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.684766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eeb80-8e03-482d-b3f5-2a42a2573137 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.695906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.696599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.696876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.697150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.697858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.700604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.750145 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2287/4584] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:04 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:58:04.757132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f3ad3-ada2-4260-af74-1ea49a2ef5bf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.769391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f3ad3-ada2-4260-af74-1ea49a2ef5bf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.859597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.860442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.860839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.861217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.862034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.864423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.897532 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2298/4585] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:04 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:04.907347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.919218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e305cdb-2ea1-4157-9e98-1690f6ac5b13 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:04.932025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:04.932854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:04.933140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:04.933411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:04.934126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:04.935801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:04.968603 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2288/4586] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:04.970327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:04.983954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bd360-ad11-4a36-bfd7-433440ee286a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:05.002851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:05.003769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:05.004053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:05.004332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] PATH_INFO: `/v3/projects/2e58c5e52ed24c658949691450adcdd2/users/4cf848591bb644c7aaceea0d6f0a1295/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:05.039667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e58c5e52ed24c658949691450adcdd2, user_id=4cf848591bb644c7aaceea0d6f0a1295, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:05.043074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:05.075093 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2299/4587] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:04 2022] PUT /identity/v3/projects/2e58c5e52ed24c658949691450adcdd2/users/4cf848591bb644c7aaceea0d6f0a1295/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:05.080508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:05.094309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938eeab3-768e-493c-8e12-0c5aa36c76ae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:05.193947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7225-8cc9-4300-b85e-763e48007da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:05.194400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7225-8cc9-4300-b85e-763e48007da3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:05.194958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7225-8cc9-4300-b85e-763e48007da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:05.195572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7225-8cc9-4300-b85e-763e48007da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:05.196684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa7225-8cc9-4300-b85e-763e48007da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:05.198838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa7225-8cc9-4300-b85e-763e48007da3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:05.214479 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2289/4588] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:05.216785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:05.240168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343997d-0a3d-489b-a225-9331d582c18c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:05.246600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:05.248000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:05.248540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:05.249118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] PATH_INFO: `/v3/projects/2e58c5e52ed24c658949691450adcdd2/users/4cf848591bb644c7aaceea0d6f0a1295/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:05.253673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e58c5e52ed24c658949691450adcdd2, user_id=4cf848591bb644c7aaceea0d6f0a1295, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:05.261139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:05.298006 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2300/4589] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:05 2022] PUT /identity/v3/projects/2e58c5e52ed24c658949691450adcdd2/users/4cf848591bb644c7aaceea0d6f0a1295/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:05.315405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73510ea-9227-4841-adb9-0ee76611288a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:05.315731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73510ea-9227-4841-adb9-0ee76611288a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:05.316152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73510ea-9227-4841-adb9-0ee76611288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:05.366588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d73510ea-9227-4841-adb9-0ee76611288a None None] MFA Rules not processed for user `4cf848591bb644c7aaceea0d6f0a1295`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:05.367986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d73510ea-9227-4841-adb9-0ee76611288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:05.507239 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2290/4590] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:05.519111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:05.520684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:05.600912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3186633-29fc-4d0a-8d05-501fc3be9034 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:05.604529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:05.605297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:05.605584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:05.605860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:05.616924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:05.618742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:05.628829 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2301/4591] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:07.038781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8c33-a711-4eb7-bbbb-bf6aa2973ffd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:07.039265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8c33-a711-4eb7-bbbb-bf6aa2973ffd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:07.039372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e8c33-a711-4eb7-bbbb-bf6aa2973ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:07.096132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-615e8c33-a711-4eb7-bbbb-bf6aa2973ffd None None] MFA Rules not processed for user `fcebb1ddd0bd4445aa0070c0b66bd259`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:07.097260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-615e8c33-a711-4eb7-bbbb-bf6aa2973ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:07.187503 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2291/4592] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:07.199164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:07.201187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:07.306291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c17ad6-6e63-435b-965c-47ff25c8b795 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:07.320662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b6db8-cf40-40d3-87d5-33586dd424f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:07.321494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6db8-cf40-40d3-87d5-33586dd424f8 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:07.321912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6db8-cf40-40d3-87d5-33586dd424f8 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:07.322510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b6db8-cf40-40d3-87d5-33586dd424f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:07.333924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b6db8-cf40-40d3-87d5-33586dd424f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:07.335615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b6db8-cf40-40d3-87d5-33586dd424f8 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:07.349298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2302/4593] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:08.583665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:08.584850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:08.586586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:08.656786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:08.662069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:08.803012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:08.805225 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2292/4594] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:58:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:08.805989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:08.806684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:08.822798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:08.824376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:08.841960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:08.844466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:08.872398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2303/4595] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:58:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:08.874609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:08.877582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:08.972479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594990f-37ad-430a-a8c5-9246774878f4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:08.988758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:08.989478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:08.989761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:08.990696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:09.007055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:09.010269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:09.056736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2293/4596] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:58:09.059859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba592448-b989-4fd4-a7fb-e6fa9f9881f4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:09.066817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004587aa-f361-4bdd-ae8b-10dc5d9bc51c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:09.067990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004587aa-f361-4bdd-ae8b-10dc5d9bc51c service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:09.068502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004587aa-f361-4bdd-ae8b-10dc5d9bc51c service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:09.069094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004587aa-f361-4bdd-ae8b-10dc5d9bc51c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:09.092963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004587aa-f361-4bdd-ae8b-10dc5d9bc51c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:09.094925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004587aa-f361-4bdd-ae8b-10dc5d9bc51c service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:09.141214 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2304/4597] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:58:09.915177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:10.079775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cb247-1920-46ce-9c33-808808b12a8b service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:10.102423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:10.103394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:10.103723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:10.103948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] PATH_INFO: `/v3/users/63b37e2805824e84afc24b155578549a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:10.105744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b37e2805824e84afc24b155578549a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:10.108244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:10.214009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b37e2805824e84afc24b155578549a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:10.227293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b37e2805824e84afc24b155578549a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:10.229539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b37e2805824e84afc24b155578549a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:10.230448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b37e2805824e84afc24b155578549a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:10.245967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b37e2805824e84afc24b155578549a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:10.275890 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2294/4598] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:09 2022] DELETE /identity/v3/users/63b37e2805824e84afc24b155578549a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:10.284545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:10.285515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:10.286945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:10.322977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:10.325433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:10.467405 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2305/4599] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:10.487367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:10.488125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:10.660575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc63c7e-e1c1-4319-8faf-ef6596999c43 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:10.674542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ecaa6-4103-4911-9fc1-a45cfca47507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:10.676261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecaa6-4103-4911-9fc1-a45cfca47507 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:10.676553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecaa6-4103-4911-9fc1-a45cfca47507 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:10.677749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ecaa6-4103-4911-9fc1-a45cfca47507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:10.710157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecaa6-4103-4911-9fc1-a45cfca47507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:10.711729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ecaa6-4103-4911-9fc1-a45cfca47507 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:10.741589 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2295/4600] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:11.456411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:11.458579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:11.507105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9cc4-ea09-4209-8bea-cd56a9b23dbf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:11.522672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:11.523602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:11.523885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:11.524906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] PATH_INFO: `/v3/projects/2190f20198fd43458f1834b1233e5587` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:11.526758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2190f20198fd43458f1834b1233e5587)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:11.531301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:11.587672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fa83-8ecb-4bb9-a909-936abe2e8ced None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:11.588254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fa83-8ecb-4bb9-a909-936abe2e8ced None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:11.588465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7fa83-8ecb-4bb9-a909-936abe2e8ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:11.629188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-19c7fa83-8ecb-4bb9-a909-936abe2e8ced None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:11.632730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19c7fa83-8ecb-4bb9-a909-936abe2e8ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:11.661665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2190f20198fd43458f1834b1233e5587', 'request_id': 'req-2780a7b8-529f-45fb-9b2d-61bf4b319069'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:11.676646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2190f20198fd43458f1834b1233e5587', 'request_id': 'req-2780a7b8-529f-45fb-9b2d-61bf4b319069'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:11.704946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2190f20198fd43458f1834b1233e5587', 'request_id': 'req-2780a7b8-529f-45fb-9b2d-61bf4b319069'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:11.717144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] The token cache is being invalidate because project 2190f20198fd43458f1834b1233e5587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:11.718164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:11.721862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:11.730052 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2306/4601] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:11 2022] DELETE /identity/v3/projects/2190f20198fd43458f1834b1233e5587 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:11.732620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:11.734883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:11.804809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2296/4602] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:11.897413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a7b8-529f-45fb-9b2d-61bf4b319069 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:11.913983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:11.915062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:11.915449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:11.915831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] PATH_INFO: `/v3/users/4cf848591bb644c7aaceea0d6f0a1295` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:11.917363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf848591bb644c7aaceea0d6f0a1295)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:11.919772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:12.062162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf848591bb644c7aaceea0d6f0a1295'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:12.064141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf848591bb644c7aaceea0d6f0a1295'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:12.096694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf848591bb644c7aaceea0d6f0a1295'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:12.102485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf848591bb644c7aaceea0d6f0a1295'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:12.135695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60054f8f-812a-4830-b9d5-26c59294e468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf848591bb644c7aaceea0d6f0a1295'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:12.165007 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2307/4603] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:11 2022] DELETE /identity/v3/users/4cf848591bb644c7aaceea0d6f0a1295 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:12.634405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fa83-8ecb-4bb9-a909-936abe2e8ced None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:12.656157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7fa83-8ecb-4bb9-a909-936abe2e8ced None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:12.814494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:12.815863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:12.816356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:12.816840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] PATH_INFO: `/v3/projects/2e58c5e52ed24c658949691450adcdd2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:12.818482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e58c5e52ed24c658949691450adcdd2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:12.820814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:12.916682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e58c5e52ed24c658949691450adcdd2', 'request_id': 'req-55f5ffd4-9491-4141-9c7a-1b1a840df077'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:12.945753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e58c5e52ed24c658949691450adcdd2', 'request_id': 'req-55f5ffd4-9491-4141-9c7a-1b1a840df077'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:12.970189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e58c5e52ed24c658949691450adcdd2', 'request_id': 'req-55f5ffd4-9491-4141-9c7a-1b1a840df077'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:13.004084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] The token cache is being invalidate because project 2e58c5e52ed24c658949691450adcdd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:13.004909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:13.005814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-55f5ffd4-9491-4141-9c7a-1b1a840df077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:13.008813 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2297/4604] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:12 2022] DELETE /identity/v3/projects/2e58c5e52ed24c658949691450adcdd2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:13.013294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdcee4-528a-4645-81d5-d799c44df451 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.014270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdcee4-528a-4645-81d5-d799c44df451 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.014881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdcee4-528a-4645-81d5-d799c44df451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.052723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bcbdcee4-528a-4645-81d5-d799c44df451 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:13.056595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bcbdcee4-528a-4645-81d5-d799c44df451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:13.236684 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2308/4605] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:13.246064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94748ce6-c522-4d73-b495-5e6da1b1d2c4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.246741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94748ce6-c522-4d73-b495-5e6da1b1d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.247168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94748ce6-c522-4d73-b495-5e6da1b1d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.308990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-94748ce6-c522-4d73-b495-5e6da1b1d2c4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:13.318224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-94748ce6-c522-4d73-b495-5e6da1b1d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:13.368170 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2298/4606] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:13.372763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdcee4-528a-4645-81d5-d799c44df451 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:13.385500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdcee4-528a-4645-81d5-d799c44df451 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:13.392868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:13.394120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.394555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.395017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.395887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:58:13.396533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:13.398718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:13.436065 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2309/4607] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:58:13.440262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94748ce6-c522-4d73-b495-5e6da1b1d2c4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:13.492049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94748ce6-c522-4d73-b495-5e6da1b1d2c4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:13.511009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:13.512167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.512627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.513073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.513959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:13.516969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:13.585830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:13.586846 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2299/4608] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:13 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:13.601101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40f58-8342-4422-a97e-bfa31185c2b4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:13.743097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:13.744986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.745629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.746299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.748199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:13.751268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:13.782656 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2310/4609] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:13 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:13.784241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:13.799219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a9c38-6932-4411-bb20-21e52df2b5be admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:13.810619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:13.810619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.810619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.810619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.812226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:13.815767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:13.836480 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2300/4610] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:13.840788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:13.880893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a3101-dc96-4a37-95b6-3e43556c1ea5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:13.888855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61134a9-c677-46f6-b186-48e2219a1f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:13.889971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61134a9-c677-46f6-b186-48e2219a1f93 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.890706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61134a9-c677-46f6-b186-48e2219a1f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.891150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61134a9-c677-46f6-b186-48e2219a1f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.892001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61134a9-c677-46f6-b186-48e2219a1f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:13.893973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61134a9-c677-46f6-b186-48e2219a1f93 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:13.910409 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2311/4611] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:13.911967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:13.930060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69231be7-2fc4-4e72-b1da-b536f8e06d6b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:13.937718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:13.939191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:13.939969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:13.940520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] PATH_INFO: `/v3/projects/105bb835cbb8424598141c6db1db76dd/users/24b26978cffe47498a1f1e773a983d94/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:13.961273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=105bb835cbb8424598141c6db1db76dd, user_id=24b26978cffe47498a1f1e773a983d94, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:13.968591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:13.996488 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2301/4612] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:13 2022] PUT /identity/v3/projects/105bb835cbb8424598141c6db1db76dd/users/24b26978cffe47498a1f1e773a983d94/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:14.127718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:14.128257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:14.128543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:14.221774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] MFA Rules not processed for user `24b26978cffe47498a1f1e773a983d94`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:14.229489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:14.334228 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2312/4613] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:14.340000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:14.344105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:14.497886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3eb3-6097-46ef-ad75-7b2804ba21cb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:14.502494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:14.503495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:14.504012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:14.504447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:14.521534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:14.523516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:14.541812 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2302/4614] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:23.543677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:23.546592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:23.696262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32509eed-c4b2-4f90-8e4c-8ab1f39dbb8c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:23.709360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:23.710554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:23.711032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:23.711468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] PATH_INFO: `/v3/users/a8cd93dbf4db4d899a3c6148183be9f2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:23.712877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8cd93dbf4db4d899a3c6148183be9f2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:23.717074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:23.840776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8cd93dbf4db4d899a3c6148183be9f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:23.841505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8cd93dbf4db4d899a3c6148183be9f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:23.862222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8cd93dbf4db4d899a3c6148183be9f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:23.863014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8cd93dbf4db4d899a3c6148183be9f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:23.879409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85e140f1-5e68-44a6-a9a4-541639aed14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8cd93dbf4db4d899a3c6148183be9f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:23.914514 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2313/4615] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:23 2022] DELETE /identity/v3/users/a8cd93dbf4db4d899a3c6148183be9f2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:24.611371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:24.631945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4508-53f5-4868-b0c1-a82d4948748c service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:24.841031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:24.843875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:24.846020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:24.847242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] PATH_INFO: `/v3/projects/1a49ba5398834c43baabd7435e85d81b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:24.852125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a49ba5398834c43baabd7435e85d81b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:24.862993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:25.042071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a49ba5398834c43baabd7435e85d81b', 'request_id': 'req-410e5217-99f5-4d20-b970-393ba4df8841'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:25.057927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a49ba5398834c43baabd7435e85d81b', 'request_id': 'req-410e5217-99f5-4d20-b970-393ba4df8841'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:25.072942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a49ba5398834c43baabd7435e85d81b', 'request_id': 'req-410e5217-99f5-4d20-b970-393ba4df8841'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:25.102707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] The token cache is being invalidate because project 1a49ba5398834c43baabd7435e85d81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:25.103037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:25.103882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-410e5217-99f5-4d20-b970-393ba4df8841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:25.105920 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2303/4616] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:24 2022] DELETE /identity/v3/projects/1a49ba5398834c43baabd7435e85d81b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:25.114675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4622b-ae68-4c4d-a1f8-0c2c23409d00 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:25.116171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4622b-ae68-4c4d-a1f8-0c2c23409d00 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:25.116624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4622b-ae68-4c4d-a1f8-0c2c23409d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:25.180507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c6c4622b-ae68-4c4d-a1f8-0c2c23409d00 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:25.181936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c6c4622b-ae68-4c4d-a1f8-0c2c23409d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:25.327897 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2314/4617] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:25.335145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c1d08-3860-461a-9014-02e5356bc05f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:25.335577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c1d08-3860-461a-9014-02e5356bc05f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:25.335958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c1d08-3860-461a-9014-02e5356bc05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:25.385614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-153c1d08-3860-461a-9014-02e5356bc05f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:25.392195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-153c1d08-3860-461a-9014-02e5356bc05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:25.426723 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2304/4618] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:25.430604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4622b-ae68-4c4d-a1f8-0c2c23409d00 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:25.457084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4622b-ae68-4c4d-a1f8-0c2c23409d00 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:25.464577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:25.466048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:25.467499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:25.467800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:25.469379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:58:25.469858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:25.472576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:25.492748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2315/4619] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:58:25.495953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c1d08-3860-461a-9014-02e5356bc05f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:25.513164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c1d08-3860-461a-9014-02e5356bc05f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:25.533843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:25.534530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:25.534863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:25.535201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:25.535913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:25.549292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:25.608968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2305/4620] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:25.611823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:25.626031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be69d7-051d-4421-a5da-4260e91ab8a8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:25.748956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:25.750145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:25.751814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:25.752698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:25.753694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:25.756277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:25.797069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:25.801351 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2316/4621] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:25 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:25.835009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd136a-aa5e-4b01-b471-d421e358c461 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:25.848509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:25.849488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:25.849955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:25.850408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:25.851458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:25.858501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:25.881437 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2306/4622] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:25.885213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:25.914445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e878f25-3871-4d7c-b1dc-8d3874158ea8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:25.923798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49f6ab-6bde-4394-90c8-1c372227e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:25.924488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49f6ab-6bde-4394-90c8-1c372227e4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:25.924775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49f6ab-6bde-4394-90c8-1c372227e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:25.925051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49f6ab-6bde-4394-90c8-1c372227e4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:25.925790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49f6ab-6bde-4394-90c8-1c372227e4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:25.927439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49f6ab-6bde-4394-90c8-1c372227e4e8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:25.958250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:25.959354 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2317/4623] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:25.980371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdb186-9576-4de1-a439-590eba4198ce admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:26.002544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:26.004065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:26.004065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:26.005083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] PATH_INFO: `/v3/projects/8b773c5686d64d8a8d701f1d4ac3a925/users/5c25a60580f5449fad5d3b5eb79b7041/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:26.046391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b773c5686d64d8a8d701f1d4ac3a925, user_id=5c25a60580f5449fad5d3b5eb79b7041, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:26.049539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:26.083676 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2307/4624] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:25 2022] PUT /identity/v3/projects/8b773c5686d64d8a8d701f1d4ac3a925/users/5c25a60580f5449fad5d3b5eb79b7041/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:26.085371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:26.085371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:26.086314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:26.119254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:26.123033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:26.229477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2318/4625] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:58:26.245101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:26.246853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:26.374118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78629f-a93c-4d8f-aea2-441c48063c82 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:26.386695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea85f4-1f5e-43ed-9782-f988f3ca172b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:26.387415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea85f4-1f5e-43ed-9782-f988f3ca172b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:26.387944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea85f4-1f5e-43ed-9782-f988f3ca172b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:26.388229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea85f4-1f5e-43ed-9782-f988f3ca172b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:26.407635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea85f4-1f5e-43ed-9782-f988f3ca172b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:26.409447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea85f4-1f5e-43ed-9782-f988f3ca172b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:26.428470 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2308/4626] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:27.289643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:27.290491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:27.315935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2621bb-cdf4-485e-95ef-41acda0638c2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:27.338193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:27.343492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:27.346409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:27.347044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] PATH_INFO: `/v3/users/cd2d1719f99840248a4fd9404ecf13a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:27.348883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2d1719f99840248a4fd9404ecf13a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:27.356874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:27.432571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2d1719f99840248a4fd9404ecf13a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:27.433286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2d1719f99840248a4fd9404ecf13a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:27.449923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2d1719f99840248a4fd9404ecf13a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:27.450975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2d1719f99840248a4fd9404ecf13a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:27.469741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2d1719f99840248a4fd9404ecf13a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:27.494705 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2319/4627] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:27 2022] DELETE /identity/v3/users/cd2d1719f99840248a4fd9404ecf13a5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:27.496125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:27.496616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:27.497231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:27.531702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:27.533951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:27.695443 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2309/4628] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:27.716338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:27.717961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:27.844143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d349e-12cd-41ca-bf71-66bad141be27 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:27.859136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:27.860083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:27.860794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:27.861290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:27.877738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:27.880654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:27.901672 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2320/4629] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:28.933929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:28.935421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:28.969475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f647b-f6d6-425c-aae0-2f6dac7864ac None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:28.975285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:28.976498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:28.976934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:28.977356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] PATH_INFO: `/v3/users/24b26978cffe47498a1f1e773a983d94` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:28.978812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b26978cffe47498a1f1e773a983d94)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:29.000123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:29.025125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:29.028287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.069763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3e1e2-6fd3-4579-b3b0-f56387cae761 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:29.108092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b26978cffe47498a1f1e773a983d94'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.118285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b26978cffe47498a1f1e773a983d94'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.119431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b26978cffe47498a1f1e773a983d94'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.121197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b26978cffe47498a1f1e773a983d94'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.124841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:29.125932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.126377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.126947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] PATH_INFO: `/v3/projects/4295ac4ae3494ccd8aee1a736cf9f6bc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.131460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4295ac4ae3494ccd8aee1a736cf9f6bc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:29.133779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:29.134514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ff62265f-b381-4891-b3ac-77f7f8531e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b26978cffe47498a1f1e773a983d94'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.160208 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2310/4630] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:28 2022] DELETE /identity/v3/users/24b26978cffe47498a1f1e773a983d94 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:29.181145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db938f9f-2835-4d5f-87be-4ddf8f1ea354 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.181639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db938f9f-2835-4d5f-87be-4ddf8f1ea354 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.182111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db938f9f-2835-4d5f-87be-4ddf8f1ea354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.231052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-db938f9f-2835-4d5f-87be-4ddf8f1ea354 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:29.235160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db938f9f-2835-4d5f-87be-4ddf8f1ea354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.251224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4295ac4ae3494ccd8aee1a736cf9f6bc', 'request_id': 'req-fb84eab1-4226-4fc5-bb38-331390e8fef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.279492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4295ac4ae3494ccd8aee1a736cf9f6bc', 'request_id': 'req-fb84eab1-4226-4fc5-bb38-331390e8fef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.299050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4295ac4ae3494ccd8aee1a736cf9f6bc', 'request_id': 'req-fb84eab1-4226-4fc5-bb38-331390e8fef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.339153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] The token cache is being invalidate because project 4295ac4ae3494ccd8aee1a736cf9f6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:29.347916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.349506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb84eab1-4226-4fc5-bb38-331390e8fef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:29.360987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2311/4632] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:29.364725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2321/4632] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:29 2022] DELETE /identity/v3/projects/4295ac4ae3494ccd8aee1a736cf9f6bc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:58:29.364958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42369e7-df6c-4fa2-bc0f-0795d972d9da None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.364958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42369e7-df6c-4fa2-bc0f-0795d972d9da None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.364958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42369e7-df6c-4fa2-bc0f-0795d972d9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.365181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.365181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.365181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.416075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:29.417769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.425587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e42369e7-df6c-4fa2-bc0f-0795d972d9da None None] MFA Rules not processed for user `5c25a60580f5449fad5d3b5eb79b7041`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:29.427039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e42369e7-df6c-4fa2-bc0f-0795d972d9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.438869 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2322/4633] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:29.440370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:29.445114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.547973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf394e-a653-407c-90ae-40822ac5ecfc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:29.548653 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2312/4634] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:29.550499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c41c32-06fc-4b67-aff0-201c976c7569 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.551030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c41c32-06fc-4b67-aff0-201c976c7569 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.551527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c41c32-06fc-4b67-aff0-201c976c7569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.561573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:29.563115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.563400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.563757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.584109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:29.585296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:29.586581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-90c41c32-06fc-4b67-aff0-201c976c7569 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:29.588116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90c41c32-06fc-4b67-aff0-201c976c7569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.599777 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2323/4635] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:29.600584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:29.600818 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2313/4636] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:29.602056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.604911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c41c32-06fc-4b67-aff0-201c976c7569 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:29.631373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c41c32-06fc-4b67-aff0-201c976c7569 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:29.645876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:29.647181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.647625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.648125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.649058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:58:29.650068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:29.654174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:29.686740 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2314/4637] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:58:29.692636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:29.713821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374aa6b7-c1c2-4d28-b264-77b256b258d2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:29.727741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:29.728882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.731352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.731645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.733808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:29.736184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:29.767897 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2315/4638] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:29 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:29.772110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:29.797486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264d126-6fa6-4fdd-99af-af794d94f45f service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:29.866014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523bab8-6172-4242-96bf-256464651830 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:29.872095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:29.872821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.873152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.874019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.874871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:29.876856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:29.914810 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2316/4639] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:29 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:29.914810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:29.918513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:29.945079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:29.945324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d27e8-9126-4551-894f-ea684caced35 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:29.946763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.947418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.947924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.952032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:29.953506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:29.953797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:29.954080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] PATH_INFO: `/v3/projects/105bb835cbb8424598141c6db1db76dd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:29.956367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105bb835cbb8424598141c6db1db76dd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:29.959049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.027080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.028149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105bb835cbb8424598141c6db1db76dd', 'request_id': 'req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:30.030486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.036283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105bb835cbb8424598141c6db1db76dd', 'request_id': 'req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:30.047522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105bb835cbb8424598141c6db1db76dd', 'request_id': 'req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:30.058561 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2324/4640] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:30.059673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.069094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] The token cache is being invalidate because project 105bb835cbb8424598141c6db1db76dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:30.069094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:30.071323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:30.074721 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2317/4641] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:29 2022] DELETE /identity/v3/projects/105bb835cbb8424598141c6db1db76dd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:30.076945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.080774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:30.082751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b973e-f5ab-4834-8436-66d4c1e14a36 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.145596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff82d8-3906-4b39-a740-afe90e61012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.146268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff82d8-3906-4b39-a740-afe90e61012a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.146547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff82d8-3906-4b39-a740-afe90e61012a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.146867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff82d8-3906-4b39-a740-afe90e61012a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.147589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff82d8-3906-4b39-a740-afe90e61012a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.149213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff82d8-3906-4b39-a740-afe90e61012a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.163123 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2325/4642] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:30.164693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.165310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.165310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.204639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:30.205922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:30.236908 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2326/4643] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:30.236908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.238446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:30.241936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f1aec-718c-4a64-8a3f-c2a25336ded7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.261300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.262193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.262744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9972fe7-7415-4617-b333-b0ba3193f1b1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.263289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.263725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.267050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:30.279215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a77fb1-bbcf-4915-a74c-8584370f89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.280334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77fb1-bbcf-4915-a74c-8584370f89a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.280623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77fb1-bbcf-4915-a74c-8584370f89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.280897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a77fb1-bbcf-4915-a74c-8584370f89a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.281641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77fb1-bbcf-4915-a74c-8584370f89a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.283398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a77fb1-bbcf-4915-a74c-8584370f89a7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.309491 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2327/4644] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:30.311592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503a48-8e49-4ad2-af68-b99d54ab9836 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.311887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503a48-8e49-4ad2-af68-b99d54ab9836 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.312170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67503a48-8e49-4ad2-af68-b99d54ab9836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.355410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-67503a48-8e49-4ad2-af68-b99d54ab9836 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:30.359625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-67503a48-8e49-4ad2-af68-b99d54ab9836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:30.384786 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2328/4645] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:30.385700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503a48-8e49-4ad2-af68-b99d54ab9836 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.401878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.408954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67503a48-8e49-4ad2-af68-b99d54ab9836 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.411268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.424584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2af7e-1c36-40c7-ac79-3657f70ca725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.425491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2af7e-1c36-40c7-ac79-3657f70ca725 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.425781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2af7e-1c36-40c7-ac79-3657f70ca725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.426060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2af7e-1c36-40c7-ac79-3657f70ca725 admin admin] PATH_INFO: `/v3/projects/17d1717bd7f2430eb5c2d3ce577e8160/users/cbf88df4a61b436ebbe7f5c78306117e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.434207 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2318/4646] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:30.435515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.462992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3b8d-e352-450d-8229-f48580cec248 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.470506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.471422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.471889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.479975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2af7e-1c36-40c7-ac79-3657f70ca725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d1717bd7f2430eb5c2d3ce577e8160, user_id=cbf88df4a61b436ebbe7f5c78306117e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.480566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.481670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:58:30.482140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.484732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2af7e-1c36-40c7-ac79-3657f70ca725 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.486842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.500645 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2319/4647] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:58:30.505980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.529348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47f9dd-4c5d-49fb-a72b-a0a8fe3d9a47 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.535940 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2329/4648] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:30 2022] PUT /identity/v3/projects/17d1717bd7f2430eb5c2d3ce577e8160/users/cbf88df4a61b436ebbe7f5c78306117e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:30.547544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.547887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.548117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.631928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] MFA Rules not processed for user `cbf88df4a61b436ebbe7f5c78306117e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:30.635175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:30.674145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.675543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.675811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.676099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.676946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.682654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.732810 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2320/4649] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:30 2022] POST /identity/v3/projects => generated 369 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:30.738406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.834647 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2330/4650] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:30.849428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.853786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:30.860438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125c1d8-bf49-4307-a4b6-baca2514476a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.869385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.870552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.871224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.871766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.873221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.875602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:30.922298 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2321/4651] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:30 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:30.926916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:30.951114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7952-73e7-4716-a14d-adb47d645f8e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:30.965544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:30.966821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:30.967501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:30.968002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:30.970540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:30.972526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:31.006088 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2322/4652] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:31.007915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:31.028451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231423c-2282-4b80-a883-3c98c34d01e2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:31.036190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:31.037062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:31.037457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:31.038003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:31.039149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:31.041466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:31.063368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd48e2-8678-4d2f-8793-09bd1349077f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:31.064108 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2323/4653] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:58:31.067910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:31.093001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07025e72-277e-41af-a92f-8cfaff301814 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:31.104896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31962285-52df-4111-a3a0-f7052d3bdbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:31.106732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31962285-52df-4111-a3a0-f7052d3bdbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:31.108076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31962285-52df-4111-a3a0-f7052d3bdbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:31.112424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31962285-52df-4111-a3a0-f7052d3bdbb3 admin admin] PATH_INFO: `/v3/projects/e8e04e47c1cd4025a59809f6e8d6d7b6/users/fce3ec220fb84ccbab439630115e7ef4/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:31.155954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31962285-52df-4111-a3a0-f7052d3bdbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e04e47c1cd4025a59809f6e8d6d7b6, user_id=fce3ec220fb84ccbab439630115e7ef4, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:31.165855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31962285-52df-4111-a3a0-f7052d3bdbb3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:31.169805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:31.171173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:31.171644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:31.172113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:31.188616 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2324/4654] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:31 2022] PUT /identity/v3/projects/e8e04e47c1cd4025a59809f6e8d6d7b6/users/fce3ec220fb84ccbab439630115e7ef4/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:31.212706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12281378-39bd-4c7d-b2b1-d5f166223386 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:31.214306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12281378-39bd-4c7d-b2b1-d5f166223386 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:31.215482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12281378-39bd-4c7d-b2b1-d5f166223386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:31.264475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:31.266504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:31.280014 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2331/4655] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:58:31.283150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-12281378-39bd-4c7d-b2b1-d5f166223386 None None] MFA Rules not processed for user `fce3ec220fb84ccbab439630115e7ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:31.285507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-12281378-39bd-4c7d-b2b1-d5f166223386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:31.440124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2325/4656] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:31.468595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:31.470116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:31.492685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44baaeb1-bc1f-4001-927a-8a2e2364822f service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:31.577474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:31.580533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:31.580824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:31.581109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:31.608547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:31.611916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:31.665564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2332/4657] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:32.505991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:32.506509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:32.506594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:32.530663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] MFA Rules not processed for user `5c25a60580f5449fad5d3b5eb79b7041`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:32.532146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:32.635538 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2326/4658] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:33.023292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:33.024849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:33.188148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaeec0-4de2-4132-b3fc-0426b3f36e9d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:33.194854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:33.195528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:33.195809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:33.196080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:33.204854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:33.244881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:33.246569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:33.265761 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2333/4659] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:34.074732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:34.078057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:34.197883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74075-3b95-428d-b715-134a9f5ee1df None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:34.207598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:34.208493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:34.211125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:34.212391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] PATH_INFO: `/v3/users/fcebb1ddd0bd4445aa0070c0b66bd259` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:34.213664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcebb1ddd0bd4445aa0070c0b66bd259)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:34.218905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:34.287996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcebb1ddd0bd4445aa0070c0b66bd259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:34.311878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcebb1ddd0bd4445aa0070c0b66bd259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:34.314128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcebb1ddd0bd4445aa0070c0b66bd259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:34.316474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcebb1ddd0bd4445aa0070c0b66bd259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:34.338175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d76685c-6264-4a91-8e69-058bf7556750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcebb1ddd0bd4445aa0070c0b66bd259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:34.387200 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2327/4660] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:58:34 2022] DELETE /identity/v3/users/fcebb1ddd0bd4445aa0070c0b66bd259 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:36.836443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:36.864538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689123a-16f2-4714-bc59-30880bbfe716 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:37.047726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:37.049794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:37.050434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:37.053116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] PATH_INFO: `/v3/projects/150a87722b1c4b659e8a918d6a22c739` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:37.056577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=150a87722b1c4b659e8a918d6a22c739)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:37.058560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:37.217701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150a87722b1c4b659e8a918d6a22c739', 'request_id': 'req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:37.247537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150a87722b1c4b659e8a918d6a22c739', 'request_id': 'req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:37.264902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150a87722b1c4b659e8a918d6a22c739', 'request_id': 'req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:37.285138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] The token cache is being invalidate because project 150a87722b1c4b659e8a918d6a22c739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:58:37.285478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:37.286109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5d6f9fe1-2ca4-4606-a6dd-866f73211f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:58:37.288492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2334/4661] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:58:36 2022] DELETE /identity/v3/projects/150a87722b1c4b659e8a918d6a22c739 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:37.293305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34801e5-f938-42ef-bcde-b1ffd0faf33c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:37.295377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34801e5-f938-42ef-bcde-b1ffd0faf33c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:37.296005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34801e5-f938-42ef-bcde-b1ffd0faf33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:37.330330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c34801e5-f938-42ef-bcde-b1ffd0faf33c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:37.332245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c34801e5-f938-42ef-bcde-b1ffd0faf33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:37.495207 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2328/4662] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:37.503305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:37.503601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:37.503884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:37.532698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:37.551587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:37.571152 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2335/4663] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:37.575131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34801e5-f938-42ef-bcde-b1ffd0faf33c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:37.601809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:37.604411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34801e5-f938-42ef-bcde-b1ffd0faf33c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:37.605959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:37.616611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:37.617691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:37.618082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:37.619556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:37.620420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:58:37.621032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:37.629879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:37.687903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2329/4664] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:58:37.693364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:37.720876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df1207-a271-4756-8531-2b19e0101517 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:37.734066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:37.735679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:37.737465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:37.737783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:37.741324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:37.745416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:37.787196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b3437-b8b4-4249-a868-c33612c354bd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:37.799595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:37.801437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:37.802022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:37.802783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:37.806205 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2330/4665] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:58:37 2022] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:37.807176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:37.810310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:37.991855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0908083-324e-434c-b311-e5731d996ff4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:37.998573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:37.999387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:37.999675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:37.999950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:38.003273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:38.007521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:38.050700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:38.054889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:38.058594 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2331/4666] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:58:37 2022] POST /identity/v3/users => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:58:38.059655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:38.087856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425850f9-6788-4508-8abf-ec0114975cdc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:38.088102 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2336/4667] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:38.111749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:38.114893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:38.115220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:38.115500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:38.118487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:38.122607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:38.142239 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2332/4668] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:38.146629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:38.163505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725af5d-1a20-4b6e-b582-c3cccd3ea15c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:38.172956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be272738-85b8-4b5b-8e87-894c8187f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:38.173914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272738-85b8-4b5b-8e87-894c8187f1fe admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:38.174413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272738-85b8-4b5b-8e87-894c8187f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:38.175005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272738-85b8-4b5b-8e87-894c8187f1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:38.175968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272738-85b8-4b5b-8e87-894c8187f1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:38.178593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272738-85b8-4b5b-8e87-894c8187f1fe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:38.199051 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2337/4669] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:58:38.205833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:38.227669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e231db-afd4-463e-917d-e9fdd6be387a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:38.233735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:38.234887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:38.235280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:38.235659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] PATH_INFO: `/v3/projects/4d8cbe750a6f4170bb6e7ac39950027c/users/f0b0415cebe4474c9d7c004508e9fd68/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:38.283042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8cbe750a6f4170bb6e7ac39950027c, user_id=f0b0415cebe4474c9d7c004508e9fd68, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:38.286374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:38.315226 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2333/4670] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:58:38 2022] PUT /identity/v3/projects/4d8cbe750a6f4170bb6e7ac39950027c/users/f0b0415cebe4474c9d7c004508e9fd68/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:58:38.319125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf6833-3642-4250-b75f-b2ccf0bd4663 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:38.319836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf6833-3642-4250-b75f-b2ccf0bd4663 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:38.320345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf6833-3642-4250-b75f-b2ccf0bd4663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:38.350282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f2cf6833-3642-4250-b75f-b2ccf0bd4663 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:38.352002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2cf6833-3642-4250-b75f-b2ccf0bd4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:38.495404 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2338/4671] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:38.539803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:38.541753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:38.705969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73dd81f-c3ef-42a8-b937-40bb0a7a3bb6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:38.710664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345d5e8-bdfb-4ff7-80f2-6a34b0f16770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:38.711449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d5e8-bdfb-4ff7-80f2-6a34b0f16770 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:38.711805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d5e8-bdfb-4ff7-80f2-6a34b0f16770 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:38.712153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345d5e8-bdfb-4ff7-80f2-6a34b0f16770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:38.756423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345d5e8-bdfb-4ff7-80f2-6a34b0f16770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:38.758225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345d5e8-bdfb-4ff7-80f2-6a34b0f16770 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:38.786950 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2334/4672] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:40.796158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf6833-3642-4250-b75f-b2ccf0bd4663 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:40.814976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf6833-3642-4250-b75f-b2ccf0bd4663 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:40.830004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:40.830570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:40.830980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:40.831145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:40.833215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:40.958029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:40.962393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:40.994111 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2339/4673] 10.222.0.32 () {60 vars in 1396 bytes} [Sat May 7 21:58:40 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:58:43.605831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b504c7-a7e1-406f-bb49-f626e5863dc9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:43.606425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b504c7-a7e1-406f-bb49-f626e5863dc9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:43.606628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b504c7-a7e1-406f-bb49-f626e5863dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:43.643852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-90b504c7-a7e1-406f-bb49-f626e5863dc9 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:58:43.647888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90b504c7-a7e1-406f-bb49-f626e5863dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:43.782397 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2335/4674] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:58:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:58:43.840398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:58:43.843275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:58:44.031959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ec48-da44-4e06-9514-bf5347f3a512 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:58:44.047694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:58:44.048206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:58:44.048458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:58:44.048723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:58:44.077750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:58:44.080707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:58:44.098137 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2340/4675] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:58:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:59:01.003605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:01.006693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:01.007789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:01.056208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] MFA Rules not processed for user `f0b0415cebe4474c9d7c004508e9fd68`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:01.060463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:01.207659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2336/4676] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:01.280368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:01.281864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:01.375853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e778347-b820-4467-abe6-f444cbad9423 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:01.384363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeaca5-145d-4329-b0cf-442bbaacfba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:01.385565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeaca5-145d-4329-b0cf-442bbaacfba3 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:01.386086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeaca5-145d-4329-b0cf-442bbaacfba3 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:01.386586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeaca5-145d-4329-b0cf-442bbaacfba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:01.400767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeaca5-145d-4329-b0cf-442bbaacfba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:01.402821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeaca5-145d-4329-b0cf-442bbaacfba3 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:01.417390 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2341/4677] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:59:02.273720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:02.275528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:02.514318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d6414-a546-4503-9a1f-426a2a2a56be None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:02.531170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:02.533737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:02.534117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:02.534486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:02.536568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:02.553369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:02.556478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:02.572390 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2337/4678] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:03.997119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002624f-280e-4556-90be-06751297cf8e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:03.998050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002624f-280e-4556-90be-06751297cf8e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:03.998709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002624f-280e-4556-90be-06751297cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:04.041014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3002624f-280e-4556-90be-06751297cf8e None None] MFA Rules not processed for user `228761ebf4c0406ab0977cabe351ac76`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:04.043774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3002624f-280e-4556-90be-06751297cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:04.162422 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2342/4679] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:05.566053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:05.567608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:05.600540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82541d-c870-429e-9f84-5f348b9b0668 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:05.617612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:05.618676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:05.620297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:05.620821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] PATH_INFO: `/v3/users/5c25a60580f5449fad5d3b5eb79b7041` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:05.622960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c25a60580f5449fad5d3b5eb79b7041)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:05.625947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:05.756772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c25a60580f5449fad5d3b5eb79b7041'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:05.764463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c25a60580f5449fad5d3b5eb79b7041'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:05.766689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c25a60580f5449fad5d3b5eb79b7041'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:05.767753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c25a60580f5449fad5d3b5eb79b7041'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:05.781247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-562d81ae-92fd-4b7f-85d0-823917f34d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c25a60580f5449fad5d3b5eb79b7041'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:05.826832 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2338/4680] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:05 2022] DELETE /identity/v3/users/5c25a60580f5449fad5d3b5eb79b7041 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:06.239409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002624f-280e-4556-90be-06751297cf8e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:06.266404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002624f-280e-4556-90be-06751297cf8e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:06.353955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:06.355067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:06.355422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:06.355788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] PATH_INFO: `/v3/projects/8b773c5686d64d8a8d701f1d4ac3a925` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:06.357434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b773c5686d64d8a8d701f1d4ac3a925)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:06.359874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:06.426939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b773c5686d64d8a8d701f1d4ac3a925', 'request_id': 'req-cda29023-ca21-41b2-9a4a-090bf42290da'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:06.440443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b773c5686d64d8a8d701f1d4ac3a925', 'request_id': 'req-cda29023-ca21-41b2-9a4a-090bf42290da'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:06.455481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b773c5686d64d8a8d701f1d4ac3a925', 'request_id': 'req-cda29023-ca21-41b2-9a4a-090bf42290da'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:06.472765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] The token cache is being invalidate because project 8b773c5686d64d8a8d701f1d4ac3a925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:06.473144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:06.474373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cda29023-ca21-41b2-9a4a-090bf42290da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:06.481013 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2343/4681] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:06 2022] DELETE /identity/v3/projects/8b773c5686d64d8a8d701f1d4ac3a925 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:06.482660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192e7b1-0c7a-4eb6-a1b0-e3e2ab68e886 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:06.483221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192e7b1-0c7a-4eb6-a1b0-e3e2ab68e886 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:06.483871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192e7b1-0c7a-4eb6-a1b0-e3e2ab68e886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:06.511506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c192e7b1-0c7a-4eb6-a1b0-e3e2ab68e886 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:06.513373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c192e7b1-0c7a-4eb6-a1b0-e3e2ab68e886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:06.608503 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2339/4682] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:06.611910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8151-2e44-4779-8716-9de49d99f9b3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:06.612403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8151-2e44-4779-8716-9de49d99f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:06.612932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8151-2e44-4779-8716-9de49d99f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:06.647866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-214a8151-2e44-4779-8716-9de49d99f9b3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:06.652121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-214a8151-2e44-4779-8716-9de49d99f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:06.669953 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2344/4683] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:06.674370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192e7b1-0c7a-4eb6-a1b0-e3e2ab68e886 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:06.688381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:06.688806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:06.690251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:06.690456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192e7b1-0c7a-4eb6-a1b0-e3e2ab68e886 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:06.704101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:06.704786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:06.705068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:06.705340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:06.706070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:59:06.706374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:06.709994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:06.717923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:06.721513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:06.744034 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2340/4684] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:59:06.749860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:06.784056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996585f4-4b4e-46f9-a1db-f1008b18c354 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:06.789578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:06.790603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:06.790910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:06.791177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:06.791875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:06.793793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:06.837859 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2341/4685] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:06 2022] POST /identity/v3/projects => generated 403 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:59:06.842152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:06.863549 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2345/4686] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 21:59:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:06.879879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:06.881743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:07.014719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dd0a3-0c64-4862-90e7-53a5a92d69cc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:07.026735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b0f66-3a31-45e2-8df0-1dea2dcde50e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:07.037486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:07.038178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.038460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.038735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.039478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:07.041631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:07.068675 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2342/4687] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:06 2022] POST /identity/v3/users => generated 302 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 21:59:07.073419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:07.106165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c3f6e-0f0d-4bc9-9f16-232c2de96232 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:07.115979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:07.116324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.117083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.117522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.118681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:07.120872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:07.159721 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2343/4688] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:07.165949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:07.188315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd166a5d-f9b5-4b73-ad18-16f760805cd0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:07.189309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb369d2d-1565-49d1-abc6-21239588150b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:07.190002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369d2d-1565-49d1-abc6-21239588150b service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.190285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369d2d-1565-49d1-abc6-21239588150b service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.190606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369d2d-1565-49d1-abc6-21239588150b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.209173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:07.214891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.220393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.220926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.225214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:07.233185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:07.268304 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2344/4689] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:59:07.275245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb369d2d-1565-49d1-abc6-21239588150b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:07.278137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb369d2d-1565-49d1-abc6-21239588150b service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:07.278361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:07.289028 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2346/4690] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:59:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:59:07.308750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fa82a-0a21-45cd-8e17-72c0a08bf564 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:07.322962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:07.328108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.328594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.328881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] PATH_INFO: `/v3/projects/1426f0d5b4ef478d91cfb1856c943052/users/6e9a3cda211245a18608ae0a25468113/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.366906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1426f0d5b4ef478d91cfb1856c943052, user_id=6e9a3cda211245a18608ae0a25468113, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:07.370129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:07.407386 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2345/4691] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:07 2022] PUT /identity/v3/projects/1426f0d5b4ef478d91cfb1856c943052/users/6e9a3cda211245a18608ae0a25468113/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:07.413449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16391-e6c3-4d37-8502-6c9c7ffc4a02 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.413826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16391-e6c3-4d37-8502-6c9c7ffc4a02 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.414105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b16391-e6c3-4d37-8502-6c9c7ffc4a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.477109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a5b16391-e6c3-4d37-8502-6c9c7ffc4a02 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:07.480542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a5b16391-e6c3-4d37-8502-6c9c7ffc4a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:07.687882 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2347/4692] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:07.723267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:07.725422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:07.885940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8245d-bd57-4919-9063-d102025915c1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:07.891347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21a238-32b2-444e-aaed-dea0d8e229ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:07.892369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21a238-32b2-444e-aaed-dea0d8e229ad service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.892952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21a238-32b2-444e-aaed-dea0d8e229ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.893419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21a238-32b2-444e-aaed-dea0d8e229ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.912276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21a238-32b2-444e-aaed-dea0d8e229ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:07.915024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21a238-32b2-444e-aaed-dea0d8e229ad service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:07.934407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16391-e6c3-4d37-8502-6c9c7ffc4a02 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:07.964799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b16391-e6c3-4d37-8502-6c9c7ffc4a02 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:07.983010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:07.984251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:07.985560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:07.986571 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2346/4693] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:07.986936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:07.991662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:08.027773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:08.034899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:08.062658 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2348/4694] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:11.049113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5958-3297-44cb-b157-7c0fb7e5ed44 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:11.049936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5958-3297-44cb-b157-7c0fb7e5ed44 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:11.050391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5958-3297-44cb-b157-7c0fb7e5ed44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:11.088525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-35cf5958-3297-44cb-b157-7c0fb7e5ed44 None None] MFA Rules not processed for user `6e9a3cda211245a18608ae0a25468113`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:11.090279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-35cf5958-3297-44cb-b157-7c0fb7e5ed44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:11.178760 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2347/4695] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:11.184566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:11.196966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82863-5c0f-4e1c-9d8a-207694a3c7a6 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:11.219468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:11.220547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:11.220547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:11.220765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:11.221367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:11.223326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:11.267834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2349/4696] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:11 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:11.271740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5958-3297-44cb-b157-7c0fb7e5ed44 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:11.288297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5958-3297-44cb-b157-7c0fb7e5ed44 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:11.390120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:11.390926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:11.391485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:11.391763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:11.392607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:11.395944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:11.425033 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2348/4697] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:11 2022] POST /identity/v3/users => generated 303 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:11.429272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:11.451553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04269-c9c5-4683-96b5-54f77b00a434 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:11.465147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:11.465895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:11.466182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:11.468412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:11.469240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:11.473718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:11.517809 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2350/4698] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:59:11.521942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:11.534283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf691-07d0-4861-b504-14ee17c35f05 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:11.549795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:11.550403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:11.550686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:11.551134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:11.552023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:11.553648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:11.580106 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2349/4699] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:11.584673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:11.605274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8b3bd-d11d-486f-9c3c-18a0f5975b4d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:11.621936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:11.625139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:11.628252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:11.628744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] PATH_INFO: `/v3/projects/c77bd55728474691ab88abd1cf00a7b3/users/1d76be936b614d2a9924f0696addb042/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:11.667394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77bd55728474691ab88abd1cf00a7b3, user_id=1d76be936b614d2a9924f0696addb042, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:11.670908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:11.701564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2351/4700] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:11 2022] PUT /identity/v3/projects/c77bd55728474691ab88abd1cf00a7b3/users/1d76be936b614d2a9924f0696addb042/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:12.779813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:12.785061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:12.817300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabab9c3-2571-4752-99e9-e8758fcd6adf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:12.972871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:12.974909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:12.976273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:12.976760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] PATH_INFO: `/v3/users/f0b0415cebe4474c9d7c004508e9fd68` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:12.981436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b0415cebe4474c9d7c004508e9fd68)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:12.984720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:13.043310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b0415cebe4474c9d7c004508e9fd68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:13.055552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b0415cebe4474c9d7c004508e9fd68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:13.056282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b0415cebe4474c9d7c004508e9fd68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:13.056891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b0415cebe4474c9d7c004508e9fd68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:13.066971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7158d83-77e3-4e03-898b-ec3f090cdd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b0415cebe4474c9d7c004508e9fd68'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:13.088497 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2350/4701] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:12 2022] DELETE /identity/v3/users/f0b0415cebe4474c9d7c004508e9fd68 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:14.353135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:14.355910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:14.375894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17f378-4577-4529-8cdf-3ac0da5ac568 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:14.499398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0c2f-156a-437b-9564-03e07d24be90 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:14.501422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0c2f-156a-437b-9564-03e07d24be90 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:14.501945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc0c2f-156a-437b-9564-03e07d24be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:14.502061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:14.503001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:14.503286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:14.503555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] PATH_INFO: `/v3/projects/4d8cbe750a6f4170bb6e7ac39950027c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:14.505374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8cbe750a6f4170bb6e7ac39950027c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:14.507478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:14.537000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a7bc0c2f-156a-437b-9564-03e07d24be90 None None] MFA Rules not processed for user `1d76be936b614d2a9924f0696addb042`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:14.538727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a7bc0c2f-156a-437b-9564-03e07d24be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:14.568122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8cbe750a6f4170bb6e7ac39950027c', 'request_id': 'req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:14.576759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8cbe750a6f4170bb6e7ac39950027c', 'request_id': 'req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:14.593448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8cbe750a6f4170bb6e7ac39950027c', 'request_id': 'req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:14.617060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] The token cache is being invalidate because project 4d8cbe750a6f4170bb6e7ac39950027c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:14.617970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:14.619899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6ed5fc8b-ccb0-46b0-8f61-3c30bfa6cd58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:14.629390 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2352/4702] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:14 2022] DELETE /identity/v3/projects/4d8cbe750a6f4170bb6e7ac39950027c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:14.632582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea27d8-5f3b-4ecf-9abe-d5cbcdb836fb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:14.634010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea27d8-5f3b-4ecf-9abe-d5cbcdb836fb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:14.635792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea27d8-5f3b-4ecf-9abe-d5cbcdb836fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:14.678023 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2351/4703] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:14.681204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:14.681874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:14.682725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:14.688415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-25ea27d8-5f3b-4ecf-9abe-d5cbcdb836fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:14.690170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25ea27d8-5f3b-4ecf-9abe-d5cbcdb836fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:14.748120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] MFA Rules not processed for user `6e9a3cda211245a18608ae0a25468113`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:14.753238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:14.906089 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2352/4704] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:14.914300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:14.915748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:14.940197 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2353/4705] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:15.013854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bb6b-f14d-4d31-85cc-8f954637a8a7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.014153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bb6b-f14d-4d31-85cc-8f954637a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.014442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4bb6b-f14d-4d31-85cc-8f954637a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.038963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5cc4bb6b-f14d-4d31-85cc-8f954637a8a7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:15.040873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5cc4bb6b-f14d-4d31-85cc-8f954637a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:15.049794 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2354/4706] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:15.054357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bb6b-f14d-4d31-85cc-8f954637a8a7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:15.067193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4bb6b-f14d-4d31-85cc-8f954637a8a7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.072042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.072727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.073013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.074349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.074705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:59:15.075598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:15.077265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:15.103678 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2355/4707] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:59:15.108944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:15.133626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e5715-91f2-4acb-9bee-236d63c8571e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.144479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.145960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.146281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.146608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.147262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:15.149749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a4e26-b277-4f88-9e8e-137b502bf1be None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.154717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:15.169664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.170821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.171268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.171735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.173790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:15.217919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:15.219957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:15.224153 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2356/4708] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:15 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:15.239749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:15.243212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2353/4709] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:15.326655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ef094-5bc0-43f3-9240-d17c627c38ab admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.334108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.335153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.335721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.336100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.336904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:15.343341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:15.380193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2357/4710] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:15 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:15.383870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:15.399179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebcf04-fd23-435a-a5cf-2f349dbd3dc3 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.409183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.410159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.411323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.412600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.413355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:15.415089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:15.441768 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2354/4711] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:15.449213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:15.472375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fea5e-6e97-4f57-8efc-f9d719510157 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.482047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec602db-943f-4d4c-a9c2-c52b4515834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.484045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec602db-943f-4d4c-a9c2-c52b4515834a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.484439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec602db-943f-4d4c-a9c2-c52b4515834a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.484976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec602db-943f-4d4c-a9c2-c52b4515834a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.486252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec602db-943f-4d4c-a9c2-c52b4515834a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:15.490575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec602db-943f-4d4c-a9c2-c52b4515834a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:15.514719 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2358/4712] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:15.518445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:15.532456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254e462-9ea3-492a-bafd-d23a421eb689 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.538795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.540712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.541101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.542412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] PATH_INFO: `/v3/projects/4f25e7e4b2ae4a278467bc1a4fc5fa46/users/df0de8764373461eaad7ac7b5f3eba3d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.594552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f25e7e4b2ae4a278467bc1a4fc5fa46, user_id=df0de8764373461eaad7ac7b5f3eba3d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:15.602736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:15.644540 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2355/4713] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:15 2022] PUT /identity/v3/projects/4f25e7e4b2ae4a278467bc1a4fc5fa46/users/df0de8764373461eaad7ac7b5f3eba3d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:15.656263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd48d7-d923-4ddc-a8ff-3b591d558342 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.657490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd48d7-d923-4ddc-a8ff-3b591d558342 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.657900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd48d7-d923-4ddc-a8ff-3b591d558342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:15.707346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a2dd48d7-d923-4ddc-a8ff-3b591d558342 None None] MFA Rules not processed for user `df0de8764373461eaad7ac7b5f3eba3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:15.709486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2dd48d7-d923-4ddc-a8ff-3b591d558342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:15.849491 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2359/4714] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:15.851970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:15.854304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:15.991701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bce92-289f-471e-8365-5cde8446918a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:15.996956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:15.997842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:15.998337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:15.998817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:16.011291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:16.013717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:16.028911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2356/4715] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:17.181018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05550-92c0-495b-9d9d-d0f8e938bc10 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:17.181609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05550-92c0-495b-9d9d-d0f8e938bc10 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:17.181609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05550-92c0-495b-9d9d-d0f8e938bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:17.228367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b6c05550-92c0-495b-9d9d-d0f8e938bc10 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:17.230353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b6c05550-92c0-495b-9d9d-d0f8e938bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:17.345288 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2360/4716] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:59:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:17.361914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:17.363945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:17.461783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361c656-4024-4eff-8ad7-99352768fc4b service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:17.484765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:17.485599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:17.485884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:17.486155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:17.509786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:17.511806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:17.530742 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2357/4717] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:59:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:59:19.214924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2001f9-20ff-4737-b605-233aa9582e88 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:19.216380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2001f9-20ff-4737-b605-233aa9582e88 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:19.217049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2001f9-20ff-4737-b605-233aa9582e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:19.242884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ef2001f9-20ff-4737-b605-233aa9582e88 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:19.244906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ef2001f9-20ff-4737-b605-233aa9582e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:19.280393 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2361/4718] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:59:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:19.281533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:19.297032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108750d7-bfdd-4eb4-9317-750eec04d597 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:19.315312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:19.316293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:19.316585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:19.316861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:19.337141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:19.341866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:19.360381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2358/4719] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 21:59:20.819974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d969-d857-40a8-aa00-1d7496f64133 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:20.820540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d969-d857-40a8-aa00-1d7496f64133 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:20.820540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6d969-d857-40a8-aa00-1d7496f64133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:20.852897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4ed6d969-d857-40a8-aa00-1d7496f64133 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:20.855205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4ed6d969-d857-40a8-aa00-1d7496f64133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:20.865656 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2362/4720] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:59:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:20.884298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:20.899129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872de43-bbbc-4ea3-bf36-b35192d9393b service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:20.909987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b1ecb-b5ef-4cd2-963f-44ea37ef8934 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:20.910663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1ecb-b5ef-4cd2-963f-44ea37ef8934 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:20.910997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1ecb-b5ef-4cd2-963f-44ea37ef8934 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:20.911258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b1ecb-b5ef-4cd2-963f-44ea37ef8934 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:20.931587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b1ecb-b5ef-4cd2-963f-44ea37ef8934 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:20.933386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b1ecb-b5ef-4cd2-963f-44ea37ef8934 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:20.953192 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2359/4721] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 21:59:21.318922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:21.319221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:21.319500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:21.355773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] MFA Rules not processed for user `df0de8764373461eaad7ac7b5f3eba3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:21.359220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:21.390544 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2363/4722] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:22.440660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24aebee-498c-4eb6-a75f-d4625f90683d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:22.441055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24aebee-498c-4eb6-a75f-d4625f90683d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:22.441244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24aebee-498c-4eb6-a75f-d4625f90683d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:22.476876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f24aebee-498c-4eb6-a75f-d4625f90683d None None] MFA Rules not processed for user `df0de8764373461eaad7ac7b5f3eba3d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:22.478785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f24aebee-498c-4eb6-a75f-d4625f90683d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:22.508618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2360/4723] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:29.849069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:29.850523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:30.012878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82618c-fa6f-4c39-9a70-b9c4278b6d07 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:30.022097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:30.023310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:30.023770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:30.024203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] PATH_INFO: `/v3/users/60446154374c4fac9315543687cdc0b3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:30.025697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60446154374c4fac9315543687cdc0b3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:30.030589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:30.121084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60446154374c4fac9315543687cdc0b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:30.128503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60446154374c4fac9315543687cdc0b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:30.147664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60446154374c4fac9315543687cdc0b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:30.150844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60446154374c4fac9315543687cdc0b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:30.188282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60446154374c4fac9315543687cdc0b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:30.224240 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2364/4724] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:29 2022] DELETE /identity/v3/users/60446154374c4fac9315543687cdc0b3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:30.916146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24aebee-498c-4eb6-a75f-d4625f90683d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:30.930037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24aebee-498c-4eb6-a75f-d4625f90683d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:31.008761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:31.010287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:31.011510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:31.011972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] PATH_INFO: `/v3/projects/f75cb675742543209bcbb75d99b60e97` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:31.013669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75cb675742543209bcbb75d99b60e97)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:31.016099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:31.074420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75cb675742543209bcbb75d99b60e97', 'request_id': 'req-0cee72f4-c4c2-4539-8201-4a711e1b2684'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.082708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75cb675742543209bcbb75d99b60e97', 'request_id': 'req-0cee72f4-c4c2-4539-8201-4a711e1b2684'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.093198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75cb675742543209bcbb75d99b60e97', 'request_id': 'req-0cee72f4-c4c2-4539-8201-4a711e1b2684'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.107584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] The token cache is being invalidate because project f75cb675742543209bcbb75d99b60e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:31.107967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.108856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.110895 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2361/4725] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:30 2022] DELETE /identity/v3/projects/f75cb675742543209bcbb75d99b60e97 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:31.114578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:31.117299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:31.136603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659292c-a41a-4686-8a51-0ff072922b76 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:31.252389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:31.253284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:31.253571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:31.253852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] PATH_INFO: `/v3/users/64f95294dd51410894a99fba07bdfe9d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:31.259689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f95294dd51410894a99fba07bdfe9d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:31.261911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:31.342425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f95294dd51410894a99fba07bdfe9d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.343538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f95294dd51410894a99fba07bdfe9d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.352089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f95294dd51410894a99fba07bdfe9d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.353200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f95294dd51410894a99fba07bdfe9d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.363571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-99fcab91-f88c-4a23-a7e3-6150795e7e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f95294dd51410894a99fba07bdfe9d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:31.390870 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2365/4726] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:31 2022] DELETE /identity/v3/users/64f95294dd51410894a99fba07bdfe9d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:32.176244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:32.177855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:32.230185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee72f4-c4c2-4539-8201-4a711e1b2684 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:32.384411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:32.386428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:32.387673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:32.388232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] PATH_INFO: `/v3/projects/776799dc9f9540fbaa14d08d316b0eef` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:32.390003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776799dc9f9540fbaa14d08d316b0eef)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:32.394950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:32.510925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776799dc9f9540fbaa14d08d316b0eef', 'request_id': 'req-10567ff4-db90-4fbf-b872-044c6e9225c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:32.551453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776799dc9f9540fbaa14d08d316b0eef', 'request_id': 'req-10567ff4-db90-4fbf-b872-044c6e9225c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:32.584066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776799dc9f9540fbaa14d08d316b0eef', 'request_id': 'req-10567ff4-db90-4fbf-b872-044c6e9225c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:32.614556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] The token cache is being invalidate because project 776799dc9f9540fbaa14d08d316b0eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:32.614983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:32.616261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-10567ff4-db90-4fbf-b872-044c6e9225c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:32.619825 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2362/4727] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:32 2022] DELETE /identity/v3/projects/776799dc9f9540fbaa14d08d316b0eef => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:32.624678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c86af-f2cf-4826-8e4b-68476ed9000a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:32.625273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c86af-f2cf-4826-8e4b-68476ed9000a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:32.625273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c86af-f2cf-4826-8e4b-68476ed9000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:32.650212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e7c86af-f2cf-4826-8e4b-68476ed9000a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:32.652413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e7c86af-f2cf-4826-8e4b-68476ed9000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:32.750020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2366/4728] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:32.757442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c040f9-532e-435c-b3de-bd6d4cecdc4f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:32.758170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c040f9-532e-435c-b3de-bd6d4cecdc4f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:32.758668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c040f9-532e-435c-b3de-bd6d4cecdc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:32.783102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-10c040f9-532e-435c-b3de-bd6d4cecdc4f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:32.785802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-10c040f9-532e-435c-b3de-bd6d4cecdc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:32.797850 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2363/4729] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:32.802048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c86af-f2cf-4826-8e4b-68476ed9000a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:32.814004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c86af-f2cf-4826-8e4b-68476ed9000a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:32.820813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:32.821483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:32.822021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:32.822543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:32.823606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:59:32.823895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:32.825572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:32.876693 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2367/4730] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:59:32.880686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c040f9-532e-435c-b3de-bd6d4cecdc4f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:32.896799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:32.911545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:32.913096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c040f9-532e-435c-b3de-bd6d4cecdc4f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:32.934560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:32.936531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:32.937527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:32.938132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:32.939587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:32.943537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:32.982900 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2364/4731] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:32 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:32.988403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:33.034975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb39f9f-d799-45fd-a046-49155dea2ffa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:33.133980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7883-b2e2-401f-8d1a-f410f410123a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:33.136823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:33.137537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.137824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.138098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.141262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:33.142675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:33.143965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.144368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.144796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.149085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:33.151256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:33.181359 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2365/4732] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:32 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:33.187035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:33.243048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bb658-8273-4a8f-9713-eb49dfd8543c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:33.255049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:33.256360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.256999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.257490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.259103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:33.260966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:33.279178 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2366/4733] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:33.286723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:33.312256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:33.314912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:33.325753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f388062-18e4-4ef9-a9ac-50a714e07804 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:33.331710 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2368/4734] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 21:59:33.358160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d59cf5-0280-4660-9ef4-cd691c130951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:33.358890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59cf5-0280-4660-9ef4-cd691c130951 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.359181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59cf5-0280-4660-9ef4-cd691c130951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.359461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d59cf5-0280-4660-9ef4-cd691c130951 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.360193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d59cf5-0280-4660-9ef4-cd691c130951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:33.361832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d59cf5-0280-4660-9ef4-cd691c130951 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:33.401111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2367/4735] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:33.401251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:33.424032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114efc5-f378-4a4e-b35f-464bc8ba718a service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:33.435116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782c57f-57c5-4b67-a0cf-68b64b60fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:33.437472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c57f-57c5-4b67-a0cf-68b64b60fd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.437472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c57f-57c5-4b67-a0cf-68b64b60fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.437472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782c57f-57c5-4b67-a0cf-68b64b60fd78 admin admin] PATH_INFO: `/v3/projects/18829d5c3c8840fa8cdd552a94dd7d51/users/4b3b33ec3baf44beb8a02372cf1ec60c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.473156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c57f-57c5-4b67-a0cf-68b64b60fd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18829d5c3c8840fa8cdd552a94dd7d51, user_id=4b3b33ec3baf44beb8a02372cf1ec60c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:33.479158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782c57f-57c5-4b67-a0cf-68b64b60fd78 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:33.502711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2369/4736] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:33 2022] PUT /identity/v3/projects/18829d5c3c8840fa8cdd552a94dd7d51/users/4b3b33ec3baf44beb8a02372cf1ec60c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:33.513997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.514291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.514757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.545785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] MFA Rules not processed for user `4b3b33ec3baf44beb8a02372cf1ec60c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:33.547668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:33.640136 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2368/4737] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:33.650097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144282e-4545-49dc-880d-77bb3f4c1dfc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.651059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144282e-4545-49dc-880d-77bb3f4c1dfc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.651529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144282e-4545-49dc-880d-77bb3f4c1dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.671146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e144282e-4545-49dc-880d-77bb3f4c1dfc None None] MFA Rules not processed for user `4b3b33ec3baf44beb8a02372cf1ec60c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:33.673279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e144282e-4545-49dc-880d-77bb3f4c1dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:33.687826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2370/4738] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:33.697156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:33.708502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:33.903611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846639a5-1133-478c-8412-0c6b2614a185 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:33.918076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f5bf5-7a56-41e5-952f-b1d94372c16f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:33.920773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5bf5-7a56-41e5-952f-b1d94372c16f service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.921472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5bf5-7a56-41e5-952f-b1d94372c16f service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.924837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f5bf5-7a56-41e5-952f-b1d94372c16f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:33.944384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f5bf5-7a56-41e5-952f-b1d94372c16f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:33.947102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f5bf5-7a56-41e5-952f-b1d94372c16f service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:33.970315 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2369/4739] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:33.994201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55248f15-0959-45d2-a046-54b052767403 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:33.994497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55248f15-0959-45d2-a046-54b052767403 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:33.994805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55248f15-0959-45d2-a046-54b052767403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:34.030171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-55248f15-0959-45d2-a046-54b052767403 None None] MFA Rules not processed for user `4b3b33ec3baf44beb8a02372cf1ec60c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:34.034646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-55248f15-0959-45d2-a046-54b052767403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:34.057878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2371/4740] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:34.185577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c781-fafe-462f-88e7-bdd735da88bf None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:34.186128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c781-fafe-462f-88e7-bdd735da88bf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:34.186128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c781-fafe-462f-88e7-bdd735da88bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:34.243280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-37e9c781-fafe-462f-88e7-bdd735da88bf None None] MFA Rules not processed for user `4b3b33ec3baf44beb8a02372cf1ec60c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:34.244894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-37e9c781-fafe-462f-88e7-bdd735da88bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:34.257250 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2370/4741] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:34.578732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58244-b9f4-4e56-9709-485b7a4ac043 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:34.579053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58244-b9f4-4e56-9709-485b7a4ac043 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:34.579330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58244-b9f4-4e56-9709-485b7a4ac043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:34.607654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f2e58244-b9f4-4e56-9709-485b7a4ac043 None None] MFA Rules not processed for user `4b3b33ec3baf44beb8a02372cf1ec60c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:34.610116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2e58244-b9f4-4e56-9709-485b7a4ac043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:34.628694 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2372/4742] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:34.649238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085415-41d1-42a3-a40e-1d4b8ebddfa6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:34.649738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085415-41d1-42a3-a40e-1d4b8ebddfa6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:34.650118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085415-41d1-42a3-a40e-1d4b8ebddfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:34.687438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6e085415-41d1-42a3-a40e-1d4b8ebddfa6 None None] MFA Rules not processed for user `4b3b33ec3baf44beb8a02372cf1ec60c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:34.688921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6e085415-41d1-42a3-a40e-1d4b8ebddfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:34.698849 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2371/4743] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:34.719074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58244-b9f4-4e56-9709-485b7a4ac043 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:34.812782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58244-b9f4-4e56-9709-485b7a4ac043 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:34.818471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:34.823270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:34.823665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:34.824047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] PATH_INFO: `/v3/users/4b3b33ec3baf44beb8a02372cf1ec60c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:34.825728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3b33ec3baf44beb8a02372cf1ec60c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:34.829042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:34.882749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3b33ec3baf44beb8a02372cf1ec60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:34.883870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3b33ec3baf44beb8a02372cf1ec60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:34.891529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3b33ec3baf44beb8a02372cf1ec60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:34.892501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3b33ec3baf44beb8a02372cf1ec60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:34.900967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3b33ec3baf44beb8a02372cf1ec60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:34.928760 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2373/4744] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:34 2022] DELETE /identity/v3/users/4b3b33ec3baf44beb8a02372cf1ec60c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:34.933412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:34.934253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:34.934761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:34.971210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:34.973337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:35.059043 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2372/4745] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:35.079227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:35.080745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:35.193236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20aa2f3-65c1-4945-9c73-5e82c6357679 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:35.222864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:35.223633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:35.224265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:35.224265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:35.236439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:35.238122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:35.249711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2374/4746] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:35.400150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:35.401942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:35.421964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff162d6-71d6-44ac-88bf-e2ac1484c6e5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:35.428907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:35.430258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:35.430910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:35.431381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] PATH_INFO: `/v3/users/228761ebf4c0406ab0977cabe351ac76` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:35.432981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=228761ebf4c0406ab0977cabe351ac76)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:35.436567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:35.507213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228761ebf4c0406ab0977cabe351ac76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.520245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228761ebf4c0406ab0977cabe351ac76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.521191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228761ebf4c0406ab0977cabe351ac76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.521817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228761ebf4c0406ab0977cabe351ac76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.532753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228761ebf4c0406ab0977cabe351ac76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.590242 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2373/4747] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:35 2022] DELETE /identity/v3/users/228761ebf4c0406ab0977cabe351ac76 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:35.722992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:35.724536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:35.740390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a7b79-99d3-4f8b-ac88-4fd54e80a61e service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:35.843609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:35.844669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:35.844965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:35.845247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] PATH_INFO: `/v3/projects/18829d5c3c8840fa8cdd552a94dd7d51` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:35.846617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18829d5c3c8840fa8cdd552a94dd7d51)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:35.854326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:35.894355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:35.896040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:35.924716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebdbfe-5ce2-41b9-8b79-46d49a56c89e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:35.950963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18829d5c3c8840fa8cdd552a94dd7d51', 'request_id': 'req-f931f4f2-4da6-47da-aced-8247daf695c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.959871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18829d5c3c8840fa8cdd552a94dd7d51', 'request_id': 'req-f931f4f2-4da6-47da-aced-8247daf695c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.970198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18829d5c3c8840fa8cdd552a94dd7d51', 'request_id': 'req-f931f4f2-4da6-47da-aced-8247daf695c6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.986385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] The token cache is being invalidate because project 18829d5c3c8840fa8cdd552a94dd7d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:35.986704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.987396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f931f4f2-4da6-47da-aced-8247daf695c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:35.990818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2375/4748] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:35 2022] DELETE /identity/v3/projects/18829d5c3c8840fa8cdd552a94dd7d51 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:35.994869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78222a98-ce75-43f3-bee1-06502e96c45f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:35.995912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78222a98-ce75-43f3-bee1-06502e96c45f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:35.996312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78222a98-ce75-43f3-bee1-06502e96c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.021639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-78222a98-ce75-43f3-bee1-06502e96c45f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:36.022928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-78222a98-ce75-43f3-bee1-06502e96c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:36.040080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.041032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.041264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.041680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] PATH_INFO: `/v3/projects/85587313eff94af59406aca0c1a96a02` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.043675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85587313eff94af59406aca0c1a96a02)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.047301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.129596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85587313eff94af59406aca0c1a96a02', 'request_id': 'req-401a426c-0e0f-4038-80c8-5c1f76f43bf4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:36.137764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85587313eff94af59406aca0c1a96a02', 'request_id': 'req-401a426c-0e0f-4038-80c8-5c1f76f43bf4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:36.142910 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2376/4749] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:36.151574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72bc33-7918-479c-8d46-d430d2999f2c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.152506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72bc33-7918-479c-8d46-d430d2999f2c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.152506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72bc33-7918-479c-8d46-d430d2999f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.155684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85587313eff94af59406aca0c1a96a02', 'request_id': 'req-401a426c-0e0f-4038-80c8-5c1f76f43bf4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:36.171455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] The token cache is being invalidate because project 85587313eff94af59406aca0c1a96a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:36.174256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:36.175126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8e72bc33-7918-479c-8d46-d430d2999f2c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:36.175324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-401a426c-0e0f-4038-80c8-5c1f76f43bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:36.176779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8e72bc33-7918-479c-8d46-d430d2999f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:36.179261 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2374/4750] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:35 2022] DELETE /identity/v3/projects/85587313eff94af59406aca0c1a96a02 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:36.184865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535984e-7d05-4bf2-ad97-ffbd5ab818f3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.185390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535984e-7d05-4bf2-ad97-ffbd5ab818f3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.185848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535984e-7d05-4bf2-ad97-ffbd5ab818f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.224612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5535984e-7d05-4bf2-ad97-ffbd5ab818f3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:36.225032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5535984e-7d05-4bf2-ad97-ffbd5ab818f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:36.298734 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2377/4751] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:36.302972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72bc33-7918-479c-8d46-d430d2999f2c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.316459 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2375/4752] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:36.319451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2440e5-e174-4090-ada0-81be31b8ae49 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.319750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2440e5-e174-4090-ada0-81be31b8ae49 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.320033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2440e5-e174-4090-ada0-81be31b8ae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.322369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72bc33-7918-479c-8d46-d430d2999f2c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.329549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.330616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.331403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.331902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.332909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:59:36.333684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.340891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.351352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6f2440e5-e174-4090-ada0-81be31b8ae49 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:36.352755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6f2440e5-e174-4090-ada0-81be31b8ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:36.367767 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2376/4753] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:36.369275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2440e5-e174-4090-ada0-81be31b8ae49 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.383182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2440e5-e174-4090-ada0-81be31b8ae49 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.390042 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2378/4754] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:59:36.390466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.390814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.391692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.392243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.393391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.395033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:59:36.395625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.397557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.417819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fd1ed-e74f-491c-aac9-d785e7ecf3ec admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.418512 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2377/4755] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 21:59:36.420245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.426599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.427486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.427778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.428136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.428760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.430706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.442514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ec083-a24e-4d50-90db-fa9ff74ee1eb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.450102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.452602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.453583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.454263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.455590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.459156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.490242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2379/4756] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:36.495938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.514612 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2378/4757] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:36.516394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.601768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ef5e3-576b-43d8-893b-a5fc8badca27 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.608756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.609824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.610265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.610644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.611560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.613657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.630176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc64c05-aa8b-40f3-883e-d300839547a3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.637671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.639276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.639557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.639838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.640562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.642962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.650293 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2379/4758] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:36.651910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.674042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7c3a-451b-475c-827e-a3a472cac3a0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.689949 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2380/4759] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:36.693690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.694607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.696660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.697212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.697881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.701933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.707159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.711823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e367c-8503-4104-a633-e7579c9cf420 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.726426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2380/4760] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:36.729758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.731183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.731501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.732318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.733137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.733460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.735590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.760100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f2826-bc37-4b9c-939d-29470fc91b1e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.773186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.773885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.774171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.774447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.775297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.782702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.783806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2381/4761] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:36.787958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.804164 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2381/4762] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:36.804558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb11b4b-909b-4465-916d-d8e0ad25dde0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.805536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.811813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.812838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.813317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.814024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.814989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.817811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.830120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64b012-5859-481c-9f60-fd976b588b17 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.831765 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2382/4763] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:36.836637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:36.849081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ff3d-be61-4e66-a989-98ec3b4e85fd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:36.850822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90fb31-4cf0-43b6-88bf-df8c43e236f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.851830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90fb31-4cf0-43b6-88bf-df8c43e236f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.852124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90fb31-4cf0-43b6-88bf-df8c43e236f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.852400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90fb31-4cf0-43b6-88bf-df8c43e236f0 admin admin] PATH_INFO: `/v3/projects/42a275b437594296b48dcf24858d61f3/users/489625599dce4b9ea71e3ed13c28c30f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.857622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030ddd6-b77a-47cb-bdad-6ce0f698d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:36.859228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ddd6-b77a-47cb-bdad-6ce0f698d1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.859619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ddd6-b77a-47cb-bdad-6ce0f698d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.859998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030ddd6-b77a-47cb-bdad-6ce0f698d1a8 admin admin] PATH_INFO: `/v3/projects/1fb49d7a99844a7ab8ef30fb59250e7d/users/99294a64e28046d8b57260f74c325990/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.884163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030ddd6-b77a-47cb-bdad-6ce0f698d1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb49d7a99844a7ab8ef30fb59250e7d, user_id=99294a64e28046d8b57260f74c325990, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.885380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90fb31-4cf0-43b6-88bf-df8c43e236f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a275b437594296b48dcf24858d61f3, user_id=489625599dce4b9ea71e3ed13c28c30f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:36.887915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030ddd6-b77a-47cb-bdad-6ce0f698d1a8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.889322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90fb31-4cf0-43b6-88bf-df8c43e236f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:36.908918 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2383/4764] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:36 2022] PUT /identity/v3/projects/1fb49d7a99844a7ab8ef30fb59250e7d/users/99294a64e28046d8b57260f74c325990/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:36.914330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.914926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.915422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.923045 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2382/4765] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:36 2022] PUT /identity/v3/projects/42a275b437594296b48dcf24858d61f3/users/489625599dce4b9ea71e3ed13c28c30f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:36.928216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:36.928518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:36.929064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:36.956692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:36.958192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:36.983771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:36.986759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:37.098204 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2384/4766] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:37.124109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:37.126321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:37.217678 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2383/4767] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:37.240786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3e758-e496-44f2-8eaf-e17fdc1b245e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:37.251128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57343939-1dcb-44d1-9e9d-f0ce526920f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:37.251979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57343939-1dcb-44d1-9e9d-f0ce526920f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:37.252704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57343939-1dcb-44d1-9e9d-f0ce526920f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:37.252862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57343939-1dcb-44d1-9e9d-f0ce526920f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:37.269507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57343939-1dcb-44d1-9e9d-f0ce526920f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:37.271236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57343939-1dcb-44d1-9e9d-f0ce526920f5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:37.284030 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2385/4768] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:37.304779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:37.307208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:37.325225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ab8ac-6d49-4dba-b4e9-28faa6ddfb02 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:37.331585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa987a6-01fb-4b61-a707-853f08c1d076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:37.332622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa987a6-01fb-4b61-a707-853f08c1d076 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:37.333182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa987a6-01fb-4b61-a707-853f08c1d076 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:37.333680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa987a6-01fb-4b61-a707-853f08c1d076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:37.346617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa987a6-01fb-4b61-a707-853f08c1d076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:37.349450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa987a6-01fb-4b61-a707-853f08c1d076 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:37.378386 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2384/4769] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:38.979567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:38.980111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:38.980111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:39.039328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] MFA Rules not processed for user `489625599dce4b9ea71e3ed13c28c30f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:39.043256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:39.203522 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2386/4770] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:39.215864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:39.217022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:39.217472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:39.247969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] MFA Rules not processed for user `489625599dce4b9ea71e3ed13c28c30f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:39.249365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:39.267840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2385/4771] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:39.275619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:39.277348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:39.415163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136bf22-988f-4461-b49c-17a0b2b43f37 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:39.423723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:39.424625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:39.425106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:39.425577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:39.448257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:39.456905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:39.477263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2387/4772] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:40.824984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:40.827623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:40.878288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcc8ce-a250-4296-97aa-226eb4b3478d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:40.898012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:40.898939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:40.899224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:40.899499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] PATH_INFO: `/v3/users/6e9a3cda211245a18608ae0a25468113` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:40.905144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9a3cda211245a18608ae0a25468113)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:40.907187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:40.997770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9a3cda211245a18608ae0a25468113'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.007246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9a3cda211245a18608ae0a25468113'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.008222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9a3cda211245a18608ae0a25468113'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.008718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9a3cda211245a18608ae0a25468113'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.041007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9a3cda211245a18608ae0a25468113'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.085786 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2386/4773] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:40 2022] DELETE /identity/v3/users/6e9a3cda211245a18608ae0a25468113 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:41.423116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:41.443467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656323d-d07e-494c-896c-a45d5c1f4ad2 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:41.617515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:41.618764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:41.619313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:41.619803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] PATH_INFO: `/v3/projects/1426f0d5b4ef478d91cfb1856c943052` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:41.622421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1426f0d5b4ef478d91cfb1856c943052)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:41.625942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:41.730178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1426f0d5b4ef478d91cfb1856c943052', 'request_id': 'req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.744515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1426f0d5b4ef478d91cfb1856c943052', 'request_id': 'req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.782484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1426f0d5b4ef478d91cfb1856c943052', 'request_id': 'req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.798452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] The token cache is being invalidate because project 1426f0d5b4ef478d91cfb1856c943052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:41.799484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.800246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.802888 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2388/4774] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:41 2022] DELETE /identity/v3/projects/1426f0d5b4ef478d91cfb1856c943052 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:41.808145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:41.810612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:41.827004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7d0ba-9029-4979-964b-e596e74039a3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:41.900724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:41.901876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:41.902160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:41.902485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] PATH_INFO: `/v3/users/1d76be936b614d2a9924f0696addb042` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:41.904357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d76be936b614d2a9924f0696addb042)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:41.906348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:41.962192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d76be936b614d2a9924f0696addb042'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.969905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d76be936b614d2a9924f0696addb042'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.970549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d76be936b614d2a9924f0696addb042'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.971200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d76be936b614d2a9924f0696addb042'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:41.985680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18bfac71-c571-4f1c-ac1a-016dec1fbad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d76be936b614d2a9924f0696addb042'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:42.013331 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2387/4775] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:41 2022] DELETE /identity/v3/users/1d76be936b614d2a9924f0696addb042 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:59:42.964072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:42.972669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:43.000584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4f74-8a17-4f18-a4dd-ec0891dbc982 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:43.147953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:43.148904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.149455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.149743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] PATH_INFO: `/v3/projects/c77bd55728474691ab88abd1cf00a7b3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.151144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77bd55728474691ab88abd1cf00a7b3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:43.153946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:43.238984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77bd55728474691ab88abd1cf00a7b3', 'request_id': 'req-e78dd86a-fd7c-4e1c-a638-3e769b214e72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:43.247161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77bd55728474691ab88abd1cf00a7b3', 'request_id': 'req-e78dd86a-fd7c-4e1c-a638-3e769b214e72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:43.260770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77bd55728474691ab88abd1cf00a7b3', 'request_id': 'req-e78dd86a-fd7c-4e1c-a638-3e769b214e72'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:43.276294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] The token cache is being invalidate because project c77bd55728474691ab88abd1cf00a7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:43.276851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:43.278635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e78dd86a-fd7c-4e1c-a638-3e769b214e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:43.282262 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2389/4776] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:42 2022] DELETE /identity/v3/projects/c77bd55728474691ab88abd1cf00a7b3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:43.287139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9eb5f-0105-4ab7-b92a-f3ccc9f5bc13 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.287623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9eb5f-0105-4ab7-b92a-f3ccc9f5bc13 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.287724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9eb5f-0105-4ab7-b92a-f3ccc9f5bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.311362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-77a9eb5f-0105-4ab7-b92a-f3ccc9f5bc13 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:43.312615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-77a9eb5f-0105-4ab7-b92a-f3ccc9f5bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:43.391522 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2388/4777] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:43.393340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a464c0-bb48-417e-8b1a-51cb46aec627 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.393638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a464c0-bb48-417e-8b1a-51cb46aec627 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.393920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a464c0-bb48-417e-8b1a-51cb46aec627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.414307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f9a464c0-bb48-417e-8b1a-51cb46aec627 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:43.415586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f9a464c0-bb48-417e-8b1a-51cb46aec627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:43.424647 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2390/4778] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:43.429023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9eb5f-0105-4ab7-b92a-f3ccc9f5bc13 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:43.439815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9eb5f-0105-4ab7-b92a-f3ccc9f5bc13 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:43.455361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:43.456127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.456416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.456694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.457431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:59:43.457743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:43.459467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:43.473366 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2389/4779] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:59:43.478145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a464c0-bb48-417e-8b1a-51cb46aec627 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:43.488760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a464c0-bb48-417e-8b1a-51cb46aec627 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:43.493827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:43.494526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.494850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.495135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.495846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:43.498227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:43.532053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2391/4780] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:43 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:43.534448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:43.545408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1bc76-7d81-48c9-9398-9ba94de4ae33 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:43.612878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:43.613877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.614391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.614970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.616055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:43.618638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:43.645271 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2390/4781] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:43 2022] POST /identity/v3/users => generated 302 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:43.650556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:43.665092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11224ff6-3977-42f2-a13c-c478b28d9b6e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:43.671694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:43.671694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.672095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.672272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.673028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:43.674733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:43.691958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2392/4782] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:43.695845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:43.708070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b56dcf-2b3a-4b02-935c-e50be3f4e941 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:43.721981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8dfae-5e5e-4bf6-a46c-9efef9e131f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:43.722672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dfae-5e5e-4bf6-a46c-9efef9e131f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.723003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dfae-5e5e-4bf6-a46c-9efef9e131f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.724100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dfae-5e5e-4bf6-a46c-9efef9e131f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.725072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8dfae-5e5e-4bf6-a46c-9efef9e131f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:43.727500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8dfae-5e5e-4bf6-a46c-9efef9e131f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:43.745345 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2391/4783] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:43.749946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:43.764769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e633a3-29fc-484e-9602-c0c9caf09b68 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:43.773261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:43.774744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.775152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.775517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] PATH_INFO: `/v3/projects/66fb2536c7644582a177d475b2aeb5c7/users/8694bea6f296475a8f69c937b8486bf9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.792629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fb2536c7644582a177d475b2aeb5c7, user_id=8694bea6f296475a8f69c937b8486bf9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:43.795874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:43.819127 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2393/4784] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:43 2022] PUT /identity/v3/projects/66fb2536c7644582a177d475b2aeb5c7/users/8694bea6f296475a8f69c937b8486bf9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:59:43.826369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47998-e837-4706-a024-d907d111f5f8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:43.826922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47998-e837-4706-a024-d907d111f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:43.827308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47998-e837-4706-a024-d907d111f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:43.863024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dbd47998-e837-4706-a024-d907d111f5f8 None None] MFA Rules not processed for user `8694bea6f296475a8f69c937b8486bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:43.864256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dbd47998-e837-4706-a024-d907d111f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:43.949344 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2392/4785] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:44.091320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:44.229338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f6eae-9dd9-4713-9381-c78cc589fc28 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:44.243063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:44.243734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:44.244024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:44.244373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] PATH_INFO: `/v3/users/8694bea6f296475a8f69c937b8486bf9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:44.247247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8694bea6f296475a8f69c937b8486bf9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:44.249717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:44.312933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8694bea6f296475a8f69c937b8486bf9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:44.318382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8694bea6f296475a8f69c937b8486bf9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:44.327038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8694bea6f296475a8f69c937b8486bf9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:44.327782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8694bea6f296475a8f69c937b8486bf9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:44.338400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8694bea6f296475a8f69c937b8486bf9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:44.361783 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2394/4786] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 21:59:44 2022] DELETE /identity/v3/users/8694bea6f296475a8f69c937b8486bf9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:44.365961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:44.366979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:44.367656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:44.393164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:44.394601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:44.487570 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2393/4787] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:44.500306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:44.501984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:44.563113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ac520-aa07-457b-93f3-5da5238ac10f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:44.567311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3d535-4725-4c50-9b15-03289669035d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:44.568083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d535-4725-4c50-9b15-03289669035d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:44.568437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d535-4725-4c50-9b15-03289669035d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:44.570486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3d535-4725-4c50-9b15-03289669035d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:44.591625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3d535-4725-4c50-9b15-03289669035d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:44.593466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3d535-4725-4c50-9b15-03289669035d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:44.610502 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2395/4788] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:45.379099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:45.381092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:45.398257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf257b92-eb7c-4189-aa39-4ab3be99852c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:45.418464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:45.420408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.420702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.420983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] PATH_INFO: `/v3/projects/66fb2536c7644582a177d475b2aeb5c7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.422550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66fb2536c7644582a177d475b2aeb5c7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:45.427030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:45.499507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66fb2536c7644582a177d475b2aeb5c7', 'request_id': 'req-ad5bc776-c25e-41e6-bde5-7f136508a420'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:45.513248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66fb2536c7644582a177d475b2aeb5c7', 'request_id': 'req-ad5bc776-c25e-41e6-bde5-7f136508a420'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:45.523329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66fb2536c7644582a177d475b2aeb5c7', 'request_id': 'req-ad5bc776-c25e-41e6-bde5-7f136508a420'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:45.537203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] The token cache is being invalidate because project 66fb2536c7644582a177d475b2aeb5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 21:59:45.537773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:45.540688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ad5bc776-c25e-41e6-bde5-7f136508a420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 21:59:45.542501 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2394/4789] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 21:59:45 2022] DELETE /identity/v3/projects/66fb2536c7644582a177d475b2aeb5c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 21:59:45.548633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a144-2ce0-40ba-a1b2-b41010705fe7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.549123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a144-2ce0-40ba-a1b2-b41010705fe7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.549233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a144-2ce0-40ba-a1b2-b41010705fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.573195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bff6a144-2ce0-40ba-a1b2-b41010705fe7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:45.574549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bff6a144-2ce0-40ba-a1b2-b41010705fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:45.645962 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2396/4790] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:45.654522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b7472-1442-4bbb-befd-f8a669b9fbb5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.654836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b7472-1442-4bbb-befd-f8a669b9fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.655328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b7472-1442-4bbb-befd-f8a669b9fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.678936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-871b7472-1442-4bbb-befd-f8a669b9fbb5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:45.680448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-871b7472-1442-4bbb-befd-f8a669b9fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:45.690359 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2395/4791] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:45.694883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a144-2ce0-40ba-a1b2-b41010705fe7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:45.706611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a144-2ce0-40ba-a1b2-b41010705fe7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:45.711848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:45.712626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.713068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.713598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.714626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 21:59:45.715096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:45.716932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:45.730972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2397/4792] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 21:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 21:59:45.735067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b7472-1442-4bbb-befd-f8a669b9fbb5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:45.745146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b7472-1442-4bbb-befd-f8a669b9fbb5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:45.751939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:45.752620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.752903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.753178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.753892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:45.755899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:45.786806 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2396/4793] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 21:59:45 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:45.793661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:45.805872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c33f5-6c0e-4b1d-a162-f5c3ee5ad03c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:45.871984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:45.873130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.873130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.873377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.874271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:45.876614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:45.899986 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2398/4794] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 21:59:45 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 21:59:45.904479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:45.915498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7ef84-bf2d-49ff-a0f5-756bbbb1f683 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:45.921488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:45.922215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.922501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.922817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.923548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:45.925748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:45.937400 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2397/4795] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 21:59:45.942090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:45.954222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728c861-e480-4173-b0cc-419f763de0be admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:45.960641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88159165-aeba-4028-af09-4ac9c299be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:45.961899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88159165-aeba-4028-af09-4ac9c299be82 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:45.962188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88159165-aeba-4028-af09-4ac9c299be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:45.962810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88159165-aeba-4028-af09-4ac9c299be82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:45.963217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88159165-aeba-4028-af09-4ac9c299be82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:45.965379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88159165-aeba-4028-af09-4ac9c299be82 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:45.979214 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2399/4796] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 21:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 21:59:45.980461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:45.995169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047b5df-6019-4b71-98ab-cdc693dca1c7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:46.002475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:46.003740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:46.004033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:46.004337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] PATH_INFO: `/v3/projects/81e5c5d849ea4fc59d5c4fc58b31530f/users/5ea5d144165a4e129de242905439e951/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:46.029024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e5c5d849ea4fc59d5c4fc58b31530f, user_id=5ea5d144165a4e129de242905439e951, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:46.033514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:46.056486 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2398/4797] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 21:59:45 2022] PUT /identity/v3/projects/81e5c5d849ea4fc59d5c4fc58b31530f/users/5ea5d144165a4e129de242905439e951/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 21:59:46.058798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:46.059152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:46.059966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:46.102539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:46.103800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:46.167090 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2400/4798] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 21:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 21:59:46.240091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:46.241873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:46.306180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3d55c-41e1-4614-bbb7-b99d8bc7f943 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:46.310068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097ccb-3333-4e4d-8261-78b33355b45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:46.310757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097ccb-3333-4e4d-8261-78b33355b45d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:46.311075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097ccb-3333-4e4d-8261-78b33355b45d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:46.311354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097ccb-3333-4e4d-8261-78b33355b45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:46.327412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097ccb-3333-4e4d-8261-78b33355b45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:46.328918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097ccb-3333-4e4d-8261-78b33355b45d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:46.342380 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2399/4799] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:46.971889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:46.973936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:47.084212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e48a87-0459-4ccf-8b3d-d96b57d7c030 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:47.103028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:47.103753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:47.104046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:47.104311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:47.121197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:47.274530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:47.279032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:47.293717 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2401/4800] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 21:59:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 21:59:47.629726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637bbf5-b4c9-481c-b124-b184877e5a17 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:47.630229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637bbf5-b4c9-481c-b124-b184877e5a17 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:47.630443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637bbf5-b4c9-481c-b124-b184877e5a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:47.661981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f637bbf5-b4c9-481c-b124-b184877e5a17 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 21:59:47.663575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f637bbf5-b4c9-481c-b124-b184877e5a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:47.747255 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2400/4801] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 21:59:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 21:59:47.780038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 21:59:47.782328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 21:59:47.929151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a487edb-3b26-4df9-b27b-bb336f0d8d18 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 21:59:47.945241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e875fdf-6999-4732-8b34-0445c8bcfdb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 21:59:47.946228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e875fdf-6999-4732-8b34-0445c8bcfdb9 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 21:59:47.946587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e875fdf-6999-4732-8b34-0445c8bcfdb9 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 21:59:47.947012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e875fdf-6999-4732-8b34-0445c8bcfdb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 21:59:47.960103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e875fdf-6999-4732-8b34-0445c8bcfdb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 21:59:47.964733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e875fdf-6999-4732-8b34-0445c8bcfdb9 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 21:59:47.975410 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2402/4802] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 21:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 22:00:01.776668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:01.777810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:01.777810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:01.846790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] MFA Rules not processed for user `99294a64e28046d8b57260f74c325990`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:01.849707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:02.053133 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2401/4803] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:02.063531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:02.064099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:02.064099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:02.097771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] MFA Rules not processed for user `99294a64e28046d8b57260f74c325990`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:02.101468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:02.132035 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2403/4804] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:02.144185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:02.145640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:02.203379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ce192-bd99-4f0f-803d-f74970ea1d67 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:02.232715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115f8e8-794b-4fb2-8b9c-1c76b63af802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:02.234364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f8e8-794b-4fb2-8b9c-1c76b63af802 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:02.234651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f8e8-794b-4fb2-8b9c-1c76b63af802 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:02.238307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115f8e8-794b-4fb2-8b9c-1c76b63af802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:02.278552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115f8e8-794b-4fb2-8b9c-1c76b63af802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:02.280776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115f8e8-794b-4fb2-8b9c-1c76b63af802 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:02.297933 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2402/4805] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:03.726666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:03.730948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:03.769249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c927-02b5-4007-8b84-5942717265c5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:03.774690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:03.777417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:03.777960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:03.778463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] PATH_INFO: `/v3/users/fce3ec220fb84ccbab439630115e7ef4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:03.780049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce3ec220fb84ccbab439630115e7ef4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:03.783286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:03.869041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce3ec220fb84ccbab439630115e7ef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:03.870087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce3ec220fb84ccbab439630115e7ef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:03.880285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce3ec220fb84ccbab439630115e7ef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:03.881589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce3ec220fb84ccbab439630115e7ef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:03.901685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce3ec220fb84ccbab439630115e7ef4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:03.946174 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2404/4806] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:00:03 2022] DELETE /identity/v3/users/fce3ec220fb84ccbab439630115e7ef4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:03.951816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:03.952826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:03.953391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:03.989563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:03.991498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:04.081868 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2403/4807] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:04.115075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:04.117949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:04.295709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90d7e5-e57d-4ea6-8a5a-c3bd1dfad7cb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:04.309806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:04.310607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:04.311022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:04.311728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:04.338441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:04.340914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:04.355577 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2405/4808] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:04.513331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:04.514938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:04.534373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e5fe7-4a22-4716-90da-c5645f206e46 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:04.552732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eca77b-97a4-4073-a2c8-382d24be96f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:04.553684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eca77b-97a4-4073-a2c8-382d24be96f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:04.553684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eca77b-97a4-4073-a2c8-382d24be96f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:04.553991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eca77b-97a4-4073-a2c8-382d24be96f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:04.563872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d0eca77b-97a4-4073-a2c8-382d24be96f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:04.614506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eca77b-97a4-4073-a2c8-382d24be96f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:04.616021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eca77b-97a4-4073-a2c8-382d24be96f6 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:04.670122 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2404/4809] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:06.948521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:06.950794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:06.980052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e80fd-7f4d-4319-bc2e-530293740abd service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:06.992179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:07.000661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:07.000948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:07.001453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] PATH_INFO: `/v3/projects/e8e04e47c1cd4025a59809f6e8d6d7b6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:07.004320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e04e47c1cd4025a59809f6e8d6d7b6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:07.006814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:07.133172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e04e47c1cd4025a59809f6e8d6d7b6', 'request_id': 'req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:07.151150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e04e47c1cd4025a59809f6e8d6d7b6', 'request_id': 'req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:07.203291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e04e47c1cd4025a59809f6e8d6d7b6', 'request_id': 'req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:07.269218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] The token cache is being invalidate because project e8e04e47c1cd4025a59809f6e8d6d7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:00:07.269523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:07.279238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c6d8e4dd-5d06-43e4-94b3-96d6f60acecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:07.282098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2406/4810] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:06 2022] DELETE /identity/v3/projects/e8e04e47c1cd4025a59809f6e8d6d7b6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:07.287095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd66b-4787-4c5a-a490-a969ee95d861 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:07.287588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd66b-4787-4c5a-a490-a969ee95d861 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:07.287853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd66b-4787-4c5a-a490-a969ee95d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:07.345949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a45cd66b-4787-4c5a-a490-a969ee95d861 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:07.347370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a45cd66b-4787-4c5a-a490-a969ee95d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:07.518399 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2405/4811] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:07.520098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101943-cec9-42b9-844d-a19dead23065 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:07.520622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101943-cec9-42b9-844d-a19dead23065 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:07.520965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b101943-cec9-42b9-844d-a19dead23065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:07.583751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2b101943-cec9-42b9-844d-a19dead23065 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:07.585236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b101943-cec9-42b9-844d-a19dead23065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:07.596561 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2407/4812] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:07.600584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd66b-4787-4c5a-a490-a969ee95d861 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:07.614370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd66b-4787-4c5a-a490-a969ee95d861 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:07.637663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:07.638541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:07.638969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:07.640379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:07.641242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:00:07.642283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:07.647133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:07.685888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2406/4813] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:00:07.690486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101943-cec9-42b9-844d-a19dead23065 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:07.706495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b101943-cec9-42b9-844d-a19dead23065 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:07.734239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:07.736153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:07.737699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:07.738398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:07.739667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:07.742301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:07.824871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:07.826068 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2408/4814] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:00:07 2022] POST /identity/v3/projects => generated 359 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:00:07.838814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aab617-f9d1-454e-ac9c-cca1ee6ee424 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:07.970320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:07.971355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:07.971801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:07.972262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:07.973122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:07.977263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:08.028799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2407/4815] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:00:07 2022] POST /identity/v3/users => generated 280 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:00:08.044165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:08.058729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df312-a593-430c-8fe4-4dd45f3114db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:08.069158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:08.069981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:08.075702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:08.076357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:08.077378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:08.079325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:08.109401 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2409/4816] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:00:08.110749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:08.130674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038f4a2-1aef-4a49-99b5-beeb22cb6712 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:08.139384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eeddbb-a718-4b1c-9a58-edf96852074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:08.140105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeddbb-a718-4b1c-9a58-edf96852074d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:08.140391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeddbb-a718-4b1c-9a58-edf96852074d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:08.140665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eeddbb-a718-4b1c-9a58-edf96852074d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:08.141392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eeddbb-a718-4b1c-9a58-edf96852074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:08.143039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eeddbb-a718-4b1c-9a58-edf96852074d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:08.182915 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2408/4817] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:00:08.184117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:08.197773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2b37c-18f3-4533-8310-f1a8752753c4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:08.213194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:08.214959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:08.215438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:08.215877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] PATH_INFO: `/v3/projects/d7da299cb7fd4b569f047ab71e3255d4/users/3b46f9c0992b40c29cf70cfcb30384bc/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:08.243255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7da299cb7fd4b569f047ab71e3255d4, user_id=3b46f9c0992b40c29cf70cfcb30384bc, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:08.247375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:08.315447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2410/4818] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:00:08 2022] PUT /identity/v3/projects/d7da299cb7fd4b569f047ab71e3255d4/users/3b46f9c0992b40c29cf70cfcb30384bc/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:08.325435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448daae5-e6cd-42d2-93f4-abcc31fb9294 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:08.325893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448daae5-e6cd-42d2-93f4-abcc31fb9294 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:08.326011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448daae5-e6cd-42d2-93f4-abcc31fb9294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:08.414802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-448daae5-e6cd-42d2-93f4-abcc31fb9294 None None] MFA Rules not processed for user `3b46f9c0992b40c29cf70cfcb30384bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:08.418425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-448daae5-e6cd-42d2-93f4-abcc31fb9294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:08.596492 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2409/4819] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:08 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:08.719533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:08.723318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:08.861561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f901224-b44a-4579-9d0a-380e536305c1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:08.879492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:08.880398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:08.880859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:08.882041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:08.905768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:08.907304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:08.930328 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2411/4820] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:08 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:12.625611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:12.626109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:12.626466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:12.694855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] MFA Rules not processed for user `5ea5d144165a4e129de242905439e951`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:12.696944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:12.875247 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2410/4821] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:13.252799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:13.254557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:13.355605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d22c68-d99d-41e8-8492-141a15cbb4f5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:13.362567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:13.363372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:13.363747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:13.364278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:13.375146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:13.376920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:13.390999 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2412/4822] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:18.628174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:18.630154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:18.804910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b43d9-bac8-4f67-b1b1-c300ec29b193 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:18.820773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:18.823370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:18.828507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:18.833407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] PATH_INFO: `/v3/users/bdc18dc6c5214fbb9c1fa61eeb514cc9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:18.835527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc18dc6c5214fbb9c1fa61eeb514cc9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:18.839298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:18.963506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc18dc6c5214fbb9c1fa61eeb514cc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:18.992711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc18dc6c5214fbb9c1fa61eeb514cc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:18.993469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc18dc6c5214fbb9c1fa61eeb514cc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:18.994159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc18dc6c5214fbb9c1fa61eeb514cc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:19.012563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39824276-9cf5-4167-a067-7e47b4a32a74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc18dc6c5214fbb9c1fa61eeb514cc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:19.050543 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2411/4823] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:00:18 2022] DELETE /identity/v3/users/bdc18dc6c5214fbb9c1fa61eeb514cc9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:20.020335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:20.081292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34203f-7070-487b-a3bf-d9d059466ef4 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:20.102692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf6e09-782e-4fd7-b2a8-c363ac450490 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.103535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf6e09-782e-4fd7-b2a8-c363ac450490 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.103975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf6e09-782e-4fd7-b2a8-c363ac450490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.141846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eacf6e09-782e-4fd7-b2a8-c363ac450490 None None] MFA Rules not processed for user `5ea5d144165a4e129de242905439e951`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:20.143453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eacf6e09-782e-4fd7-b2a8-c363ac450490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:20.221291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:20.223706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.224118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.224759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] PATH_INFO: `/v3/projects/93c3c71171814bb7b1018904086ad506` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.229046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c3c71171814bb7b1018904086ad506)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:20.234758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:20.319730 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2412/4824] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:20.333673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c3c71171814bb7b1018904086ad506', 'request_id': 'req-767a2f85-2547-4c55-88a3-a1e36cf4494d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:20.343104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c3c71171814bb7b1018904086ad506', 'request_id': 'req-767a2f85-2547-4c55-88a3-a1e36cf4494d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:20.355391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c3c71171814bb7b1018904086ad506', 'request_id': 'req-767a2f85-2547-4c55-88a3-a1e36cf4494d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:20.397228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] The token cache is being invalidate because project 93c3c71171814bb7b1018904086ad506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:00:20.398587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:20.400818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-767a2f85-2547-4c55-88a3-a1e36cf4494d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:20.409009 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2413/4825] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:20 2022] DELETE /identity/v3/projects/93c3c71171814bb7b1018904086ad506 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:20.410503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ffd66-1db7-4147-891e-317c1a3e0f63 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.410862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ffd66-1db7-4147-891e-317c1a3e0f63 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.411158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ffd66-1db7-4147-891e-317c1a3e0f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.448893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6c5ffd66-1db7-4147-891e-317c1a3e0f63 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:20.450605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6c5ffd66-1db7-4147-891e-317c1a3e0f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:20.582356 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2413/4826] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:20.590399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011940d-a09f-4aca-9fd6-4f3a33e47d94 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.590936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011940d-a09f-4aca-9fd6-4f3a33e47d94 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.591447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011940d-a09f-4aca-9fd6-4f3a33e47d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.614748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a011940d-a09f-4aca-9fd6-4f3a33e47d94 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:20.616373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a011940d-a09f-4aca-9fd6-4f3a33e47d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:20.629614 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2414/4827] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:20.630091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ffd66-1db7-4147-891e-317c1a3e0f63 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:20.642129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ffd66-1db7-4147-891e-317c1a3e0f63 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:20.648025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:20.648972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.649256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.649533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.650315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:00:20.650627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:20.653063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:20.672410 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2414/4828] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:00:20.676328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011940d-a09f-4aca-9fd6-4f3a33e47d94 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:20.686603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011940d-a09f-4aca-9fd6-4f3a33e47d94 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:20.693725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:20.694740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.695638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.696174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.697103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:20.699889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:20.757074 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2415/4829] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:00:20 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:00:20.759605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:20.770474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b839e6c-9926-4d28-83a2-54b9c2cca1de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:20.837903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:20.838599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.839759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.840051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.840755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:20.842732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:20.868744 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2415/4830] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:00:20 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:00:20.872747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:20.887519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54e21d-5201-4270-9aef-7291e88ceda6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:20.894935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:20.896189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.897830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.898398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.899628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:20.903168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:20.924818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2416/4831] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:00:20.928727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:20.941722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97164b2-b86e-482c-8d22-e7d2af129274 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:20.947749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8e590-a237-46e8-9d5f-543d2f0429cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:20.950153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8e590-a237-46e8-9d5f-543d2f0429cb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.950714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8e590-a237-46e8-9d5f-543d2f0429cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.951273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8e590-a237-46e8-9d5f-543d2f0429cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:20.952516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8e590-a237-46e8-9d5f-543d2f0429cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:20.954612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8e590-a237-46e8-9d5f-543d2f0429cb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:20.969397 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2416/4832] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:00:20.973357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:20.983847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe404eb6-0c77-4809-9322-623b0f0b4426 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:20.989892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:20.991102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:20.991552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:20.992029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] PATH_INFO: `/v3/projects/57990769f50b412194a108cdd627a767/users/887054d178de43b18a472fed2297659d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:21.015864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57990769f50b412194a108cdd627a767, user_id=887054d178de43b18a472fed2297659d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:21.019325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:21.045206 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2417/4833] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:00:20 2022] PUT /identity/v3/projects/57990769f50b412194a108cdd627a767/users/887054d178de43b18a472fed2297659d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:21.051269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:21.051767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:21.052242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:21.085313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:21.086722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:21.092891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:21.094585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:21.166372 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2417/4834] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:21.177952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:21.179672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:21.199470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f080a8-47d7-4f7c-bf3b-f5f16df343f1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:21.207586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:21.209803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:21.210354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:21.210951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] PATH_INFO: `/v3/users/489625599dce4b9ea71e3ed13c28c30f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:21.213407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] RBAC: Authorizing `identity:delete_user(user_id=489625599dce4b9ea71e3ed13c28c30f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:21.217311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:21.334991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b9fde-42c4-48d3-91ed-226b0ca59c74 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:21.335526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489625599dce4b9ea71e3ed13c28c30f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:21.336420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489625599dce4b9ea71e3ed13c28c30f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:21.347717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489625599dce4b9ea71e3ed13c28c30f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:21.348823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489625599dce4b9ea71e3ed13c28c30f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:21.361252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489625599dce4b9ea71e3ed13c28c30f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:21.362837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd2c6-fe38-4ee1-951e-36eece57dabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:21.365006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd2c6-fe38-4ee1-951e-36eece57dabf service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:21.365999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd2c6-fe38-4ee1-951e-36eece57dabf service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:21.367893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd2c6-fe38-4ee1-951e-36eece57dabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:21.373200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7febd2c6-fe38-4ee1-951e-36eece57dabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:21.391128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febd2c6-fe38-4ee1-951e-36eece57dabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:21.393100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febd2c6-fe38-4ee1-951e-36eece57dabf service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:21.403464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2418/4835] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:00:21 2022] DELETE /identity/v3/users/489625599dce4b9ea71e3ed13c28c30f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:21.425786 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2418/4836] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:00:22.595307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:22.597190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:22.770258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848c7e-8bf6-4236-9f3e-9e916e12211c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:22.778049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:22.780777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:22.782052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:22.782594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] PATH_INFO: `/v3/projects/42a275b437594296b48dcf24858d61f3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:22.785985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a275b437594296b48dcf24858d61f3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:22.788661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:22.888988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a275b437594296b48dcf24858d61f3', 'request_id': 'req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:22.897273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a275b437594296b48dcf24858d61f3', 'request_id': 'req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:22.914970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a275b437594296b48dcf24858d61f3', 'request_id': 'req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:22.939650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] The token cache is being invalidate because project 42a275b437594296b48dcf24858d61f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:00:22.940680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:22.942982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09c48b68-c5de-43f8-9d43-a3a49b2d9e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:00:22.948753 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2419/4837] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:00:22 2022] DELETE /identity/v3/projects/42a275b437594296b48dcf24858d61f3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:22.956992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696614bc-e5bd-4a4f-aee2-8740ea696835 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:22.957859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696614bc-e5bd-4a4f-aee2-8740ea696835 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:22.958392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696614bc-e5bd-4a4f-aee2-8740ea696835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:22.998412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-696614bc-e5bd-4a4f-aee2-8740ea696835 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:23.005868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-696614bc-e5bd-4a4f-aee2-8740ea696835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:23.183413 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2419/4838] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:23.192028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189746-00c9-48cc-bda8-3f8b695ea949 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:23.192338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189746-00c9-48cc-bda8-3f8b695ea949 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:23.192624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e189746-00c9-48cc-bda8-3f8b695ea949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:23.245889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4e189746-00c9-48cc-bda8-3f8b695ea949 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:23.252312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4e189746-00c9-48cc-bda8-3f8b695ea949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:23.289054 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2420/4839] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:23.294713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696614bc-e5bd-4a4f-aee2-8740ea696835 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:23.320940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696614bc-e5bd-4a4f-aee2-8740ea696835 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:23.331874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:23.333444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:23.333890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:23.334348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:23.335372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:00:23.335839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:23.337626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:23.371578 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2420/4840] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:00:23.376167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e189746-00c9-48cc-bda8-3f8b695ea949 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:23.389588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e189746-00c9-48cc-bda8-3f8b695ea949 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:23.404661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:23.405618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:23.406088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:23.406516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:23.407398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:23.409511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:23.519805 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2421/4841] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:00:23 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:00:23.523761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:23.539002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f0a93-f4a1-444f-8df7-d3b5942341fa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:23.765480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:23.767853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:23.768145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:23.768459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:23.774114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:23.782365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:23.837987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2421/4842] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:00:23 2022] POST /identity/v3/users => generated 294 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:00:23.842936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:23.870727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb488a2-a7be-4633-8b08-343cd38cb9aa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:23.895154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:23.898257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:23.902204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:23.902722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:23.928755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:23.938617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:24.003605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2422/4843] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:00:24.005484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:24.025981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70adf47-021d-4e1e-b49a-d9be112b598f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:24.038199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6795d-46fe-4fc6-85c5-43a358859590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:24.041470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6795d-46fe-4fc6-85c5-43a358859590 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:24.041872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6795d-46fe-4fc6-85c5-43a358859590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:24.042097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6795d-46fe-4fc6-85c5-43a358859590 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:24.050907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6795d-46fe-4fc6-85c5-43a358859590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:24.055905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6795d-46fe-4fc6-85c5-43a358859590 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:24.088192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:24.088517 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2422/4844] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:00:24.113556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5333840-e9be-418c-b2f9-cc7808284ad8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:24.123410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:24.123758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:24.124046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:24.130269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4f3b9-4cfd-439d-b9b4-51d3cda65f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:24.133070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f3b9-4cfd-439d-b9b4-51d3cda65f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:24.133370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f3b9-4cfd-439d-b9b4-51d3cda65f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:24.134797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4f3b9-4cfd-439d-b9b4-51d3cda65f41 admin admin] PATH_INFO: `/v3/projects/169e1e6f26414e3eaa454bc14100fece/users/ddc30338eaa944db87c27cab6eb949ca/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:24.171370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4f3b9-4cfd-439d-b9b4-51d3cda65f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169e1e6f26414e3eaa454bc14100fece, user_id=ddc30338eaa944db87c27cab6eb949ca, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:24.173057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:24.175467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:24.176765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4f3b9-4cfd-439d-b9b4-51d3cda65f41 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:24.214550 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2423/4845] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:00:24 2022] PUT /identity/v3/projects/169e1e6f26414e3eaa454bc14100fece/users/ddc30338eaa944db87c27cab6eb949ca/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:00:24.225083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:24.225501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:24.225813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:24.288204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:24.290723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:24.383411 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2423/4846] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:00:24.398757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:24.400829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:24.494819 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2424/4847] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:00:24.511482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc73e-6893-49e7-b1cb-356577dba183 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:24.560331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:24.561927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:24.638749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99019a9-a4d2-42d4-a5a1-6da907691238 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:24.641198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99019a9-a4d2-42d4-a5a1-6da907691238 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:24.641863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99019a9-a4d2-42d4-a5a1-6da907691238 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:24.643322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99019a9-a4d2-42d4-a5a1-6da907691238 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:24.691097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93d393-c02e-42d4-8cee-9837cc59a345 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:24.702952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97c3b1-9bf0-4b61-85a7-3365a7e69f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:24.704066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97c3b1-9bf0-4b61-85a7-3365a7e69f11 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:24.704363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97c3b1-9bf0-4b61-85a7-3365a7e69f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:24.704641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97c3b1-9bf0-4b61-85a7-3365a7e69f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:24.726818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97c3b1-9bf0-4b61-85a7-3365a7e69f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:24.731983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97c3b1-9bf0-4b61-85a7-3365a7e69f11 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:24.759661 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2425/4848] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:00:24.760063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99019a9-a4d2-42d4-a5a1-6da907691238 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:24.763813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99019a9-a4d2-42d4-a5a1-6da907691238 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:24.785342 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2424/4849] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:00:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 22:00:30.785195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76475dc-90b5-4eb6-be03-347108b8a0c1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:30.786672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76475dc-90b5-4eb6-be03-347108b8a0c1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:30.787475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76475dc-90b5-4eb6-be03-347108b8a0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:30.858614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e76475dc-90b5-4eb6-be03-347108b8a0c1 None None] MFA Rules not processed for user `ddc30338eaa944db87c27cab6eb949ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:30.862137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e76475dc-90b5-4eb6-be03-347108b8a0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:30.994640 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2426/4850] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:31.006405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:31.006405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:31.007202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:31.049759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] MFA Rules not processed for user `ddc30338eaa944db87c27cab6eb949ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:31.051860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:31.076326 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2425/4851] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:31.085333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e91634-898a-49ee-9cf7-88c5578b82bb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:31.086985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e91634-898a-49ee-9cf7-88c5578b82bb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:31.087354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e91634-898a-49ee-9cf7-88c5578b82bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:31.131644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-93e91634-898a-49ee-9cf7-88c5578b82bb None None] MFA Rules not processed for user `ddc30338eaa944db87c27cab6eb949ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:31.137362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-93e91634-898a-49ee-9cf7-88c5578b82bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:31.157095 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2427/4852] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:31.167974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:31.170123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:31.379075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a8916-f684-4fc7-8cb6-ee90c968a41d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:31.389502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf9bce-8887-4317-8143-e11072078b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:31.390302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf9bce-8887-4317-8143-e11072078b60 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:31.391194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf9bce-8887-4317-8143-e11072078b60 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:31.392765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf9bce-8887-4317-8143-e11072078b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:31.423785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf9bce-8887-4317-8143-e11072078b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:31.428959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf9bce-8887-4317-8143-e11072078b60 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:31.456365 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2426/4853] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:33.429982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb815d-f238-48df-93b4-4c04d714de7a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:33.430533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb815d-f238-48df-93b4-4c04d714de7a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:33.430533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb815d-f238-48df-93b4-4c04d714de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:33.521700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6efb815d-f238-48df-93b4-4c04d714de7a None None] MFA Rules not processed for user `ddc30338eaa944db87c27cab6eb949ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:33.522987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6efb815d-f238-48df-93b4-4c04d714de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:33.573790 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2428/4854] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:36.411807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35087f6e-0590-48e5-940d-1a8d6e2fbf59 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:36.412373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35087f6e-0590-48e5-940d-1a8d6e2fbf59 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:36.412373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35087f6e-0590-48e5-940d-1a8d6e2fbf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:36.468145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-35087f6e-0590-48e5-940d-1a8d6e2fbf59 None None] MFA Rules not processed for user `ddc30338eaa944db87c27cab6eb949ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:36.469364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-35087f6e-0590-48e5-940d-1a8d6e2fbf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:36.507086 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2427/4855] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:43.253046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb815d-f238-48df-93b4-4c04d714de7a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:43.272063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb815d-f238-48df-93b4-4c04d714de7a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:43.279740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:43.281885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:43.282414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:43.282957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:43.285832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:43.310430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:43.313317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:43.330795 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2429/4856] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:46.259901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35087f6e-0590-48e5-940d-1a8d6e2fbf59 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:46.273640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35087f6e-0590-48e5-940d-1a8d6e2fbf59 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:46.290473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c0081-79d5-44dd-8e71-b21847d2b684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:46.292350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c0081-79d5-44dd-8e71-b21847d2b684 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:46.292827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c0081-79d5-44dd-8e71-b21847d2b684 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:46.293288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c0081-79d5-44dd-8e71-b21847d2b684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:46.298162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4d9c0081-79d5-44dd-8e71-b21847d2b684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:46.363995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c0081-79d5-44dd-8e71-b21847d2b684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:46.373510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c0081-79d5-44dd-8e71-b21847d2b684 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:46.422550 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2428/4857] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:47.231665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:47.233101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:47.432485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdda52-bcac-4944-83fb-4356767a65c7 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:47.451412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:47.452069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:47.452357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:47.454312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:47.454611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:47.490004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:47.492096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:47.519818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2430/4858] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:48.498349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a3c9-d6fa-4c64-9f00-2e2457701f8c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:48.498871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a3c9-d6fa-4c64-9f00-2e2457701f8c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:48.501394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0a3c9-d6fa-4c64-9f00-2e2457701f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:48.572476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4dd0a3c9-d6fa-4c64-9f00-2e2457701f8c None None] MFA Rules not processed for user `887054d178de43b18a472fed2297659d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:48.575411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4dd0a3c9-d6fa-4c64-9f00-2e2457701f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:48.706451 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2429/4859] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:48.718261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:00:48.719746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:48.748352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c6dbe-2c83-457e-8f4f-d3342ad8b99e service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:00:48.763399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2173cb0-e4ff-4d80-bf40-0d61c08c31b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:00:48.764937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2173cb0-e4ff-4d80-bf40-0d61c08c31b6 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:48.765459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2173cb0-e4ff-4d80-bf40-0d61c08c31b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:48.766130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2173cb0-e4ff-4d80-bf40-0d61c08c31b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:48.778275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2173cb0-e4ff-4d80-bf40-0d61c08c31b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:00:48.781059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2173cb0-e4ff-4d80-bf40-0d61c08c31b6 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:00:48.793490 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2431/4860] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:00:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:00:59.141025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b21d2-91e7-41e9-a40e-694b9d69d308 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:59.142015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b21d2-91e7-41e9-a40e-694b9d69d308 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:59.142464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b21d2-91e7-41e9-a40e-694b9d69d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:00:59.185104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3b7b21d2-91e7-41e9-a40e-694b9d69d308 None None] MFA Rules not processed for user `99294a64e28046d8b57260f74c325990`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:00:59.186756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3b7b21d2-91e7-41e9-a40e-694b9d69d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:00:59.333045 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2430/4861] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:00:59.982970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:00:59.983505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:00:59.983752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:00.019976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] MFA Rules not processed for user `887054d178de43b18a472fed2297659d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:00.022536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:00.043497 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2432/4862] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:00:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:00.614269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b21d2-91e7-41e9-a40e-694b9d69d308 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:00.637382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b21d2-91e7-41e9-a40e-694b9d69d308 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:00.642598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da790d-bd01-4d42-a4e0-98c82a543f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:00.657521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da790d-bd01-4d42-a4e0-98c82a543f1f service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:00.657986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da790d-bd01-4d42-a4e0-98c82a543f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:00.658426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da790d-bd01-4d42-a4e0-98c82a543f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:00.662757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-32da790d-bd01-4d42-a4e0-98c82a543f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:00.684829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da790d-bd01-4d42-a4e0-98c82a543f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:00.688721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da790d-bd01-4d42-a4e0-98c82a543f1f service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:00.703333 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2431/4863] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:02.118146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:02.119731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:02.331759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7efa6-d7cf-4df0-a467-deb5ce2a94b1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:02.368136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:02.371548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:02.372099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:02.372584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:02.376011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:02.398497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:02.401533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:02.452685 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2433/4864] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:03.388349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed06f-db29-40f0-83ee-e57ed167389f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:03.389873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed06f-db29-40f0-83ee-e57ed167389f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:03.390321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ed06f-db29-40f0-83ee-e57ed167389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:03.414096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b48ed06f-db29-40f0-83ee-e57ed167389f None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:03.416301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b48ed06f-db29-40f0-83ee-e57ed167389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:03.432076 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2432/4865] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:01:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:03.449999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:03.468775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffea2ab-8e85-4804-aa66-75b36cfd6c5f service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:03.476019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:03.476980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:03.478378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:03.478940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:03.502154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:03.514764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:03.546447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2434/4866] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:01:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:01:12.344230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed06f-db29-40f0-83ee-e57ed167389f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:12.373974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ed06f-db29-40f0-83ee-e57ed167389f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:12.396303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:12.396974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:12.397263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:12.397544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:12.399480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:12.417041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:12.419098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:12.449323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2433/4867] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:16.448110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:16.450697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:16.480830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bea06-e75d-4729-b45b-4008624857a2 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:16.487282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:16.488707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:16.489218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:16.489669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] PATH_INFO: `/v3/users/58c7ff193f244ddfa887908f05a920c3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:16.491236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c7ff193f244ddfa887908f05a920c3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:16.494754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:16.576057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c7ff193f244ddfa887908f05a920c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:16.577934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c7ff193f244ddfa887908f05a920c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:16.592853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c7ff193f244ddfa887908f05a920c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:16.593815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c7ff193f244ddfa887908f05a920c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:16.613061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c7ff193f244ddfa887908f05a920c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:16.642463 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2435/4868] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:01:16 2022] DELETE /identity/v3/users/58c7ff193f244ddfa887908f05a920c3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:16.928159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:16.947771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd90df-2dd4-4963-bd72-f3eb5e82c331 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:17.153141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:17.154297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:17.154743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:17.155188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] PATH_INFO: `/v3/projects/70a2fded25c74c839c01e55a91e7f7fc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:17.156609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a2fded25c74c839c01e55a91e7f7fc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:17.158724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:17.315492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a2fded25c74c839c01e55a91e7f7fc', 'request_id': 'req-df657329-f439-4a64-8186-f1171cfbbbb0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.341819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a2fded25c74c839c01e55a91e7f7fc', 'request_id': 'req-df657329-f439-4a64-8186-f1171cfbbbb0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.380583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a2fded25c74c839c01e55a91e7f7fc', 'request_id': 'req-df657329-f439-4a64-8186-f1171cfbbbb0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.399743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] The token cache is being invalidate because project 70a2fded25c74c839c01e55a91e7f7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:01:17.401177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.402911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.405596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2434/4869] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:16 2022] DELETE /identity/v3/projects/70a2fded25c74c839c01e55a91e7f7fc => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:17.409748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:17.411606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:17.454070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77695b6c-9080-460a-b990-e4de46719c9c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:17.562453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:17.563722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:17.564189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:17.564633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] PATH_INFO: `/v3/users/83a018138b7c4abdb7907dc7cf6331d6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:17.567957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a018138b7c4abdb7907dc7cf6331d6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:17.570424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:17.652740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a018138b7c4abdb7907dc7cf6331d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.654877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a018138b7c4abdb7907dc7cf6331d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.675746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a018138b7c4abdb7907dc7cf6331d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.676667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a018138b7c4abdb7907dc7cf6331d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.695158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1139727a-393a-4669-8c38-021ded850051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a018138b7c4abdb7907dc7cf6331d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:17.739619 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2436/4870] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:01:17 2022] DELETE /identity/v3/users/83a018138b7c4abdb7907dc7cf6331d6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:18.258330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:18.262074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:18.309420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df657329-f439-4a64-8186-f1171cfbbbb0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:18.415999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:18.417282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:18.417780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:18.418281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] PATH_INFO: `/v3/projects/3f39abdb186c4a85b6ebb6fb4a2cd983` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:18.419801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f39abdb186c4a85b6ebb6fb4a2cd983)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:18.423066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:18.507031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f39abdb186c4a85b6ebb6fb4a2cd983', 'request_id': 'req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:18.546181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f39abdb186c4a85b6ebb6fb4a2cd983', 'request_id': 'req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:18.577120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f39abdb186c4a85b6ebb6fb4a2cd983', 'request_id': 'req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:18.602144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] The token cache is being invalidate because project 3f39abdb186c4a85b6ebb6fb4a2cd983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:01:18.603679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:18.605916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b8b73113-0c5c-4ab8-a1a4-a08c63c28fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:18.608432 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2435/4871] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:18 2022] DELETE /identity/v3/projects/3f39abdb186c4a85b6ebb6fb4a2cd983 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:18.613250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6067a-936b-434d-b3bd-5193ef2e4c96 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:18.614203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6067a-936b-434d-b3bd-5193ef2e4c96 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:18.614718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6067a-936b-434d-b3bd-5193ef2e4c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:18.644814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d0b6067a-936b-434d-b3bd-5193ef2e4c96 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:18.646947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d0b6067a-936b-434d-b3bd-5193ef2e4c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:18.749899 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2437/4872] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:18.757938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8864ea-58ff-48c7-ab1c-af793b6d4dd5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:18.759081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8864ea-58ff-48c7-ab1c-af793b6d4dd5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:18.760172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8864ea-58ff-48c7-ab1c-af793b6d4dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:18.798927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fc8864ea-58ff-48c7-ab1c-af793b6d4dd5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:18.801259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc8864ea-58ff-48c7-ab1c-af793b6d4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:18.829950 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2436/4873] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:18.831799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6067a-936b-434d-b3bd-5193ef2e4c96 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:18.844490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6067a-936b-434d-b3bd-5193ef2e4c96 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:18.852609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:18.857807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:18.858319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:18.858608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:18.859423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:01:18.859732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:18.861597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:18.881694 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2438/4874] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:01:18.882975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8864ea-58ff-48c7-ab1c-af793b6d4dd5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:18.894620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8864ea-58ff-48c7-ab1c-af793b6d4dd5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:18.900250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:18.900920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:18.901209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:18.901481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:18.902373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:18.904923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:18.943383 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2437/4875] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:01:18 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:01:18.947640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:18.967312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be911a5-61f9-4d9f-847f-ace24708f45b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:19.097543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:19.098614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:19.099012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:19.099981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:19.101549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:19.105581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:19.153134 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2439/4876] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:01:18 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:01:19.155240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:19.169868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9f1ec-5d72-4c9b-a540-2df20a49b850 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:19.175847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:19.180053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:19.180053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:19.180053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:19.180053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:19.181826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:19.220807 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2438/4877] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:01:19.222684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:19.245581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01734603-8225-4076-acd2-f79f0ad46ac4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:19.259798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35820d1b-9676-4713-b9bb-59ed866d2795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:19.261075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820d1b-9676-4713-b9bb-59ed866d2795 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:19.261497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820d1b-9676-4713-b9bb-59ed866d2795 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:19.261846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35820d1b-9676-4713-b9bb-59ed866d2795 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:19.262691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35820d1b-9676-4713-b9bb-59ed866d2795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:19.264419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35820d1b-9676-4713-b9bb-59ed866d2795 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:19.291386 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2440/4878] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:01:19.293440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:19.307498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbfd99-7833-447d-b4de-4738654a9248 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:19.336102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:19.337049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:19.338139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:19.338451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] PATH_INFO: `/v3/projects/759c66c34f414c19b2109393738ef639/users/8cdc0c878f6e4e5da2a2848d63a02f0d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:19.373523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759c66c34f414c19b2109393738ef639, user_id=8cdc0c878f6e4e5da2a2848d63a02f0d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:19.376706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:19.422748 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2439/4879] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:01:19 2022] PUT /identity/v3/projects/759c66c34f414c19b2109393738ef639/users/8cdc0c878f6e4e5da2a2848d63a02f0d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:19.427802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:19.429021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:19.429514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:19.452579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:19.453869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:19.598829 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2441/4880] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:19.649313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:19.651909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:19.804192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d974754-0a55-4e6f-83d2-337ac8f694e9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:19.815606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc7b78-e3b1-43c4-94af-f5ed8970cf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:19.816998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc7b78-e3b1-43c4-94af-f5ed8970cf03 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:19.817292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc7b78-e3b1-43c4-94af-f5ed8970cf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:19.817572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc7b78-e3b1-43c4-94af-f5ed8970cf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:19.855932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc7b78-e3b1-43c4-94af-f5ed8970cf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:19.858737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc7b78-e3b1-43c4-94af-f5ed8970cf03 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:19.883295 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2440/4881] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:29.976370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:29.982522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:30.016365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95c57a-b733-47a7-9c8e-3948ee4d8887 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:30.020769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:30.021449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:30.021663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:30.022175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:30.026226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:30.042528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:30.045304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:30.061414 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2442/4882] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:32.957339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee832ae-5327-464e-ad50-3ae9c731d5a6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:32.957928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee832ae-5327-464e-ad50-3ae9c731d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:32.958034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee832ae-5327-464e-ad50-3ae9c731d5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:33.019756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fee832ae-5327-464e-ad50-3ae9c731d5a6 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:33.024165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fee832ae-5327-464e-ad50-3ae9c731d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:33.158060 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2441/4883] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:01:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:01:33.173335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:33.174983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:33.337290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf77a12-2a3c-4af0-bf76-13e3d1b8e077 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:33.363897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:33.365001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:33.365460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:33.365908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:33.383060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:33.392593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:33.429453 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2443/4884] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:01:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:01:34.129491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d52a-309d-444b-ad21-82c45adf4c54 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:34.130526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d52a-309d-444b-ad21-82c45adf4c54 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:34.131023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d52a-309d-444b-ad21-82c45adf4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:34.197051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-58f6d52a-309d-444b-ad21-82c45adf4c54 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:34.208038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-58f6d52a-309d-444b-ad21-82c45adf4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:34.262742 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2442/4885] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:01:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:34.281495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:34.297553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b523501-aa72-464f-9a40-fcdfe04330f5 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:34.314954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:34.315910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:34.316587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:34.317092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:34.348645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:34.350401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:34.377220 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2444/4886] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:01:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:01:35.033065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f2fa0-eec7-42bd-96a7-245def44496a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:35.033728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f2fa0-eec7-42bd-96a7-245def44496a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:35.034189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f2fa0-eec7-42bd-96a7-245def44496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:35.071241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-294f2fa0-eec7-42bd-96a7-245def44496a None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:35.072469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-294f2fa0-eec7-42bd-96a7-245def44496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:35.092734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2443/4887] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:01:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:35.107789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:35.125386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a12309-7d19-4a75-b324-2c86fc8ca1a8 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:35.139176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:35.140139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:35.140584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:35.141195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:35.167230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:35.169165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:35.205604 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2445/4888] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:01:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:01:36.330998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc717-09e7-46d4-a18c-202922287550 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:36.331830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc717-09e7-46d4-a18c-202922287550 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:36.332266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bc717-09e7-46d4-a18c-202922287550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:36.398027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d15bc717-09e7-46d4-a18c-202922287550 None None] MFA Rules not processed for user `8cdc0c878f6e4e5da2a2848d63a02f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:36.399763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d15bc717-09e7-46d4-a18c-202922287550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:36.586081 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2444/4889] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:37.134935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:37.136919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:37.286653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9cb7e-a666-4776-9835-4fa4758e54b6 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:37.302073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a1748-49c2-4cf4-bc5e-e997447885a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:37.302787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1748-49c2-4cf4-bc5e-e997447885a0 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:37.303055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1748-49c2-4cf4-bc5e-e997447885a0 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:37.303515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a1748-49c2-4cf4-bc5e-e997447885a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:37.322876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1748-49c2-4cf4-bc5e-e997447885a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:37.324776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a1748-49c2-4cf4-bc5e-e997447885a0 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:37.350297 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2446/4890] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:39.266867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc717-09e7-46d4-a18c-202922287550 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:39.286618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bc717-09e7-46d4-a18c-202922287550 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:39.297345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:39.298457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:39.299110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:39.299645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:39.304449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:39.342989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:39.345437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:39.381466 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2445/4891] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:41.157360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00a7a-5553-49bd-82b1-9890c32b183a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:41.157946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00a7a-5553-49bd-82b1-9890c32b183a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:41.157946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00a7a-5553-49bd-82b1-9890c32b183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:41.178602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ead00a7a-5553-49bd-82b1-9890c32b183a None None] MFA Rules not processed for user `8cdc0c878f6e4e5da2a2848d63a02f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:41.180212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ead00a7a-5553-49bd-82b1-9890c32b183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:41.192864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2447/4892] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:43.158816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:43.160339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:43.205052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a40f-a46a-4862-b3a1-0c2e712fab04 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:43.214190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:43.215251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:43.215739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:43.216199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:43.218922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:43.257797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:43.261235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:43.288487 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2446/4893] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:48.514558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6a8b-f731-4645-ba29-982d8845e094 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:48.515208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6a8b-f731-4645-ba29-982d8845e094 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:48.515477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d6a8b-f731-4645-ba29-982d8845e094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:48.570416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fa5d6a8b-f731-4645-ba29-982d8845e094 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:48.573480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fa5d6a8b-f731-4645-ba29-982d8845e094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:48.590807 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2448/4894] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:48.607021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:48.625347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debd474-930e-4dea-b165-27ff256b6baf service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:48.653051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:48.654104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:48.654557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:48.655424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:48.667029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:48.674368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:48.688400 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2447/4895] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:01:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:01:49.330024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4869e3b-6b18-42c0-b21a-a009bf798bec None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:49.330374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4869e3b-6b18-42c0-b21a-a009bf798bec None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:49.330658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4869e3b-6b18-42c0-b21a-a009bf798bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:49.357000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b4869e3b-6b18-42c0-b21a-a009bf798bec None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:49.358127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4869e3b-6b18-42c0-b21a-a009bf798bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:49.369659 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2449/4896] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:49.382704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:49.398801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50fe05-def2-4702-ae3e-0f47607dda2e service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:49.409471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:49.410134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:49.410424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:49.410697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:49.423830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:49.425442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:49.434473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2448/4897] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:01:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:01:49.827250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:49.828134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:49.828580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:49.854374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:49.855810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:49.879969 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2450/4898] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:01:49.880750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:49.904883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45859675-2f53-456b-beb2-e158bc070774 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:49.912157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:49.916703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:49.916703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:49.916703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:49.930090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:49.932309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:49.966559 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2449/4899] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:01:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:01:50.066998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:50.068515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:50.085791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a79c45-8a34-479c-ad75-00af1c41c79a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:50.089248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:50.090232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:50.090590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:50.090972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] PATH_INFO: `/v3/users/df0de8764373461eaad7ac7b5f3eba3d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:50.092377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0de8764373461eaad7ac7b5f3eba3d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:50.094396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:50.127489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:50.128954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:50.146847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7800574-eed7-43fa-b1d6-33fd9de3658c service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:50.152456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0de8764373461eaad7ac7b5f3eba3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.153131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0de8764373461eaad7ac7b5f3eba3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.153877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:50.154760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:50.155891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:50.156425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] PATH_INFO: `/v3/users/cbf88df4a61b436ebbe7f5c78306117e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:50.158092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf88df4a61b436ebbe7f5c78306117e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:50.160332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:50.164634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0de8764373461eaad7ac7b5f3eba3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.166004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0de8764373461eaad7ac7b5f3eba3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.180172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0ec1d092-8b6d-453f-be89-ac2092fc3efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0de8764373461eaad7ac7b5f3eba3d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.222547 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2451/4900] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:01:50 2022] DELETE /identity/v3/users/df0de8764373461eaad7ac7b5f3eba3d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:50.229624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:50.231590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:50.232019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:50.242617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf88df4a61b436ebbe7f5c78306117e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.253408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:50.254826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:50.260418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf88df4a61b436ebbe7f5c78306117e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.261346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf88df4a61b436ebbe7f5c78306117e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.267514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf88df4a61b436ebbe7f5c78306117e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.282747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0f9544b-f870-432c-bf7c-d7fc796c22aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf88df4a61b436ebbe7f5c78306117e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:50.331246 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2450/4901] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:01:50 2022] DELETE /identity/v3/users/cbf88df4a61b436ebbe7f5c78306117e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:01:50.335539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99791949-6d10-43d5-aa4f-0e0bb64f3527 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:50.335941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99791949-6d10-43d5-aa4f-0e0bb64f3527 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:50.337035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99791949-6d10-43d5-aa4f-0e0bb64f3527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:50.360295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-99791949-6d10-43d5-aa4f-0e0bb64f3527 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:50.361879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-99791949-6d10-43d5-aa4f-0e0bb64f3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:50.379822 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2452/4902] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:50.388516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:50.389483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:50.470608 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2451/4903] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:01:50.479954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99791949-6d10-43d5-aa4f-0e0bb64f3527 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:50.484298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a478a-80d1-4702-bcb7-b1da912ae72e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:50.576367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:50.577053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:50.577358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:50.577683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:50.592307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99791949-6d10-43d5-aa4f-0e0bb64f3527 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:50.596904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d61e21-eb3a-449f-8df2-7428558dc1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:50.597593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:50.598375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61e21-eb3a-449f-8df2-7428558dc1bf service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:50.598919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61e21-eb3a-449f-8df2-7428558dc1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:50.599404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61e21-eb3a-449f-8df2-7428558dc1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:50.600147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:50.610417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d61e21-eb3a-449f-8df2-7428558dc1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:50.611924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d61e21-eb3a-449f-8df2-7428558dc1bf service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:50.612463 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2453/4904] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:50.630816 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2452/4905] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:01:50.928880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:50.931710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:50.951294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da232e1-c51d-4cf3-9e4f-085956d54960 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:50.967955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:50.969339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:50.970641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:50.971124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] PATH_INFO: `/v3/projects/17d1717bd7f2430eb5c2d3ce577e8160` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:50.981208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d1717bd7f2430eb5c2d3ce577e8160)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:50.987698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.076143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d1717bd7f2430eb5c2d3ce577e8160', 'request_id': 'req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.083721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d1717bd7f2430eb5c2d3ce577e8160', 'request_id': 'req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.095720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d1717bd7f2430eb5c2d3ce577e8160', 'request_id': 'req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.113756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] The token cache is being invalidate because project 17d1717bd7f2430eb5c2d3ce577e8160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:01:51.114070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.115103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc648aa1-eaf1-4697-8ec3-9a8255fc534b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.118687 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2454/4906] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:50 2022] DELETE /identity/v3/projects/17d1717bd7f2430eb5c2d3ce577e8160 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:51.123487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.124799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.125353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.146723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:51.148357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:51.252520 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2453/4907] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:51.261128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e783-5078-4bca-8dbf-9028b09f483e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.261413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e783-5078-4bca-8dbf-9028b09f483e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.261687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911e783-5078-4bca-8dbf-9028b09f483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.275876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.279681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:51.292760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0911e783-5078-4bca-8dbf-9028b09f483e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:51.294451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0911e783-5078-4bca-8dbf-9028b09f483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:51.294582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a006dd-0c0e-41fa-b1cf-43a358a2e944 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.300794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.301790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.302073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.302349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] PATH_INFO: `/v3/projects/4f25e7e4b2ae4a278467bc1a4fc5fa46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.303707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f25e7e4b2ae4a278467bc1a4fc5fa46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.305855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.308199 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2455/4908] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:51.312275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e783-5078-4bca-8dbf-9028b09f483e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.334912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911e783-5078-4bca-8dbf-9028b09f483e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.343851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.345075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.345603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.346201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.347356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:01:51.348765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.354363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.372547 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2456/4909] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:01:51.373316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'request_id': 'req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.376509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.386429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'request_id': 'req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.400134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce065c-bf49-4d35-86f1-0420351cdc41 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.407827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f25e7e4b2ae4a278467bc1a4fc5fa46', 'request_id': 'req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.425388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] The token cache is being invalidate because project 4f25e7e4b2ae4a278467bc1a4fc5fa46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:01:51.425715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.427671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d25a7a3f-20d1-4d5b-9794-97fbb6821efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:51.430568 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2454/4910] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:51 2022] DELETE /identity/v3/projects/4f25e7e4b2ae4a278467bc1a4fc5fa46 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:51.436619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31a05f-efbf-4d4f-8c9c-fbd31b504ef3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.437228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31a05f-efbf-4d4f-8c9c-fbd31b504ef3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.437448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc31a05f-efbf-4d4f-8c9c-fbd31b504ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.496045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cc31a05f-efbf-4d4f-8c9c-fbd31b504ef3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:51.497645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cc31a05f-efbf-4d4f-8c9c-fbd31b504ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:51.512324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.513507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.514148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.514711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.515902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.518279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.571224 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2457/4911] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:01:51 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:01:51.572974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.576625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:51.647642 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2455/4912] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:51.656937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944439ae-ff1e-4453-b062-90209953a8e5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.657370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944439ae-ff1e-4453-b062-90209953a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.657755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944439ae-ff1e-4453-b062-90209953a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.684894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-944439ae-ff1e-4453-b062-90209953a8e5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:51.687225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-944439ae-ff1e-4453-b062-90209953a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:51.713499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6551e6c-b945-44e4-b913-008db6800569 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.725086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.727318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.727827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.728278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.729461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.732034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.772455 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2458/4913] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:01:51 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:01:51.790499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.818966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d03074-0e1c-47a4-831d-31e67fa58f95 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.823946 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2456/4914] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:51.827753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.827924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944439ae-ff1e-4453-b062-90209953a8e5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.828681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.828970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.829245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.830972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.833170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.851158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944439ae-ff1e-4453-b062-90209953a8e5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.852259 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2459/4915] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:01:51.857498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.871365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.872051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.872334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.872616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.873354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:01:51.873662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.875453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.879826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a73fd2-2f60-484e-972e-36f529e5398b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.889999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.892026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.892313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.892662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.894014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.896460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:51.902255 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2457/4916] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:01:51.912223 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2460/4917] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:01:51.915857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.916010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:51.930912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72236a2-c956-4005-9990-63b06be51a5a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.936116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf9c87-b5a7-4ab0-aa34-7139c11c2229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.937424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf9c87-b5a7-4ab0-aa34-7139c11c2229 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.942835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf9c87-b5a7-4ab0-aa34-7139c11c2229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.942835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf9c87-b5a7-4ab0-aa34-7139c11c2229 admin admin] PATH_INFO: `/v3/projects/442c8c92c2ea4bf496bd9367fc0ff8f6/users/8d22f4f78a2f410da5efe29ab9d37071/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.951266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c16b9-b68c-4e18-933c-56ec1aa0f0f0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:51.963649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:51.964345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:51.964697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:51.965388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:51.966184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:51.968758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.009378 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2458/4918] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:01:51 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:01:52.013539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:52.105209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bc778-9d9f-450b-9357-2e3a0503e0aa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:52.121038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:52.121038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.121038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.121038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.121546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:52.123220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.135009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf9c87-b5a7-4ab0-aa34-7139c11c2229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442c8c92c2ea4bf496bd9367fc0ff8f6, user_id=8d22f4f78a2f410da5efe29ab9d37071, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:52.137973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf9c87-b5a7-4ab0-aa34-7139c11c2229 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.155580 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2459/4919] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:01:52 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:01:52.158422 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2461/4920] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:01:51 2022] PUT /identity/v3/projects/442c8c92c2ea4bf496bd9367fc0ff8f6/users/8d22f4f78a2f410da5efe29ab9d37071/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:52.169726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.170102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.170453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.174701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:52.192326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537d3d7-291c-4340-b843-cf556c3064f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:52.222460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] MFA Rules not processed for user `8d22f4f78a2f410da5efe29ab9d37071`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:52.225005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:52.299030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:52.299830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.300507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.303451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.304590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:52.307237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.330315 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2460/4921] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:01:52.332091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:52.348373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0b3dd-eb88-4f88-98a2-16c9660e9f4b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:52.354429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:52.355443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.355809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.356716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.357533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:52.359745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.366317 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2462/4922] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:52.381115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:52.382622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:52.385447 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2461/4923] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:01:52.389413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:52.413889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b71ae8-27a6-447c-8879-2528e57f86cb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:52.426438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5866-0a26-4ce1-bba4-275cf98397d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:52.427374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5866-0a26-4ce1-bba4-275cf98397d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.427661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5866-0a26-4ce1-bba4-275cf98397d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.427957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5866-0a26-4ce1-bba4-275cf98397d4 admin admin] PATH_INFO: `/v3/projects/8fae94ca8c9b4b089482ee965e14b5bb/users/436bc83cc1a24ef1b3b3cbc6fbef44ab/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.465333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5866-0a26-4ce1-bba4-275cf98397d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fae94ca8c9b4b089482ee965e14b5bb, user_id=436bc83cc1a24ef1b3b3cbc6fbef44ab, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:52.468361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5866-0a26-4ce1-bba4-275cf98397d4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.487984 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2462/4924] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:01:52 2022] PUT /identity/v3/projects/8fae94ca8c9b4b089482ee965e14b5bb/users/436bc83cc1a24ef1b3b3cbc6fbef44ab/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:52.504099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683bfba-91ad-4ebe-8805-f42eba543480 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:52.504303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.504566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.504918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.533701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] MFA Rules not processed for user `436bc83cc1a24ef1b3b3cbc6fbef44ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:52.534920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:52.613658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:52.614972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.615338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.615678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.630144 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2463/4925] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:52.640670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:52.643379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:52.731714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:52.733983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.749659 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2463/4926] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:52.758900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7c86f-4bc8-4f43-b74d-a8f9249bbbaf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:52.765298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b847f6b-40d5-47f3-a2d1-510268c47c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:52.766118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847f6b-40d5-47f3-a2d1-510268c47c6c service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:52.766403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847f6b-40d5-47f3-a2d1-510268c47c6c service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:52.766679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847f6b-40d5-47f3-a2d1-510268c47c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:52.777625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b847f6b-40d5-47f3-a2d1-510268c47c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:52.781515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b847f6b-40d5-47f3-a2d1-510268c47c6c service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:52.798908 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2464/4927] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:01:52.892693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:52.993897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f767d3-a0bc-45b0-b4e8-f97778b0b6ae service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:53.001142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:53.001142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:53.001464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:53.001844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] PATH_INFO: `/v3/users/436bc83cc1a24ef1b3b3cbc6fbef44ab` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:53.003191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=436bc83cc1a24ef1b3b3cbc6fbef44ab)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:53.005308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:53.082122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436bc83cc1a24ef1b3b3cbc6fbef44ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:53.083289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436bc83cc1a24ef1b3b3cbc6fbef44ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:53.094553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436bc83cc1a24ef1b3b3cbc6fbef44ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:53.095654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436bc83cc1a24ef1b3b3cbc6fbef44ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:53.107674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436bc83cc1a24ef1b3b3cbc6fbef44ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:53.134197 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2464/4928] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:01:52 2022] DELETE /identity/v3/users/436bc83cc1a24ef1b3b3cbc6fbef44ab => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:53.139385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:53.139675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:53.140007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:53.167125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:53.168419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:53.249171 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2465/4929] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:53.261621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:53.263201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:53.352349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aabb32-6048-4759-9e15-0503ee4258fc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:53.357807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fa754-68f4-4d45-8e8f-949620d48748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:53.358470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa754-68f4-4d45-8e8f-949620d48748 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:53.358761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa754-68f4-4d45-8e8f-949620d48748 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:53.359144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fa754-68f4-4d45-8e8f-949620d48748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:53.370626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fa754-68f4-4d45-8e8f-949620d48748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:53.372375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fa754-68f4-4d45-8e8f-949620d48748 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:53.383771 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2465/4930] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:54.390685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:54.392914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:54.420245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05805830-7c13-4f82-8a95-63a1387711c4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:54.433513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:54.434535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:54.434834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:54.435112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] PATH_INFO: `/v3/projects/8fae94ca8c9b4b089482ee965e14b5bb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:54.437625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fae94ca8c9b4b089482ee965e14b5bb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:54.451401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:54.551349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fae94ca8c9b4b089482ee965e14b5bb', 'request_id': 'req-753518ee-29e7-4b95-80ea-acf1d6cb7228'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:54.561532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fae94ca8c9b4b089482ee965e14b5bb', 'request_id': 'req-753518ee-29e7-4b95-80ea-acf1d6cb7228'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:54.574047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fae94ca8c9b4b089482ee965e14b5bb', 'request_id': 'req-753518ee-29e7-4b95-80ea-acf1d6cb7228'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:54.596953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] The token cache is being invalidate because project 8fae94ca8c9b4b089482ee965e14b5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:01:54.599558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:54.600791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-753518ee-29e7-4b95-80ea-acf1d6cb7228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:54.604574 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2466/4931] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:01:54 2022] DELETE /identity/v3/projects/8fae94ca8c9b4b089482ee965e14b5bb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:54.610150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5243cf6-68b9-4587-ac24-ae3b6bc0ea6c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:54.610150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5243cf6-68b9-4587-ac24-ae3b6bc0ea6c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:54.610150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5243cf6-68b9-4587-ac24-ae3b6bc0ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:54.628759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f5243cf6-68b9-4587-ac24-ae3b6bc0ea6c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:54.630171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f5243cf6-68b9-4587-ac24-ae3b6bc0ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:54.727192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2466/4932] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:54.732742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4246c-1758-4648-8eb8-09d3e192966c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:54.734138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4246c-1758-4648-8eb8-09d3e192966c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:54.735292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4246c-1758-4648-8eb8-09d3e192966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:54.780471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-70b4246c-1758-4648-8eb8-09d3e192966c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:54.781798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-70b4246c-1758-4648-8eb8-09d3e192966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:54.806012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5243cf6-68b9-4587-ac24-ae3b6bc0ea6c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:54.806328 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2467/4933] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:54.827378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5243cf6-68b9-4587-ac24-ae3b6bc0ea6c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:54.847003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:54.847708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:54.847970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:54.848251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:54.850499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:01:54.851033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:54.853458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:54.884991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4246c-1758-4648-8eb8-09d3e192966c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:54.900972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2467/4934] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:01:54.907027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4246c-1758-4648-8eb8-09d3e192966c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:54.920423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:54.921896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:54.923442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:54.923858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:54.924708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:54.926997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:54.971103 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2468/4935] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:01:54 2022] POST /identity/v3/projects => generated 399 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:01:54.975052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:54.991873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dbb1d-6021-42b5-b70d-2acea57be3ca admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:55.143622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:55.147128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:55.147621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:55.148322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:55.149732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:55.153072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:55.186299 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2468/4936] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:01:54 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:01:55.187555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:55.206398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af49aa6-4954-48c0-95ec-c026f70af776 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:55.215433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:55.216132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:55.216592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:55.216841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:55.217572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:55.219250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:55.248111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2469/4937] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:01:55.251027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:55.299914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecc97a-9de6-404e-b583-f9a96bc529f8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:55.319121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486026d5-7c8a-46cf-b595-db5c27ede4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:55.319972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486026d5-7c8a-46cf-b595-db5c27ede4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:55.320112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486026d5-7c8a-46cf-b595-db5c27ede4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:55.320452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486026d5-7c8a-46cf-b595-db5c27ede4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:55.321255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486026d5-7c8a-46cf-b595-db5c27ede4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:55.323475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486026d5-7c8a-46cf-b595-db5c27ede4f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:55.376086 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2469/4938] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:01:55.379955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:55.390927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260ed99-1d56-48af-a463-d91fcb842906 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:55.419595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:55.420504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:55.420994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:55.423724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] PATH_INFO: `/v3/projects/7c1ba68595ec4a0ab30a1245d2af00b4/users/f7b6cdf678924373bb24bb562faf90c2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:55.465519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1ba68595ec4a0ab30a1245d2af00b4, user_id=f7b6cdf678924373bb24bb562faf90c2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:55.469744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:55.497003 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2470/4939] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:01:55 2022] PUT /identity/v3/projects/7c1ba68595ec4a0ab30a1245d2af00b4/users/f7b6cdf678924373bb24bb562faf90c2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:01:55.503027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5818ca-abf0-442a-a9be-328c1a1977ea None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:55.503027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5818ca-abf0-442a-a9be-328c1a1977ea None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:55.503027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5818ca-abf0-442a-a9be-328c1a1977ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:55.553730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7d5818ca-abf0-442a-a9be-328c1a1977ea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:55.562175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7d5818ca-abf0-442a-a9be-328c1a1977ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:55.736142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2470/4940] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:55.754022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:55.757324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:55.941024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e0312-57ca-4b10-acee-9ab0bf08e84a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:55.953488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2398f-ff8c-4d08-9d3b-6c6379e217a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:55.954353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2398f-ff8c-4d08-9d3b-6c6379e217a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:55.954999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2398f-ff8c-4d08-9d3b-6c6379e217a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:55.955456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2398f-ff8c-4d08-9d3b-6c6379e217a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:55.977249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2398f-ff8c-4d08-9d3b-6c6379e217a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:55.989593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2398f-ff8c-4d08-9d3b-6c6379e217a6 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:56.006956 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2471/4941] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:57.522085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:57.522670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:57.522670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:57.550717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] MFA Rules not processed for user `f7b6cdf678924373bb24bb562faf90c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:57.552543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:57.628298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2471/4942] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:01:57.638256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:57.639189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:57.639476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:57.662398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] MFA Rules not processed for user `f7b6cdf678924373bb24bb562faf90c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:57.664952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:57.674554 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2472/4943] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:01:57.686486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:57.689525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:57.784266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69deb322-50c3-4a40-a2a2-4ca81d2ee540 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:57.791675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9762e-eac9-4198-8c11-4008d2c279bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:57.792829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9762e-eac9-4198-8c11-4008d2c279bd service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:57.792940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9762e-eac9-4198-8c11-4008d2c279bd service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:57.793165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9762e-eac9-4198-8c11-4008d2c279bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:57.803347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9762e-eac9-4198-8c11-4008d2c279bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:57.805573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9762e-eac9-4198-8c11-4008d2c279bd service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:57.817482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2472/4944] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:01:59.338166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:59.340798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:59.369908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838777-f77e-4ee9-b89e-4d05ac70a064 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:59.389912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:59.391120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:59.391587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:59.392029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] PATH_INFO: `/v3/users/3b46f9c0992b40c29cf70cfcb30384bc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:59.395539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b46f9c0992b40c29cf70cfcb30384bc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:01:59.398100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:01:59.507217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b46f9c0992b40c29cf70cfcb30384bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:59.522554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b46f9c0992b40c29cf70cfcb30384bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:59.523864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b46f9c0992b40c29cf70cfcb30384bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:59.524675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b46f9c0992b40c29cf70cfcb30384bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:59.556652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b46f9c0992b40c29cf70cfcb30384bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:01:59.586926 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2473/4945] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:01:59 2022] DELETE /identity/v3/users/3b46f9c0992b40c29cf70cfcb30384bc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:01:59.587979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:59.588470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:59.588606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:59.619880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:01:59.621148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:59.723315 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2473/4946] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:01:59.795901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:01:59.797825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:01:59.941058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06394d63-9ffe-440b-8023-d37580770841 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:01:59.973016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377947b2-4931-4220-a416-b220aab6b853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:01:59.973607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377947b2-4931-4220-a416-b220aab6b853 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:01:59.973901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377947b2-4931-4220-a416-b220aab6b853 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:01:59.974178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377947b2-4931-4220-a416-b220aab6b853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:01:59.997876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377947b2-4931-4220-a416-b220aab6b853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:00.005116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377947b2-4931-4220-a416-b220aab6b853 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:00.048270 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2474/4947] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:01.332327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:01.333914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:01.354150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e516c-b472-43ea-97c1-6b7f4c6f0db0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:01.374624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:01.376237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:01.376758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:01.377782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] PATH_INFO: `/v3/projects/d7da299cb7fd4b569f047ab71e3255d4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:01.379320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7da299cb7fd4b569f047ab71e3255d4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:01.381792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:01.496168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7da299cb7fd4b569f047ab71e3255d4', 'request_id': 'req-3bcc4009-9f8a-464e-84da-34b2d870428c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:01.507095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7da299cb7fd4b569f047ab71e3255d4', 'request_id': 'req-3bcc4009-9f8a-464e-84da-34b2d870428c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:01.521244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7da299cb7fd4b569f047ab71e3255d4', 'request_id': 'req-3bcc4009-9f8a-464e-84da-34b2d870428c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:01.559939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] The token cache is being invalidate because project d7da299cb7fd4b569f047ab71e3255d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:01.560364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:01.562163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3bcc4009-9f8a-464e-84da-34b2d870428c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:01.569492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2474/4948] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:01 2022] DELETE /identity/v3/projects/d7da299cb7fd4b569f047ab71e3255d4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:01.571932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a9319-7ee2-4b2c-bfab-6c1d0abca885 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:01.572908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a9319-7ee2-4b2c-bfab-6c1d0abca885 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:01.573357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a9319-7ee2-4b2c-bfab-6c1d0abca885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:01.618984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8e3a9319-7ee2-4b2c-bfab-6c1d0abca885 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:01.621440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8e3a9319-7ee2-4b2c-bfab-6c1d0abca885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:01.795909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a139-673b-4b75-9b88-9ad1022d56e1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:01.796206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a139-673b-4b75-9b88-9ad1022d56e1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:01.796540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0a139-673b-4b75-9b88-9ad1022d56e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:01.800292 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2475/4949] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:01.833191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-62e0a139-673b-4b75-9b88-9ad1022d56e1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:01.838037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-62e0a139-673b-4b75-9b88-9ad1022d56e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:01.865834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2475/4950] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:01.868990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a9319-7ee2-4b2c-bfab-6c1d0abca885 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:01.880910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a9319-7ee2-4b2c-bfab-6c1d0abca885 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:01.905594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:01.906570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:01.907071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:01.907532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:01.908444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:01.908944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:01.910808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:01.927477 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2476/4951] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:01.932684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0a139-673b-4b75-9b88-9ad1022d56e1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:01.961205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0a139-673b-4b75-9b88-9ad1022d56e1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:01.980073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:01.980782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:01.981155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:01.981462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:01.983040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:01.985245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:02.022915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2476/4952] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:01 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:02.023688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:02.039604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3b89a-f448-463a-8bd8-1844daa7b89b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:02.213356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:02.215221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:02.216048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:02.216528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:02.237508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:02.244057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:02.308713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:02.324993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2477/4953] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:02 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:02.328167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c0aa9-3f5b-4144-8c0e-b3a0104ed8f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:02.334614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:02.335455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:02.336082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:02.336538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:02.337453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:02.339548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:02.361612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:02.361891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2477/4954] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:02.377784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83943f84-1d14-4891-9658-9e9c7b97e266 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:02.388100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c397b-d430-455d-8612-b5e069f9bfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:02.389124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c397b-d430-455d-8612-b5e069f9bfdb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:02.389575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c397b-d430-455d-8612-b5e069f9bfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:02.390027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c397b-d430-455d-8612-b5e069f9bfdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:02.390963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c397b-d430-455d-8612-b5e069f9bfdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:02.392790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c397b-d430-455d-8612-b5e069f9bfdb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:02.408118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2478/4955] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:02.408464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:02.429183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5cb91-f521-43c3-bb13-5a4459bb7556 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:02.447093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:02.448004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:02.448285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:02.448558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] PATH_INFO: `/v3/projects/2c736237bf764ceead5bfeddee3b6f10/users/6d567b88c6f84830870b27eda9f23e85/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:02.481905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c736237bf764ceead5bfeddee3b6f10, user_id=6d567b88c6f84830870b27eda9f23e85, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:02.484783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:02.505910 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2478/4956] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:02 2022] PUT /identity/v3/projects/2c736237bf764ceead5bfeddee3b6f10/users/6d567b88c6f84830870b27eda9f23e85/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:02.516919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33b76-36ae-452a-a5d5-cd8ac6991c2e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:02.517460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33b76-36ae-452a-a5d5-cd8ac6991c2e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:02.517931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a33b76-36ae-452a-a5d5-cd8ac6991c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:02.560089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-35a33b76-36ae-452a-a5d5-cd8ac6991c2e None None] MFA Rules not processed for user `6d567b88c6f84830870b27eda9f23e85`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:02.561826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-35a33b76-36ae-452a-a5d5-cd8ac6991c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:02.647708 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2479/4957] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:02.678437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:02.681706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:02.768472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d1aa8-fd9f-453b-8322-16c1633890aa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:02.773044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab0f29-dd16-4189-99f8-eb23a77bb067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:02.773875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab0f29-dd16-4189-99f8-eb23a77bb067 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:02.774163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab0f29-dd16-4189-99f8-eb23a77bb067 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:02.774436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab0f29-dd16-4189-99f8-eb23a77bb067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:02.783962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab0f29-dd16-4189-99f8-eb23a77bb067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:02.785547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab0f29-dd16-4189-99f8-eb23a77bb067 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:02.796461 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2479/4958] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:02.814013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a33b76-36ae-452a-a5d5-cd8ac6991c2e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:02.892312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a33b76-36ae-452a-a5d5-cd8ac6991c2e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:02.898617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:02.900710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:02.901004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:02.901283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] PATH_INFO: `/v3/users/6d567b88c6f84830870b27eda9f23e85` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:02.902632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d567b88c6f84830870b27eda9f23e85)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:02.905273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:02.963226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d567b88c6f84830870b27eda9f23e85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:02.970633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d567b88c6f84830870b27eda9f23e85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:02.971540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d567b88c6f84830870b27eda9f23e85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:02.972162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d567b88c6f84830870b27eda9f23e85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:02.983215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d567b88c6f84830870b27eda9f23e85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:03.005221 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2480/4959] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:02 2022] DELETE /identity/v3/users/6d567b88c6f84830870b27eda9f23e85 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:03.007041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:03.007509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:03.007927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:03.026488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:03.027843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:03.095979 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2480/4960] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:03.113049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:03.114607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:03.190846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afaa19-c58b-41ba-b988-1d290eb34694 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:03.199541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f966e-1936-4444-9841-cf15e60bbf1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:03.202563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f966e-1936-4444-9841-cf15e60bbf1e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:03.202674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f966e-1936-4444-9841-cf15e60bbf1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:03.202960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f966e-1936-4444-9841-cf15e60bbf1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:03.214176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f966e-1936-4444-9841-cf15e60bbf1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:03.216122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f966e-1936-4444-9841-cf15e60bbf1e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:03.228084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2481/4961] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:04.139001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:04.141060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:04.160197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1eab-3cea-496c-b73e-971253881f16 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:04.174544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:04.175553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.175913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.176240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] PATH_INFO: `/v3/projects/2c736237bf764ceead5bfeddee3b6f10` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.177638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c736237bf764ceead5bfeddee3b6f10)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:04.181090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:04.262005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c736237bf764ceead5bfeddee3b6f10', 'request_id': 'req-158c66a7-bc21-4f5a-b7a9-30388b2cde70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:04.271892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c736237bf764ceead5bfeddee3b6f10', 'request_id': 'req-158c66a7-bc21-4f5a-b7a9-30388b2cde70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:04.314566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c736237bf764ceead5bfeddee3b6f10', 'request_id': 'req-158c66a7-bc21-4f5a-b7a9-30388b2cde70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:04.339238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] The token cache is being invalidate because project 2c736237bf764ceead5bfeddee3b6f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:04.339529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:04.341909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-158c66a7-bc21-4f5a-b7a9-30388b2cde70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:04.345608 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2481/4962] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:04 2022] DELETE /identity/v3/projects/2c736237bf764ceead5bfeddee3b6f10 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:04.350455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebaebd-fb98-48e9-87ed-babd306e73d8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.351028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebaebd-fb98-48e9-87ed-babd306e73d8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.351142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ebaebd-fb98-48e9-87ed-babd306e73d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.403617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-28ebaebd-fb98-48e9-87ed-babd306e73d8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:04.405753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28ebaebd-fb98-48e9-87ed-babd306e73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:04.542289 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2482/4963] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:04.550285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01f48-e3cd-4dda-a7f1-d3d04995a47c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.552288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01f48-e3cd-4dda-a7f1-d3d04995a47c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.552786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01f48-e3cd-4dda-a7f1-d3d04995a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.575746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4cb01f48-e3cd-4dda-a7f1-d3d04995a47c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:04.577253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4cb01f48-e3cd-4dda-a7f1-d3d04995a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:04.587676 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2482/4964] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:04.592433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebaebd-fb98-48e9-87ed-babd306e73d8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:04.609958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ebaebd-fb98-48e9-87ed-babd306e73d8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:04.616295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:04.617705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.617993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.618409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.619294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:04.619595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:04.621235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:04.644457 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2483/4965] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:04.645876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb01f48-e3cd-4dda-a7f1-d3d04995a47c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:04.657371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb01f48-e3cd-4dda-a7f1-d3d04995a47c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:04.668468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:04.669168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.669447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.669721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.670536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:04.673125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:04.707004 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2483/4966] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:04 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:04.716334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:04.734762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda05f0-6068-4d13-a05b-dcbb482d3881 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:04.852384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:04.853072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.853356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.853652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.855343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:04.863471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:04.893830 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2484/4967] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:04 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:04.901684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:04.915677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1b2a-7244-4531-ab67-57aae8ee610c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:04.923759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:04.924767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.925471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.926072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.927053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:04.930676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:04.966487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:04.978515 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2484/4968] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:04.982118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b74c-bd36-45a0-8e4c-7ea151afe6ad admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:04.995632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c85b3-b63f-4b26-9fcb-5072caa636bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:04.997210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c85b3-b63f-4b26-9fcb-5072caa636bf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:04.997723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c85b3-b63f-4b26-9fcb-5072caa636bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:04.998341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c85b3-b63f-4b26-9fcb-5072caa636bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:04.999651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c85b3-b63f-4b26-9fcb-5072caa636bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:05.001507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c85b3-b63f-4b26-9fcb-5072caa636bf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:05.019231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:05.030585 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2485/4969] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:05.033956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5468aab-b066-48e0-8242-9b3b1f4c0dba admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:05.041087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:05.043534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:05.044085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:05.045309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] PATH_INFO: `/v3/projects/15c8c0d57c6d4f4bb7f6cd82cf377743/users/da86a93fb28d47d784320359548c94b8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:05.082614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c8c0d57c6d4f4bb7f6cd82cf377743, user_id=da86a93fb28d47d784320359548c94b8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:05.087120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:05.129480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27ef4-2bff-44a5-8402-da533899c4ce None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:05.129720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27ef4-2bff-44a5-8402-da533899c4ce None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:05.130008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee27ef4-2bff-44a5-8402-da533899c4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:05.147491 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2485/4970] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:05 2022] PUT /identity/v3/projects/15c8c0d57c6d4f4bb7f6cd82cf377743/users/da86a93fb28d47d784320359548c94b8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:05.183021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9ee27ef4-2bff-44a5-8402-da533899c4ce None None] MFA Rules not processed for user `da86a93fb28d47d784320359548c94b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:05.184293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ee27ef4-2bff-44a5-8402-da533899c4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:05.295219 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2486/4971] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:05.346765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:05.349145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:05.419474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073959f-aba2-4d68-9ddb-40d6820cc8d9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:05.423485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d34d9-259f-4400-b0e2-0263647c6b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:05.424162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d34d9-259f-4400-b0e2-0263647c6b20 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:05.424446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d34d9-259f-4400-b0e2-0263647c6b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:05.424723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d34d9-259f-4400-b0e2-0263647c6b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:05.435147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d34d9-259f-4400-b0e2-0263647c6b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:05.436922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d34d9-259f-4400-b0e2-0263647c6b20 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:05.454898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2486/4972] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:06.582260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee27ef4-2bff-44a5-8402-da533899c4ce None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:06.672832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee27ef4-2bff-44a5-8402-da533899c4ce None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:06.692141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:06.693180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:06.693467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:06.693779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] PATH_INFO: `/v3/users/da86a93fb28d47d784320359548c94b8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:06.695851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da86a93fb28d47d784320359548c94b8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:06.708583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:06.781276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da86a93fb28d47d784320359548c94b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:06.790185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da86a93fb28d47d784320359548c94b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:06.791487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da86a93fb28d47d784320359548c94b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:06.792105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da86a93fb28d47d784320359548c94b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:06.805839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da86a93fb28d47d784320359548c94b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:06.831665 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2487/4973] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:06 2022] DELETE /identity/v3/users/da86a93fb28d47d784320359548c94b8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:06.836509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:06.837392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:06.838626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:06.868048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:06.869290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:06.983033 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2487/4974] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:06.993293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:06.995085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:07.108250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4963d4-0bd1-47e2-8595-b8c2b450b65c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:07.119360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749b501-4e76-4ba3-a96a-3d420f889f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:07.120044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749b501-4e76-4ba3-a96a-3d420f889f38 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:07.120337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749b501-4e76-4ba3-a96a-3d420f889f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:07.120658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749b501-4e76-4ba3-a96a-3d420f889f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:07.141058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749b501-4e76-4ba3-a96a-3d420f889f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:07.146403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749b501-4e76-4ba3-a96a-3d420f889f38 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:07.162671 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2488/4975] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:07.626418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:07.628271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:07.673294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0e096-53b2-45dc-9dd2-171ee598c1ea None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:07.690121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:07.693819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:07.695230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:07.696703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] PATH_INFO: `/v3/projects/15c8c0d57c6d4f4bb7f6cd82cf377743` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:07.713344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c8c0d57c6d4f4bb7f6cd82cf377743)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:07.718997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:07.794676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c8c0d57c6d4f4bb7f6cd82cf377743', 'request_id': 'req-b0162536-890a-488b-9a5e-a250b29409bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:07.802464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c8c0d57c6d4f4bb7f6cd82cf377743', 'request_id': 'req-b0162536-890a-488b-9a5e-a250b29409bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:07.813258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c8c0d57c6d4f4bb7f6cd82cf377743', 'request_id': 'req-b0162536-890a-488b-9a5e-a250b29409bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:07.855523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] The token cache is being invalidate because project 15c8c0d57c6d4f4bb7f6cd82cf377743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:07.858576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:07.859431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0162536-890a-488b-9a5e-a250b29409bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:07.862249 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2488/4976] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:07 2022] DELETE /identity/v3/projects/15c8c0d57c6d4f4bb7f6cd82cf377743 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:07.868541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedfc6c-bf77-4799-b74f-d5804e0176cf None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:07.869467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedfc6c-bf77-4799-b74f-d5804e0176cf None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:07.869924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedfc6c-bf77-4799-b74f-d5804e0176cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:07.901026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3aedfc6c-bf77-4799-b74f-d5804e0176cf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:07.904637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3aedfc6c-bf77-4799-b74f-d5804e0176cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:08.112368 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2489/4977] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:08.121766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17332bc4-8fad-484b-8865-41edf61b475e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.122060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17332bc4-8fad-484b-8865-41edf61b475e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.122428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17332bc4-8fad-484b-8865-41edf61b475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.158404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-17332bc4-8fad-484b-8865-41edf61b475e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:08.162003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-17332bc4-8fad-484b-8865-41edf61b475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:08.183613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2489/4978] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:08.187857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedfc6c-bf77-4799-b74f-d5804e0176cf None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.206401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedfc6c-bf77-4799-b74f-d5804e0176cf None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.219876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.220879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.221357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.221815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.222714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:08.223213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.227899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.250312 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2490/4979] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:08.255036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17332bc4-8fad-484b-8865-41edf61b475e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.270873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17332bc4-8fad-484b-8865-41edf61b475e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.290477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.291187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.291473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.291749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.292448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.294447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.349472 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2490/4980] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:08 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:08.356643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.374996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec2a7-d773-46f9-869d-3788b11d78f9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.458978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.459777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.460125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.460401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.463103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.466339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.501513 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2491/4981] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:08 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:08.502278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.520818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c2f32-c637-429f-9154-f456e131ba54 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.528762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.529785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.530271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.530957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.532406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.540291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.563162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.598273 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2491/4982] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:02:08.603662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc1481c-66b4-42d4-abca-d7e5e78eba6f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.610010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76ebc3-b100-40de-8e18-63a86c00d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.610807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76ebc3-b100-40de-8e18-63a86c00d2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.611161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76ebc3-b100-40de-8e18-63a86c00d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.611518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76ebc3-b100-40de-8e18-63a86c00d2a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.612326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76ebc3-b100-40de-8e18-63a86c00d2a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.614150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76ebc3-b100-40de-8e18-63a86c00d2a6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.633539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.646892 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2492/4983] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:08.649571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0bc5c-9c16-45b2-bb12-912ab803b42b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.657092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.658624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.659185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.659727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] PATH_INFO: `/v3/projects/8ea307efc44a4c648173ea614ab793a4/users/a251148af7f940b596a159886a883bb9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.701780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea307efc44a4c648173ea614ab793a4, user_id=a251148af7f940b596a159886a883bb9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.706655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.743859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32bb4-4442-42ab-be4b-c6603b9a6bd2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.744157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32bb4-4442-42ab-be4b-c6603b9a6bd2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.744439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32bb4-4442-42ab-be4b-c6603b9a6bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.750255 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2492/4984] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:08 2022] PUT /identity/v3/projects/8ea307efc44a4c648173ea614ab793a4/users/a251148af7f940b596a159886a883bb9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:08.792654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.795330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:08.801295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-06e32bb4-4442-42ab-be4b-c6603b9a6bd2 None None] MFA Rules not processed for user `a251148af7f940b596a159886a883bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:08.803782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-06e32bb4-4442-42ab-be4b-c6603b9a6bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:08.911371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bdd21-6539-4dff-912a-c7a46956be9a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.917139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2493/4985] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:08.921891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e32bb4-4442-42ab-be4b-c6603b9a6bd2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:08.925616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.926509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.926863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.927096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] PATH_INFO: `/v3/users/ddc30338eaa944db87c27cab6eb949ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.928333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc30338eaa944db87c27cab6eb949ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.930322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.934331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e32bb4-4442-42ab-be4b-c6603b9a6bd2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:08.939956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:08.940760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:08.941326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:08.941608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:08.942381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:08.944402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:08.985389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2494/4986] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:08 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:08.986468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:09.001033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc30338eaa944db87c27cab6eb949ca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.002893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc30338eaa944db87c27cab6eb949ca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.014480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc30338eaa944db87c27cab6eb949ca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.015259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc30338eaa944db87c27cab6eb949ca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.036653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc30338eaa944db87c27cab6eb949ca'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.071533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2493/4987] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:08 2022] DELETE /identity/v3/users/ddc30338eaa944db87c27cab6eb949ca => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:09.100056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4689ee6-30d6-4995-805f-bd95f8948eb9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:09.204767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:09.205376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.205661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.205942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.206639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:09.209280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:09.246075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2495/4988] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:08 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:09.247741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:09.249877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:09.271815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2ea2c-efeb-4438-bfa3-ca6dd5a67ed3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:09.281233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:09.283461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.283981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.284502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.285896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:09.289829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:09.305377 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2494/4989] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:09.310292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:09.325041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b175ee-1c30-4ee9-ab87-73d39b99c8ad admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:09.333669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:09.334627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.334962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.335239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] PATH_INFO: `/v3/projects/9cb6bf95cef54b8bad7713035faaebe5/users/3f4544cdba464c2da48d6f79a5d4e536/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.354030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6bf95cef54b8bad7713035faaebe5, user_id=3f4544cdba464c2da48d6f79a5d4e536, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:09.356956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:09.372968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2496/4990] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:09 2022] PUT /identity/v3/projects/9cb6bf95cef54b8bad7713035faaebe5/users/3f4544cdba464c2da48d6f79a5d4e536/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:09.376902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:09.387075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0a8b4-2893-42cf-a664-7a03f10f1295 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:09.442542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f834336-7e58-45a6-826f-e441030a250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:09.443134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834336-7e58-45a6-826f-e441030a250a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.443422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834336-7e58-45a6-826f-e441030a250a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.443695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f834336-7e58-45a6-826f-e441030a250a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.444422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834336-7e58-45a6-826f-e441030a250a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:09.446065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f834336-7e58-45a6-826f-e441030a250a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:09.455927 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2495/4991] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:09.460248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:09.475645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05848b-bd16-45a1-9b16-ec10f9a0a8e5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:09.481648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:09.486098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.486396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.486669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] PATH_INFO: `/v3/projects/9cb6bf95cef54b8bad7713035faaebe5/users/3f4544cdba464c2da48d6f79a5d4e536/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.488864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb6bf95cef54b8bad7713035faaebe5, user_id=3f4544cdba464c2da48d6f79a5d4e536, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:09.491605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:09.503850 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2497/4992] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:09 2022] PUT /identity/v3/projects/9cb6bf95cef54b8bad7713035faaebe5/users/3f4544cdba464c2da48d6f79a5d4e536/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:09.514687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.515013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.515297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.546617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] MFA Rules not processed for user `3f4544cdba464c2da48d6f79a5d4e536`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:09.547880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:09.570835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:09.572595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:09.653357 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2496/4993] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:09.661939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:09.663573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:09.679506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178836e-2231-483f-9ce1-c2944548fa2c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:09.687337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:09.688508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.688798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.689074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] PATH_INFO: `/v3/projects/169e1e6f26414e3eaa454bc14100fece` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.691014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] RBAC: Authorizing `identity:delete_project(project_id=169e1e6f26414e3eaa454bc14100fece)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:09.692966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:09.750458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea330189-4099-4bb5-b874-afa56cf67bde None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:09.764111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169e1e6f26414e3eaa454bc14100fece', 'request_id': 'req-521156ef-c2f9-4ae4-ac1e-454099ee790f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.778958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169e1e6f26414e3eaa454bc14100fece', 'request_id': 'req-521156ef-c2f9-4ae4-ac1e-454099ee790f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.798668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169e1e6f26414e3eaa454bc14100fece', 'request_id': 'req-521156ef-c2f9-4ae4-ac1e-454099ee790f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.823455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] The token cache is being invalidate because project 169e1e6f26414e3eaa454bc14100fece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:09.823922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.824437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-521156ef-c2f9-4ae4-ac1e-454099ee790f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:09.826986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2498/4994] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:09 2022] DELETE /identity/v3/projects/169e1e6f26414e3eaa454bc14100fece => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:09.827285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fba483-f8d2-4e44-b9af-aae47a696963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:09.828344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fba483-f8d2-4e44-b9af-aae47a696963 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.828642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fba483-f8d2-4e44-b9af-aae47a696963 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.828950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fba483-f8d2-4e44-b9af-aae47a696963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.831306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c4fba483-f8d2-4e44-b9af-aae47a696963 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:09.832113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10536c85-0650-4d0d-a921-78797552937c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.832570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10536c85-0650-4d0d-a921-78797552937c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.833021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10536c85-0650-4d0d-a921-78797552937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:09.872219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-10536c85-0650-4d0d-a921-78797552937c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:09.882279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-10536c85-0650-4d0d-a921-78797552937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:09.943508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fba483-f8d2-4e44-b9af-aae47a696963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:09.951167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fba483-f8d2-4e44-b9af-aae47a696963 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:09.962453 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2497/4995] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:09.973497 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2499/4996] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:09.981489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139a212-1d89-4d8a-a719-cffda97bf9a4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:09.982401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139a212-1d89-4d8a-a719-cffda97bf9a4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:09.983008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139a212-1d89-4d8a-a719-cffda97bf9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.014542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b139a212-1d89-4d8a-a719-cffda97bf9a4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:10.016186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b139a212-1d89-4d8a-a719-cffda97bf9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:10.028446 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2498/4997] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:10.032564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10536c85-0650-4d0d-a921-78797552937c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.044154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10536c85-0650-4d0d-a921-78797552937c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.049275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.049963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.050217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.050545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.051256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:10.056273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.059002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.080242 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2500/4998] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:10.081332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139a212-1d89-4d8a-a719-cffda97bf9a4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.096188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139a212-1d89-4d8a-a719-cffda97bf9a4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.101912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.103190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.103888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:10.104255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.104782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.105220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.106175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.109505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.123540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f101422-8769-4833-b74d-03bef418a729 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.131376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.133323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.133631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.133949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.135991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:10.148944 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2499/4999] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:10 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:10.154039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.216892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.218761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.229192 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2501/5000] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:10.236549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06c68b-c89d-4917-b291-8101acab4b1b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.242510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.243358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.243644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.243918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.244610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.246558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.280605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2500/5001] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:10 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:10.282471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.298042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665056a-3d4a-44a6-8f11-1c7a2788b260 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.303805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.305404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.305404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.306510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.307344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.309105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.326339 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2502/5002] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:10.327330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.340510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f227b-ba43-4689-98c5-171baf34490d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.346162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d51219-4235-45a8-9d21-145be4a6697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.347338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d51219-4235-45a8-9d21-145be4a6697a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.347808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d51219-4235-45a8-9d21-145be4a6697a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.348247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d51219-4235-45a8-9d21-145be4a6697a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.349403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d51219-4235-45a8-9d21-145be4a6697a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.352119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d51219-4235-45a8-9d21-145be4a6697a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.368980 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2501/5003] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:10.370134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.383474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ef34b-e8c9-4c17-9689-8c4ffbf44fb4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.391717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.392896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.393363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.407371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] PATH_INFO: `/v3/projects/85c3142e67d842ef8c79c4f7ff74bbe9/users/63dccfa2a6544fc6bbe30f7d8b53c2de/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.437311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c3142e67d842ef8c79c4f7ff74bbe9, user_id=63dccfa2a6544fc6bbe30f7d8b53c2de, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.440577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.476983 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2503/5004] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:10 2022] PUT /identity/v3/projects/85c3142e67d842ef8c79c4f7ff74bbe9/users/63dccfa2a6544fc6bbe30f7d8b53c2de/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:10.479642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84902-4fa7-4d99-b415-29d945ab4ae1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.482112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84902-4fa7-4d99-b415-29d945ab4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.482479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84902-4fa7-4d99-b415-29d945ab4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.518240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1ac84902-4fa7-4d99-b415-29d945ab4ae1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:10.519742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ac84902-4fa7-4d99-b415-29d945ab4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:10.585799 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2502/5005] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:10.596461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:10.598199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:10.662390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7b372-4cf2-41fa-a4aa-289031217d74 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:10.666658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:10.667426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:10.667773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:10.668114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:10.677477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:10.679136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:10.689686 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2504/5006] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:12.112571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874c85-3c76-4436-8d91-761942b85c93 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:12.113037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874c85-3c76-4436-8d91-761942b85c93 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:12.113140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19874c85-3c76-4436-8d91-761942b85c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:12.137080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-19874c85-3c76-4436-8d91-761942b85c93 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:12.138376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-19874c85-3c76-4436-8d91-761942b85c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:12.202954 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2503/5007] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:02:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:12.231527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:12.233976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:12.326617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b37ce-fefc-4050-810c-cad220129418 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:12.327040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b37ce-fefc-4050-810c-cad220129418 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:12.327325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b37ce-fefc-4050-810c-cad220129418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:12.345804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612a786-ba5e-4e77-8dab-3bf9bb5845ab service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:12.354207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:12.355421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:12.356889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:12.356889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:12.367948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:12.369537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f69b37ce-fefc-4050-810c-cad220129418 None None] MFA Rules not processed for user `63dccfa2a6544fc6bbe30f7d8b53c2de`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:12.370141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:12.376508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f69b37ce-fefc-4050-810c-cad220129418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:12.380892 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2505/5008] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:02:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:02:12.485116 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2504/5009] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:12.496039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:12.497128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:12.621736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3162f-676a-4603-99ee-34d36cd0837d service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:12.629390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:12.630752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:12.631528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:12.632915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:12.647472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:12.650370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:12.681915 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2506/5010] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:14.127397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b37ce-fefc-4050-810c-cad220129418 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:14.152922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b37ce-fefc-4050-810c-cad220129418 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:14.172324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:14.173221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:14.173509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:14.173832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] PATH_INFO: `/v3/users/63dccfa2a6544fc6bbe30f7d8b53c2de` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:14.183841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63dccfa2a6544fc6bbe30f7d8b53c2de)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:14.186719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:14.339162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63dccfa2a6544fc6bbe30f7d8b53c2de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:14.344219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63dccfa2a6544fc6bbe30f7d8b53c2de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:14.355858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63dccfa2a6544fc6bbe30f7d8b53c2de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:14.357698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63dccfa2a6544fc6bbe30f7d8b53c2de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:14.385318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b252786d-e9bd-427f-90a5-ea4f13f35aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63dccfa2a6544fc6bbe30f7d8b53c2de'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:14.434723 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2505/5011] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:14 2022] DELETE /identity/v3/users/63dccfa2a6544fc6bbe30f7d8b53c2de => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:15.193797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:15.268174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b825d3-e3ef-47c4-9cac-429273cfb93a service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:15.493142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:15.494163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:15.494448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:15.494726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] PATH_INFO: `/v3/projects/85c3142e67d842ef8c79c4f7ff74bbe9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:15.496109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c3142e67d842ef8c79c4f7ff74bbe9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:15.502577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:15.606320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c3142e67d842ef8c79c4f7ff74bbe9', 'request_id': 'req-1afb0bfa-d49c-4771-96e2-ecc5499396cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:15.615984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c3142e67d842ef8c79c4f7ff74bbe9', 'request_id': 'req-1afb0bfa-d49c-4771-96e2-ecc5499396cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:15.631651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c3142e67d842ef8c79c4f7ff74bbe9', 'request_id': 'req-1afb0bfa-d49c-4771-96e2-ecc5499396cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:15.660014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] The token cache is being invalidate because project 85c3142e67d842ef8c79c4f7ff74bbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:15.660368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:15.662183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1afb0bfa-d49c-4771-96e2-ecc5499396cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:15.666651 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2507/5012] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:15 2022] DELETE /identity/v3/projects/85c3142e67d842ef8c79c4f7ff74bbe9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:15.673043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6465f-d954-4f5b-91c0-0d13995a3e4c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:15.674528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6465f-d954-4f5b-91c0-0d13995a3e4c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:15.675181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6465f-d954-4f5b-91c0-0d13995a3e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:15.703006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-93c6465f-d954-4f5b-91c0-0d13995a3e4c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:15.709460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-93c6465f-d954-4f5b-91c0-0d13995a3e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:15.849619 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2506/5013] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:15.856796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa30e7-5fc0-4dde-948b-fc235a2f9c00 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:15.857713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa30e7-5fc0-4dde-948b-fc235a2f9c00 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:15.857713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa30e7-5fc0-4dde-948b-fc235a2f9c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:15.902027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4bfa30e7-5fc0-4dde-948b-fc235a2f9c00 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:15.903297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4bfa30e7-5fc0-4dde-948b-fc235a2f9c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:15.956399 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2508/5014] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:15.963673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6465f-d954-4f5b-91c0-0d13995a3e4c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:15.986887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6465f-d954-4f5b-91c0-0d13995a3e4c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:15.999399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:16.003910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.004728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.010181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.011360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:16.012919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:16.016288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:16.056434 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2507/5015] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:16.057681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa30e7-5fc0-4dde-948b-fc235a2f9c00 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:16.074507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa30e7-5fc0-4dde-948b-fc235a2f9c00 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:16.095461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:16.096461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.096931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.097377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.098357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:16.101388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:16.162617 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2509/5016] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:16 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:16.164994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:16.182329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2f736-6fdb-416c-ad1f-167fc6dc3f54 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:16.321431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:16.322680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.322680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.323280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.324817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:16.328466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:16.354696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2508/5017] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:16 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:16.360884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:16.375931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b418a3c-1cfc-4ec0-9257-e30054d6a3e7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:16.395522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:16.396349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.396841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.397434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.399461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:16.403626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:16.448856 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2510/5018] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:02:16.452492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:16.478737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223307c1-620d-498b-94e4-bb9aff57aaf7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:16.491796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c138-e854-4c2f-be67-99ae8fea5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:16.492800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c138-e854-4c2f-be67-99ae8fea5728 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.495916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c138-e854-4c2f-be67-99ae8fea5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.496742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c138-e854-4c2f-be67-99ae8fea5728 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.497985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c138-e854-4c2f-be67-99ae8fea5728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:16.500478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c138-e854-4c2f-be67-99ae8fea5728 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:16.529916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:16.530325 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2509/5019] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:16.549421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e09396-f5cf-4200-9b6a-2055e9723e1f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:16.562649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:16.564494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.564791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.565073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] PATH_INFO: `/v3/projects/8130c27f2b84434a8d6fa5032b67aa1e/users/4fb48e4d50184d2e97674324027d9ec0/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.592303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8130c27f2b84434a8d6fa5032b67aa1e, user_id=4fb48e4d50184d2e97674324027d9ec0, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:16.596114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:16.619664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2511/5020] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:16 2022] PUT /identity/v3/projects/8130c27f2b84434a8d6fa5032b67aa1e/users/4fb48e4d50184d2e97674324027d9ec0/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:16.625026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.625319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.625600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.669387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:16.670658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:16.805167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2510/5021] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:16.816671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:16.818647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:16.911053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b00d1-e33b-4d7e-b590-992ea1c143c1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:16.918581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e2a4c-5fc5-4f51-a460-cce1c86bb4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:16.919496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2a4c-5fc5-4f51-a460-cce1c86bb4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:16.919848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2a4c-5fc5-4f51-a460-cce1c86bb4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:16.920342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e2a4c-5fc5-4f51-a460-cce1c86bb4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:16.942364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2a4c-5fc5-4f51-a460-cce1c86bb4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:16.948644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e2a4c-5fc5-4f51-a460-cce1c86bb4e8 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:16.973043 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2512/5022] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:18.177803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:18.180503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:18.213490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6af29c-2f52-49fa-85ec-c89e3b72e4d3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:18.233879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:18.235000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:18.235284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:18.235558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] PATH_INFO: `/v3/users/8d22f4f78a2f410da5efe29ab9d37071` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:18.242000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d22f4f78a2f410da5efe29ab9d37071)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:18.244372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:18.352431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d22f4f78a2f410da5efe29ab9d37071'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:18.354152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d22f4f78a2f410da5efe29ab9d37071'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:18.372040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d22f4f78a2f410da5efe29ab9d37071'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:18.377397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d22f4f78a2f410da5efe29ab9d37071'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:18.389727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d22f4f78a2f410da5efe29ab9d37071'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:18.451679 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2511/5023] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:18 2022] DELETE /identity/v3/users/8d22f4f78a2f410da5efe29ab9d37071 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:18.456799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:18.457852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:18.458444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:18.505697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:18.507913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:18.697892 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2513/5024] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:18.719888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:18.723171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:18.900362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52717f55-dcb4-440d-aa27-971704c33dc6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:18.919326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4187f-74cc-4b37-9ea5-4df174685924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:18.922021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4187f-74cc-4b37-9ea5-4df174685924 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:18.923078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4187f-74cc-4b37-9ea5-4df174685924 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:18.925488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4187f-74cc-4b37-9ea5-4df174685924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:18.978092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4187f-74cc-4b37-9ea5-4df174685924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:18.986076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4187f-74cc-4b37-9ea5-4df174685924 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:19.050455 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2512/5025] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:19.563955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:19.566671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:19.611834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e7080-6097-41e2-8c98-1dc21a60884f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:19.627539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:19.630476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:19.635113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:19.635892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] PATH_INFO: `/v3/projects/442c8c92c2ea4bf496bd9367fc0ff8f6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:19.638170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=442c8c92c2ea4bf496bd9367fc0ff8f6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:19.643259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:19.735357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442c8c92c2ea4bf496bd9367fc0ff8f6', 'request_id': 'req-3808bfe3-2ffc-4409-b58b-968b0711f794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:19.744189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442c8c92c2ea4bf496bd9367fc0ff8f6', 'request_id': 'req-3808bfe3-2ffc-4409-b58b-968b0711f794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:19.757496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442c8c92c2ea4bf496bd9367fc0ff8f6', 'request_id': 'req-3808bfe3-2ffc-4409-b58b-968b0711f794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:19.796159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] The token cache is being invalidate because project 442c8c92c2ea4bf496bd9367fc0ff8f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:19.796520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:19.799362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3808bfe3-2ffc-4409-b58b-968b0711f794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:19.812941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0ff57-91d7-4b85-9843-8d3457c5a329 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:19.813467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0ff57-91d7-4b85-9843-8d3457c5a329 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:19.813562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0ff57-91d7-4b85-9843-8d3457c5a329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:19.815137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2514/5026] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:19 2022] DELETE /identity/v3/projects/442c8c92c2ea4bf496bd9367fc0ff8f6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:19.868455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-63f0ff57-91d7-4b85-9843-8d3457c5a329 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:19.873661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-63f0ff57-91d7-4b85-9843-8d3457c5a329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:20.114915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2513/5027] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:20.123448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c4226-1197-4d58-bc83-c83258633c42 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.123765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c4226-1197-4d58-bc83-c83258633c42 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.124048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c4226-1197-4d58-bc83-c83258633c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:20.152506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-545c4226-1197-4d58-bc83-c83258633c42 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:20.153607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-545c4226-1197-4d58-bc83-c83258633c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:20.174804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0ff57-91d7-4b85-9843-8d3457c5a329 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:20.180255 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2515/5028] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:20.186856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0ff57-91d7-4b85-9843-8d3457c5a329 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:20.193169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:20.266933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.266933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.266933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:20.266933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:20.266933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:20.266933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:20.267565 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2514/5029] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:02:20.267791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c4226-1197-4d58-bc83-c83258633c42 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:20.288106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c4226-1197-4d58-bc83-c83258633c42 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:20.314377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:20.315164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.315484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.315791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:20.316626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:20.321963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:20.420625 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2516/5030] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:20 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:02:20.425091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:20.442727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec62f5c-3fef-4d4d-8bd6-44a5eb4d2dd1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:20.551599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:20.552600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.559182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.559687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:20.564857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:20.576573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:20.625746 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2515/5031] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:20 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:20.630536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:20.653747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d737b-031c-4105-b4a0-3ec12f780f46 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:20.677667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:20.687321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.687321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.687321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:20.687321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:20.703847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:20.743209 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2517/5032] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:20.744670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:20.767489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a935a-6b82-4248-b562-fffb34f5615c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:20.787033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b565fc-bb2b-48d5-a36e-ccd181dafbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:20.787728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b565fc-bb2b-48d5-a36e-ccd181dafbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.789934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b565fc-bb2b-48d5-a36e-ccd181dafbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.790439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b565fc-bb2b-48d5-a36e-ccd181dafbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:20.800504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b565fc-bb2b-48d5-a36e-ccd181dafbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:20.808125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b565fc-bb2b-48d5-a36e-ccd181dafbd0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:20.845612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:20.847317 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2516/5033] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:20.861795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a7d0f-a56e-4fbd-90d8-8a7778e7cf30 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:20.875473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:20.876755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.877277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.877863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] PATH_INFO: `/v3/projects/cb22125c0ed04c21af380551961aedb0/users/6c9b64fee3d04e36b8bebd82e1170d85/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:20.899072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb22125c0ed04c21af380551961aedb0, user_id=6c9b64fee3d04e36b8bebd82e1170d85, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:20.903220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:20.932804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2518/5034] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:20 2022] PUT /identity/v3/projects/cb22125c0ed04c21af380551961aedb0/users/6c9b64fee3d04e36b8bebd82e1170d85/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:20.944060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:20.944722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:20.944722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:21.016168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] MFA Rules not processed for user `6c9b64fee3d04e36b8bebd82e1170d85`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:21.018448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:21.144167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2517/5035] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:21.156429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:21.158424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:21.330163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc6af7-0596-4259-8d7e-a7ed78fe9724 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:21.334957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:21.336590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:21.337115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:21.337622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:21.350198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:21.353817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:21.384477 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2519/5036] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:25.076213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:25.078419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:25.250227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cb9c2-da98-4005-bbd7-0bd204be7240 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:25.256649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:25.258370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:25.258660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:25.259191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] PATH_INFO: `/v3/users/f7b6cdf678924373bb24bb562faf90c2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:25.262562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b6cdf678924373bb24bb562faf90c2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:25.265396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:25.346456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b6cdf678924373bb24bb562faf90c2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:25.347321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b6cdf678924373bb24bb562faf90c2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:25.356519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b6cdf678924373bb24bb562faf90c2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:25.357444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b6cdf678924373bb24bb562faf90c2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:25.373795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-00d47b3a-fb5b-451f-b0d7-8cedc620f8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b6cdf678924373bb24bb562faf90c2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:25.417295 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2518/5037] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:25 2022] DELETE /identity/v3/users/f7b6cdf678924373bb24bb562faf90c2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:26.260224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:26.278671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cd861-aefe-442b-a18e-0778ac9de056 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:26.435558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:26.437239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:26.437705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:26.439592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] PATH_INFO: `/v3/projects/7c1ba68595ec4a0ab30a1245d2af00b4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:26.442233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1ba68595ec4a0ab30a1245d2af00b4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:26.446444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:26.561041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1ba68595ec4a0ab30a1245d2af00b4', 'request_id': 'req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:26.568396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1ba68595ec4a0ab30a1245d2af00b4', 'request_id': 'req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:26.583166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1ba68595ec4a0ab30a1245d2af00b4', 'request_id': 'req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:26.597631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] The token cache is being invalidate because project 7c1ba68595ec4a0ab30a1245d2af00b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:26.598330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:26.599309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9b0982b-05c4-41bc-8a79-e7d17d3512ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:26.610565 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2520/5038] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:26 2022] DELETE /identity/v3/projects/7c1ba68595ec4a0ab30a1245d2af00b4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:26.618804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef97e-e988-4930-a152-7e2b3422a33b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:26.619504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef97e-e988-4930-a152-7e2b3422a33b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:26.619780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ef97e-e988-4930-a152-7e2b3422a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:26.656612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1e8ef97e-e988-4930-a152-7e2b3422a33b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:26.658164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1e8ef97e-e988-4930-a152-7e2b3422a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:26.804063 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2519/5039] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:26.811868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dde463-cb70-40c2-aa61-374f04478e43 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:26.812585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dde463-cb70-40c2-aa61-374f04478e43 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:26.812880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dde463-cb70-40c2-aa61-374f04478e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:26.862930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-51dde463-cb70-40c2-aa61-374f04478e43 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:26.868753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51dde463-cb70-40c2-aa61-374f04478e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:26.903719 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2521/5040] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:26.907960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef97e-e988-4930-a152-7e2b3422a33b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:26.924409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ef97e-e988-4930-a152-7e2b3422a33b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:26.969988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:26.971761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:26.972250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:26.974283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:26.976010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:26.978617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:26.984749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:27.023647 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2520/5041] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:27.024778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dde463-cb70-40c2-aa61-374f04478e43 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:27.034937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dde463-cb70-40c2-aa61-374f04478e43 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:27.050737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:27.051319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:27.052438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:27.053625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:27.055511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:27.061081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:27.118530 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2522/5042] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:27 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:27.122197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:27.139785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21f93b-5277-4943-a65b-54e95feea1b8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:27.277901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32de6e0-35c6-40f5-872b-f8b40132e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:27.278595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32de6e0-35c6-40f5-872b-f8b40132e92e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:27.280492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32de6e0-35c6-40f5-872b-f8b40132e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:27.280764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32de6e0-35c6-40f5-872b-f8b40132e92e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:27.282389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32de6e0-35c6-40f5-872b-f8b40132e92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:27.286000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32de6e0-35c6-40f5-872b-f8b40132e92e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:27.365346 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2521/5043] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:27 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:27.367848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:27.384860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5f9e-1866-4e39-9038-14ae629026d4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:27.386382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5f9e-1866-4e39-9038-14ae629026d4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:27.388272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d5f9e-1866-4e39-9038-14ae629026d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:27.395522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551791a-5aaf-4248-8cab-c7b0c76d6be6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:27.417490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:27.420553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:27.420850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:27.423086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:27.428686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:27.430388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:27.469995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d67d5f9e-1866-4e39-9038-14ae629026d4 None None] MFA Rules not processed for user `887054d178de43b18a472fed2297659d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:27.477026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d67d5f9e-1866-4e39-9038-14ae629026d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:27.485811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2523/5044] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:27.488025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:27.523454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6489ab-2e4b-41d4-b53c-b8e5a38b7efc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:27.529302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:27.530273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:27.531177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:27.531707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:27.532827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:27.535490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:27.549430 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2524/5045] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:27.553031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:27.570872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56372eff-0e6b-4532-b864-8c0e41276e37 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:27.579119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca47e3c-108a-4d15-8321-3d83df3b433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:27.580195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca47e3c-108a-4d15-8321-3d83df3b433f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:27.580476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca47e3c-108a-4d15-8321-3d83df3b433f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:27.580849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca47e3c-108a-4d15-8321-3d83df3b433f admin admin] PATH_INFO: `/v3/projects/6c27fff94315415da226f59a0c9de354/users/a8eb802dd28d4b3696d33a882edb6c6e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:27.608272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca47e3c-108a-4d15-8321-3d83df3b433f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c27fff94315415da226f59a0c9de354, user_id=a8eb802dd28d4b3696d33a882edb6c6e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:27.614086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca47e3c-108a-4d15-8321-3d83df3b433f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:27.637943 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2522/5046] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:27.687592 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2525/5047] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:27 2022] PUT /identity/v3/projects/6c27fff94315415da226f59a0c9de354/users/a8eb802dd28d4b3696d33a882edb6c6e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:27.690085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:27.690505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:27.690944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:27.766280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] MFA Rules not processed for user `a8eb802dd28d4b3696d33a882edb6c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:27.771721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:28.014844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:28.014844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:28.015603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:28.027753 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2523/5048] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:28.061785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] MFA Rules not processed for user `a8eb802dd28d4b3696d33a882edb6c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:28.065323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:28.094909 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2526/5049] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:28.102486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:28.104045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:28.307920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e61ee-bf04-4488-a18d-3b5ad0dd5dee None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:28.329322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba43aa8-df29-44a5-b825-0b5f37c63f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:28.329995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba43aa8-df29-44a5-b825-0b5f37c63f63 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:28.330320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba43aa8-df29-44a5-b825-0b5f37c63f63 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:28.330577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba43aa8-df29-44a5-b825-0b5f37c63f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:28.347903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba43aa8-df29-44a5-b825-0b5f37c63f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:28.349956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba43aa8-df29-44a5-b825-0b5f37c63f63 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:28.376150 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2524/5050] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:28.536717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:28.543298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:28.743372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55e66-3637-4798-adaf-7f41abdc0ee7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:28.759839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7042e1-9cc6-4d59-b18c-51e8f89e0120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:28.760770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7042e1-9cc6-4d59-b18c-51e8f89e0120 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:28.761253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7042e1-9cc6-4d59-b18c-51e8f89e0120 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:28.761711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7042e1-9cc6-4d59-b18c-51e8f89e0120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:28.764968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-be7042e1-9cc6-4d59-b18c-51e8f89e0120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:28.782819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7042e1-9cc6-4d59-b18c-51e8f89e0120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:28.785183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7042e1-9cc6-4d59-b18c-51e8f89e0120 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:28.847911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2527/5051] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:31.091677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f911a-fb44-463c-8349-a8e2b6dfdb08 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:31.092176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f911a-fb44-463c-8349-a8e2b6dfdb08 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:31.092323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f911a-fb44-463c-8349-a8e2b6dfdb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:31.176782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3a6f911a-fb44-463c-8349-a8e2b6dfdb08 None None] MFA Rules not processed for user `4fb48e4d50184d2e97674324027d9ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:31.180197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a6f911a-fb44-463c-8349-a8e2b6dfdb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:31.356447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2525/5052] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:31.369586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:31.370145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:31.370354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:31.397372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] MFA Rules not processed for user `4fb48e4d50184d2e97674324027d9ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:31.399829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:31.408286 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2528/5053] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:31.422191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f911a-fb44-463c-8349-a8e2b6dfdb08 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:31.446150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f911a-fb44-463c-8349-a8e2b6dfdb08 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:31.458930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4b561-c4e3-484b-857a-97de24cfea80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:31.460713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b561-c4e3-484b-857a-97de24cfea80 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:31.461251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b561-c4e3-484b-857a-97de24cfea80 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:31.461930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4b561-c4e3-484b-857a-97de24cfea80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:31.482055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4b561-c4e3-484b-857a-97de24cfea80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:31.484679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4b561-c4e3-484b-857a-97de24cfea80 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:31.504547 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2526/5054] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:31.910195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:31.912093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:31.972389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87328-84f0-4225-b11d-e1033a9401e6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:31.980287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:31.981690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:31.982123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:31.982741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:31.986830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:32.023495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:32.025141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:32.050284 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2529/5055] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:32.910212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711c9cc-92aa-49e1-8e7f-07dfb346da50 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:32.911227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711c9cc-92aa-49e1-8e7f-07dfb346da50 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:32.911682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711c9cc-92aa-49e1-8e7f-07dfb346da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:32.950346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0711c9cc-92aa-49e1-8e7f-07dfb346da50 None None] MFA Rules not processed for user `4fb48e4d50184d2e97674324027d9ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:32.952170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0711c9cc-92aa-49e1-8e7f-07dfb346da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:32.968489 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2527/5056] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:38.694331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:38.695916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:38.776939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df57e6e-c31f-4340-86ad-3bf94410f7d6 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:38.785441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:38.786628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:38.786954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:38.787422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] PATH_INFO: `/v3/users/6c9b64fee3d04e36b8bebd82e1170d85` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:38.789658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9b64fee3d04e36b8bebd82e1170d85)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:38.792186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:38.868821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9b64fee3d04e36b8bebd82e1170d85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:38.900516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9b64fee3d04e36b8bebd82e1170d85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:38.903159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9b64fee3d04e36b8bebd82e1170d85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:38.904651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9b64fee3d04e36b8bebd82e1170d85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:38.931835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9b64fee3d04e36b8bebd82e1170d85'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:38.986570 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2530/5057] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:38 2022] DELETE /identity/v3/users/6c9b64fee3d04e36b8bebd82e1170d85 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:38.991643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:38.992211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:38.992211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:39.025425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:39.026974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:39.122042 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2528/5058] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:39.171545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:39.173121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:39.270070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bbc00-9c7c-47db-bcc8-9ebc22db2173 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:39.278530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b67485-f580-481e-bd73-ad8d42d3b116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:39.280490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b67485-f580-481e-bd73-ad8d42d3b116 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:39.281011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b67485-f580-481e-bd73-ad8d42d3b116 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:39.281344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b67485-f580-481e-bd73-ad8d42d3b116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:39.323641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b67485-f580-481e-bd73-ad8d42d3b116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:39.326222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b67485-f580-481e-bd73-ad8d42d3b116 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:39.359628 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2531/5059] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:40.804091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:40.805673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:40.842538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc1773-194e-428c-b614-e130835598d4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:40.863426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:40.864586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:40.865602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:40.867008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] PATH_INFO: `/v3/projects/cb22125c0ed04c21af380551961aedb0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:40.869214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb22125c0ed04c21af380551961aedb0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:40.874133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:40.996553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb22125c0ed04c21af380551961aedb0', 'request_id': 'req-e798d1de-6569-4fff-976b-5784d9ecd068'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.012014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb22125c0ed04c21af380551961aedb0', 'request_id': 'req-e798d1de-6569-4fff-976b-5784d9ecd068'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.028311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb22125c0ed04c21af380551961aedb0', 'request_id': 'req-e798d1de-6569-4fff-976b-5784d9ecd068'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.057519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] The token cache is being invalidate because project cb22125c0ed04c21af380551961aedb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:41.057820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.058560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e798d1de-6569-4fff-976b-5784d9ecd068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.060431 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2529/5060] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:40 2022] DELETE /identity/v3/projects/cb22125c0ed04c21af380551961aedb0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:41.065920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2366-df26-4a6d-9f9f-d23e9593213b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.066817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2366-df26-4a6d-9f9f-d23e9593213b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.067289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c2366-df26-4a6d-9f9f-d23e9593213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.090290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c21c2366-df26-4a6d-9f9f-d23e9593213b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:41.092007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c21c2366-df26-4a6d-9f9f-d23e9593213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:41.167737 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2532/5061] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:41.175524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15fb2d-4237-4599-a97b-c85e48830ece None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.175822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15fb2d-4237-4599-a97b-c85e48830ece None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.176319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15fb2d-4237-4599-a97b-c85e48830ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.208110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ee15fb2d-4237-4599-a97b-c85e48830ece None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:41.209199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee15fb2d-4237-4599-a97b-c85e48830ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:41.229119 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2530/5062] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:41.238801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2366-df26-4a6d-9f9f-d23e9593213b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.249930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c2366-df26-4a6d-9f9f-d23e9593213b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:41.259128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:41.259815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.260103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.260384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.261125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:41.261438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:41.263079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:41.276791 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2533/5063] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:41.281199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15fb2d-4237-4599-a97b-c85e48830ece None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.290930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15fb2d-4237-4599-a97b-c85e48830ece None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:41.297201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:41.298546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.300234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.302907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.304005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:41.306097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:41.322303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.325311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:41.345341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad901ded-c62a-488c-8065-d75f2ad088c9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:41.352641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:41.353925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.354390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.354847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] PATH_INFO: `/v3/users/99294a64e28046d8b57260f74c325990` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.356887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99294a64e28046d8b57260f74c325990)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:41.360403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2531/5064] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:41 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:41.361585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.363256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:41.449432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e8f6-f3db-4779-821f-729fabe1a414 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:41.454674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99294a64e28046d8b57260f74c325990'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.454991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:41.455945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.456475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.457161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.458357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:41.462683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:41.467675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99294a64e28046d8b57260f74c325990'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.468399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99294a64e28046d8b57260f74c325990'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.469022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99294a64e28046d8b57260f74c325990'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.480910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99294a64e28046d8b57260f74c325990'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:41.488201 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2532/5065] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:41 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:41.494794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.496729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:41.516438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3f2f2-0dc4-4d55-9850-c8498d6fa781 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:41.523529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:41.524951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.525667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.526361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.527377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:41.530337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:41.543514 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2534/5066] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:41 2022] DELETE /identity/v3/users/99294a64e28046d8b57260f74c325990 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:41.587435 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2533/5067] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:41.589044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.704898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b268-b742-4c79-aa9c-c35bdbd40706 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:41.715327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198b3e4-4f16-453e-a503-047ba1065820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:41.716029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198b3e4-4f16-453e-a503-047ba1065820 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.716473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198b3e4-4f16-453e-a503-047ba1065820 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.716759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198b3e4-4f16-453e-a503-047ba1065820 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.718272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198b3e4-4f16-453e-a503-047ba1065820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:41.719967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198b3e4-4f16-453e-a503-047ba1065820 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:41.734687 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2535/5068] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:41.743256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.751097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48427-d146-45d6-90b9-425d759b55b9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:41.755676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:41.757161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.757438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.757709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] PATH_INFO: `/v3/projects/faec6df79427410583eae323ce69ce42/users/55d66936df934de7b9ee663dfe043f4d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.773362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=faec6df79427410583eae323ce69ce42, user_id=55d66936df934de7b9ee663dfe043f4d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:41.776102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:41.790431 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2534/5069] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:41 2022] PUT /identity/v3/projects/faec6df79427410583eae323ce69ce42/users/55d66936df934de7b9ee663dfe043f4d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:41.800916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:41.801471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:41.801848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:41.835240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] MFA Rules not processed for user `55d66936df934de7b9ee663dfe043f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:41.836632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:41.930807 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2536/5070] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:41.935094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.941836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:41.943350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:42.044944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce05f4-4fc7-46ee-a7ea-10d8f0fb7dfe None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.049315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.050244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.050516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.050820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] PATH_INFO: `/v3/projects/1fb49d7a99844a7ab8ef30fb59250e7d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.056218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb49d7a99844a7ab8ef30fb59250e7d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.058167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.102718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580d8ec-8c96-4c26-b171-3d3e5e3b5e1b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.132429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.134253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.135765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.136106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.137844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.139718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.176596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb49d7a99844a7ab8ef30fb59250e7d', 'request_id': 'req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:42.187872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb49d7a99844a7ab8ef30fb59250e7d', 'request_id': 'req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:42.205041 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2535/5071] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:41 2022] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:42.213675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb49d7a99844a7ab8ef30fb59250e7d', 'request_id': 'req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:42.220284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.246170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] The token cache is being invalidate because project 1fb49d7a99844a7ab8ef30fb59250e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:42.246686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:42.247986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dec3f1d6-f5e5-4e98-bf10-af53c8fc6892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:42.250939 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2537/5072] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:41 2022] DELETE /identity/v3/projects/1fb49d7a99844a7ab8ef30fb59250e7d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:42.261651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c8639-209e-44f2-9e9f-a5114ce53ee8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.262072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c8639-209e-44f2-9e9f-a5114ce53ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.262724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c8639-209e-44f2-9e9f-a5114ce53ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.292005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-747c8639-209e-44f2-9e9f-a5114ce53ee8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:42.299009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-747c8639-209e-44f2-9e9f-a5114ce53ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:42.340601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62cec9-c7c5-4379-9478-8769d2700bf6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.380019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.380736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.381021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.381645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.384214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.387973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.432957 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2536/5073] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:42 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:42.438141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.441213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:42.462422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a439de6-3e00-443f-af68-57b5e88b62c6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.466840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2538/5074] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:42.473811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044a07e-e79f-4679-976f-9d8686e59812 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.474150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044a07e-e79f-4679-976f-9d8686e59812 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.474378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044a07e-e79f-4679-976f-9d8686e59812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.484960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.485670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.485946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.486226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.491726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.509027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.547806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0044a07e-e79f-4679-976f-9d8686e59812 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:42.549115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0044a07e-e79f-4679-976f-9d8686e59812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:42.557153 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2537/5075] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:02:42.565170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.573897 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2539/5076] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:42.578352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044a07e-e79f-4679-976f-9d8686e59812 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.595720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044a07e-e79f-4679-976f-9d8686e59812 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.600909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b6065-cc9f-4a0c-9795-34b22f4dc0b1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.602228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.602941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.603226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.603504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.604235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:42.604539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.606189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.634644 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2540/5077] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:02:42.638733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.653168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc15a22-b686-4fef-b25b-7768c89fe34f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.659931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.661666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.662744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.664489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.664977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.665779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.665938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.666984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] PATH_INFO: `/v3/projects/1d90c8b39bff4f71b1339c80ac3bd9b1/users/a3a83037e88d4d718b12a7c05103f6c5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.667287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.669688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.741996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d90c8b39bff4f71b1339c80ac3bd9b1, user_id=a3a83037e88d4d718b12a7c05103f6c5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.748054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.748891 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2541/5078] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:42 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:02:42.754405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.780023 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2538/5079] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:42 2022] PUT /identity/v3/projects/1d90c8b39bff4f71b1339c80ac3bd9b1/users/a3a83037e88d4d718b12a7c05103f6c5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:42.781533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.873926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ae7c9-1cfb-4ff4-a26e-a03ce62b8b5b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.894218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a6516-fc92-45bb-86ae-93a543e52a84 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.902095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.903612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.904409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.904698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.904978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.905226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.905352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.905637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.905756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.906514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.907833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.909090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.949865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2542/5080] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:42 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:42.951775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.952588 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2539/5081] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:42.961275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:42.966852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c9945-242f-42bd-b414-979534e6c019 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.976530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:42.977490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:42.977882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:42.978805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:42.980740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:42.984852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:42.986346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76fedd-205d-47ea-bcd3-94c19a9a39f6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:42.999969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56b43a-d4f7-4393-8392-cb9f562c90c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:43.001081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b43a-d4f7-4393-8392-cb9f562c90c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.001772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b43a-d4f7-4393-8392-cb9f562c90c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.002843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56b43a-d4f7-4393-8392-cb9f562c90c0 admin admin] PATH_INFO: `/v3/projects/1d90c8b39bff4f71b1339c80ac3bd9b1/users/a3a83037e88d4d718b12a7c05103f6c5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.008846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56b43a-d4f7-4393-8392-cb9f562c90c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d90c8b39bff4f71b1339c80ac3bd9b1, user_id=a3a83037e88d4d718b12a7c05103f6c5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:43.012292 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2543/5082] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:02:43.014447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56b43a-d4f7-4393-8392-cb9f562c90c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:43.016399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:43.034561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3995104-8eb3-4962-9892-e5726db65182 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:43.055406 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2540/5083] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:42 2022] PUT /identity/v3/projects/1d90c8b39bff4f71b1339c80ac3bd9b1/users/a3a83037e88d4d718b12a7c05103f6c5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:43.067025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.067309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.068129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.121897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] MFA Rules not processed for user `a3a83037e88d4d718b12a7c05103f6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:43.126507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:43.166540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:43.167633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.168225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.183395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.185845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:43.190148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:43.237444 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2544/5084] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:43.244299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:43.266732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a6ff6-1316-41ea-9c58-b4ea5300d336 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:43.289027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a8fc3-1ef6-44ba-b123-5ba65cce1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:43.290476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a8fc3-1ef6-44ba-b123-5ba65cce1028 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.291988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a8fc3-1ef6-44ba-b123-5ba65cce1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.293374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a8fc3-1ef6-44ba-b123-5ba65cce1028 admin admin] PATH_INFO: `/v3/projects/bc2de9467a4740fca69eb2e185be0ce8/users/88214dbdd1334702864f6426a098d794/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.339668 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2541/5085] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:43.358003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:43.358473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a8fc3-1ef6-44ba-b123-5ba65cce1028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2de9467a4740fca69eb2e185be0ce8, user_id=88214dbdd1334702864f6426a098d794, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:43.360231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:43.362216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a8fc3-1ef6-44ba-b123-5ba65cce1028 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:43.421383 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2545/5086] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:43 2022] PUT /identity/v3/projects/bc2de9467a4740fca69eb2e185be0ce8/users/88214dbdd1334702864f6426a098d794/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:43.432841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b303a82-1092-4085-9aff-df2bebc4e2e5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.433258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b303a82-1092-4085-9aff-df2bebc4e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.434004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b303a82-1092-4085-9aff-df2bebc4e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.483094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0b303a82-1092-4085-9aff-df2bebc4e2e5 None None] MFA Rules not processed for user `88214dbdd1334702864f6426a098d794`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:43.484883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b303a82-1092-4085-9aff-df2bebc4e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:43.502314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6b62f-5d4b-477a-840d-6ea01a9a61ff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:43.613112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:43.614242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.616546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.617014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.673600 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2546/5087] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:43.676132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.676603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.677091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.706207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:43.707755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:43.739237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:43.739935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:43.755105 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2542/5088] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:43.759097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:43.878965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4bc7-a88a-438d-b918-5830bd49fda5 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:43.894947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:43.895798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:43.895931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:43.896188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:43.896886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:43.900010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:43.912053 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2547/5089] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:43.926431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:43.928938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:43.957795 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2543/5090] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:43 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:43.962175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:44.062622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45f578-0a12-4242-9bd6-3dd1e8f8021c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:44.072933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:44.074110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.075248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.075773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.077532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:44.080562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:44.133603 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2544/5091] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:43 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:02:44.137181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:44.156175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a730e64-e66a-4648-9922-5db7e0ef140f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:44.156685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c2a19-1ed4-4573-b626-0b25d2a7207f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:44.170014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:44.170727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.171425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.172043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.172814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:44.174948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:44.191815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2545/5092] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:02:44.197119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:44.225293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1d8ca-a1b1-48d0-ab04-7143300912f2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:44.244410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:44.248192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.248492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.251821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] PATH_INFO: `/v3/projects/cffb669619014584a0dc673f5127bf33/users/81bec98456a349e9896c540d14bfe50a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.337018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffb669619014584a0dc673f5127bf33, user_id=81bec98456a349e9896c540d14bfe50a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:44.349323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:44.378392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:44.379742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.380256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.383402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.393840 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2546/5093] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:44 2022] PUT /identity/v3/projects/cffb669619014584a0dc673f5127bf33/users/81bec98456a349e9896c540d14bfe50a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:44.394909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:44.535098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:44.537249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:44.559378 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2548/5094] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:02:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 22:02:44.580054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7877-5898-4d72-a57b-9b4da8bf396b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:44.594348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:44.598529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:44.599336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.599523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.599805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.600579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:44.605058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:44.620945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4eb559-1c42-42da-a070-842f8d8a7be1 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:44.640511 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2547/5095] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:44.641360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:44.642199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:44.646210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.647647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.649977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] PATH_INFO: `/v3/users/55d66936df934de7b9ee663dfe043f4d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.660534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d66936df934de7b9ee663dfe043f4d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:44.665614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:44.678735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780f5b-1f08-4277-b7a8-52bce94980e1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:44.727701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae85ed-3800-4674-a114-34fe14e1785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:44.728620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae85ed-3800-4674-a114-34fe14e1785f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.728904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae85ed-3800-4674-a114-34fe14e1785f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.729184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae85ed-3800-4674-a114-34fe14e1785f admin admin] PATH_INFO: `/v3/projects/cffb669619014584a0dc673f5127bf33/users/81bec98456a349e9896c540d14bfe50a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.748502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae85ed-3800-4674-a114-34fe14e1785f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffb669619014584a0dc673f5127bf33, user_id=81bec98456a349e9896c540d14bfe50a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:44.758026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae85ed-3800-4674-a114-34fe14e1785f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:44.791665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d66936df934de7b9ee663dfe043f4d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:44.796745 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2548/5096] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:44 2022] PUT /identity/v3/projects/cffb669619014584a0dc673f5127bf33/users/81bec98456a349e9896c540d14bfe50a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:44.808636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ae5a-977c-44a3-84e6-75643f4c5fee None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.809565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ae5a-977c-44a3-84e6-75643f4c5fee None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.810298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952ae5a-977c-44a3-84e6-75643f4c5fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.815129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d66936df934de7b9ee663dfe043f4d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:44.815851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d66936df934de7b9ee663dfe043f4d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:44.818179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d66936df934de7b9ee663dfe043f4d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:44.839706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d32b32c0-381d-4849-ae0f-0d8e43fe6998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d66936df934de7b9ee663dfe043f4d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:44.875240 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2549/5097] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:44 2022] DELETE /identity/v3/users/55d66936df934de7b9ee663dfe043f4d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:44.877357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:44.878050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:44.878184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:44.914914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3952ae5a-977c-44a3-84e6-75643f4c5fee None None] MFA Rules not processed for user `81bec98456a349e9896c540d14bfe50a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:44.916362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3952ae5a-977c-44a3-84e6-75643f4c5fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:44.953408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:44.956138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:45.129715 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2550/5098] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:45.160652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:45.164148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:45.205535 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2549/5099] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:45.216956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952ae5a-977c-44a3-84e6-75643f4c5fee None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:45.233088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952ae5a-977c-44a3-84e6-75643f4c5fee None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:45.246994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:45.247679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:45.247966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:45.248243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:45.249052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:45.250945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:45.291962 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2550/5100] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:02:45 2022] POST /identity/v3/domains => generated 275 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:02:45.292723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:45.327834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f2f32-9e7b-432e-b5a1-82c3abaabe90 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:45.409976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:45.427914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:45.430627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:45.431484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:45.453585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a780b-8751-4946-899b-09159642d3e2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:45.477714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:45.478409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:45.478699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:45.479014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:45.479712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:45.481654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:45.541780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:45.543631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:45.560495 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2551/5101] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:45 2022] POST /identity/v3/groups => generated 280 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:02:45.563968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2551/5102] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:45.565219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:45.582685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f531df7-f78a-4b02-88aa-5ae87f09ceeb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:45.588621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:45.590179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:45.590840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:45.591195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/4bdf449d017748828e1a54e7e10bbe5d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:45.599163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:update_group(group_id=4bdf449d017748828e1a54e7e10bbe5d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:45.601256 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:45.601256 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:02:45.601256 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:02:45.603196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:45.676250 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2552/5103] 10.222.0.32 () {60 vars in 1246 bytes} [Sat May 7 22:02:45 2022] PATCH /identity/v3/groups/4bdf449d017748828e1a54e7e10bbe5d => generated 292 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:02:45.680351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:45.702279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7168e4-54f9-44f4-8f71-8bd1784c8681 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:45.714487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:45.715400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:45.715685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:45.715963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/4bdf449d017748828e1a54e7e10bbe5d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:45.727337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:get_group(group_id=4bdf449d017748828e1a54e7e10bbe5d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:45.728400 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:45.728400 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:02:45.728400 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:02:45.731609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:45.732610 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2552/5104] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:45 2022] GET /identity/v3/groups/4bdf449d017748828e1a54e7e10bbe5d => generated 292 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:45.737384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:45.752357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be358ec8-720f-466f-9a2c-9c8139c4ab90 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:45.768759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:45.769492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:45.769783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:45.770064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/4bdf449d017748828e1a54e7e10bbe5d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:45.784638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:update_group(group_id=4bdf449d017748828e1a54e7e10bbe5d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:45.786725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:45.829283 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2553/5105] 10.222.0.32 () {60 vars in 1245 bytes} [Sat May 7 22:02:45 2022] PATCH /identity/v3/groups/4bdf449d017748828e1a54e7e10bbe5d => generated 309 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:45.833020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:45.852447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96585e-bb52-4d23-a2b1-4e12971228be tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:45.870056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:45.871428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:45.871913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:45.872387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/4bdf449d017748828e1a54e7e10bbe5d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:45.879002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4bdf449d017748828e1a54e7e10bbe5d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:45.883192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:45.992953 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2553/5106] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:02:45 2022] DELETE /identity/v3/groups/4bdf449d017748828e1a54e7e10bbe5d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:45.998127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.009593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab8069-0151-4d68-af27-e6cf3008b5a3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:46.155332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:46.156080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:46.156378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:46.156662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:46.157373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:46.159356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:46.186339 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2554/5107] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:45 2022] POST /identity/v3/groups => generated 326 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:46.191650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.217439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed7869-59d4-4d52-a3e0-be03e0ba9bde tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:46.228876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:46.230813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:46.231115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:46.231390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:46.232094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:46.238464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:46.302257 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2554/5108] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:46 2022] POST /identity/v3/users => generated 321 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:46.307451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.329289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceaca8-647e-494e-9c2e-dd37a7cd5f4a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:46.336024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:46.337256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:46.337767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:46.338325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/46bfbaa22e4b4efaa350e4bcb72b7717` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:46.385382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=46bfbaa22e4b4efaa350e4bcb72b7717)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:46.386633 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:46.386633 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:02:46.386633 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:02:46.389851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:46.427595 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2555/5109] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:02:46 2022] PUT /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/46bfbaa22e4b4efaa350e4bcb72b7717 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:46.432687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.445357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469600-6236-4b5a-8292-b3fbd49da9a1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:46.555463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:46.556663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:46.557171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:46.557670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:46.558522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:46.561960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:46.615087 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2555/5110] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:46 2022] POST /identity/v3/users => generated 323 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:46.615330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.633298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde3706-6253-47a3-a0ef-57782a92cf5c tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:46.653149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:46.654072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:46.654463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:46.654626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/fb507ea66abc46fa9aba82bc9300d506` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:46.691904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=fb507ea66abc46fa9aba82bc9300d506)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:46.694946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:46.735668 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2556/5111] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:02:46 2022] PUT /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/fb507ea66abc46fa9aba82bc9300d506 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:46.740034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.764835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7557a4-3d36-49e7-9032-9d9284f8e962 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:46.784063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.785968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:46.903518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:46.906447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:46.907073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:46.907477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:46.908312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:46.913071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:46.927994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f875f6-1f92-4010-a582-935c0aa0b48b tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:46.934806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:46.936299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:46.937357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:46.937874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] PATH_INFO: `/v3/projects/faec6df79427410583eae323ce69ce42` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:46.939823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faec6df79427410583eae323ce69ce42)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:46.942075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:46.964938 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2556/5112] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:46 2022] POST /identity/v3/users => generated 321 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:46.966294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:46.991797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facd97d-867f-43b1-b445-2fc409e2eed1 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:47.009130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:47.013695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:47.014422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:47.015355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/6f17c3e41165421582d3045e31d00200` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:47.050306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faec6df79427410583eae323ce69ce42', 'request_id': 'req-ed2c39a0-09fa-4926-acb8-2d770edc55f3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.052613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=6f17c3e41165421582d3045e31d00200)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:47.055408 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:47.055408 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:02:47.055408 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:02:47.057184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:47.071912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faec6df79427410583eae323ce69ce42', 'request_id': 'req-ed2c39a0-09fa-4926-acb8-2d770edc55f3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.087639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faec6df79427410583eae323ce69ce42', 'request_id': 'req-ed2c39a0-09fa-4926-acb8-2d770edc55f3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.097137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2557/5113] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:02:46 2022] PUT /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/6f17c3e41165421582d3045e31d00200 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:47.098706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:47.110647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] The token cache is being invalidate because project faec6df79427410583eae323ce69ce42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:47.111281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.113305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.118619 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2557/5114] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:46 2022] DELETE /identity/v3/projects/faec6df79427410583eae323ce69ce42 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:47.119582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:47.121028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:47.182678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab9c79-cf64-47e3-a0ef-c7707bdc9e4d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:47.189168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:47.190125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:47.190638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:47.191040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:47.192710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a84a4cc24eb340c8aaff4f020730232f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:47.200861 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:47.200861 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:02:47.200861 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:02:47.200861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:47.239983 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2558/5115] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:02:47 2022] GET /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users => generated 1081 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:47.242409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:47.244157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c39a0-09fa-4926-acb8-2d770edc55f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:47.247237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:47.269918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09e22b-d61c-4366-816c-c7a0c1c4ccd7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:47.280085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:47.281095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:47.281387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:47.281667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/46bfbaa22e4b4efaa350e4bcb72b7717` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:47.284974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=46bfbaa22e4b4efaa350e4bcb72b7717)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:47.286264 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:47.286264 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:02:47.286264 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:02:47.289351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:47.319764 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2559/5116] 10.222.0.32 () {58 vars in 1341 bytes} [Sat May 7 22:02:47 2022] HEAD /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/46bfbaa22e4b4efaa350e4bcb72b7717 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:47.328448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:47.348666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7513b-14be-4c2c-a751-c4b21b075c8a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:47.365623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:47.365623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:47.367441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:47.367441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/46bfbaa22e4b4efaa350e4bcb72b7717` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:47.370903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=46bfbaa22e4b4efaa350e4bcb72b7717)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:47.372534 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:47.372534 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:02:47.372534 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:02:47.378548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:47.380443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:47.381652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:47.382036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:47.382516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] PATH_INFO: `/v3/users/a3a83037e88d4d718b12a7c05103f6c5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:47.385815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a83037e88d4d718b12a7c05103f6c5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:47.391464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:47.400901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '46bfbaa22e4b4efaa350e4bcb72b7717'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.441260 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2560/5117] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:02:47 2022] DELETE /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/46bfbaa22e4b4efaa350e4bcb72b7717 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:47.450656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:47.517247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a83037e88d4d718b12a7c05103f6c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.518685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a83037e88d4d718b12a7c05103f6c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.538268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a83037e88d4d718b12a7c05103f6c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.539531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a83037e88d4d718b12a7c05103f6c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.552691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59d1de-9264-4d17-8692-b17820d3c393 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:47.554817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a83037e88d4d718b12a7c05103f6c5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.563194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:47.564295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:47.564639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:47.564979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/fb507ea66abc46fa9aba82bc9300d506` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:47.567783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=fb507ea66abc46fa9aba82bc9300d506)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:47.570721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:47.578908 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2558/5118] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:47 2022] DELETE /identity/v3/users/a3a83037e88d4d718b12a7c05103f6c5 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:47.596615 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2561/5119] 10.222.0.32 () {58 vars in 1341 bytes} [Sat May 7 22:02:47 2022] HEAD /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/fb507ea66abc46fa9aba82bc9300d506 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:47.598448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:47.601378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:47.798686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cd69-4e34-439c-96d3-f0501a29718b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:47.810596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:47.812112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:47.812642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:47.827028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/fb507ea66abc46fa9aba82bc9300d506` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:47.833307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=fb507ea66abc46fa9aba82bc9300d506)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:47.836099 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:47.836099 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:02:47.836099 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:02:47.838253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:47.861412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fb507ea66abc46fa9aba82bc9300d506'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:47.888733 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2559/5120] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:02:47 2022] DELETE /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/fb507ea66abc46fa9aba82bc9300d506 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:47.893348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:47.917904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989f7c5-e63b-4ebe-b177-ec1207f1d9da tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:48.141136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:48.142356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:48.143202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:48.144964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/6f17c3e41165421582d3045e31d00200` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:48.147618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=6f17c3e41165421582d3045e31d00200)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:48.150287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:48.179661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2562/5121] 10.222.0.32 () {58 vars in 1341 bytes} [Sat May 7 22:02:47 2022] HEAD /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/6f17c3e41165421582d3045e31d00200 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:48.183260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:48.208038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689b93e-3000-46ee-a09c-39f357bce098 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:48.227781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:48.229437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:48.229986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:48.230549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/6f17c3e41165421582d3045e31d00200` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:48.233083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a84a4cc24eb340c8aaff4f020730232f, user_id=6f17c3e41165421582d3045e31d00200)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:48.235495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:48.269336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6f17c3e41165421582d3045e31d00200'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.296562 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2560/5122] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:02:48 2022] DELETE /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users/6f17c3e41165421582d3045e31d00200 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:48.300615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:48.316249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34a930-2953-48bb-ba65-0b89fca3763a tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:48.423711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:48.424877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:48.425279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:48.425671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:48.427740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a84a4cc24eb340c8aaff4f020730232f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:48.430386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:48.447792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2563/5123] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:02:48 2022] GET /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f/users => generated 145 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:48.448483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:48.459263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb7537-7bb2-4dea-8bae-0830e6bd8abd tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:48.480253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:48.481442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:48.482505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:48.483447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users/6f17c3e41165421582d3045e31d00200` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:48.486026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6f17c3e41165421582d3045e31d00200)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:48.489778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:48.589211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f17c3e41165421582d3045e31d00200'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.590131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f17c3e41165421582d3045e31d00200'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.608872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f17c3e41165421582d3045e31d00200'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.608872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f17c3e41165421582d3045e31d00200'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.617717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f17c3e41165421582d3045e31d00200'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.657035 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2561/5124] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:48 2022] DELETE /identity/v3/users/6f17c3e41165421582d3045e31d00200 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:48.660860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:48.663643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:48.679044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7cfda-9328-4dec-b8b2-74850001d69f tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:48.693613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:48.695480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:48.849057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:48.851215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:48.867376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:48.872187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users/fb507ea66abc46fa9aba82bc9300d506` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:48.874210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fb507ea66abc46fa9aba82bc9300d506)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:48.874335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1fc26-ae83-47b9-9922-4d924f732c11 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:48.890459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:48.890682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:48.891672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:48.892022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:48.892382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] PATH_INFO: `/v3/projects/1d90c8b39bff4f71b1339c80ac3bd9b1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:48.893705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d90c8b39bff4f71b1339c80ac3bd9b1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:48.899691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:48.967013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb507ea66abc46fa9aba82bc9300d506'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.972532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d90c8b39bff4f71b1339c80ac3bd9b1', 'request_id': 'req-02df08fa-4d4c-4b91-8abd-eae341fcccf6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.977719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb507ea66abc46fa9aba82bc9300d506'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.978652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb507ea66abc46fa9aba82bc9300d506'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.980737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb507ea66abc46fa9aba82bc9300d506'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.985038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d90c8b39bff4f71b1339c80ac3bd9b1', 'request_id': 'req-02df08fa-4d4c-4b91-8abd-eae341fcccf6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:48.993964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb507ea66abc46fa9aba82bc9300d506'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.016085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d90c8b39bff4f71b1339c80ac3bd9b1', 'request_id': 'req-02df08fa-4d4c-4b91-8abd-eae341fcccf6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.030806 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2564/5125] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:48 2022] DELETE /identity/v3/users/fb507ea66abc46fa9aba82bc9300d506 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:49.039605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] The token cache is being invalidate because project 1d90c8b39bff4f71b1339c80ac3bd9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:49.039912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.040616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-02df08fa-4d4c-4b91-8abd-eae341fcccf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.041120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.044165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:49.046148 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2562/5126] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:48 2022] DELETE /identity/v3/projects/1d90c8b39bff4f71b1339c80ac3bd9b1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:49.047583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730727d2-a216-4b75-852a-542c60654239 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.047866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730727d2-a216-4b75-852a-542c60654239 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.048337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730727d2-a216-4b75-852a-542c60654239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.072053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-730727d2-a216-4b75-852a-542c60654239 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:49.073427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-730727d2-a216-4b75-852a-542c60654239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:49.138224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554c664-b4e2-402e-adc6-7db5b1f530b2 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.143150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.144033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.144318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.144602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users/46bfbaa22e4b4efaa350e4bcb72b7717` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.148536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_user(user_id=46bfbaa22e4b4efaa350e4bcb72b7717)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.150842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.177133 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2563/5127] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:49.185393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476be3-beca-41b8-96a4-5ecf2f79e7de None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.186203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476be3-beca-41b8-96a4-5ecf2f79e7de None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.186686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1476be3-beca-41b8-96a4-5ecf2f79e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.221586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d1476be3-beca-41b8-96a4-5ecf2f79e7de None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:49.222965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bfbaa22e4b4efaa350e4bcb72b7717'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.225761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d1476be3-beca-41b8-96a4-5ecf2f79e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:49.234084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bfbaa22e4b4efaa350e4bcb72b7717'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.235327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bfbaa22e4b4efaa350e4bcb72b7717'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.236457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bfbaa22e4b4efaa350e4bcb72b7717'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.249167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2564/5128] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:49.252690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bfbaa22e4b4efaa350e4bcb72b7717'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:49.257456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476be3-beca-41b8-96a4-5ecf2f79e7de None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.273671 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2565/5129] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:49 2022] DELETE /identity/v3/users/46bfbaa22e4b4efaa350e4bcb72b7717 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:49.276349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1476be3-beca-41b8-96a4-5ecf2f79e7de None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.279032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.282057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:49.410416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.411673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.411968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.412249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.415261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab6a1b-27a0-4c61-828b-cab56a8e8090 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.415630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:49.415972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.420609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.423209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.427064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.429441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.429441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/a84a4cc24eb340c8aaff4f020730232f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.430913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a84a4cc24eb340c8aaff4f020730232f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.433104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.446376 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2565/5130] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:49.456939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.472698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563a3a9-c575-427e-9ee8-acb9080b8fcc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.479660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.480350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.480625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.487766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.491993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2566/5131] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:02:49 2022] DELETE /identity/v3/groups/a84a4cc24eb340c8aaff4f020730232f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:49.494330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.497529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.506236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.549037 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2566/5132] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:49 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:49.550385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.644029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573c5a9-9bbf-471f-8ce2-57cbae5141d5 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.749645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89d95-487b-4f11-99db-faa8765f1c79 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.762858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.762858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.763331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.763622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.764907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.770057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.779015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.779938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.780548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.781102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.782043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.783349 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:49.783349 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:02:49.783349 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:02:49.784867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.812405 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2567/5133] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:49 2022] POST /identity/v3/groups => generated 326 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:49.813903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.842391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c18d5-2105-403e-a50e-d964c9185cce tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.848841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.849667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.850829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.851361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.852162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.853328 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2567/5134] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:49 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:49.858678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.870356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.896341 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2568/5135] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:49 2022] POST /identity/v3/groups => generated 326 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:49.899665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.904667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cc845-c067-46af-a848-7273adaa7fb2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.916303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.918102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.918506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.946798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.946798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.946798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:49.953908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4bd53-4b07-427d-9097-a696137303e9 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:49.969400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:49.973096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:49.973270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:49.973779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:49.974113 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2568/5136] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:49.978022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:49.981006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:49.985152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.002428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3330365-8b45-44a5-b13c-182992d52be8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.010965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.011693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.012104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.013368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.013368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.015418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.015822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2569/5137] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:49 2022] POST /identity/v3/groups => generated 325 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:50.024268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.039352 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2569/5138] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:50.040323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.053057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c142-bbd5-4427-ba63-e2c6f8fe861e tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.055705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8f7de-9f3a-458b-a90d-a050428da63b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.072272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef70bc-dd95-4c58-a786-2d9237b179c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.073184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef70bc-dd95-4c58-a786-2d9237b179c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.075179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef70bc-dd95-4c58-a786-2d9237b179c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.076170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef70bc-dd95-4c58-a786-2d9237b179c1 admin admin] PATH_INFO: `/v3/projects/0bfbc2af7bf14b8d800a83bd2ac84472/users/a7710da8d78647f7a80edf0e463592e6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.079692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.082310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.082803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.083259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.085630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.086874 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:50.086874 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:02:50.086874 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:02:50.088566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.100586 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2570/5139] 10.222.0.32 () {58 vars in 1124 bytes} [Sat May 7 22:02:50 2022] GET /identity/v3/groups => generated 1487 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:50.105143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.115590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef70bc-dd95-4c58-a786-2d9237b179c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bfbc2af7bf14b8d800a83bd2ac84472, user_id=a7710da8d78647f7a80edf0e463592e6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.118958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef70bc-dd95-4c58-a786-2d9237b179c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.120915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03871b5-21a0-4764-a8ac-d03ac7d20bb7 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.130190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.131312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.132274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.132662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/b787ba20a68444809e0019f4866af77d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.144044 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2570/5140] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:50 2022] PUT /identity/v3/projects/0bfbc2af7bf14b8d800a83bd2ac84472/users/a7710da8d78647f7a80edf0e463592e6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:50.155073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b787ba20a68444809e0019f4866af77d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.155849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e697d-ccb4-4e22-a6b5-40e9021f6275 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.156593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e697d-ccb4-4e22-a6b5-40e9021f6275 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.157045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e697d-ccb4-4e22-a6b5-40e9021f6275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.157197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.234075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2571/5141] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:02:50 2022] DELETE /identity/v3/groups/b787ba20a68444809e0019f4866af77d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:50.238029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.241636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a91e697d-ccb4-4e22-a6b5-40e9021f6275 None None] MFA Rules not processed for user `a7710da8d78647f7a80edf0e463592e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:50.242992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a91e697d-ccb4-4e22-a6b5-40e9021f6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:50.365625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a2ca5-3ef1-4fc1-9bd1-9cdb3919b177 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.371941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.372985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.373381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.373938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/40b8b1353b4747b0bc26b75876c8e40d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.382963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_group(group_id=40b8b1353b4747b0bc26b75876c8e40d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.385132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.452781 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2571/5142] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:50.458936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e697d-ccb4-4e22-a6b5-40e9021f6275 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.478443 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2572/5143] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:02:50 2022] DELETE /identity/v3/groups/40b8b1353b4747b0bc26b75876c8e40d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:50.498612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.608290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e697d-ccb4-4e22-a6b5-40e9021f6275 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.617423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931976-068d-43c0-96aa-fdaf63483f22 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.626496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.626496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.626496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.626978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/d55285eb26604b60913978f76e0a4d41` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.630077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d55285eb26604b60913978f76e0a4d41)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.632896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.704473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.707597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.708435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.708854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.713006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.721147 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2573/5144] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:02:50 2022] DELETE /identity/v3/groups/d55285eb26604b60913978f76e0a4d41 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:50.721582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.724136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.791428 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2572/5145] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:50 2022] POST /identity/v3/projects => generated 381 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:50.792386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:50.870043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602a1d2-931f-4838-aae4-5bb7bf17d7d6 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.910138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8b775-89d6-47bd-9315-814174511ca4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:50.924313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:50.925207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:50.925558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:50.925836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:50.926898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:50.939473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:50.976804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2573/5146] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:50 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:50.980430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.001335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.002171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.002563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.003028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.004517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.006029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9728d5-2d7d-4945-ae44-99071935a4ab admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.007833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.017643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.018425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.018718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.019063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.022412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.032336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.052473 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2574/5147] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:51.057842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.062993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2574/5148] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:50 2022] POST /identity/v3/users => generated 323 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:51.064153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.078494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242271e-1c4b-48fb-815e-c91abcd3d294 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.083915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee46fe6-d621-47c5-8012-ef1dc2513c60 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.084973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.085766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.086158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.086552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.087451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.090459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.091915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.093184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.093942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.094555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] PATH_INFO: `/v3/projects/cb38925beadd4a858d7cb55390a21a3e/users/a3530069a54b4d2b994c94c80318e7f5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.117867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb38925beadd4a858d7cb55390a21a3e, user_id=a3530069a54b4d2b994c94c80318e7f5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.120916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.135134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2575/5149] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:51 2022] POST /identity/v3/groups => generated 326 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:51.141017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.151993 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2575/5150] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:51 2022] PUT /identity/v3/projects/cb38925beadd4a858d7cb55390a21a3e/users/a3530069a54b4d2b994c94c80318e7f5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:51.153093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.174728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83363280-f5c0-450a-ab07-3357a5a515c4 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.275545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07293d-60a3-43ca-bd4b-6be001e78385 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.290587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.292009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.292415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.293100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.293943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.295878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.305023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.305872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.306165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.306452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/e797226bdad747be8a20c014177b1c46/users/49d5dd095f724390b66e4215a0175d74` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.324866 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2576/5151] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:51.326678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.332076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e797226bdad747be8a20c014177b1c46, user_id=49d5dd095f724390b66e4215a0175d74)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.336255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.340681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480c673-bfb8-4816-96ec-d7d79c0b38bb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.352772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d71f-7390-453d-90ff-a0160d8a1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.354042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d71f-7390-453d-90ff-a0160d8a1c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.354584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d71f-7390-453d-90ff-a0160d8a1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.355097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d71f-7390-453d-90ff-a0160d8a1c30 admin admin] PATH_INFO: `/v3/projects/cb38925beadd4a858d7cb55390a21a3e/users/a3530069a54b4d2b994c94c80318e7f5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.358140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961d71f-7390-453d-90ff-a0160d8a1c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb38925beadd4a858d7cb55390a21a3e, user_id=a3530069a54b4d2b994c94c80318e7f5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.361878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961d71f-7390-453d-90ff-a0160d8a1c30 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.371108 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2576/5152] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:02:51 2022] PUT /identity/v3/groups/e797226bdad747be8a20c014177b1c46/users/49d5dd095f724390b66e4215a0175d74 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:51.375494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.379095 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2577/5153] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:51 2022] PUT /identity/v3/projects/cb38925beadd4a858d7cb55390a21a3e/users/a3530069a54b4d2b994c94c80318e7f5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:51.479399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4dbc1-9c9b-4593-80c0-16d04d6ef06d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.517485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.518995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.519396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.594862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] MFA Rules not processed for user `a3530069a54b4d2b994c94c80318e7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:51.596425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:51.615293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.616487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.617353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.617807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.618676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.620931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.653037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2577/5154] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:02:51 2022] POST /identity/v3/groups => generated 326 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:51.654253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.683666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161442d-8d1a-46e8-9531-3aa76cec1713 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:51.721752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:51.722927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:51.723387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:51.725846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/4fd4533e3d654d17b90acada812a910c/users/49d5dd095f724390b66e4215a0175d74` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:51.753786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=4fd4533e3d654d17b90acada812a910c, user_id=49d5dd095f724390b66e4215a0175d74)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:51.757556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:51.832800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2578/5155] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:02:51.848137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:51.850901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:51.902743 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2578/5156] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:02:51 2022] PUT /identity/v3/groups/4fd4533e3d654d17b90acada812a910c/users/49d5dd095f724390b66e4215a0175d74 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:51.907281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:52.036439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ff606-d1cb-4926-a360-6eff73dfd073 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:52.104452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:52.106457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:52.106755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:52.107081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:52.143528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d3924-f53c-446c-b0c9-07588b5110bb tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:52.155372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:52.156324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:52.156609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:52.156884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users/49d5dd095f724390b66e4215a0175d74/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:52.162465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=49d5dd095f724390b66e4215a0175d74)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:52.168159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:52.179600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:52.181083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:52.192851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2579/5157] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:52.222230 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2579/5158] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:02:51 2022] GET /identity/v3/users/49d5dd095f724390b66e4215a0175d74/groups => generated 838 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:52.227251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:52.246078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0f160-2743-450f-83ed-61b180de19b2 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:52.264928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:52.271087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:52.272751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:52.273056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/4fd4533e3d654d17b90acada812a910c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:52.276289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_group(group_id=4fd4533e3d654d17b90acada812a910c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:52.279596 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:02:52.279596 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:02:52.279596 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:02:52.297683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:52.467064 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2580/5159] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:02:52 2022] DELETE /identity/v3/groups/4fd4533e3d654d17b90acada812a910c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:52.469700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:52.481038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad09582-5513-4e8c-810c-f78d04900af3 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:52.597278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:52.598151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:52.598435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:52.598713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/groups/e797226bdad747be8a20c014177b1c46` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:52.608023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e797226bdad747be8a20c014177b1c46)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:52.609734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:52.729439 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2580/5160] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:02:52 2022] DELETE /identity/v3/groups/e797226bdad747be8a20c014177b1c46 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:52.735180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:52.750606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543960f2-4e03-4f22-8085-312d1f162543 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:52.796005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:52.873252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:52.874182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:52.874454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:52.874734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/users/49d5dd095f724390b66e4215a0175d74` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:52.876440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_user(user_id=49d5dd095f724390b66e4215a0175d74)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:52.878586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:52.960393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a4d22-693c-4ec9-ab39-4a0e8a9d8817 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:52.974444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3530069a54b4d2b994c94c80318e7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb38925beadd4a858d7cb55390a21a3e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:52.977262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:52.977452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:52.977745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:52.978500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:52.978825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:52.980490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:52.988114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d5dd095f724390b66e4215a0175d74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:52.988810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d5dd095f724390b66e4215a0175d74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.009366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d5dd095f724390b66e4215a0175d74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.010088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d5dd095f724390b66e4215a0175d74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.011956 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2581/5161] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:02:53.016994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:53.019228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:53.034131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d5dd095f724390b66e4215a0175d74'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.040614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918de63-d028-4c3d-8f3f-c4f83780a857 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:53.053945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3530069a54b4d2b994c94c80318e7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb38925beadd4a858d7cb55390a21a3e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:53.054313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:53.054604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:53.055772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:53.058323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:53.061523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:53.076972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2581/5162] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:52 2022] DELETE /identity/v3/users/49d5dd095f724390b66e4215a0175d74 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:53.079142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:53.083619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:53.149841 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2582/5163] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:53 2022] POST /identity/v3/projects => generated 354 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:53.153426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:53.342560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c33f-197c-4e59-ae6a-21ca60c7366d tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:53.391441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e6220-5b40-4865-8b4b-da5cfddda8ea tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:53.406069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3530069a54b4d2b994c94c80318e7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb38925beadd4a858d7cb55390a21a3e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:53.407267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:53.407911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:53.408380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:53.410054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:53.410539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:53.412984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:53.429450 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2583/5164] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:53.459973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:53.461468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:53.461925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:53.463017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/domains/fdfc50b8415e4c02bab578cede941cdb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:53.465122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fdfc50b8415e4c02bab578cede941cdb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:53.467996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:53.501324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:53.509007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.510754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.518286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8e49-db95-4b4a-a24b-ee569c51dcce tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:53.568738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.570939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.576711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2582/5165] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:02:53 2022] PATCH /identity/v3/domains/fdfc50b8415e4c02bab578cede941cdb => generated 276 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:53.606806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:53.619840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:53.644380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3530069a54b4d2b994c94c80318e7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cb38925beadd4a858d7cb55390a21a3e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:53.645449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:53.646175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:53.646558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] PATH_INFO: `/v3/projects/8bb666dd88634b9d92df9a120cb99f8f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:53.649744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8bb666dd88634b9d92df9a120cb99f8f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:53.652341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:53.733816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb666dd88634b9d92df9a120cb99f8f', 'request_id': 'req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.741992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb666dd88634b9d92df9a120cb99f8f', 'request_id': 'req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.761739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb666dd88634b9d92df9a120cb99f8f', 'request_id': 'req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.766032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057a313-0864-4889-9522-518efcffecc0 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:53.778075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] The token cache is being invalidate because project 8bb666dd88634b9d92df9a120cb99f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:53.779192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.780265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:53.787049 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2584/5166] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:53 2022] DELETE /identity/v3/projects/8bb666dd88634b9d92df9a120cb99f8f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:53.969461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81bec98456a349e9896c540d14bfe50a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cffb669619014584a0dc673f5127bf33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:53.970263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:53.970547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:53.970849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] PATH_INFO: `/v3/domains/fdfc50b8415e4c02bab578cede941cdb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:53.989447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fdfc50b8415e4c02bab578cede941cdb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:53.991447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:54.039917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.049992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.143764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb', 'request_id': 'req-488238fe-fd1a-45bc-8c87-2428899b78e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.152805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb', 'request_id': 'req-488238fe-fd1a-45bc-8c87-2428899b78e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.166902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb', 'request_id': 'req-488238fe-fd1a-45bc-8c87-2428899b78e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.189643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] The token cache is being invalidate because project fdfc50b8415e4c02bab578cede941cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:54.189915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.191808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.208795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb', 'request_id': 'req-488238fe-fd1a-45bc-8c87-2428899b78e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.213265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb', 'request_id': 'req-488238fe-fd1a-45bc-8c87-2428899b78e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.214211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fdfc50b8415e4c02bab578cede941cdb', 'request_id': 'req-488238fe-fd1a-45bc-8c87-2428899b78e8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.221169 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2583/5167] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:02:53 2022] DELETE /identity/v3/domains/fdfc50b8415e4c02bab578cede941cdb => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:54.224904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:54.226938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:54.312927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:54.314584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:54.331738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a757c-d8e7-4a99-bec6-48c0c63bcdc4 tempest-VolumeQuotaClassesTest-1035108939 tempest-VolumeQuotaClassesTest-1035108939-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:54.516734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488238fe-fd1a-45bc-8c87-2428899b78e8 tempest-GroupsV3TestJSON-1728557962 tempest-GroupsV3TestJSON-1728557962-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:54.520443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:54.521782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:54.522440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:54.523650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] PATH_INFO: `/v3/users/88214dbdd1334702864f6426a098d794` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:54.525445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88214dbdd1334702864f6426a098d794)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:54.528542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:54.529696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:54.530810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:54.531289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:54.531852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] PATH_INFO: `/v3/users/a7710da8d78647f7a80edf0e463592e6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:54.533553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7710da8d78647f7a80edf0e463592e6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:54.535839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:54.617631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88214dbdd1334702864f6426a098d794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.641172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88214dbdd1334702864f6426a098d794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.643864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88214dbdd1334702864f6426a098d794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.645151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88214dbdd1334702864f6426a098d794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.656299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7710da8d78647f7a80edf0e463592e6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.657804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7710da8d78647f7a80edf0e463592e6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.659631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-63aef90f-4ae9-44bc-ab8a-b6eab2b06ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88214dbdd1334702864f6426a098d794'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.672763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7710da8d78647f7a80edf0e463592e6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.675815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7710da8d78647f7a80edf0e463592e6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.706567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4388813-bc73-42ef-9239-54cc40391d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7710da8d78647f7a80edf0e463592e6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:54.727861 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2585/5168] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:54 2022] DELETE /identity/v3/users/88214dbdd1334702864f6426a098d794 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:54.734366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:54.734961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:54.735092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:54.766977 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2584/5169] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:54 2022] DELETE /identity/v3/users/a7710da8d78647f7a80edf0e463592e6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:54.770272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:54.771899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:54.777979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:54.814470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:54.815734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:54.860335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:54.861665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:54.980498 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2586/5170] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:54.987315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:54.989213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:54.995309 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2585/5171] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:55.007777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:55.010191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:55.079135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91643abd-1960-45c3-9aee-3bd9d818cd58 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:55.089603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:55.090268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:55.090550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:55.090853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:55.113819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:55.116577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:55.125144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ac43e-4d1c-4442-8a29-87ab7cf1ca75 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:55.134124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7fe0c2-4123-4b2d-950c-ba906262a4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:55.134806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe0c2-4123-4b2d-950c-ba906262a4eb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:55.135167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe0c2-4123-4b2d-950c-ba906262a4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:55.135516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fe0c2-4123-4b2d-950c-ba906262a4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:55.142234 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2587/5172] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:02:55.152433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe0c2-4123-4b2d-950c-ba906262a4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:55.168595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7fe0c2-4123-4b2d-950c-ba906262a4eb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:55.181276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:55.183295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:55.198325 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2586/5173] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:55.210108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fa8a1-262a-42be-9315-a7cb12165015 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:55.222561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:55.224270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:55.224783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:55.225876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] PATH_INFO: `/v3/users/a251148af7f940b596a159886a883bb9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:55.227320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a251148af7f940b596a159886a883bb9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:55.231197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:55.358408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a251148af7f940b596a159886a883bb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:55.371257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a251148af7f940b596a159886a883bb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:55.372392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a251148af7f940b596a159886a883bb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:55.373893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a251148af7f940b596a159886a883bb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:55.398529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a251148af7f940b596a159886a883bb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:55.439900 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2588/5174] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:55 2022] DELETE /identity/v3/users/a251148af7f940b596a159886a883bb9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:55.448404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:55.449046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:55.449635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:55.472995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:55.474498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:55.559140 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2587/5175] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:55.570832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:55.576003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:55.672464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e1219-02f3-41b5-84c9-83c753ffdf6c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:55.677314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:55.678616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:55.679159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:55.679569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:55.691997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:55.694354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:55.704997 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2589/5176] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:02:56.310655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:56.312410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:56.344073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403b078-a464-409f-a9a0-d536b3407b45 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:56.350717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:56.351645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:56.351940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:56.352213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] PATH_INFO: `/v3/projects/bc2de9467a4740fca69eb2e185be0ce8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:56.354199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2de9467a4740fca69eb2e185be0ce8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:56.356316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:56.453916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2de9467a4740fca69eb2e185be0ce8', 'request_id': 'req-2b24d936-6d57-4e5b-a85c-6251c83e878b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.463267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2de9467a4740fca69eb2e185be0ce8', 'request_id': 'req-2b24d936-6d57-4e5b-a85c-6251c83e878b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.474797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2de9467a4740fca69eb2e185be0ce8', 'request_id': 'req-2b24d936-6d57-4e5b-a85c-6251c83e878b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.494952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] The token cache is being invalidate because project bc2de9467a4740fca69eb2e185be0ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:56.495224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.496239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.498194 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2588/5177] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:56 2022] DELETE /identity/v3/projects/bc2de9467a4740fca69eb2e185be0ce8 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:56.502836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:56.524210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:56.529850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc6b23-05de-4ad6-96f8-8c8ff67d31a1 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:56.530899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:56.650414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:56.651924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:56.652220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:56.652542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] PATH_INFO: `/v3/users/81bec98456a349e9896c540d14bfe50a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:56.654508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bec98456a349e9896c540d14bfe50a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:56.657114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:56.704634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24d936-6d57-4e5b-a85c-6251c83e878b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:56.737714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:56.738666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:56.739942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:56.740228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] PATH_INFO: `/v3/projects/8ea307efc44a4c648173ea614ab793a4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:56.742699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea307efc44a4c648173ea614ab793a4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:56.748577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:56.766491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bec98456a349e9896c540d14bfe50a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.780143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bec98456a349e9896c540d14bfe50a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.781159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bec98456a349e9896c540d14bfe50a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.781997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bec98456a349e9896c540d14bfe50a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.796397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bec98456a349e9896c540d14bfe50a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.829668 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2590/5178] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:56 2022] DELETE /identity/v3/users/81bec98456a349e9896c540d14bfe50a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:56.830512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:56.832045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:56.862228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea307efc44a4c648173ea614ab793a4', 'request_id': 'req-84a6d599-6b3e-4e44-9375-87fceb345353'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.874741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea307efc44a4c648173ea614ab793a4', 'request_id': 'req-84a6d599-6b3e-4e44-9375-87fceb345353'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.894025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea307efc44a4c648173ea614ab793a4', 'request_id': 'req-84a6d599-6b3e-4e44-9375-87fceb345353'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.922199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] The token cache is being invalidate because project 8ea307efc44a4c648173ea614ab793a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:56.925843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.928056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:56.930988 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2589/5179] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:56 2022] DELETE /identity/v3/projects/8ea307efc44a4c648173ea614ab793a4 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:56.934926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:56.936947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:56.943096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53755c3-d44b-490c-a6f7-ea4ac22aab80 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:56.954377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:56.955347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:56.955630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:56.955908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] PATH_INFO: `/v3/projects/0bfbc2af7bf14b8d800a83bd2ac84472` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:56.957136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bfbc2af7bf14b8d800a83bd2ac84472)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:56.962001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:57.026024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bfbc2af7bf14b8d800a83bd2ac84472', 'request_id': 'req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.035347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bfbc2af7bf14b8d800a83bd2ac84472', 'request_id': 'req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.047558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bfbc2af7bf14b8d800a83bd2ac84472', 'request_id': 'req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.063086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] The token cache is being invalidate because project 0bfbc2af7bf14b8d800a83bd2ac84472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:57.063959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.065051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.067103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6d599-6b3e-4e44-9375-87fceb345353 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:57.067734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2591/5180] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:56 2022] DELETE /identity/v3/projects/0bfbc2af7bf14b8d800a83bd2ac84472 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:57.072623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:57.076093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:57.160763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1567fb1-ecd5-4ba9-b8d5-b07d633cc127 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:57.172073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:57.173223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:57.173973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:57.174407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] PATH_INFO: `/v3/users/a3530069a54b4d2b994c94c80318e7f5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:57.175358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:57.176452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3530069a54b4d2b994c94c80318e7f5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:57.177531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:57.181724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:57.181724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] PATH_INFO: `/v3/users/3f4544cdba464c2da48d6f79a5d4e536` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:57.182013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:57.182134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4544cdba464c2da48d6f79a5d4e536)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:57.185571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:57.276341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4544cdba464c2da48d6f79a5d4e536'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.277194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4544cdba464c2da48d6f79a5d4e536'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.292748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4544cdba464c2da48d6f79a5d4e536'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.293787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4544cdba464c2da48d6f79a5d4e536'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.296462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3530069a54b4d2b994c94c80318e7f5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.310399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4544cdba464c2da48d6f79a5d4e536'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.328953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3530069a54b4d2b994c94c80318e7f5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.331759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3530069a54b4d2b994c94c80318e7f5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.335544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3530069a54b4d2b994c94c80318e7f5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.361640 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2590/5181] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:56 2022] DELETE /identity/v3/users/3f4544cdba464c2da48d6f79a5d4e536 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:57.362216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3530069a54b4d2b994c94c80318e7f5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:57.406827 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2592/5182] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:02:57 2022] DELETE /identity/v3/users/a3530069a54b4d2b994c94c80318e7f5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:02:57.615188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:57.617471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:57.786280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19137c5-4be1-4dd6-82a8-cfaa95a64126 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:57.867277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:57.868800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:57.869318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:57.870240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] PATH_INFO: `/v3/projects/cffb669619014584a0dc673f5127bf33` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:57.871859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffb669619014584a0dc673f5127bf33)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:57.875047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:57.992094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffb669619014584a0dc673f5127bf33', 'request_id': 'req-96fb3454-b930-4769-970d-bbd35f9af9fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.029959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffb669619014584a0dc673f5127bf33', 'request_id': 'req-96fb3454-b930-4769-970d-bbd35f9af9fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.033686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.036101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.041386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffb669619014584a0dc673f5127bf33', 'request_id': 'req-96fb3454-b930-4769-970d-bbd35f9af9fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.074752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] The token cache is being invalidate because project cffb669619014584a0dc673f5127bf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:58.074752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.075414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.078320 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2591/5183] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:57 2022] DELETE /identity/v3/projects/cffb669619014584a0dc673f5127bf33 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:58.078510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2ca9-c289-455f-9edd-02c56852f64f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.083739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.085310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.204573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3454-b930-4769-970d-bbd35f9af9fe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.206059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.206983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.207256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.207600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] PATH_INFO: `/v3/projects/cb38925beadd4a858d7cb55390a21a3e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.209210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb38925beadd4a858d7cb55390a21a3e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.211209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.218745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.219653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.219937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.220305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] PATH_INFO: `/v3/projects/9cb6bf95cef54b8bad7713035faaebe5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.223722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb6bf95cef54b8bad7713035faaebe5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.227360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.296879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb38925beadd4a858d7cb55390a21a3e', 'request_id': 'req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.304845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb38925beadd4a858d7cb55390a21a3e', 'request_id': 'req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.308767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb6bf95cef54b8bad7713035faaebe5', 'request_id': 'req-66993ba0-a352-4b45-b1e9-d5f26e3f9423'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.316136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb38925beadd4a858d7cb55390a21a3e', 'request_id': 'req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.321398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb6bf95cef54b8bad7713035faaebe5', 'request_id': 'req-66993ba0-a352-4b45-b1e9-d5f26e3f9423'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.334274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb6bf95cef54b8bad7713035faaebe5', 'request_id': 'req-66993ba0-a352-4b45-b1e9-d5f26e3f9423'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.334919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] The token cache is being invalidate because project cb38925beadd4a858d7cb55390a21a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:58.335417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.336248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e6e67730-7ed5-4950-8c0a-4d59b428bd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.338294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2593/5184] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:58 2022] DELETE /identity/v3/projects/cb38925beadd4a858d7cb55390a21a3e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:58.340004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476435-c966-47c0-a8ee-a70ec44d099a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.340299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476435-c966-47c0-a8ee-a70ec44d099a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.340576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476435-c966-47c0-a8ee-a70ec44d099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.355354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] The token cache is being invalidate because project 9cb6bf95cef54b8bad7713035faaebe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:02:58.356066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.356967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-66993ba0-a352-4b45-b1e9-d5f26e3f9423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:02:58.361871 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2592/5185] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:02:58 2022] DELETE /identity/v3/projects/9cb6bf95cef54b8bad7713035faaebe5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:58.361871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ccb04-9a9a-4468-836e-dd0536096dc6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.361871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ccb04-9a9a-4468-836e-dd0536096dc6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.361871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ccb04-9a9a-4468-836e-dd0536096dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.369917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cc476435-c966-47c0-a8ee-a70ec44d099a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:58.372162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cc476435-c966-47c0-a8ee-a70ec44d099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.385309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-754ccb04-9a9a-4468-836e-dd0536096dc6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:58.386525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-754ccb04-9a9a-4468-836e-dd0536096dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.444498 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2594/5186] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:58.446243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e4755-97bf-41fb-97ec-5133261bf0a9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.446752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e4755-97bf-41fb-97ec-5133261bf0a9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.447282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e4755-97bf-41fb-97ec-5133261bf0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.466760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-965e4755-97bf-41fb-97ec-5133261bf0a9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:58.468418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-965e4755-97bf-41fb-97ec-5133261bf0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.476973 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2593/5187] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:58.478271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772e93-ec1f-41d3-92eb-83d4779014bd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.478562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772e93-ec1f-41d3-92eb-83d4779014bd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.478891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772e93-ec1f-41d3-92eb-83d4779014bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.488305 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2595/5188] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:58.489971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f607b42-1c26-4a18-909b-ae1f70ac7ef2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.491366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f607b42-1c26-4a18-909b-ae1f70ac7ef2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.492066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f607b42-1c26-4a18-909b-ae1f70ac7ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.515541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-15772e93-ec1f-41d3-92eb-83d4779014bd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:58.517042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-15772e93-ec1f-41d3-92eb-83d4779014bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.527759 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2594/5189] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:58.529314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9904d-7287-443c-a7e1-858f840c81a3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.529838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9904d-7287-443c-a7e1-858f840c81a3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.530339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9904d-7287-443c-a7e1-858f840c81a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.533992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1f607b42-1c26-4a18-909b-ae1f70ac7ef2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:58.535255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1f607b42-1c26-4a18-909b-ae1f70ac7ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.551817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fbd9904d-7287-443c-a7e1-858f840c81a3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:58.553966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fbd9904d-7287-443c-a7e1-858f840c81a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:58.558934 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2596/5190] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:58.562439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f607b42-1c26-4a18-909b-ae1f70ac7ef2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.575375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2595/5191] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:58.580836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f607b42-1c26-4a18-909b-ae1f70ac7ef2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.581993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9904d-7287-443c-a7e1-858f840c81a3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.586714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.587514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.587868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.588226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.589233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:58.589608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.591329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.619108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9904d-7287-443c-a7e1-858f840c81a3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.633444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.634122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.634406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.634683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.635438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:58.635745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.637366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.644975 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2597/5192] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:58.644975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.654314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555bee5-5ed0-4e27-a390-de000934fac3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.665743 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2596/5193] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:58.665743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.671208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.671973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.672332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.672683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.673366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd3a48-0d7d-4d25-bd69-495b51e0d140 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.673558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:02:58.673939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.675768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.680888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.681872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.683090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.683436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.684477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.687475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.691393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2598/5194] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:02:58.692359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.705256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da0431-cfa8-4b90-bf00-4d0a3245d46e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.710671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.711340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.712009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.712009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.712814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.714986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.736570 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2597/5195] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:58.736570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.754817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2599/5196] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:58.755691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.826664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414f758-225b-4b21-badf-142131ea21dc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.829608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de48994-008b-4f66-80bc-ced84403206f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.831635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.832482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.832780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.833164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.833852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.836025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.836764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.836896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.837071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.837546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.838305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.840493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.870939 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2600/5197] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:58.872544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.879836 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2598/5198] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:58.881217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:58.889180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c3490-a96b-4319-999d-bca87838955c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.972087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.973041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.973332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.973784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.974400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d63673-b1ee-42af-9b05-7812cd367a15 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:58.974534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.977343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:58.982610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:58.983319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:58.983601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:58.983936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:58.984605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:58.986214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.000065 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2599/5199] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:59.000907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.013880 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2601/5200] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:58 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:59.016045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8fd40b-c650-4564-984f-cd85b81441d2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.017818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.022559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.023597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.024133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.024406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.025087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.027049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.030284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c696b-5f9f-4ee2-bf2f-189d1d89d26a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.035386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.039691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.039953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.040420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.041401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.045951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.052497 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2600/5201] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:59.053364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.058293 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2602/5202] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:59.064927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452f6e2-e25a-4ba6-80e1-3027014ab1ff admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.066971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.070716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.071672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.072373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.072862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.073796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.075724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.082581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263d6a-ef3e-4e96-9a4b-c895c0effd28 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.089952 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2601/5203] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:59.091170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.104304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ae8ff-b3b1-42ed-8e94-33a7e318283d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.105274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.107490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.107597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.108679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.109427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.111087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.112499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.113708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.114608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.116209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] PATH_INFO: `/v3/projects/5f15541c238b40a1a35562a3dd3a8cc6/users/f38a0e6feb4445c4932b6c205c4d81c5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.127838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2603/5204] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:59.128726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.142105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f15541c238b40a1a35562a3dd3a8cc6, user_id=f38a0e6feb4445c4932b6c205c4d81c5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.143985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376c2bd-3e8c-4b30-a316-160ea931d662 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.148372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.152544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.155225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.155519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.155801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.156750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.158392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.171318 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2604/5205] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:59.172202 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2602/5206] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:59 2022] PUT /identity/v3/projects/5f15541c238b40a1a35562a3dd3a8cc6/users/f38a0e6feb4445c4932b6c205c4d81c5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:59.175529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.175696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.191261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f0e78-c7bc-41f7-98a9-94b2cd49175d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.267061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608eda2-9017-4594-9771-a2f8d458abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.268111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608eda2-9017-4594-9771-a2f8d458abfb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.268454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608eda2-9017-4594-9771-a2f8d458abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.268805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608eda2-9017-4594-9771-a2f8d458abfb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.269607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608eda2-9017-4594-9771-a2f8d458abfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.271305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540535d1-3c3a-42dc-8157-3ab520348216 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.271513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608eda2-9017-4594-9771-a2f8d458abfb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.277136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.278102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.278456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.278831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] PATH_INFO: `/v3/projects/9efc1fbca3ab413fabfc108b752dd251/users/e1d72e319762436a9a2f8a69e5402bf6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.285813 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2605/5207] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:02:59.285813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7fffe-f1da-4e07-beec-4de4056708b8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.285813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7fffe-f1da-4e07-beec-4de4056708b8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.285813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7fffe-f1da-4e07-beec-4de4056708b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.321498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8cf7fffe-f1da-4e07-beec-4de4056708b8 None None] MFA Rules not processed for user `f38a0e6feb4445c4932b6c205c4d81c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:59.321967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efc1fbca3ab413fabfc108b752dd251, user_id=e1d72e319762436a9a2f8a69e5402bf6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.322731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8cf7fffe-f1da-4e07-beec-4de4056708b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:59.324727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.347016 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2603/5208] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:59 2022] PUT /identity/v3/projects/9efc1fbca3ab413fabfc108b752dd251/users/e1d72e319762436a9a2f8a69e5402bf6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:59.348737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.412083 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2606/5209] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:59.414310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c602a-f0a0-4647-a016-55be15296f20 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.414917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c602a-f0a0-4647-a016-55be15296f20 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.415359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c602a-f0a0-4647-a016-55be15296f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.457406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e66c602a-f0a0-4647-a016-55be15296f20 None None] MFA Rules not processed for user `e1d72e319762436a9a2f8a69e5402bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:59.459257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e66c602a-f0a0-4647-a016-55be15296f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:59.474469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ae057-6e86-4803-ab95-c952d5a79a76 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.480777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.481860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.482169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.482432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] PATH_INFO: `/v3/projects/2a5d57b941a64854991f5362a6ca472d/users/94ebbc9f79074e27a853c55b02dea4b8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.502667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5d57b941a64854991f5362a6ca472d, user_id=94ebbc9f79074e27a853c55b02dea4b8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.505690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.532075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2604/5210] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:02:59 2022] PUT /identity/v3/projects/2a5d57b941a64854991f5362a6ca472d/users/94ebbc9f79074e27a853c55b02dea4b8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:02:59.532850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.594157 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2607/5211] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:59.595494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867a0c-62ca-4dde-9962-9cc331d94b9d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.595783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867a0c-62ca-4dde-9962-9cc331d94b9d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.596059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84867a0c-62ca-4dde-9962-9cc331d94b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.634503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-84867a0c-62ca-4dde-9962-9cc331d94b9d None None] MFA Rules not processed for user `94ebbc9f79074e27a853c55b02dea4b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:02:59.635159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486a9d1-3561-4f09-b040-72c247dc8ca4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.635750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-84867a0c-62ca-4dde-9962-9cc331d94b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:59.641454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.642808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.642984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.643242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.644016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.646051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.689821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2605/5212] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:59.690878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.750545 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2608/5213] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:02:59.751642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867a0c-62ca-4dde-9962-9cc331d94b9d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.776180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84867a0c-62ca-4dde-9962-9cc331d94b9d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.818693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00726e8-90f6-47de-bf9c-b972b657d1df admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.824167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.824858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.825125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.825418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.826094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.828288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.861963 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2606/5214] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:59.862633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.862921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.863407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.863694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.863972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.864581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:02:59.864713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.867231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:02:59.891665 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2609/5215] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:02:59.892892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:02:59.904115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1cf5-2324-437f-bd4a-af357a96160e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.941984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71c01e-de18-48fb-9554-a8eec9252653 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:02:59.946120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.946806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.947081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.950204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.977043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:02:59.977814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:02:59.978263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:02:59.978700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:02:59.981528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:02:59.982440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.005519 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2610/5216] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:02:59 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:00.006482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.017342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.018971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.020712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02664-4836-4944-b235-af05ae59c620 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.027889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.028570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.028854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.029129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.029879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.031980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.036493 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2607/5217] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:02:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:00.037916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.053292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91425ec-3d4f-4d29-94d3-02f975b0bb34 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.058398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.059114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.059394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.059951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.060976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.061893 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2611/5218] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:00.062576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.067609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.076205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45774b9-265d-44a1-b5fc-3c499d9a79a7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.082815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2608/5219] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:00.083794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.086089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.087232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.091222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.091509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] PATH_INFO: `/v3/projects/691942ff0a25485791c91627dfe1d71e/users/5ab6178cb566472a9fbb3c33c3f55b39/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.097554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fa810-bd1c-4db9-89c7-75f60de77878 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.103060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.103934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.104219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.104496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] PATH_INFO: `/v3/users/94ebbc9f79074e27a853c55b02dea4b8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.105884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ebbc9f79074e27a853c55b02dea4b8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.108017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.113159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=691942ff0a25485791c91627dfe1d71e, user_id=5ab6178cb566472a9fbb3c33c3f55b39, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.117321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.138017 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2612/5220] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:00 2022] PUT /identity/v3/projects/691942ff0a25485791c91627dfe1d71e/users/5ab6178cb566472a9fbb3c33c3f55b39/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:00.138017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.171647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ebbc9f79074e27a853c55b02dea4b8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:00.172319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ebbc9f79074e27a853c55b02dea4b8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:00.182804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ebbc9f79074e27a853c55b02dea4b8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:00.183821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ebbc9f79074e27a853c55b02dea4b8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:00.202965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ebbc9f79074e27a853c55b02dea4b8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:00.238009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f6d0d-4fee-434e-bd90-9512ea552b7b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.243501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9176e5-1373-40c5-b185-d77df9c470f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.253705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9176e5-1373-40c5-b185-d77df9c470f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.253705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9176e5-1373-40c5-b185-d77df9c470f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.253705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9176e5-1373-40c5-b185-d77df9c470f5 admin admin] PATH_INFO: `/v3/projects/336202678c2c4f33a2e0397c2d458695/users/9763cfae50e5479f867479c18cb2d75d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.270248 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2609/5221] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:00 2022] DELETE /identity/v3/users/94ebbc9f79074e27a853c55b02dea4b8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:00.270248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.270248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:00.277350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9176e5-1373-40c5-b185-d77df9c470f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336202678c2c4f33a2e0397c2d458695, user_id=9763cfae50e5479f867479c18cb2d75d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.281676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9176e5-1373-40c5-b185-d77df9c470f5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.321563 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2613/5222] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:00 2022] PUT /identity/v3/projects/336202678c2c4f33a2e0397c2d458695/users/9763cfae50e5479f867479c18cb2d75d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:00.334448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.334448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.334448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.372497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:00.374419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:00.414827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160df2a-0f87-48dd-b74c-7716c7619cf0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.479818 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2614/5223] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:00.479818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.479818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:00.494330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8cc8-1fab-4f60-8d10-eb9c7d3aacce None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.501544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.502228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.502515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.502887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.503540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.505160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.518677 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2615/5224] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:00.518677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.519902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.520627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:00.520751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.521057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.521952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.522800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.524489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.535472 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2610/5225] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:00.536940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.550034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377be25-2b6c-476f-a80a-a3f540c22cb9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.555150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.556034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.556322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.556608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] PATH_INFO: `/v3/projects/336202678c2c4f33a2e0397c2d458695/users/9763cfae50e5479f867479c18cb2d75d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.558656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=336202678c2c4f33a2e0397c2d458695, user_id=9763cfae50e5479f867479c18cb2d75d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.563368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.592096 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2611/5226] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:00 2022] PUT /identity/v3/projects/336202678c2c4f33a2e0397c2d458695/users/9763cfae50e5479f867479c18cb2d75d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:00.592096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.614733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e164fec-eae7-40c8-aabf-d00a06c124a0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.666558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2d4a2-a943-474b-a629-31868c93e68f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.675709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d532713-1987-4c2e-991b-bfa57ffe1f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.676942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d532713-1987-4c2e-991b-bfa57ffe1f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.677418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d532713-1987-4c2e-991b-bfa57ffe1f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.677915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d532713-1987-4c2e-991b-bfa57ffe1f0c admin admin] PATH_INFO: `/v3/projects/691942ff0a25485791c91627dfe1d71e/users/5ab6178cb566472a9fbb3c33c3f55b39/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.680248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d532713-1987-4c2e-991b-bfa57ffe1f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=691942ff0a25485791c91627dfe1d71e, user_id=5ab6178cb566472a9fbb3c33c3f55b39, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.681843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6a255-4cbe-4440-bb11-602d42eeedfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.682503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a255-4cbe-4440-bb11-602d42eeedfb service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.682806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a255-4cbe-4440-bb11-602d42eeedfb service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.683096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6a255-4cbe-4440-bb11-602d42eeedfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.683946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d532713-1987-4c2e-991b-bfa57ffe1f0c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.695358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a255-4cbe-4440-bb11-602d42eeedfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.698493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6a255-4cbe-4440-bb11-602d42eeedfb service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.698967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2612/5227] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:00 2022] PUT /identity/v3/projects/691942ff0a25485791c91627dfe1d71e/users/5ab6178cb566472a9fbb3c33c3f55b39/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:00.700640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017def9-abc0-4283-9161-29de38c5996f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.701093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017def9-abc0-4283-9161-29de38c5996f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.701531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017def9-abc0-4283-9161-29de38c5996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.710663 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2616/5228] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:00.714731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6672e-11e9-4af7-a51b-839ea1455136 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.715113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6672e-11e9-4af7-a51b-839ea1455136 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.715706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6672e-11e9-4af7-a51b-839ea1455136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.734051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2017def9-abc0-4283-9161-29de38c5996f None None] MFA Rules not processed for user `9763cfae50e5479f867479c18cb2d75d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:00.737960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2017def9-abc0-4283-9161-29de38c5996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:00.763264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-edd6672e-11e9-4af7-a51b-839ea1455136 None None] MFA Rules not processed for user `5ab6178cb566472a9fbb3c33c3f55b39`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:00.764689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-edd6672e-11e9-4af7-a51b-839ea1455136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:00.863125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2613/5229] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:00.877303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017def9-abc0-4283-9161-29de38c5996f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.879533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2017def9-abc0-4283-9161-29de38c5996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:00.884414 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2617/5230] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:00.889048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6672e-11e9-4af7-a51b-839ea1455136 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.913122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6672e-11e9-4af7-a51b-839ea1455136 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.925840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.927354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.928559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.929020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.930598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:00.931904 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:03:00.931904 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:03:00.931904 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:03:00.933259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:00.960554 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2618/5231] 10.222.0.32 () {60 vars in 1184 bytes} [Sat May 7 22:03:00 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:00.964602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:00.989634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ec4d5-7568-4199-8590-d0795bf1855a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:00.997426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:00.998587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:00.998930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:00.999268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1f985739e2334467a29c466d141dad6d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:00.999938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=1f985739e2334467a29c466d141dad6d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.001092 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:03:01.001092 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:03:01.001092 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:03:01.001960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.011035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017def9-abc0-4283-9161-29de38c5996f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.011506 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2619/5232] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:03:00 2022] GET /identity/v3/OS-OAUTH1/consumers/1f985739e2334467a29c466d141dad6d => generated 220 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:01.015570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.020245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.024929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.025312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.025601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.029580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.037283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12597a3f-38d6-4c25-9811-ea937a4d8544 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.061364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.062436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.064651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.070516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1f985739e2334467a29c466d141dad6d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.071526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1f985739e2334467a29c466d141dad6d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.072747 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:03:01.072747 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:03:01.072747 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:03:01.073697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.073923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invalidating token cache because consumer 1f985739e2334467a29c466d141dad6d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:01.074204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.077662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.101078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1f985739e2334467a29c466d141dad6d', 'request_id': 'req-6b51de21-6403-45c4-a318-1569ceb4c58f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.124629 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2620/5233] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 22:03:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1f985739e2334467a29c466d141dad6d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:01.130607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.133765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.135047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.135453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.157652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51de21-6403-45c4-a318-1569ceb4c58f tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.161948 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2614/5234] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:01.164454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.165758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.165758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.166032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.166739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.168426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.190599 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2621/5235] 10.222.0.32 () {60 vars in 1184 bytes} [Sat May 7 22:03:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:01.192895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.212943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9c98b-4207-4172-8568-4ab8fffdaaf0 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.225416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.226443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.226736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.227231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.227872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a2bca9035b634fda9e54576dd1bded5d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.229037 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:03:01.229037 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:03:01.229037 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:03:01.229934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.245907 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2615/5236] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:03:01 2022] GET /identity/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d => generated 220 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:01.249014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.266032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.268253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.268980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d08938-7da2-4471-80b8-e644002458f1 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.280731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.281732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.282577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.282577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.282977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a2bca9035b634fda9e54576dd1bded5d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.284732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.284856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invalidating token cache because consumer a2bca9035b634fda9e54576dd1bded5d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:01.285230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.286607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.316004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a2bca9035b634fda9e54576dd1bded5d', 'request_id': 'req-ee4dd22e-2167-4954-9e61-6e283198734d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.340462 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2622/5237] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 22:03:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:01.341718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.345012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.372164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4dd22e-2167-4954-9e61-6e283198734d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.382038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.383572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.383871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.384668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.385344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a2bca9035b634fda9e54576dd1bded5d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.387540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.393719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb02e3b-2c01-4656-acfb-eddbd5bd110a tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.399701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.400642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.401727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.401886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] PATH_INFO: `/v3/projects/2a5d57b941a64854991f5362a6ca472d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.404569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5d57b941a64854991f5362a6ca472d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.408412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) May 07 22:03:01.416998 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found May 07 22:03:01.418926 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:03:01.424315 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2623/5238] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:03:01 2022] GET /identity/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d => generated 74 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 22:03:01.425220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.437910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a17a0-8f73-4cd1-b033-aa953aca7bf8 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.450915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.451764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.452046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.452380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.453035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a2bca9035b634fda9e54576dd1bded5d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.454947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.455216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invalidating token cache because consumer a2bca9035b634fda9e54576dd1bded5d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:01.455492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.456190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( May 07 22:03:01.485543 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:03:01.492138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2624/5239] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 22:03:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a2bca9035b634fda9e54576dd1bded5d => generated 74 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 22:03:01.493237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.494504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.510472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e5d37-e9f6-4ab8-a573-352d9447282e tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.516148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5d57b941a64854991f5362a6ca472d', 'request_id': 'req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.526444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5d57b941a64854991f5362a6ca472d', 'request_id': 'req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.546802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5d57b941a64854991f5362a6ca472d', 'request_id': 'req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.563515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] The token cache is being invalidate because project 2a5d57b941a64854991f5362a6ca472d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:01.563840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.565791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ed37c37e-bd58-4772-9e80-b6d5a552d3fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.571586 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2616/5240] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:01 2022] DELETE /identity/v3/projects/2a5d57b941a64854991f5362a6ca472d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:01.572891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88383927-2df1-40bd-ab57-ae58e44137a7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.573181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88383927-2df1-40bd-ab57-ae58e44137a7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.575037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88383927-2df1-40bd-ab57-ae58e44137a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.607437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-88383927-2df1-40bd-ab57-ae58e44137a7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:01.608906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88383927-2df1-40bd-ab57-ae58e44137a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.635309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.636040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.636410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.636594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.637369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.639181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.659177 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2625/5241] 10.222.0.32 () {60 vars in 1184 bytes} [Sat May 7 22:03:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:01.663703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.667023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.716685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89410ed8-0a7d-44be-8b12-f63331a3c131 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.723276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.724366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.725608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.726132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.727512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.729648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.730174 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2617/5242] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:01.731895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf4e1-f018-49e5-8e6b-7b748421e9a7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.732197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf4e1-f018-49e5-8e6b-7b748421e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.732478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf4e1-f018-49e5-8e6b-7b748421e9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.751476 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2626/5243] 10.222.0.32 () {60 vars in 1184 bytes} [Sat May 7 22:03:01 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:01.755475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.763093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-13caf4e1-f018-49e5-8e6b-7b748421e9a7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:01.764429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-13caf4e1-f018-49e5-8e6b-7b748421e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.773184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e28718-7590-40c4-8719-16a073d3e9cd tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.774791 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2618/5244] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:01.778831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caf4e1-f018-49e5-8e6b-7b748421e9a7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.782418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.783319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.783847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.784420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.785069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.786092 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:03:01.786092 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:03:01.786092 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:03:01.787100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.794309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caf4e1-f018-49e5-8e6b-7b748421e9a7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.798042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2627/5245] 10.222.0.32 () {58 vars in 1163 bytes} [Sat May 7 22:03:01 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:01.799204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.799357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.799952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.800190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.800418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.801141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:01.801439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.803467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.819621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f8b2a-9638-4ce4-9f2e-427857449824 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.825265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.826020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2619/5246] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:01.826462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.826856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.826985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.827197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d581ff86197c42b9b5c2bdece88400fa` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.827829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d581ff86197c42b9b5c2bdece88400fa)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.829410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.829684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invalidating token cache because consumer d581ff86197c42b9b5c2bdece88400fa has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:01.829994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.830683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.842378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48579487-9573-4bca-8ca7-cc53f4626160 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.847422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.848786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd581ff86197c42b9b5c2bdece88400fa', 'request_id': 'req-ab82abac-1d04-47d4-8839-c042639d4f91'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.849329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.850607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.851050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.851825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.853911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.868133 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2628/5247] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 22:03:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d581ff86197c42b9b5c2bdece88400fa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:01.871937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.873341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.888494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82abac-1d04-47d4-8839-c042639d4f91 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.890879 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2620/5248] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:01 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:01.895350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:01.899359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:01.969000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.969669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.970007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.970308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0739fd54720c4bb995e5d8192a9c07e3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.971037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0739fd54720c4bb995e5d8192a9c07e3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.972797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:01.973065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invalidating token cache because consumer 0739fd54720c4bb995e5d8192a9c07e3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:01.973349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.974009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.981094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37189fc2-3f77-41ba-96e9-df6212993dd5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:01.986083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:01.986760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:01.987070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:01.987354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:01.987563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0739fd54720c4bb995e5d8192a9c07e3', 'request_id': 'req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:01.988096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:01.990408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.007228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2629/5249] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 22:03:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0739fd54720c4bb995e5d8192a9c07e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:02.012169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.015521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:02.030330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b87ccd-1bf9-49e6-a5c8-10f29203c1b3 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.030741 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2621/5250] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:01 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:02.034789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.035429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.036083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.036507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.036786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.038200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:02.038337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.039936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.055146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358a422-6149-472d-891f-a52dfed6673f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.057042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2630/5251] 10.222.0.32 () {60 vars in 1184 bytes} [Sat May 7 22:03:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:02.062634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.064292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.065254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.065750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.066357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.067385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.069970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.081877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79bcef-9e99-44b5-823a-e22c48dcb52d tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.085259 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2622/5252] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:02.089383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.096025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.107110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.108660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.109030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/852f3cf1128e4feca34191d13cdc2785` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.109822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=852f3cf1128e4feca34191d13cdc2785)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.111193 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:03:02.111193 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:03:02.111193 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:03:02.112777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.115969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f7f0c-d5ab-417e-9f81-cb9b06e4008e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.125711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.126607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.127230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.127699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.135076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.135076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.150812 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2623/5253] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:03:02.152924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.159835 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2631/5254] 10.222.0.32 () {60 vars in 1284 bytes} [Sat May 7 22:03:02 2022] PATCH /identity/v3/OS-OAUTH1/consumers/852f3cf1128e4feca34191d13cdc2785 => generated 221 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:02.163545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba278da-eac3-4a83-8b2d-269ae0585035 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.163718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.168348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec160b5-ef97-4a2a-8a6e-5d5da57f20a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.169403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec160b5-ef97-4a2a-8a6e-5d5da57f20a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.169866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec160b5-ef97-4a2a-8a6e-5d5da57f20a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.170209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec160b5-ef97-4a2a-8a6e-5d5da57f20a7 admin admin] PATH_INFO: `/v3/projects/496d6c4436364effa7fa3e8577d05729/users/792c2071a6254c73920ca02fdfa4494b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.174296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521f88-f77b-47d7-b01f-a15fe628285b tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.179145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.179970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.180426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.180897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/852f3cf1128e4feca34191d13cdc2785` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.181769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=852f3cf1128e4feca34191d13cdc2785)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.183421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.186561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec160b5-ef97-4a2a-8a6e-5d5da57f20a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496d6c4436364effa7fa3e8577d05729, user_id=792c2071a6254c73920ca02fdfa4494b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.188518 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2632/5255] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:03:02 2022] GET /identity/v3/OS-OAUTH1/consumers/852f3cf1128e4feca34191d13cdc2785 => generated 221 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:02.192325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec160b5-ef97-4a2a-8a6e-5d5da57f20a7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.192540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.206170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b987f69-7450-4f9f-8495-39cc3fde6302 tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.214811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2624/5256] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:02 2022] PUT /identity/v3/projects/496d6c4436364effa7fa3e8577d05729/users/792c2071a6254c73920ca02fdfa4494b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:02.225071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.225367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.225647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.260096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] MFA Rules not processed for user `792c2071a6254c73920ca02fdfa4494b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:02.261575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:02.272534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ab6178cb566472a9fbb3c33c3f55b39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '691942ff0a25485791c91627dfe1d71e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.273818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.274317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.274861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/852f3cf1128e4feca34191d13cdc2785` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.277279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=852f3cf1128e4feca34191d13cdc2785)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.279352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.279681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invalidating token cache because consumer 852f3cf1128e4feca34191d13cdc2785 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:02.279944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.280740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.296308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '852f3cf1128e4feca34191d13cdc2785', 'request_id': 'req-b4933de1-760f-411e-9764-8b482304665c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.323596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2633/5257] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 22:03:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/852f3cf1128e4feca34191d13cdc2785 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:02.329136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.330593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:02.354818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2625/5258] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:02.367425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.368911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:02.415023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4933de1-760f-411e-9764-8b482304665c tempest-OAUTHConsumersV3Test-886534165 tempest-OAUTHConsumersV3Test-886534165-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.418708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.419657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.419882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.420146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] PATH_INFO: `/v3/users/f38a0e6feb4445c4932b6c205c4d81c5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.421380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38a0e6feb4445c4932b6c205c4d81c5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.423370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.431368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53060974-ad8b-4613-8c5d-5e40329b998a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.434950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd23e0-5900-49c3-a0c4-042d0fb48477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.435586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd23e0-5900-49c3-a0c4-042d0fb48477 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.436227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd23e0-5900-49c3-a0c4-042d0fb48477 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.436510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd23e0-5900-49c3-a0c4-042d0fb48477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.445543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd23e0-5900-49c3-a0c4-042d0fb48477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.447032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd23e0-5900-49c3-a0c4-042d0fb48477 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.456898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2626/5259] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:03:02.469160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38a0e6feb4445c4932b6c205c4d81c5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.475867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38a0e6feb4445c4932b6c205c4d81c5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.476659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38a0e6feb4445c4932b6c205c4d81c5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.477290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38a0e6feb4445c4932b6c205c4d81c5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.484886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38a0e6feb4445c4932b6c205c4d81c5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:02.502228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2634/5260] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:02 2022] DELETE /identity/v3/users/f38a0e6feb4445c4932b6c205c4d81c5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:02.507342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.507710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.508058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.526280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:02.527506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:02.584490 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2627/5261] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:02.594368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:02.595873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:02.654493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c6d3d-11b3-4b48-b503-bf7dc844b7e8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:02.658755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:02.659524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:02.659816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:02.660103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:02.670559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:02.672052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:02.683112 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2635/5262] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:03.017055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:03.018562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:03.042182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429e291-24b3-489b-8caa-7663b0aa9dd3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:03.058676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:03.059594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:03.059880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:03.060158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] PATH_INFO: `/v3/projects/5f15541c238b40a1a35562a3dd3a8cc6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:03.061911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f15541c238b40a1a35562a3dd3a8cc6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:03.064107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:03.122078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f15541c238b40a1a35562a3dd3a8cc6', 'request_id': 'req-45fcdd06-41c6-47eb-bea2-508bcad346da'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.134872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f15541c238b40a1a35562a3dd3a8cc6', 'request_id': 'req-45fcdd06-41c6-47eb-bea2-508bcad346da'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.145351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f15541c238b40a1a35562a3dd3a8cc6', 'request_id': 'req-45fcdd06-41c6-47eb-bea2-508bcad346da'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.157769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] The token cache is being invalidate because project 5f15541c238b40a1a35562a3dd3a8cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:03.158140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.158902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.160573 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2628/5263] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:03 2022] DELETE /identity/v3/projects/5f15541c238b40a1a35562a3dd3a8cc6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:03.165498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:03.179700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f234c-c8d5-4676-bacf-5569686bcf63 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:03.255611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:03.257108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:03.257391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:03.257981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] PATH_INFO: `/v3/users/5ab6178cb566472a9fbb3c33c3f55b39` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:03.259441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab6178cb566472a9fbb3c33c3f55b39)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:03.261395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:03.314662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab6178cb566472a9fbb3c33c3f55b39'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.323382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab6178cb566472a9fbb3c33c3f55b39'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.324002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab6178cb566472a9fbb3c33c3f55b39'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.324683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab6178cb566472a9fbb3c33c3f55b39'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.332508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89b131d0-555d-46af-ba08-e861a9984d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab6178cb566472a9fbb3c33c3f55b39'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.349878 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2636/5264] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:03 2022] DELETE /identity/v3/users/5ab6178cb566472a9fbb3c33c3f55b39 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:03.659217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:03.660857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:03.679911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcdd06-41c6-47eb-bea2-508bcad346da admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:03.746341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:03.747285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:03.747571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:03.747849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] PATH_INFO: `/v3/projects/691942ff0a25485791c91627dfe1d71e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:03.749096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691942ff0a25485791c91627dfe1d71e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:03.751096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:03.800578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691942ff0a25485791c91627dfe1d71e', 'request_id': 'req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.807415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691942ff0a25485791c91627dfe1d71e', 'request_id': 'req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.821268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691942ff0a25485791c91627dfe1d71e', 'request_id': 'req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.834507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] The token cache is being invalidate because project 691942ff0a25485791c91627dfe1d71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:03.834905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.835485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fba1d9a2-f707-4ea3-abb4-43baa1c8b604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:03.837057 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2629/5265] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:03 2022] DELETE /identity/v3/projects/691942ff0a25485791c91627dfe1d71e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:03.844431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21b77-24b1-41a2-a738-f7d815b0c8a1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:03.845331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21b77-24b1-41a2-a738-f7d815b0c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:03.845946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd21b77-24b1-41a2-a738-f7d815b0c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:03.873000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7fd21b77-24b1-41a2-a738-f7d815b0c8a1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:03.875055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7fd21b77-24b1-41a2-a738-f7d815b0c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:03.990819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2637/5266] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:03.995923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27167-fb6e-4977-a21b-5b8af57857ec None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:03.996281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27167-fb6e-4977-a21b-5b8af57857ec None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:03.996551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a27167-fb6e-4977-a21b-5b8af57857ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.016310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-42a27167-fb6e-4977-a21b-5b8af57857ec None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:04.017654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-42a27167-fb6e-4977-a21b-5b8af57857ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:04.028083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2630/5267] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:04.032620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21b77-24b1-41a2-a738-f7d815b0c8a1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.045467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd21b77-24b1-41a2-a738-f7d815b0c8a1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.061864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.062566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.062897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.063147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.063880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:04.064188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.065885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.082826 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2638/5268] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:04.087485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a27167-fb6e-4977-a21b-5b8af57857ec None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.097299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a27167-fb6e-4977-a21b-5b8af57857ec None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.104279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.105230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.105693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.106148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.107058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.109098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.144407 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2631/5269] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:04 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:04.149283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.160817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699acb3-93e4-4a3a-bc2e-01dfeb6cddc0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.222391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.223211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.223584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.223976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.225310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.227486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.250804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2639/5270] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:04 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:04.253463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.265307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302fa6a-78d6-48b5-8631-cacb36bb7ef4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.272247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.272996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.273398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.273751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.274545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.276419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.302001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2632/5271] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:04.309613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.320949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb266390-7fbf-40da-9ba0-35ce8474e90e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.326817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a8a51-2b03-47c5-a192-043f55753993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.328355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8a51-2b03-47c5-a192-043f55753993 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.328646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8a51-2b03-47c5-a192-043f55753993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.328920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a8a51-2b03-47c5-a192-043f55753993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.329693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8a51-2b03-47c5-a192-043f55753993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.331474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a8a51-2b03-47c5-a192-043f55753993 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.346391 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2640/5272] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:04.350669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.361460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f14d3-dcdc-4181-a7b7-562c91a6266e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.367796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.369075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.369885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.370399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] PATH_INFO: `/v3/projects/9981cf6c1fb94e9cb5c6201f5f029e72/users/49226aacc969454490f463ec0d32fbe6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.389190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9981cf6c1fb94e9cb5c6201f5f029e72, user_id=49226aacc969454490f463ec0d32fbe6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.392101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.408094 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2633/5273] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:04 2022] PUT /identity/v3/projects/9981cf6c1fb94e9cb5c6201f5f029e72/users/49226aacc969454490f463ec0d32fbe6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:04.491215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5b8f-cdb4-4b80-8b42-f6daee2c22bb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.491607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5b8f-cdb4-4b80-8b42-f6daee2c22bb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.492082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab5b8f-cdb4-4b80-8b42-f6daee2c22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.523811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-44ab5b8f-cdb4-4b80-8b42-f6daee2c22bb None None] MFA Rules not processed for user `49226aacc969454490f463ec0d32fbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:04.525251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-44ab5b8f-cdb4-4b80-8b42-f6daee2c22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:04.599849 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2641/5274] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:04.611774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.613502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:04.671614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f3176-2ee8-4535-99cf-700da7574bc2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.675497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.676145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.676462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.676741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.685613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.687391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.696647 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2634/5275] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:04.794154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f415f0-db65-492b-88ee-974def2a876f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.794443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f415f0-db65-492b-88ee-974def2a876f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.794727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f415f0-db65-492b-88ee-974def2a876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.815652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-83f415f0-db65-492b-88ee-974def2a876f None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:04.816847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-83f415f0-db65-492b-88ee-974def2a876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:04.871139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2642/5276] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:03:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:04.883995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:04.885359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:04.953317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcede0-3d5b-45ff-bdc5-d1043bd5e5d0 service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:04.958355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:04.959046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:04.959329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:04.959603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:04.967860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:04.969519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:04.977991 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2635/5277] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:05.404261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96e97d-413e-4760-8bc9-cf340deeb88e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:05.404799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96e97d-413e-4760-8bc9-cf340deeb88e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:05.404911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96e97d-413e-4760-8bc9-cf340deeb88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:05.425634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1a96e97d-413e-4760-8bc9-cf340deeb88e None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:05.426913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1a96e97d-413e-4760-8bc9-cf340deeb88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:05.436555 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2643/5278] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:03:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:05.450870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:05.465596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ea3e-f070-404f-9221-15b18885ea70 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:05.471089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:05.471745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:05.472031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:05.472312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:05.481905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:05.483613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:05.493818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2636/5279] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:06.024997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997857-d77f-4b89-bacf-784f47bcdfb0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:06.025287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997857-d77f-4b89-bacf-784f47bcdfb0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:06.025761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997857-d77f-4b89-bacf-784f47bcdfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:06.059991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9c997857-d77f-4b89-bacf-784f47bcdfb0 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:06.059991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9c997857-d77f-4b89-bacf-784f47bcdfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:06.074968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2644/5280] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:03:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:06.088456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:06.106828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e313c-ceee-4d91-9738-448f2e3b90da service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:06.114752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:06.116660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:06.117019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:06.117575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:06.135991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:06.138851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:06.151970 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2637/5281] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:06.361993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c544-073e-4309-8841-ca43fa4b69d7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:06.362314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c544-073e-4309-8841-ca43fa4b69d7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:06.362596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c544-073e-4309-8841-ca43fa4b69d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:06.381361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5f41c544-073e-4309-8841-ca43fa4b69d7 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:06.382547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5f41c544-073e-4309-8841-ca43fa4b69d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:06.389894 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2645/5282] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:03:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:06.402710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:06.415506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d273f-4fb6-47b5-99d9-399c2608cb1c service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:06.421525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:06.422243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:06.422599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:06.422976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:06.432708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:06.434310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:06.443780 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2638/5283] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:06.736158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf97f2-4b80-4d3c-ade0-a13a6fda2928 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:06.736625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf97f2-4b80-4d3c-ade0-a13a6fda2928 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:06.736731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf97f2-4b80-4d3c-ade0-a13a6fda2928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:06.754450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-60cf97f2-4b80-4d3c-ade0-a13a6fda2928 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:06.755794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60cf97f2-4b80-4d3c-ade0-a13a6fda2928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:06.763190 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2646/5284] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:03:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:06.775752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:06.788825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624eeef7-e4f0-4e2c-9304-542266f9f25a service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:06.794085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:06.794750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:06.795166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:06.795473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:06.804136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:06.805836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:06.814672 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2639/5285] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:07.054068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5b9b6-8ca6-4cc1-a840-c04cbfa63580 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:07.054694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5b9b6-8ca6-4cc1-a840-c04cbfa63580 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:07.055018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5b9b6-8ca6-4cc1-a840-c04cbfa63580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:07.094507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-37b5b9b6-8ca6-4cc1-a840-c04cbfa63580 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:07.095756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-37b5b9b6-8ca6-4cc1-a840-c04cbfa63580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:07.103917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2647/5286] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:07.117281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:07.131180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a809c-f1ad-494e-8f1c-e59442df6190 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:07.137084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6969e6-706e-4916-998d-2ea6e9f9e301 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:07.137924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6969e6-706e-4916-998d-2ea6e9f9e301 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:07.138300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6969e6-706e-4916-998d-2ea6e9f9e301 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:07.138671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6969e6-706e-4916-998d-2ea6e9f9e301 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:07.149426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6969e6-706e-4916-998d-2ea6e9f9e301 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:07.151197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6969e6-706e-4916-998d-2ea6e9f9e301 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:07.160479 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2640/5287] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:07.343353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5b9b6-8ca6-4cc1-a840-c04cbfa63580 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:07.421630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5b9b6-8ca6-4cc1-a840-c04cbfa63580 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:07.426891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:07.427827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:07.428262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:07.428538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] PATH_INFO: `/v3/users/49226aacc969454490f463ec0d32fbe6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:07.429749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49226aacc969454490f463ec0d32fbe6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:07.431944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:07.480016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49226aacc969454490f463ec0d32fbe6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:07.488863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49226aacc969454490f463ec0d32fbe6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:07.489525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49226aacc969454490f463ec0d32fbe6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:07.490846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49226aacc969454490f463ec0d32fbe6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:07.501712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49226aacc969454490f463ec0d32fbe6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:07.537084 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2648/5288] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:07 2022] DELETE /identity/v3/users/49226aacc969454490f463ec0d32fbe6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:07.541221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:07.541515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:07.541872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:07.599869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:07.601172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:07.777216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2641/5289] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:07.787852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:07.789314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:07.866032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68afd0-9342-4a6d-863a-74ec8c8712e6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:07.869936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fead8e1-112a-4645-b283-8dbdb14ce1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:07.870635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fead8e1-112a-4645-b283-8dbdb14ce1df service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:07.870983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fead8e1-112a-4645-b283-8dbdb14ce1df service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:07.871300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fead8e1-112a-4645-b283-8dbdb14ce1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:07.883335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fead8e1-112a-4645-b283-8dbdb14ce1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:07.885232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fead8e1-112a-4645-b283-8dbdb14ce1df service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:07.904677 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2649/5290] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:08.483983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:08.486610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:08.508538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce74cd-a9b1-48fa-8300-26395392cc45 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:08.522508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:08.523715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:08.525883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:08.526422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] PATH_INFO: `/v3/users/a8eb802dd28d4b3696d33a882edb6c6e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:08.529511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:08.530004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:08.530344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8eb802dd28d4b3696d33a882edb6c6e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:08.530673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:08.535848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:08.556382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:08.559281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:08.659714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8eb802dd28d4b3696d33a882edb6c6e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.660608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8eb802dd28d4b3696d33a882edb6c6e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.671336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8eb802dd28d4b3696d33a882edb6c6e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.672179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8eb802dd28d4b3696d33a882edb6c6e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.680814 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2650/5291] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:03:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:08.681919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:08.682967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8eb802dd28d4b3696d33a882edb6c6e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.683792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:08.707602 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2642/5292] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:08 2022] DELETE /identity/v3/users/a8eb802dd28d4b3696d33a882edb6c6e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:08.711115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:08.711269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22c068-5c6d-45c1-ad43-814cbfd80fc8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:08.711491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:08.795563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:08.796076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fed5f-be05-4e9d-9c10-01adc93c936e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:08.796438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:08.796720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:08.797001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] PATH_INFO: `/v3/projects/9981cf6c1fb94e9cb5c6201f5f029e72` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:08.799928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9981cf6c1fb94e9cb5c6201f5f029e72)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:08.800960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17addca0-8a19-4410-88ee-898e57c08123 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:08.801603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17addca0-8a19-4410-88ee-898e57c08123 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:08.801885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17addca0-8a19-4410-88ee-898e57c08123 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:08.802421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17addca0-8a19-4410-88ee-898e57c08123 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:08.804564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:08.872643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17addca0-8a19-4410-88ee-898e57c08123 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:08.874535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17addca0-8a19-4410-88ee-898e57c08123 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:08.884295 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2643/5293] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:08.894602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:08.895105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:08.895539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:08.899571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9981cf6c1fb94e9cb5c6201f5f029e72', 'request_id': 'req-940ed440-1160-43d2-9236-9db6a85869ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.913179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9981cf6c1fb94e9cb5c6201f5f029e72', 'request_id': 'req-940ed440-1160-43d2-9236-9db6a85869ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.915573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:08.917174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:08.933049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9981cf6c1fb94e9cb5c6201f5f029e72', 'request_id': 'req-940ed440-1160-43d2-9236-9db6a85869ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.955266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] The token cache is being invalidate because project 9981cf6c1fb94e9cb5c6201f5f029e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:08.955572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.960496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-940ed440-1160-43d2-9236-9db6a85869ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:08.966647 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2651/5294] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:08 2022] DELETE /identity/v3/projects/9981cf6c1fb94e9cb5c6201f5f029e72 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:08.971689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164abc7-4d3d-4bba-8f01-12d89ce3197d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:08.972176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164abc7-4d3d-4bba-8f01-12d89ce3197d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:08.972626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164abc7-4d3d-4bba-8f01-12d89ce3197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:08.991569 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2644/5295] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:09.013413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.014356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f164abc7-4d3d-4bba-8f01-12d89ce3197d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:09.015520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:09.015845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f164abc7-4d3d-4bba-8f01-12d89ce3197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:09.050630 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2652/5296] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:09.063288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e17e-fe8a-44e0-a91e-2e77d912f9d6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.063766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e17e-fe8a-44e0-a91e-2e77d912f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.064439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8e17e-fe8a-44e0-a91e-2e77d912f9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.091807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd25c5-e16a-4c6d-99d0-368b196f8ea0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:09.094846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f5c8e17e-fe8a-44e0-a91e-2e77d912f9d6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:09.096160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:09.096570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f5c8e17e-fe8a-44e0-a91e-2e77d912f9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:09.097047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.097335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.097612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.106523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2653/5297] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:09.109168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:09.110808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:09.111257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8e17e-fe8a-44e0-a91e-2e77d912f9d6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.122863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8e17e-fe8a-44e0-a91e-2e77d912f9d6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:09.127589 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2645/5298] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:09.128928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:09.129807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.130265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.130832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.131767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:09.132301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:09.134172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:09.149803 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2654/5299] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:09.154278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.168334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b73364-0866-43c6-9676-0982c3771d77 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:09.183424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:09.184294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.184739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.185208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.187659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:09.205149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:09.264977 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2646/5300] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:09 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:09.269577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.286971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe24817-1907-4e7d-90f1-5eaea910e373 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:09.398444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:09.399744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.400243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.400712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.401587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:09.403868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:09.445617 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2655/5301] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:09 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:03:09.447012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.461228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844dba5-3781-4dbd-84be-4510e8c5059c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:09.475825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:09.476663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.476959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.477237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.477974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:09.479641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:09.515408 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2647/5302] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:09.519654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.533161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548a70a-5a43-46ea-889f-23dd61c0624f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:09.548248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f23d6c-27e2-4855-809e-46c13a48d1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:09.549313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23d6c-27e2-4855-809e-46c13a48d1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.549800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23d6c-27e2-4855-809e-46c13a48d1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.550250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f23d6c-27e2-4855-809e-46c13a48d1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.551718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23d6c-27e2-4855-809e-46c13a48d1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:09.552992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f23d6c-27e2-4855-809e-46c13a48d1e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:09.590074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.597218 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2656/5303] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:09.605549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e2e5d-42dc-4fd3-84ba-134d9ee310d7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:09.626227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:09.627956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.628455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.628947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] PATH_INFO: `/v3/projects/44c32bd640f04a509f928a0008e27f03/users/1bbd3976a3c9408eba1845f2039f7a2e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.664142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c32bd640f04a509f928a0008e27f03, user_id=1bbd3976a3c9408eba1845f2039f7a2e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:09.666881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:09.697363 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2648/5304] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:09 2022] PUT /identity/v3/projects/44c32bd640f04a509f928a0008e27f03/users/1bbd3976a3c9408eba1845f2039f7a2e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:09.710155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3d4f4-483f-49a3-96b9-d66b2b2a69ab None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:09.710486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3d4f4-483f-49a3-96b9-d66b2b2a69ab None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:09.710725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3d4f4-483f-49a3-96b9-d66b2b2a69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:09.764986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-87d3d4f4-483f-49a3-96b9-d66b2b2a69ab None None] MFA Rules not processed for user `1bbd3976a3c9408eba1845f2039f7a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:09.767823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-87d3d4f4-483f-49a3-96b9-d66b2b2a69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:09.866637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:09.868468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:09.978758 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2657/5305] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:09.984031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3d4f4-483f-49a3-96b9-d66b2b2a69ab None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.025038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685125f-1873-4814-b996-6531d71eb83d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.069669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.070905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.071368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.073152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] PATH_INFO: `/v3/projects/6c27fff94315415da226f59a0c9de354` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.074942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c27fff94315415da226f59a0c9de354)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.080808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.204414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3d4f4-483f-49a3-96b9-d66b2b2a69ab None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.230469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.231182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.231469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.231748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.232446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.234396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.261500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c27fff94315415da226f59a0c9de354', 'request_id': 'req-1a0d4f9d-baf4-4613-b51a-15195944bc7f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:10.278576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c27fff94315415da226f59a0c9de354', 'request_id': 'req-1a0d4f9d-baf4-4613-b51a-15195944bc7f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:10.304290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c27fff94315415da226f59a0c9de354', 'request_id': 'req-1a0d4f9d-baf4-4613-b51a-15195944bc7f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:10.326678 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2658/5306] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:09 2022] POST /identity/v3/projects => generated 383 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:03:10.330734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.334418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] The token cache is being invalidate because project 6c27fff94315415da226f59a0c9de354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:10.334979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:10.336405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a0d4f9d-baf4-4613-b51a-15195944bc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:10.341442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2649/5307] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:09 2022] DELETE /identity/v3/projects/6c27fff94315415da226f59a0c9de354 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:10.345947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dc864-dce2-4a6d-bec8-9f44af675f99 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.346466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dc864-dce2-4a6d-bec8-9f44af675f99 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.346968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dc864-dce2-4a6d-bec8-9f44af675f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.387344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a36dc864-dce2-4a6d-bec8-9f44af675f99 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:10.388874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a36dc864-dce2-4a6d-bec8-9f44af675f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:10.473426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df4c0a-957e-47e4-9dc0-7d2e2b0aa1bc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.514046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.515137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.515661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.517876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.518860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.521046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.562414 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2650/5308] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:10.580828 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2659/5309] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:10 2022] POST /identity/v3/users => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:10.581051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0326a-c2ea-49ec-b2b8-2304603546d2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.581051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0326a-c2ea-49ec-b2b8-2304603546d2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.581051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0326a-c2ea-49ec-b2b8-2304603546d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.582136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.583972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:10.602529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0fac-ba6b-45fd-8925-f45c52a18ef6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.621231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.621925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.622801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-29e0326a-c2ea-49ec-b2b8-2304603546d2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:10.624516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-29e0326a-c2ea-49ec-b2b8-2304603546d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:10.624699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.625021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.625784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.631073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.658001 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2660/5310] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:10.658548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2651/5311] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:10.662549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.663317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0326a-c2ea-49ec-b2b8-2304603546d2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.675992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0326a-c2ea-49ec-b2b8-2304603546d2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.676436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f974e-d616-4a47-a21c-d67c985136d7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.682879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.683347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.684413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.684782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.685071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.685855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.686266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:10.686542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.686663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.687150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] PATH_INFO: `/v3/projects/26bf977e64b54d31b0bcc6f124260d83/users/e845cffa600a49959c936ad5379c043a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.688808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.703958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2652/5312] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:10.707769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.720606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538beb-cd58-4943-a3c9-a85122a502bc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.727300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.728184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.728542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.728899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.729912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.732166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.732826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bf977e64b54d31b0bcc6f124260d83, user_id=e845cffa600a49959c936ad5379c043a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.736706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.760606 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2661/5313] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:10 2022] PUT /identity/v3/projects/26bf977e64b54d31b0bcc6f124260d83/users/e845cffa600a49959c936ad5379c043a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:10.765881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.776321 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2653/5314] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:10 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:10.816505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.860282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8acd4-27b0-4c3d-ae76-b01b7902e017 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.961751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.962508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.962914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.963262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.964117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:10.965041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc4714-013a-4b07-8e75-f220c4051090 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:10.966139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:10.985358 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2662/5315] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:10.987980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:10.988759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:10.989015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:10.989159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:10.989309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:10.990050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:11.001642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:11.004942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e90eb-d4f3-4189-89f1-611dff6749ba admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:11.027208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b5f41-bc23-4a9a-a44b-4222ca9a4290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:11.029299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b5f41-bc23-4a9a-a44b-4222ca9a4290 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.030187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b5f41-bc23-4a9a-a44b-4222ca9a4290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.030979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b5f41-bc23-4a9a-a44b-4222ca9a4290 admin admin] PATH_INFO: `/v3/projects/26bf977e64b54d31b0bcc6f124260d83/users/e845cffa600a49959c936ad5379c043a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.034053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b5f41-bc23-4a9a-a44b-4222ca9a4290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bf977e64b54d31b0bcc6f124260d83, user_id=e845cffa600a49959c936ad5379c043a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:11.045994 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2654/5316] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:10 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:11.046252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b5f41-bc23-4a9a-a44b-4222ca9a4290 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:11.047663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:11.057321 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2663/5317] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:10 2022] PUT /identity/v3/projects/26bf977e64b54d31b0bcc6f124260d83/users/e845cffa600a49959c936ad5379c043a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:11.068992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.069429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb35d-e8fa-48d7-9cde-436ac746f346 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:11.069575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.069944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.120754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] MFA Rules not processed for user `e845cffa600a49959c936ad5379c043a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:11.121964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:11.199876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:11.200508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.200790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.201587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.202904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:11.211020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:11.230122 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2655/5318] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:11.232077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:11.240634 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2664/5319] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:11.244266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaffe4f-c4f8-4616-9770-d960e44cd3ab admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:11.249757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:11.251246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:11.251420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:11.252675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.253159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.253611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.254495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:11.259508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:11.284915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2656/5320] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:11.286428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:11.297969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0872d3-c851-4393-9928-9da353ca1ee1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:11.310959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d4615-cdba-47c5-b316-e564f652706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:11.312150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d4615-cdba-47c5-b316-e564f652706a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.312625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d4615-cdba-47c5-b316-e564f652706a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.313080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d4615-cdba-47c5-b316-e564f652706a admin admin] PATH_INFO: `/v3/projects/8cdcd8ea83db42c996b9c0cb8bac89aa/users/e6abaee58e2540e090b6f53b6f6ef587/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.333433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d4615-cdba-47c5-b316-e564f652706a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cdcd8ea83db42c996b9c0cb8bac89aa, user_id=e6abaee58e2540e090b6f53b6f6ef587, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:11.337661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d4615-cdba-47c5-b316-e564f652706a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:11.343632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334d33a-c967-464d-9d8e-eae1fbe6b23a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:11.348500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:11.349372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.349664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.350071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.352004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:11.358937 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2657/5321] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:11 2022] PUT /identity/v3/projects/8cdcd8ea83db42c996b9c0cb8bac89aa/users/e6abaee58e2540e090b6f53b6f6ef587/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:11.363139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5909ae-063e-403e-8045-39a2a0c7d793 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.363744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5909ae-063e-403e-8045-39a2a0c7d793 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.363744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5909ae-063e-403e-8045-39a2a0c7d793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.384761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ea5909ae-063e-403e-8045-39a2a0c7d793 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:11.386051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea5909ae-063e-403e-8045-39a2a0c7d793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:11.501219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:11.504853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:11.524468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2665/5322] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:11.538847 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2658/5323] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:11.547126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:11.548967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:11.563645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eab0de-da6c-4c2f-94ec-b49c6338278f service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:11.709233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e596df-9847-4b70-8398-8d2077094e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:11.710434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e596df-9847-4b70-8398-8d2077094e8d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:11.710710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e596df-9847-4b70-8398-8d2077094e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:11.711156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e596df-9847-4b70-8398-8d2077094e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:11.723714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e596df-9847-4b70-8398-8d2077094e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:11.725886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e596df-9847-4b70-8398-8d2077094e8d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:11.750887 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2666/5324] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:12.123516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5909ae-063e-403e-8045-39a2a0c7d793 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:12.145069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5909ae-063e-403e-8045-39a2a0c7d793 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:12.157084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c69898-851e-493c-a7d3-8ba047a75d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:12.157839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69898-851e-493c-a7d3-8ba047a75d50 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:12.158067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69898-851e-493c-a7d3-8ba047a75d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:12.158347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c69898-851e-493c-a7d3-8ba047a75d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:12.335539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c69898-851e-493c-a7d3-8ba047a75d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:12.350792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c69898-851e-493c-a7d3-8ba047a75d50 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:12.374262 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2659/5325] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:12.918428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:12.919140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:12.919140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:12.977027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:12.978269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:13.164734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2667/5326] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:13.165580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:13.166074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:13.166194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:13.212802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:13.214048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:13.232614 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2660/5327] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:13.426654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:13.428777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:13.591483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb096fe9-3d93-4b44-8a09-92292a02f1e7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:13.600599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f19f-0b1e-4b4d-80a0-004d78e9da4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:13.601475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f19f-0b1e-4b4d-80a0-004d78e9da4b service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:13.601866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f19f-0b1e-4b4d-80a0-004d78e9da4b service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:13.602247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f19f-0b1e-4b4d-80a0-004d78e9da4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:13.616709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f19f-0b1e-4b4d-80a0-004d78e9da4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:13.619062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f19f-0b1e-4b4d-80a0-004d78e9da4b service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:13.675394 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2668/5328] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:14.578464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:14.580726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:14.608194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3ce08-2bcf-43be-ba44-63123ce47a97 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:14.620284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:14.621178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:14.621521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:14.621745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] PATH_INFO: `/v3/users/792c2071a6254c73920ca02fdfa4494b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:14.627127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=792c2071a6254c73920ca02fdfa4494b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:14.629183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:14.723281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792c2071a6254c73920ca02fdfa4494b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:14.725551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792c2071a6254c73920ca02fdfa4494b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:14.736692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792c2071a6254c73920ca02fdfa4494b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:14.737542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792c2071a6254c73920ca02fdfa4494b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:14.749613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792c2071a6254c73920ca02fdfa4494b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:14.799971 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2661/5329] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:14 2022] DELETE /identity/v3/users/792c2071a6254c73920ca02fdfa4494b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:14.804496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:14.805081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:14.805081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:14.839352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:14.840505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:14.971283 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2669/5330] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:14.983937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:14.986272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:15.116351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc5331-3b0c-4258-b1c8-c5953a20be5f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:15.120453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff88dc-8c5c-4f8f-a352-8142a9f24ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:15.121897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff88dc-8c5c-4f8f-a352-8142a9f24ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:15.122243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff88dc-8c5c-4f8f-a352-8142a9f24ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:15.122722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff88dc-8c5c-4f8f-a352-8142a9f24ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:15.135063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff88dc-8c5c-4f8f-a352-8142a9f24ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:15.137279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff88dc-8c5c-4f8f-a352-8142a9f24ae1 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:15.148916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2662/5331] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:15.795030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:15.796640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:15.845228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737fb2c-e52c-440e-8cbd-e4c88cb90459 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:15.858829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:15.859866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:15.860253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:15.860621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] PATH_INFO: `/v3/projects/496d6c4436364effa7fa3e8577d05729` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:15.863715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496d6c4436364effa7fa3e8577d05729)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:15.866195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:15.990879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496d6c4436364effa7fa3e8577d05729', 'request_id': 'req-c7b00074-ee89-48ed-b272-ac563ab7cd93'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:15.999284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496d6c4436364effa7fa3e8577d05729', 'request_id': 'req-c7b00074-ee89-48ed-b272-ac563ab7cd93'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:16.020814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496d6c4436364effa7fa3e8577d05729', 'request_id': 'req-c7b00074-ee89-48ed-b272-ac563ab7cd93'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:16.039974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] The token cache is being invalidate because project 496d6c4436364effa7fa3e8577d05729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:16.040552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:16.041845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7b00074-ee89-48ed-b272-ac563ab7cd93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:16.043735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2670/5332] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:15 2022] DELETE /identity/v3/projects/496d6c4436364effa7fa3e8577d05729 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:16.050468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d344c-711d-4b10-b096-d0b576ef9ee6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.051041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d344c-711d-4b10-b096-d0b576ef9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.051390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d344c-711d-4b10-b096-d0b576ef9ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.085976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ee6d344c-711d-4b10-b096-d0b576ef9ee6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:16.088266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee6d344c-711d-4b10-b096-d0b576ef9ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:16.187477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2663/5333] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:16.196560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadb42c-dcd3-43ea-abc8-aa88e8a5d64d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.197195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadb42c-dcd3-43ea-abc8-aa88e8a5d64d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.197473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadb42c-dcd3-43ea-abc8-aa88e8a5d64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.221027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4eadb42c-dcd3-43ea-abc8-aa88e8a5d64d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:16.222701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4eadb42c-dcd3-43ea-abc8-aa88e8a5d64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:16.238537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d344c-711d-4b10-b096-d0b576ef9ee6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:16.249091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2671/5334] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:16.253140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d344c-711d-4b10-b096-d0b576ef9ee6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:16.265087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:16.266276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.270280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.270844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.271868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:16.274362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:16.276524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:16.311173 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2664/5335] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:16.314256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadb42c-dcd3-43ea-abc8-aa88e8a5d64d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:16.325953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadb42c-dcd3-43ea-abc8-aa88e8a5d64d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:16.334702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:16.335813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.336914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.337440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.339019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:16.341325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:16.403418 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2672/5336] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:16 2022] POST /identity/v3/projects => generated 371 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:16.409677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:16.434005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cc9f0-a9b7-46b8-b9d2-730c04d08957 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:16.580989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:16.581402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:16.583379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.584062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.584331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:16.584978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.585767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:16.588377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:16.616540 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2665/5337] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:16 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:16.619889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:16.637158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76eff3-40e4-4ae0-afd6-39b23acefeb2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:16.645710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:16.646595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.646982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.647332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.648424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:16.650133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:16.676802 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2666/5338] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:16.681558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:16.684449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475312d3-5167-49f6-9b82-fe746fd89079 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:16.690401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:16.691362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.691812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.692269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.692522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3a324-2844-4744-aea2-59f2b2b184b3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:16.698974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:16.702115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:16.704107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.704512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.705498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.706833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:16.710310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:16.730950 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2667/5339] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:03:16.733679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:16.754055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f026edc-eb93-4e3e-8cb2-bcf1ee21a0c2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:16.767738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd14526-91a9-4160-8721-500f589d36b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:16.768661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd14526-91a9-4160-8721-500f589d36b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.768950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd14526-91a9-4160-8721-500f589d36b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.769229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd14526-91a9-4160-8721-500f589d36b4 admin admin] PATH_INFO: `/v3/projects/e5bd7ffaf96c48688d8ebe954dc7912f/users/0cd1a3e3a02a4a7889ad46c94fbe8e4d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.790250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd14526-91a9-4160-8721-500f589d36b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bd7ffaf96c48688d8ebe954dc7912f, user_id=0cd1a3e3a02a4a7889ad46c94fbe8e4d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:16.794107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd14526-91a9-4160-8721-500f589d36b4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:16.809886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:16.812559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:16.824298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2668/5340] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:16 2022] PUT /identity/v3/projects/e5bd7ffaf96c48688d8ebe954dc7912f/users/0cd1a3e3a02a4a7889ad46c94fbe8e4d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:16.826610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:16.826939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:16.827226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:16.831755 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2673/5341] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:03:16.867455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:16.872533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:17.043929 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2669/5342] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:17.057678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:17.060125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:17.264604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d11177-cbf7-482b-8c1d-b6e8985b88b0 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:17.338959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64176e-641c-4b64-99b4-6500213b22f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:17.340066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64176e-641c-4b64-99b4-6500213b22f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:17.340592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64176e-641c-4b64-99b4-6500213b22f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:17.341111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64176e-641c-4b64-99b4-6500213b22f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:17.354244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64176e-641c-4b64-99b4-6500213b22f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:17.356307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64176e-641c-4b64-99b4-6500213b22f9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:17.371579 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2674/5343] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:28.251026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:28.260898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:28.287177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2628d-d19e-47dd-abbb-df390863bbde None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:28.296141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:28.298515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:28.298824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:28.299109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] PATH_INFO: `/v3/users/1bbd3976a3c9408eba1845f2039f7a2e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:28.301786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bbd3976a3c9408eba1845f2039f7a2e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:28.305299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:28.398195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bbd3976a3c9408eba1845f2039f7a2e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:28.399665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bbd3976a3c9408eba1845f2039f7a2e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:28.408892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bbd3976a3c9408eba1845f2039f7a2e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:28.409895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bbd3976a3c9408eba1845f2039f7a2e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:28.424751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bbd3976a3c9408eba1845f2039f7a2e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:28.461200 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2670/5344] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:28 2022] DELETE /identity/v3/users/1bbd3976a3c9408eba1845f2039f7a2e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:28.466844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9e6b-1d8f-4b37-825c-d1b47f096bba None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:28.467547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9e6b-1d8f-4b37-825c-d1b47f096bba None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:28.467547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a9e6b-1d8f-4b37-825c-d1b47f096bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:28.492580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0d0a9e6b-1d8f-4b37-825c-d1b47f096bba None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:28.493860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0d0a9e6b-1d8f-4b37-825c-d1b47f096bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:28.634636 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2675/5345] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:28.649677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:28.652141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:28.758092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f80c8-4d9d-456c-a34f-8e61712e57f8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:28.764949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:28.765904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:28.766429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:28.766698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:28.778063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:28.779846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:28.792432 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2671/5346] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:28.955575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105468dd-3ebc-4beb-b0e1-176a941cca22 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:28.956685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105468dd-3ebc-4beb-b0e1-176a941cca22 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:28.957656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105468dd-3ebc-4beb-b0e1-176a941cca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:29.010644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-105468dd-3ebc-4beb-b0e1-176a941cca22 None None] MFA Rules not processed for user `0cd1a3e3a02a4a7889ad46c94fbe8e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:29.012310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-105468dd-3ebc-4beb-b0e1-176a941cca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:29.168136 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2676/5347] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:29.172894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.174386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:29.190438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32779f97-9c23-402c-8e0d-ecc08d12e4f3 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:29.206948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:29.208236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:29.208596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:29.208866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:29.213435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:29.213435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:29.269317 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2672/5348] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:29 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:29.273263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105468dd-3ebc-4beb-b0e1-176a941cca22 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.293430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105468dd-3ebc-4beb-b0e1-176a941cca22 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:29.445819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:29.446554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:29.446861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:29.447139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:29.447834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:29.452381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:29.544111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2677/5349] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:29 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:03:29.545699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.564983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86032444-4f8f-4e43-923a-4a0289ad0995 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:29.577184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.579538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:29.580220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:29.580501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:29.580772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:29.581668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:29.587792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:29.602762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:29.624724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71753325-7bab-483a-b114-64fa0b7634b8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:29.638044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:29.641596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:29.641884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:29.645365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] PATH_INFO: `/v3/projects/44c32bd640f04a509f928a0008e27f03` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:29.646889 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2673/5350] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:29.648646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.650215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c32bd640f04a509f928a0008e27f03)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:29.659343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:29.670952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bc80a-7ac3-4681-b58e-57723a4ecb8e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:29.687535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:29.688888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:29.689433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:29.689999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] PATH_INFO: `/v3/projects/720fbf0e355c4d9c841f2380a9abce14/users/1c6f3bc5cdf64711be658dba4ff584aa/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:29.738519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720fbf0e355c4d9c841f2380a9abce14, user_id=1c6f3bc5cdf64711be658dba4ff584aa, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:29.757525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c32bd640f04a509f928a0008e27f03', 'request_id': 'req-917af470-f878-4f02-bc96-a06e9dfd6db1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:29.764288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:29.768832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c32bd640f04a509f928a0008e27f03', 'request_id': 'req-917af470-f878-4f02-bc96-a06e9dfd6db1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:29.792688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c32bd640f04a509f928a0008e27f03', 'request_id': 'req-917af470-f878-4f02-bc96-a06e9dfd6db1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:29.798052 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2674/5351] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:29 2022] PUT /identity/v3/projects/720fbf0e355c4d9c841f2380a9abce14/users/1c6f3bc5cdf64711be658dba4ff584aa/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:29.801890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.814200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] The token cache is being invalidate because project 44c32bd640f04a509f928a0008e27f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:29.815819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:29.817303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:29.825404 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2678/5352] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:29 2022] DELETE /identity/v3/projects/44c32bd640f04a509f928a0008e27f03 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:29.828529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.845067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:29.951056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436a0b6-1b57-457d-8abc-20b471c72143 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:29.961321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:29.962235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:29.962622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:29.963547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:29.964719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:29.965878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:29.982974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2675/5353] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:29.984138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:29.987087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:29.991667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917af470-f878-4f02-bc96-a06e9dfd6db1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:29.997320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:29.999343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:30.000794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:30.001390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] PATH_INFO: `/v3/users/e845cffa600a49959c936ad5379c043a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:30.002956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b061-4d95-47c2-9e1c-7b0f203ca977 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:30.003340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e845cffa600a49959c936ad5379c043a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:30.007167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:30.009504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:30.010843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:30.010843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:30.011133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] PATH_INFO: `/v3/projects/720fbf0e355c4d9c841f2380a9abce14/users/1c6f3bc5cdf64711be658dba4ff584aa/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:30.027462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720fbf0e355c4d9c841f2380a9abce14, user_id=1c6f3bc5cdf64711be658dba4ff584aa, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:30.030405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:30.072782 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2676/5354] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:29 2022] PUT /identity/v3/projects/720fbf0e355c4d9c841f2380a9abce14/users/1c6f3bc5cdf64711be658dba4ff584aa/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:30.084799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e845cffa600a49959c936ad5379c043a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:30.094924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e845cffa600a49959c936ad5379c043a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:30.096041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e845cffa600a49959c936ad5379c043a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:30.097012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e845cffa600a49959c936ad5379c043a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:30.113282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-21cce7d3-1295-41c4-8f57-db32c27f8299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e845cffa600a49959c936ad5379c043a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:30.158205 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2679/5355] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:29 2022] DELETE /identity/v3/users/e845cffa600a49959c936ad5379c043a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:30.508639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:30.511934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:30.765719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b27a1-f4e1-45df-a785-8c40e39bbae7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:30.950349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:30.957695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:30.960395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:30.961778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] PATH_INFO: `/v3/projects/26bf977e64b54d31b0bcc6f124260d83` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:30.963540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bf977e64b54d31b0bcc6f124260d83)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:30.971668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:31.086312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bf977e64b54d31b0bcc6f124260d83', 'request_id': 'req-c702bc3f-efe7-4b33-bfee-9d87aa58b748'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:31.103184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bf977e64b54d31b0bcc6f124260d83', 'request_id': 'req-c702bc3f-efe7-4b33-bfee-9d87aa58b748'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:31.112994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bf977e64b54d31b0bcc6f124260d83', 'request_id': 'req-c702bc3f-efe7-4b33-bfee-9d87aa58b748'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:31.126072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] The token cache is being invalidate because project 26bf977e64b54d31b0bcc6f124260d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:31.126376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:31.127081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c702bc3f-efe7-4b33-bfee-9d87aa58b748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:31.132783 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2677/5356] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:30 2022] DELETE /identity/v3/projects/26bf977e64b54d31b0bcc6f124260d83 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:31.134638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aefec-4edd-4dee-944c-3c448ea92cf3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.135302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aefec-4edd-4dee-944c-3c448ea92cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.135785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aefec-4edd-4dee-944c-3c448ea92cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.141383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8b0d0-c0e2-4fa4-b217-7aa0ecf780bf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.141922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8b0d0-c0e2-4fa4-b217-7aa0ecf780bf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.142406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8b0d0-c0e2-4fa4-b217-7aa0ecf780bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.160327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-775aefec-4edd-4dee-944c-3c448ea92cf3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:31.162305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-775aefec-4edd-4dee-944c-3c448ea92cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:31.177546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-53d8b0d0-c0e2-4fa4-b217-7aa0ecf780bf None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:31.179088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53d8b0d0-c0e2-4fa4-b217-7aa0ecf780bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:31.238933 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2680/5357] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:31.244757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f34124-57d1-4ac3-a010-ca2606845f03 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.244757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f34124-57d1-4ac3-a010-ca2606845f03 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.244975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f34124-57d1-4ac3-a010-ca2606845f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.295743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-52f34124-57d1-4ac3-a010-ca2606845f03 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:31.296995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-52f34124-57d1-4ac3-a010-ca2606845f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:31.319124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2681/5358] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:31.323321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f34124-57d1-4ac3-a010-ca2606845f03 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:31.327077 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2678/5359] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:31.356785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f34124-57d1-4ac3-a010-ca2606845f03 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:31.364077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:31.366808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.367208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.367594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.368432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:31.368878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:31.371004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:31.386262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2682/5360] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:31.390337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8b0d0-c0e2-4fa4-b217-7aa0ecf780bf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:31.408805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8b0d0-c0e2-4fa4-b217-7aa0ecf780bf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:31.417766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:31.418451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.418732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.419064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.419776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:31.421730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:31.464649 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2679/5361] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:31 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:03:31.465986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:31.480084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2fd1-52ef-4862-901c-7f600b8d8778 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:31.569231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:31.574998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.577070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.577697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.579515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:31.582110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:31.630632 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2683/5362] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:31 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:31.635132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:31.656460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777db4-96f5-4d8d-9206-083823c1caf6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:31.662176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:31.662899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.663654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.663941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.664677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:31.667758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:31.684452 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2680/5363] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:31.688321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:31.702370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b717a6-d201-4b27-88a5-164b9dcc9c7c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:31.716973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde6c19-af52-4fb7-a17d-e3959161675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:31.717854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde6c19-af52-4fb7-a17d-e3959161675a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.718150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde6c19-af52-4fb7-a17d-e3959161675a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.718432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde6c19-af52-4fb7-a17d-e3959161675a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.719535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde6c19-af52-4fb7-a17d-e3959161675a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:31.726897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde6c19-af52-4fb7-a17d-e3959161675a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:31.738752 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2684/5364] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:31.742601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:31.753688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7a291-4319-450d-8828-b646cef9180b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:31.764771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:31.766096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.766708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.767654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] PATH_INFO: `/v3/projects/bd18cd207653444585f61b2681aa083e/users/251bde47253c4599a89e311aff6d32fd/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.798535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd18cd207653444585f61b2681aa083e, user_id=251bde47253c4599a89e311aff6d32fd, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:31.806894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:31.870713 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2681/5365] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:31 2022] PUT /identity/v3/projects/bd18cd207653444585f61b2681aa083e/users/251bde47253c4599a89e311aff6d32fd/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:31.872783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ba22-df7e-473e-b043-4d680d53006d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:31.873100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ba22-df7e-473e-b043-4d680d53006d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:31.873508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ba22-df7e-473e-b043-4d680d53006d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:31.935108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-97e0ba22-df7e-473e-b043-4d680d53006d None None] MFA Rules not processed for user `251bde47253c4599a89e311aff6d32fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:31.936958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-97e0ba22-df7e-473e-b043-4d680d53006d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:32.077159 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2685/5366] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:32.081701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:32.297192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea0b1-a6b5-4b73-8d70-58ece0868097 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:32.312087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:32.312942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:32.313201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:32.313521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:32.314192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:32.316235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:32.399087 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2682/5367] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:32 2022] POST /identity/v3/projects => generated 373 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:32.401041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0ba22-df7e-473e-b043-4d680d53006d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:32.416931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0ba22-df7e-473e-b043-4d680d53006d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:32.565455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:32.566667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:32.568527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:32.569018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:32.569718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:32.578949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:32.646485 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2686/5368] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:32 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:03:32.650678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:32.671693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1ca8a-8f1a-4545-aa83-529fe4998809 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:32.684458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:32.685701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:32.686155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:32.686604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:32.687627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:32.690324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:32.707621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2683/5369] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:32.712766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:32.744465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f12c3-7797-4160-8cc3-34dd1ad0ed76 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:32.750231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f00c6-721a-462e-af00-49ed6670c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:32.751347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f00c6-721a-462e-af00-49ed6670c583 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:32.751828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f00c6-721a-462e-af00-49ed6670c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:32.752210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f00c6-721a-462e-af00-49ed6670c583 admin admin] PATH_INFO: `/v3/projects/336d605f24c246e08f38f8a3ab0d32f5/users/650f568cf22342ee80641f4aacd8cbb3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:32.801432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f00c6-721a-462e-af00-49ed6670c583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=336d605f24c246e08f38f8a3ab0d32f5, user_id=650f568cf22342ee80641f4aacd8cbb3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:32.808042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f00c6-721a-462e-af00-49ed6670c583 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:32.868443 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2687/5370] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:32 2022] PUT /identity/v3/projects/336d605f24c246e08f38f8a3ab0d32f5/users/650f568cf22342ee80641f4aacd8cbb3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:32.876551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:32.904598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:32.908076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:32.908589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:32.912609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d579d-b378-41cf-b6f7-7cd341ac2d7e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:33.023531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:33.029106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:33.105134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:33.105975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:33.106328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:33.106678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:33.107503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:33.111566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:33.122733 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2684/5371] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:33.126178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:33.137201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4311d-dbfa-4b9b-a04a-7fd5dd70598b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:33.143376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ab2f-ee5d-4759-a19f-3de3559da6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:33.144576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ab2f-ee5d-4759-a19f-3de3559da6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:33.144953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ab2f-ee5d-4759-a19f-3de3559da6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:33.145506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ab2f-ee5d-4759-a19f-3de3559da6ea admin admin] PATH_INFO: `/v3/projects/336d605f24c246e08f38f8a3ab0d32f5/users/650f568cf22342ee80641f4aacd8cbb3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:33.158339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ab2f-ee5d-4759-a19f-3de3559da6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=336d605f24c246e08f38f8a3ab0d32f5, user_id=650f568cf22342ee80641f4aacd8cbb3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:33.162551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ab2f-ee5d-4759-a19f-3de3559da6ea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:33.185159 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2685/5372] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:33 2022] PUT /identity/v3/projects/336d605f24c246e08f38f8a3ab0d32f5/users/650f568cf22342ee80641f4aacd8cbb3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:33.189019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbd747-c268-48fe-a249-c900f2e7293e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:33.189019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbd747-c268-48fe-a249-c900f2e7293e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:33.191832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbd747-c268-48fe-a249-c900f2e7293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:33.255740 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2688/5373] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:03:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:33.269728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:33.271955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:33.292244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-64dbd747-c268-48fe-a249-c900f2e7293e None None] MFA Rules not processed for user `650f568cf22342ee80641f4aacd8cbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:33.293516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-64dbd747-c268-48fe-a249-c900f2e7293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:33.483775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705b0cf-b54a-4284-bea5-6a68b71cbf50 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:33.531874 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2686/5374] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:33.537655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbd747-c268-48fe-a249-c900f2e7293e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:33.578762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbd747-c268-48fe-a249-c900f2e7293e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:33.592755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650f568cf22342ee80641f4aacd8cbb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '336d605f24c246e08f38f8a3ab0d32f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:33.593878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:33.593878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:33.594132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:33.594812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:33.595129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:33.596791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:33.657269 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2687/5375] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:33.663822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:33.688099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc407367-ce4c-4c71-8921-40afd959d4ab tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:33.695158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:33.695837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:33.696126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:33.696412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:33.700560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650f568cf22342ee80641f4aacd8cbb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '336d605f24c246e08f38f8a3ab0d32f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:33.701464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:33.704506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:33.705516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:33.706442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:33.711914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:33.791388 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2688/5376] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:33 2022] POST /identity/v3/projects => generated 347 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:33.796105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:33.872048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:33.876654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:33.896620 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2689/5377] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:33.974365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41214f4-ef66-4dd1-9b7e-9aa017103bff tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:33.991096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d0a8f-af54-4ac6-8900-f355e8c3b9a9 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650f568cf22342ee80641f4aacd8cbb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '336d605f24c246e08f38f8a3ab0d32f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:33.992140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0a8f-af54-4ac6-8900-f355e8c3b9a9 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:33.992508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0a8f-af54-4ac6-8900-f355e8c3b9a9 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:33.993016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0a8f-af54-4ac6-8900-f355e8c3b9a9 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:33.993942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0a8f-af54-4ac6-8900-f355e8c3b9a9 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:33.996306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0a8f-af54-4ac6-8900-f355e8c3b9a9 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:33.998105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0a8f-af54-4ac6-8900-f355e8c3b9a9 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:34.027922 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2689/5378] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:34.069188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:34.072264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:34.167173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af866b-c79d-4d69-9641-1c6b78aa8fb4 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:34.408507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:34.416452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:34.416765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:34.417874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:34.465505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:34.480041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:34.495792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2690/5379] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:03:35.979374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f633-5edd-4383-a74a-d8175c78782c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:35.979854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f633-5edd-4383-a74a-d8175c78782c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:35.979975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3f633-5edd-4383-a74a-d8175c78782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:36.049437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dbe3f633-5edd-4383-a74a-d8175c78782c None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:36.051638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dbe3f633-5edd-4383-a74a-d8175c78782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:36.260040 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2690/5380] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:03:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:36.293665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:36.554353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27971262-30ee-4882-b0f9-8071dc25b26f service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:36.581554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:36.582423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:36.582820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:36.583133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:36.600444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:36.602669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:36.613926 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2691/5381] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:37.412030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:37.412525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:37.412649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:37.443107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:37.444434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:37.466220 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2691/5382] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:03:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:37.484057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:37.501207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa460-67c3-4a20-bff7-a86f042b2006 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:37.512805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:37.513718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:37.515001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:37.515443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:37.546239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:37.551090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:37.582583 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2692/5383] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:03:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:03:38.682052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:38.684210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:38.791425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f265f47-c8a8-4051-b96e-1c6a0bcf4b9a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:38.816237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cc059-9b56-498f-b4d3-24679cc2f42b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:38.818354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc059-9b56-498f-b4d3-24679cc2f42b service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:38.818830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc059-9b56-498f-b4d3-24679cc2f42b service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:38.819281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cc059-9b56-498f-b4d3-24679cc2f42b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:38.823948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-417cc059-9b56-498f-b4d3-24679cc2f42b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:38.850134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cc059-9b56-498f-b4d3-24679cc2f42b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:38.857783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cc059-9b56-498f-b4d3-24679cc2f42b service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:38.920053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2692/5384] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:41.232834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:41.234496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:41.369072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b484f-5497-4a1e-b8a1-4d85e1a6f303 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:41.375673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:41.378730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:41.380462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:41.380989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] PATH_INFO: `/v3/users/e1d72e319762436a9a2f8a69e5402bf6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:41.382878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d72e319762436a9a2f8a69e5402bf6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:41.400149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:41.501808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d72e319762436a9a2f8a69e5402bf6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:41.512422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d72e319762436a9a2f8a69e5402bf6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:41.513502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d72e319762436a9a2f8a69e5402bf6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:41.514385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d72e319762436a9a2f8a69e5402bf6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:41.537095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d72e319762436a9a2f8a69e5402bf6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:41.596339 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2693/5385] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:41 2022] DELETE /identity/v3/users/e1d72e319762436a9a2f8a69e5402bf6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:41.600977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:41.602057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:41.602463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:41.636015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:41.640026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:41.766330 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2693/5386] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:41.789267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:41.791679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:41.927212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b0d2-9839-44d3-8af4-177a89da2fb4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:41.949261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:41.955812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:41.955812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:41.955812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:41.991651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:41.999799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:42.027007 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2694/5387] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:42.405488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:42.408029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:42.520922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485863f-47d7-40c4-b854-b427707c26e2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:42.531031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '650f568cf22342ee80641f4aacd8cbb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '336d605f24c246e08f38f8a3ab0d32f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:42.532692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:42.533304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:42.536709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] PATH_INFO: `/v3/projects/3a7d2c6c33a64b04bf784d835682d629` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:42.538952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a7d2c6c33a64b04bf784d835682d629)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:42.541603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:42.655417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7d2c6c33a64b04bf784d835682d629', 'request_id': 'req-ecbe1135-4488-4760-9e24-b7f0ecacb605'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:42.673121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7d2c6c33a64b04bf784d835682d629', 'request_id': 'req-ecbe1135-4488-4760-9e24-b7f0ecacb605'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:42.713814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7d2c6c33a64b04bf784d835682d629', 'request_id': 'req-ecbe1135-4488-4760-9e24-b7f0ecacb605'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:42.739294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] The token cache is being invalidate because project 3a7d2c6c33a64b04bf784d835682d629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:42.739904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:42.740738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ecbe1135-4488-4760-9e24-b7f0ecacb605 tempest-QuotasNegativeTest-1011050160 tempest-QuotasNegativeTest-1011050160-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:42.744467 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2694/5388] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:42 2022] DELETE /identity/v3/projects/3a7d2c6c33a64b04bf784d835682d629 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:42.750502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:42.752412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:42.772230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda1589-d4d5-419e-a195-5e412c5b5b94 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:42.878912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:42.880618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:42.881339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:42.881799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] PATH_INFO: `/v3/users/251bde47253c4599a89e311aff6d32fd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:42.883520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251bde47253c4599a89e311aff6d32fd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:42.886702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:43.034055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251bde47253c4599a89e311aff6d32fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.043399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251bde47253c4599a89e311aff6d32fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.044177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251bde47253c4599a89e311aff6d32fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.044801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251bde47253c4599a89e311aff6d32fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.066796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251bde47253c4599a89e311aff6d32fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.099175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2695/5389] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:42 2022] DELETE /identity/v3/users/251bde47253c4599a89e311aff6d32fd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:43.103513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:43.104245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:43.104750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:43.158838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:43.160737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:43.225901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:43.231388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:43.332894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b887d3-71cf-4710-9e24-492dc34d4d10 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:43.349191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:43.350117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:43.350401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:43.350982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] PATH_INFO: `/v3/projects/9efc1fbca3ab413fabfc108b752dd251` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:43.364522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efc1fbca3ab413fabfc108b752dd251)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:43.366744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:43.394530 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2695/5390] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:43.452358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:43.453352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efc1fbca3ab413fabfc108b752dd251', 'request_id': 'req-04913eeb-72b6-49e9-9e27-ae269384b878'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.454312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:43.464807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efc1fbca3ab413fabfc108b752dd251', 'request_id': 'req-04913eeb-72b6-49e9-9e27-ae269384b878'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.479777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efc1fbca3ab413fabfc108b752dd251', 'request_id': 'req-04913eeb-72b6-49e9-9e27-ae269384b878'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.496981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] The token cache is being invalidate because project 9efc1fbca3ab413fabfc108b752dd251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:43.497277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.498570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.501394 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2696/5391] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:43 2022] DELETE /identity/v3/projects/9efc1fbca3ab413fabfc108b752dd251 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:43.505416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:43.510342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:43.565722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a8bcd-f764-4540-aefc-fcb578cf7ed0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:43.633294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:43.633949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:43.634436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:43.634936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:43.635330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04913eeb-72b6-49e9-9e27-ae269384b878 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:43.637481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:43.643289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:43.644779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:43.646023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:43.646406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] PATH_INFO: `/v3/users/9763cfae50e5479f867479c18cb2d75d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:43.648404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9763cfae50e5479f867479c18cb2d75d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:43.652766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:43.654911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:43.664806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:43.667409 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2696/5392] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:43.734690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9763cfae50e5479f867479c18cb2d75d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.751393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9763cfae50e5479f867479c18cb2d75d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.751393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9763cfae50e5479f867479c18cb2d75d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.752178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9763cfae50e5479f867479c18cb2d75d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.767730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9763cfae50e5479f867479c18cb2d75d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:43.811326 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2697/5393] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:43 2022] DELETE /identity/v3/users/9763cfae50e5479f867479c18cb2d75d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:45.162592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:45.229576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa63d-1c0d-452d-9fde-0008af96cf92 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:45.320362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:45.322831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:45.339320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:45.340520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:45.340972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:45.341430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] PATH_INFO: `/v3/projects/336202678c2c4f33a2e0397c2d458695` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:45.343015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=336202678c2c4f33a2e0397c2d458695)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:45.346312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:45.409783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336202678c2c4f33a2e0397c2d458695', 'request_id': 'req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.417495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336202678c2c4f33a2e0397c2d458695', 'request_id': 'req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.432587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336202678c2c4f33a2e0397c2d458695', 'request_id': 'req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.450899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] The token cache is being invalidate because project 336202678c2c4f33a2e0397c2d458695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:45.451393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.453171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3193bb36-0ab9-4cbd-9d16-6ffec52a3b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.455894 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2697/5394] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:45 2022] DELETE /identity/v3/projects/336202678c2c4f33a2e0397c2d458695 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:45.470399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba33c5-5ed6-4331-909c-28cb1079caea None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:45.471323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba33c5-5ed6-4331-909c-28cb1079caea None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:45.471902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba33c5-5ed6-4331-909c-28cb1079caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:45.496792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-69ba33c5-5ed6-4331-909c-28cb1079caea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:45.498539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-69ba33c5-5ed6-4331-909c-28cb1079caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:45.515086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc771de-0999-41ea-a21b-fc96e69f344f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:45.593687 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2698/5395] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:45.601965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d828-c9d7-4ddf-99e0-b68162996e79 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:45.602261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d828-c9d7-4ddf-99e0-b68162996e79 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:45.602543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4d828-c9d7-4ddf-99e0-b68162996e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:45.632388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-11f4d828-c9d7-4ddf-99e0-b68162996e79 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:45.633719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-11f4d828-c9d7-4ddf-99e0-b68162996e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:45.644148 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2699/5396] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:45.648597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d828-c9d7-4ddf-99e0-b68162996e79 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:45.656329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:45.657209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:45.657497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:45.657968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] PATH_INFO: `/v3/projects/bd18cd207653444585f61b2681aa083e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:45.659304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd18cd207653444585f61b2681aa083e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:45.661823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:45.669698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4d828-c9d7-4ddf-99e0-b68162996e79 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:45.685894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:45.688767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:45.689072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:45.689361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:45.691772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:45.692144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:45.694043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:45.717696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2700/5397] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:45.730658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:45.755645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0d0c6-21f6-4a43-8ce9-90ec6cf931e7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:45.760152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd18cd207653444585f61b2681aa083e', 'request_id': 'req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.773873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd18cd207653444585f61b2681aa083e', 'request_id': 'req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.806389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd18cd207653444585f61b2681aa083e', 'request_id': 'req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.821438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] The token cache is being invalidate because project bd18cd207653444585f61b2681aa083e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:45.821935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.827225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:45.828909 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2698/5398] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:45 2022] DELETE /identity/v3/projects/bd18cd207653444585f61b2681aa083e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:45.833035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:45.834748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:45.848949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:45.849916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:45.850402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:45.851399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:45.852308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:45.854536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:45.901129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2701/5399] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:45 2022] POST /identity/v3/projects => generated 359 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:45.905603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:45.910516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:45.998651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b96840-e6f2-4869-aa5c-3cf9f48ee40c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:46.098195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b68282-0541-4ad3-ad99-aa8bd63ebfb6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:46.114729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:46.117976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:46.120916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:46.121685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:46.142320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:46.153393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:46.194824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:46.195741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:46.196022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:46.196429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] PATH_INFO: `/v3/users/650f568cf22342ee80641f4aacd8cbb3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:46.198636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] RBAC: Authorizing `identity:delete_user(user_id=650f568cf22342ee80641f4aacd8cbb3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:46.200646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:46.243671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2702/5400] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:45 2022] POST /identity/v3/users => generated 280 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:46.244619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:46.266881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f2d7-5bea-48d0-a132-f15629fc166e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:46.286651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:46.287963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:46.288260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:46.289954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:46.293695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:46.296013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:46.297078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650f568cf22342ee80641f4aacd8cbb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:46.318115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650f568cf22342ee80641f4aacd8cbb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:46.318890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650f568cf22342ee80641f4aacd8cbb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:46.319765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650f568cf22342ee80641f4aacd8cbb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:46.325340 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2703/5401] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:46.330311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650f568cf22342ee80641f4aacd8cbb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:46.331528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:46.336132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:46.354785 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2699/5402] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:45 2022] DELETE /identity/v3/users/650f568cf22342ee80641f4aacd8cbb3 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:46.368816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0938a-14ad-417b-961e-008e8368c461 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:46.451067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc0eb0-feee-4fe9-b745-e99df7fb2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:46.452038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0eb0-feee-4fe9-b745-e99df7fb2022 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:46.452321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0eb0-feee-4fe9-b745-e99df7fb2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:46.452873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc0eb0-feee-4fe9-b745-e99df7fb2022 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:46.453717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0eb0-feee-4fe9-b745-e99df7fb2022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:46.455691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc0eb0-feee-4fe9-b745-e99df7fb2022 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:46.473796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:46.487099 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2704/5403] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:46.489856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecb1f8-bf02-4857-b964-406d6623c12c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:46.496424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:46.497807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:46.498309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:46.499311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] PATH_INFO: `/v3/projects/e474cf0852044b9bb4c23287f53ecce7/users/12c1f2a624b34385b5d7b8805b1c454f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:46.557318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e474cf0852044b9bb4c23287f53ecce7, user_id=12c1f2a624b34385b5d7b8805b1c454f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:46.562314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:46.589704 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2700/5404] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:46 2022] PUT /identity/v3/projects/e474cf0852044b9bb4c23287f53ecce7/users/12c1f2a624b34385b5d7b8805b1c454f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:46.601044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:46.601650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:46.602096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:46.658869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] MFA Rules not processed for user `12c1f2a624b34385b5d7b8805b1c454f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:46.660508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:46.815630 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2705/5405] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:46 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:46.853011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:46.854951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.062920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6865ea5-ef6e-493d-a3b3-6c24e88038a4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:47.068727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:47.070008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.070170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.071628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.083319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:47.085233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:47.115074 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2701/5406] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:46 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:47.127821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:47.129718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.149382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:47.274117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff7d65-9d57-48fa-9b86-ace59abb6cdc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:47.290979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:47.292074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.292533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.292980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] PATH_INFO: `/v3/projects/336d605f24c246e08f38f8a3ab0d32f5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.298062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=336d605f24c246e08f38f8a3ab0d32f5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:47.302149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:47.341474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019a38b-ab55-4e35-99c0-85f55aeb8ec0 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:47.360985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:47.366025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.366996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.368751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] PATH_INFO: `/v3/users/12c1f2a624b34385b5d7b8805b1c454f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.375668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c1f2a624b34385b5d7b8805b1c454f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:47.378567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:47.379774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '336d605f24c246e08f38f8a3ab0d32f5', 'request_id': 'req-efe4ce15-3c58-4253-b051-04d140065cde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.387018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '336d605f24c246e08f38f8a3ab0d32f5', 'request_id': 'req-efe4ce15-3c58-4253-b051-04d140065cde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.398571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '336d605f24c246e08f38f8a3ab0d32f5', 'request_id': 'req-efe4ce15-3c58-4253-b051-04d140065cde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.412524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] The token cache is being invalidate because project 336d605f24c246e08f38f8a3ab0d32f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:47.413093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.414121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-efe4ce15-3c58-4253-b051-04d140065cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.416343 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2706/5407] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:47 2022] DELETE /identity/v3/projects/336d605f24c246e08f38f8a3ab0d32f5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:47.417983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2e1e-d4de-474d-ab2d-a09af63eda15 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.418475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2e1e-d4de-474d-ab2d-a09af63eda15 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.418976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab2e1e-d4de-474d-ab2d-a09af63eda15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.463110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-71ab2e1e-d4de-474d-ab2d-a09af63eda15 None None] MFA Rules not processed for user `1c6f3bc5cdf64711be658dba4ff584aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:47.465495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-71ab2e1e-d4de-474d-ab2d-a09af63eda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.494350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c1f2a624b34385b5d7b8805b1c454f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.508631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c1f2a624b34385b5d7b8805b1c454f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.511057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c1f2a624b34385b5d7b8805b1c454f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.513841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c1f2a624b34385b5d7b8805b1c454f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.532862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-25e6cb19-e16b-4729-bfc9-b91bfa2e2e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c1f2a624b34385b5d7b8805b1c454f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:47.571119 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2702/5408] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:47 2022] DELETE /identity/v3/users/12c1f2a624b34385b5d7b8805b1c454f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:47.572980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827747b-332f-4fbf-b366-9152fc275a41 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.573702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827747b-332f-4fbf-b366-9152fc275a41 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.574345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827747b-332f-4fbf-b366-9152fc275a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.586364 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2707/5409] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:47.587897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.588270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.588875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.603612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6827747b-332f-4fbf-b366-9152fc275a41 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:47.605646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6827747b-332f-4fbf-b366-9152fc275a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.615226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:47.617272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.688332 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2703/5410] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:47.696386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656130-3228-4f3e-8b90-f574b7417ee5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.696999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656130-3228-4f3e-8b90-f574b7417ee5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.697369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85656130-3228-4f3e-8b90-f574b7417ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.705293 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2708/5411] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:47.721090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-85656130-3228-4f3e-8b90-f574b7417ee5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:47.722653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:47.723013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-85656130-3228-4f3e-8b90-f574b7417ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.725628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.755333 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2704/5412] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:47.760345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656130-3228-4f3e-8b90-f574b7417ee5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:47.786762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85656130-3228-4f3e-8b90-f574b7417ee5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:47.793593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:47.794467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.795000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.795475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.796631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:47.797270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:47.799226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:47.826806 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2705/5413] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:47.827765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:47.831194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.848010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4ad9-07c2-4906-92b5-5597e9e8cc29 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:47.852774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db18b6-7cfb-4ae5-8f9b-8973ff72cb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:47.853753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db18b6-7cfb-4ae5-8f9b-8973ff72cb06 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.854862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db18b6-7cfb-4ae5-8f9b-8973ff72cb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.855372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db18b6-7cfb-4ae5-8f9b-8973ff72cb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.869583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db18b6-7cfb-4ae5-8f9b-8973ff72cb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:47.871081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db18b6-7cfb-4ae5-8f9b-8973ff72cb06 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:47.883440 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2709/5414] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:47.884942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62777a8-f766-4153-beea-7d500e1435c5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.885240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62777a8-f766-4153-beea-7d500e1435c5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.885520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62777a8-f766-4153-beea-7d500e1435c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:47.911642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c62777a8-f766-4153-beea-7d500e1435c5 None None] MFA Rules not processed for user `8cdc0c878f6e4e5da2a2848d63a02f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:47.913162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c62777a8-f766-4153-beea-7d500e1435c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:47.978534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60eaa-02ee-4a68-886f-78384aead29a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:47.995242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:47.996647 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2710/5415] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:47.996998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:47.997370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:47.998029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.002819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:48.003032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62777a8-f766-4153-beea-7d500e1435c5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:48.023178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62777a8-f766-4153-beea-7d500e1435c5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:48.029228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:48.029847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.030132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.030409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.031233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.035188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.093322 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2711/5416] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:47 2022] POST /identity/v3/projects => generated 353 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:48.094925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:48.114323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.116515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.136236 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2706/5417] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:48.215646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ecd4-2c8c-4efa-9835-3f1f2e701f8a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:48.226458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:48.227708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.228712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.229109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.230984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.233733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.284441 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2712/5418] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:48 2022] POST /identity/v3/users => generated 277 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:48.288581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:48.310529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d056d-9845-4f50-a983-47c5d5210184 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:48.317702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:48.318467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.318871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.319265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.320444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.322400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.336172 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2707/5419] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:48.340033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:48.352950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6f9c-ad36-4515-ae3a-652dba750daf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:48.359643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:48.361013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.361699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.362352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.363436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.367014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.384237 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2713/5420] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:48.388455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:48.404439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f9999-2426-4177-8f0e-829ae8843fdb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:48.404750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:48.407438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:48.417146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc34a60-3d81-4819-b8ef-fc75c2fa3de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:48.419280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc34a60-3d81-4819-b8ef-fc75c2fa3de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.419280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc34a60-3d81-4819-b8ef-fc75c2fa3de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.419280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc34a60-3d81-4819-b8ef-fc75c2fa3de8 admin admin] PATH_INFO: `/v3/projects/7f71f1f3f4684d59a302900c5c6354e7/users/eef4363fc32c49c280a53a6949187740/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.453262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a69e40-aaea-4cfd-954a-825cb9dd18de admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:48.464625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:48.467295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.468810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.469612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] PATH_INFO: `/v3/projects/e474cf0852044b9bb4c23287f53ecce7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.471786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e474cf0852044b9bb4c23287f53ecce7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.473380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc34a60-3d81-4819-b8ef-fc75c2fa3de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f71f1f3f4684d59a302900c5c6354e7, user_id=eef4363fc32c49c280a53a6949187740, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.476103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc34a60-3d81-4819-b8ef-fc75c2fa3de8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.478919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.505258 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2708/5421] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:48 2022] PUT /identity/v3/projects/7f71f1f3f4684d59a302900c5c6354e7/users/eef4363fc32c49c280a53a6949187740/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:48.519287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.519591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.519870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.582446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] MFA Rules not processed for user `eef4363fc32c49c280a53a6949187740`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:48.583842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:48.597791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e474cf0852044b9bb4c23287f53ecce7', 'request_id': 'req-7f11d85f-4b59-4595-8759-326a16223764'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:48.609844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e474cf0852044b9bb4c23287f53ecce7', 'request_id': 'req-7f11d85f-4b59-4595-8759-326a16223764'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:48.625821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e474cf0852044b9bb4c23287f53ecce7', 'request_id': 'req-7f11d85f-4b59-4595-8759-326a16223764'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:48.648482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] The token cache is being invalidate because project e474cf0852044b9bb4c23287f53ecce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:48.649782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:48.651558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f11d85f-4b59-4595-8759-326a16223764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:48.679290 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2714/5422] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:48 2022] DELETE /identity/v3/projects/e474cf0852044b9bb4c23287f53ecce7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:48.681976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed3bd-60ab-4a9e-8758-375f479d8474 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.683567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed3bd-60ab-4a9e-8758-375f479d8474 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.683855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ed3bd-60ab-4a9e-8758-375f479d8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.725613 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2709/5423] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:48.727554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:48.732724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:48.739625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-311ed3bd-60ab-4a9e-8758-375f479d8474 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:48.743168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-311ed3bd-60ab-4a9e-8758-375f479d8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:48.870255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ca37-cee9-4bb3-8368-fc9a20c94078 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:48.881210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:48.882355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.883637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.884154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.885181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:48.888170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:48.889719 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2715/5424] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:48.899058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a2d1c-4c36-4b43-8d59-a34f7252574d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:48.899436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a2d1c-4c36-4b43-8d59-a34f7252574d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:48.899839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a2d1c-4c36-4b43-8d59-a34f7252574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:48.930448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-745a2d1c-4c36-4b43-8d59-a34f7252574d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:48.931575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-745a2d1c-4c36-4b43-8d59-a34f7252574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:48.944138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2710/5425] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:48 2022] POST /identity/v3/projects => generated 355 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:48.947342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.090668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be1f56-8e97-40d3-93f4-f19f2b2ebab2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.091231 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2716/5426] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:49.092525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a2d1c-4c36-4b43-8d59-a34f7252574d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.102962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.105406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.105812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.107075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.109661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.112245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a2d1c-4c36-4b43-8d59-a34f7252574d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.119631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.120318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.120604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.121479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.122102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:49.122410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.123720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.124906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.148087 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2717/5427] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:49.149421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.169947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c62e7-cf76-4bb4-b470-80a2e92b8d0d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.177458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.178242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.178658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.179082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.179990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.182440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.182630 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2711/5428] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:48 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:49.189524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.227299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553019cd-6e2e-4783-9221-5c255eb8cde5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.245488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.250505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.252464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.253745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.254742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.260907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.263207 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2718/5429] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:49 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:03:49.264417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.289152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2712/5430] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:49.290739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.304806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310aead-7d1d-4154-89d2-98145df08efb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.424155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.425067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.425352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.425662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] PATH_INFO: `/v3/projects/ea3eeaa9e9c441709de92f09b9f17914/users/2a3851704830448389356223fb8ee71a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.445344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3eeaa9e9c441709de92f09b9f17914, user_id=2a3851704830448389356223fb8ee71a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.446532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de708e-de5c-4328-aef7-bec347c59f6d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.448437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.465615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.466087 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2713/5431] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:49 2022] PUT /identity/v3/projects/ea3eeaa9e9c441709de92f09b9f17914/users/2a3851704830448389356223fb8ee71a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:49.466430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.466794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.467092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.467905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.470002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.474407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.527535 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2719/5432] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:49 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:49.531741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.555214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3f791-5a49-42dc-a471-e249bd38a51c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.560724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c18e9-985a-4a4c-8e1d-dca9307aaeca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.567323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.568028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.568314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.568587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.568729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.569308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.569760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.570047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.570322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.570949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.571511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.573239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.588065 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2714/5433] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:49.588996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.601640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895a4fd-bb3e-43ca-9b1a-0536cdce151d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.605850 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2720/5434] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:49.609641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.611020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77495a7f-8972-4626-ae6a-99d5a359e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.612038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495a7f-8972-4626-ae6a-99d5a359e633 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.612464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495a7f-8972-4626-ae6a-99d5a359e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.612798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77495a7f-8972-4626-ae6a-99d5a359e633 admin admin] PATH_INFO: `/v3/projects/ea3eeaa9e9c441709de92f09b9f17914/users/2a3851704830448389356223fb8ee71a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.615344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77495a7f-8972-4626-ae6a-99d5a359e633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3eeaa9e9c441709de92f09b9f17914, user_id=2a3851704830448389356223fb8ee71a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.618532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77495a7f-8972-4626-ae6a-99d5a359e633 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.630947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d741be-871f-4ba2-b4aa-681815cb4b36 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.643286 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2715/5435] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:49 2022] PUT /identity/v3/projects/ea3eeaa9e9c441709de92f09b9f17914/users/2a3851704830448389356223fb8ee71a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:49.644845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f35f1c-e020-4c3c-959c-643256a5f7cd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.645816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f35f1c-e020-4c3c-959c-643256a5f7cd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.646349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f35f1c-e020-4c3c-959c-643256a5f7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.688766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-75f35f1c-e020-4c3c-959c-643256a5f7cd None None] MFA Rules not processed for user `2a3851704830448389356223fb8ee71a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:49.690108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-75f35f1c-e020-4c3c-959c-643256a5f7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:49.741713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.742451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.742741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.743049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.747236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.749637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.773825 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2721/5436] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:49.777837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.798163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4584631-1158-4141-ac96-b347ffb8be8a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.820570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b778a-af90-492c-a2c9-ad49d0ee53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:49.821487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b778a-af90-492c-a2c9-ad49d0ee53d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.821769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b778a-af90-492c-a2c9-ad49d0ee53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.822047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b778a-af90-492c-a2c9-ad49d0ee53d9 admin admin] PATH_INFO: `/v3/projects/6f158d8420cb42c38e5f216bc8c59b0e/users/d1178d0a050245f9b14de19acf9f10eb/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.857474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b778a-af90-492c-a2c9-ad49d0ee53d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f158d8420cb42c38e5f216bc8c59b0e, user_id=d1178d0a050245f9b14de19acf9f10eb, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:49.860594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b778a-af90-492c-a2c9-ad49d0ee53d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:49.887650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2722/5437] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:49 2022] PUT /identity/v3/projects/6f158d8420cb42c38e5f216bc8c59b0e/users/d1178d0a050245f9b14de19acf9f10eb/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:49.897385 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2716/5438] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:49 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:49.900582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571eab-c147-484b-9e89-05b2d8640618 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:49.900991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571eab-c147-484b-9e89-05b2d8640618 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:49.901918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7571eab-c147-484b-9e89-05b2d8640618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:49.902526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f35f1c-e020-4c3c-959c-643256a5f7cd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:49.913216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f35f1c-e020-4c3c-959c-643256a5f7cd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:49.970863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e7571eab-c147-484b-9e89-05b2d8640618 None None] MFA Rules not processed for user `d1178d0a050245f9b14de19acf9f10eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:49.973075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e7571eab-c147-484b-9e89-05b2d8640618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:50.021295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a3851704830448389356223fb8ee71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3eeaa9e9c441709de92f09b9f17914', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.037316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.037316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.037316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.039362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:50.040925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:50.042653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:50.076051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2717/5439] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:50.079251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:50.106842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61805f-2f07-4536-95f8-9432f7b839ff tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:50.125368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a3851704830448389356223fb8ee71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3eeaa9e9c441709de92f09b9f17914', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.126055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.126344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.126853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.127528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:50.129652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:50.141689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2723/5440] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:50.146236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571eab-c147-484b-9e89-05b2d8640618 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:50.190174 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2718/5441] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:50 2022] POST /identity/v3/projects => generated 349 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:50.194403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:50.265221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7571eab-c147-484b-9e89-05b2d8640618 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:50.361339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca896ecf-dc22-47b7-b87c-c429f6bf0485 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:50.383282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a3851704830448389356223fb8ee71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3eeaa9e9c441709de92f09b9f17914', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.384255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.384544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.384951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.385692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:50.385997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:50.387645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:50.416290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2719/5442] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:50.441186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.441974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.442260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.442533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.444893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:50.450835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:50.531403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2724/5443] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:50 2022] POST /identity/v3/projects => generated 373 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:50.532032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:50.557153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bae5c-5047-45e3-a10c-5e82784970c7 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:50.562711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:50.564859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:50.698727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dcec3-b320-48d2-9dad-f1fa3053d37d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:50.704096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.705231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.705696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.706176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.757828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85120451-8b05-449f-a2f6-fd9470f743da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.760829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120451-8b05-449f-a2f6-fd9470f743da admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.763745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120451-8b05-449f-a2f6-fd9470f743da admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.765581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120451-8b05-449f-a2f6-fd9470f743da admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.768408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85120451-8b05-449f-a2f6-fd9470f743da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:50.776706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85120451-8b05-449f-a2f6-fd9470f743da admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:50.829833 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2720/5444] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:50 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:50.837537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d37eb-65dd-4ade-85f5-85faaedeb628 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.837910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d37eb-65dd-4ade-85f5-85faaedeb628 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.838199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d37eb-65dd-4ade-85f5-85faaedeb628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.869527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-157d37eb-65dd-4ade-85f5-85faaedeb628 None None] MFA Rules not processed for user `5ea5d144165a4e129de242905439e951`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:50.871057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-157d37eb-65dd-4ade-85f5-85faaedeb628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:50.881687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:50.886652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:50.907935 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2725/5445] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:50 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:03:50.908940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:50.921594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d02c5-8618-4715-9040-bc56134c519a service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:50.928738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.929934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.930289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.930650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:50.932961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:50.936386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:50.955737 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2726/5446] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:50.961463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:50.981631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1961b1-8275-4cd4-8f44-db269c43995e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:50.996230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:50.998326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:50.998828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:50.999280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] PATH_INFO: `/v3/projects/e29ec5713c9346dfa9aed7da420ffff0/users/0f45f79002d148b493c58bffe18b4c3a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:51.035537 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2721/5447] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:51.047457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29ec5713c9346dfa9aed7da420ffff0, user_id=0f45f79002d148b493c58bffe18b4c3a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:51.059402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:51.085536 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2727/5448] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:50 2022] PUT /identity/v3/projects/e29ec5713c9346dfa9aed7da420ffff0/users/0f45f79002d148b493c58bffe18b4c3a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:51.087269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d37eb-65dd-4ade-85f5-85faaedeb628 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:51.111554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d37eb-65dd-4ade-85f5-85faaedeb628 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:51.240087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:51.241039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:51.241431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:51.241852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:51.242970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:51.244817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:51.283938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:51.295553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2722/5449] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:03:51.296819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:51.320211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364703b-fd07-46d8-8e1a-eeea0af80084 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:51.369710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a690f4-64e5-4ed6-a91a-b34b6a9edec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:51.373396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a690f4-64e5-4ed6-a91a-b34b6a9edec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:51.374083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a690f4-64e5-4ed6-a91a-b34b6a9edec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:51.374447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a690f4-64e5-4ed6-a91a-b34b6a9edec9 admin admin] PATH_INFO: `/v3/projects/e29ec5713c9346dfa9aed7da420ffff0/users/0f45f79002d148b493c58bffe18b4c3a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:51.378823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a690f4-64e5-4ed6-a91a-b34b6a9edec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29ec5713c9346dfa9aed7da420ffff0, user_id=0f45f79002d148b493c58bffe18b4c3a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:51.383760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a690f4-64e5-4ed6-a91a-b34b6a9edec9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:51.400044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c5bb4-3d78-4de5-a659-7b06ae8ff00f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:51.431944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2723/5450] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:51 2022] PUT /identity/v3/projects/e29ec5713c9346dfa9aed7da420ffff0/users/0f45f79002d148b493c58bffe18b4c3a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:51.446058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:51.447623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:51.447623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:51.508765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a3851704830448389356223fb8ee71a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3eeaa9e9c441709de92f09b9f17914', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:51.509954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:51.510244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:51.510651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] PATH_INFO: `/v3/projects/1411a58cd64c42e88ceeb300d1d5356b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:51.512195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1411a58cd64c42e88ceeb300d1d5356b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:51.518253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:51.530309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] MFA Rules not processed for user `0f45f79002d148b493c58bffe18b4c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:51.531211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:51.591683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1411a58cd64c42e88ceeb300d1d5356b', 'request_id': 'req-f2a68343-a5ed-4dbc-93c4-418a01f59375'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:51.607193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1411a58cd64c42e88ceeb300d1d5356b', 'request_id': 'req-f2a68343-a5ed-4dbc-93c4-418a01f59375'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:51.620459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1411a58cd64c42e88ceeb300d1d5356b', 'request_id': 'req-f2a68343-a5ed-4dbc-93c4-418a01f59375'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:51.644172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] The token cache is being invalidate because project 1411a58cd64c42e88ceeb300d1d5356b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:51.644808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:51.645675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:51.651129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2728/5451] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:51 2022] DELETE /identity/v3/projects/1411a58cd64c42e88ceeb300d1d5356b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:51.692422 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2724/5452] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:51.700509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:51.702741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:51.819826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68343-a5ed-4dbc-93c4-418a01f59375 tempest-QuotasTest-458099975 tempest-QuotasTest-458099975-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:51.825176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f9cfc-f8fd-48cf-8ea9-581db16e3e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:51.826137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f9cfc-f8fd-48cf-8ea9-581db16e3e5e service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:51.826434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f9cfc-f8fd-48cf-8ea9-581db16e3e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:51.826758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f9cfc-f8fd-48cf-8ea9-581db16e3e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:51.829232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-501f9cfc-f8fd-48cf-8ea9-581db16e3e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:51.948166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f9cfc-f8fd-48cf-8ea9-581db16e3e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:51.949652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f9cfc-f8fd-48cf-8ea9-581db16e3e5e service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:51.979283 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2729/5453] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:52.972348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:52.975990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:53.127873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca0c97-75af-4a72-adc7-1e408e49008e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:53.278595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:53.280152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:53.280467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:53.280841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] PATH_INFO: `/v3/users/eef4363fc32c49c280a53a6949187740` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:53.283720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef4363fc32c49c280a53a6949187740)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:53.285860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:53.355154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef4363fc32c49c280a53a6949187740'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:53.368473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef4363fc32c49c280a53a6949187740'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:53.369909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef4363fc32c49c280a53a6949187740'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:53.370623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef4363fc32c49c280a53a6949187740'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:53.387930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef4363fc32c49c280a53a6949187740'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:53.415361 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2725/5454] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:52 2022] DELETE /identity/v3/users/eef4363fc32c49c280a53a6949187740 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:53.416954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c20a6-90e4-46c2-b1fe-2dc7759eb5ca None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:53.417443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c20a6-90e4-46c2-b1fe-2dc7759eb5ca None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:53.417443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c20a6-90e4-46c2-b1fe-2dc7759eb5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:53.457928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d53c20a6-90e4-46c2-b1fe-2dc7759eb5ca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:53.459199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d53c20a6-90e4-46c2-b1fe-2dc7759eb5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:53.673739 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2730/5455] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:53.701092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:53.702578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:53.918860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f5c76-a819-42a7-9c35-f437b1894297 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:53.923278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:53.924191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:53.924653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:53.925138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:53.942393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:53.947964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:53.967909 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2726/5456] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:54.020589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11537e-24a6-455b-a87a-996cf387dedd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:54.020935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11537e-24a6-455b-a87a-996cf387dedd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:54.021193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11537e-24a6-455b-a87a-996cf387dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:54.056167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-af11537e-24a6-455b-a87a-996cf387dedd None None] MFA Rules not processed for user `0cd1a3e3a02a4a7889ad46c94fbe8e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:54.058400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-af11537e-24a6-455b-a87a-996cf387dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:54.272186 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2731/5457] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:54.910154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:54.912289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:54.977995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e91f6d-535e-4b92-8a09-75709961dc85 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:54.996157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:54.997563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:54.997943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:54.998285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] PATH_INFO: `/v3/users/d1178d0a050245f9b14de19acf9f10eb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:55.007792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1178d0a050245f9b14de19acf9f10eb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:55.009857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:55.093716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1178d0a050245f9b14de19acf9f10eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.101733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1178d0a050245f9b14de19acf9f10eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.102931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1178d0a050245f9b14de19acf9f10eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.103566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1178d0a050245f9b14de19acf9f10eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.115299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1178d0a050245f9b14de19acf9f10eb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.161158 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2727/5458] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:54 2022] DELETE /identity/v3/users/d1178d0a050245f9b14de19acf9f10eb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:55.165859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:55.166400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:55.166497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:55.189387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:55.191435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:55.334107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:55.337380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:55.382880 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2732/5459] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:55.406565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:55.409301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:55.484132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08009c06-5ee2-4272-b082-e4ec789bec8d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:55.491149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:55.492034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:55.492323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:55.492600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] PATH_INFO: `/v3/projects/7f71f1f3f4684d59a302900c5c6354e7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:55.494838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f71f1f3f4684d59a302900c5c6354e7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:55.497861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:55.562977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f71f1f3f4684d59a302900c5c6354e7', 'request_id': 'req-a896dfcf-e550-4359-8832-54703a921463'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.572824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f71f1f3f4684d59a302900c5c6354e7', 'request_id': 'req-a896dfcf-e550-4359-8832-54703a921463'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.580068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de973c-5207-4362-8516-13d2f538c28e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:55.585843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f71f1f3f4684d59a302900c5c6354e7', 'request_id': 'req-a896dfcf-e550-4359-8832-54703a921463'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.606238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] The token cache is being invalidate because project 7f71f1f3f4684d59a302900c5c6354e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:55.606848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.607987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.617402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2728/5460] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:55 2022] DELETE /identity/v3/projects/7f71f1f3f4684d59a302900c5c6354e7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:03:55.618627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:55.620723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:55.702486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:55.703347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:55.703673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:55.703965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:55.708351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:55.709869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896dfcf-e550-4359-8832-54703a921463 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:55.716297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:55.717955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:55.718131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:55.718448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] PATH_INFO: `/v3/users/2a3851704830448389356223fb8ee71a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:55.721388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3851704830448389356223fb8ee71a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:55.724563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:55.741487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:55.745347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:55.772307 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2733/5461] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:03:55.801014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3851704830448389356223fb8ee71a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.812873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3851704830448389356223fb8ee71a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.813868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3851704830448389356223fb8ee71a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.814513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3851704830448389356223fb8ee71a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.834014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db51560b-f577-4006-a139-456f8fa45c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3851704830448389356223fb8ee71a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:55.867111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2729/5462] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:55 2022] DELETE /identity/v3/users/2a3851704830448389356223fb8ee71a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:56.923579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:56.927371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:56.944426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862840a9-35db-45c0-b170-24c9a7b4090c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:57.037151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.037776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.037776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.045911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:57.046866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.047156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.047432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] PATH_INFO: `/v3/projects/6f158d8420cb42c38e5f216bc8c59b0e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.048801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f158d8420cb42c38e5f216bc8c59b0e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:57.051877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:57.065242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:57.066762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:57.139001 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2730/5463] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:57.141524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:57.143470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f158d8420cb42c38e5f216bc8c59b0e', 'request_id': 'req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.145050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:57.153715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f158d8420cb42c38e5f216bc8c59b0e', 'request_id': 'req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.169950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f158d8420cb42c38e5f216bc8c59b0e', 'request_id': 'req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.173559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2e45-eeea-4121-acf7-58e4f6cb5a63 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:57.201115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] The token cache is being invalidate because project 6f158d8420cb42c38e5f216bc8c59b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:57.201773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.202646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.205509 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2734/5464] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:56 2022] DELETE /identity/v3/projects/6f158d8420cb42c38e5f216bc8c59b0e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:57.210038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:57.217403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:57.286367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:57.287635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.288140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.288600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] PATH_INFO: `/v3/projects/ea3eeaa9e9c441709de92f09b9f17914` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.289979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3eeaa9e9c441709de92f09b9f17914)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:57.292429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:57.326219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37f1ef-ee4c-4e24-b1ef-0943407966a9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:57.333924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:57.334942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.335280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.335702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] PATH_INFO: `/v3/users/0f45f79002d148b493c58bffe18b4c3a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.337440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f45f79002d148b493c58bffe18b4c3a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:57.339690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:57.377003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3eeaa9e9c441709de92f09b9f17914', 'request_id': 'req-c158359d-8a24-46b0-bc53-e1b90f719c6e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.388398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3eeaa9e9c441709de92f09b9f17914', 'request_id': 'req-c158359d-8a24-46b0-bc53-e1b90f719c6e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.401601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3eeaa9e9c441709de92f09b9f17914', 'request_id': 'req-c158359d-8a24-46b0-bc53-e1b90f719c6e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.416575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] The token cache is being invalidate because project ea3eeaa9e9c441709de92f09b9f17914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:57.417520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.418966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c158359d-8a24-46b0-bc53-e1b90f719c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.425727 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2731/5465] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:57 2022] DELETE /identity/v3/projects/ea3eeaa9e9c441709de92f09b9f17914 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:57.434721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd236-964a-4eff-bcdd-0c682300e589 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.435426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd236-964a-4eff-bcdd-0c682300e589 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.435790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd236-964a-4eff-bcdd-0c682300e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.468419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-759dd236-964a-4eff-bcdd-0c682300e589 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:57.469821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-759dd236-964a-4eff-bcdd-0c682300e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:57.477887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f45f79002d148b493c58bffe18b4c3a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.479262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f45f79002d148b493c58bffe18b4c3a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.498271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f45f79002d148b493c58bffe18b4c3a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.500484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f45f79002d148b493c58bffe18b4c3a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.517890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a84c6a7-f0b3-44c0-b46f-d2b1699e2d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f45f79002d148b493c58bffe18b4c3a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:57.562558 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2735/5466] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:03:57 2022] DELETE /identity/v3/users/0f45f79002d148b493c58bffe18b4c3a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:57.581440 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2732/5467] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:57.591584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090917-1cd1-4436-a906-b4c07a69b7cd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.591961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090917-1cd1-4436-a906-b4c07a69b7cd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.592560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090917-1cd1-4436-a906-b4c07a69b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.616647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1d090917-1cd1-4436-a906-b4c07a69b7cd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:57.618841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1d090917-1cd1-4436-a906-b4c07a69b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:57.738171 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2736/5468] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:57.742565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd236-964a-4eff-bcdd-0c682300e589 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:57.753615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd236-964a-4eff-bcdd-0c682300e589 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:57.760125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:57.760810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.761099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.761380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.762118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:57.762423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:57.764377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:57.778827 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2733/5469] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:03:57.782604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d090917-1cd1-4436-a906-b4c07a69b7cd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:57.797086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d090917-1cd1-4436-a906-b4c07a69b7cd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:57.820837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:57.821513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.821796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.822068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.822760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:57.824899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:57.869243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2737/5470] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:57 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:57.873188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:57.884628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc638-192f-4b7c-ae0a-e6e03964c29d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:57.958157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:57.959087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:57.959373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:57.959643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:57.960407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:57.962565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:57.998732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:57.999864 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2734/5471] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:57 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:58.013853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e403b9e-abf1-49bd-945f-366964f61e42 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.023922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.025160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.025612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.026693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.028212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.030924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.055419 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2738/5472] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:58.058827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.072205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c9f55-f3d8-4fdf-ac2b-f5e5b7ae8dca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.077938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9982e-9e49-41b2-8079-30f05275598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.078880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9982e-9e49-41b2-8079-30f05275598a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.079349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9982e-9e49-41b2-8079-30f05275598a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.079789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9982e-9e49-41b2-8079-30f05275598a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.080913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9982e-9e49-41b2-8079-30f05275598a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.082744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9982e-9e49-41b2-8079-30f05275598a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.098460 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2735/5473] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:58.098990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.114643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8a132-c1f4-4f48-9cfa-2781fa119e9a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.120576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.121526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.121845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.122130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] PATH_INFO: `/v3/projects/9676372a53d94601901a452d36962ce4/users/5c56a70155934f04bd210da8fe704d42/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.142091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9676372a53d94601901a452d36962ce4, user_id=5c56a70155934f04bd210da8fe704d42, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.145667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.174341 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2739/5474] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:58 2022] PUT /identity/v3/projects/9676372a53d94601901a452d36962ce4/users/5c56a70155934f04bd210da8fe704d42/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:58.176837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6e74-a4d0-4e9b-ad3e-f3e9230245ec None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.177134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6e74-a4d0-4e9b-ad3e-f3e9230245ec None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.177417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc6e74-a4d0-4e9b-ad3e-f3e9230245ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.236599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bffc6e74-a4d0-4e9b-ad3e-f3e9230245ec None None] MFA Rules not processed for user `5c56a70155934f04bd210da8fe704d42`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:58.237843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bffc6e74-a4d0-4e9b-ad3e-f3e9230245ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:58.288513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.290486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:58.324475 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2736/5475] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:58.325443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6e74-a4d0-4e9b-ad3e-f3e9230245ec None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.380219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ec412-2938-43f5-8dc0-dff46496f4a2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.386164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.387275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.387668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.388072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] PATH_INFO: `/v3/projects/e29ec5713c9346dfa9aed7da420ffff0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.389598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29ec5713c9346dfa9aed7da420ffff0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.391982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.416155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc6e74-a4d0-4e9b-ad3e-f3e9230245ec None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.421188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.421992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.422341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.422685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.424154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.427100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.456067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29ec5713c9346dfa9aed7da420ffff0', 'request_id': 'req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:58.464162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29ec5713c9346dfa9aed7da420ffff0', 'request_id': 'req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:58.465970 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2737/5476] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:58 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:58.470570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.481621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29ec5713c9346dfa9aed7da420ffff0', 'request_id': 'req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:58.497617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] The token cache is being invalidate because project e29ec5713c9346dfa9aed7da420ffff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:03:58.497895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:58.501227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8bc2a4da-fdd3-4a43-973c-dbe92d15b9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:03:58.504768 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2740/5477] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:03:58 2022] DELETE /identity/v3/projects/e29ec5713c9346dfa9aed7da420ffff0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:58.509554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb37f6-1b2f-4d99-9969-0c9b29bf8011 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.509992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb37f6-1b2f-4d99-9969-0c9b29bf8011 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.510797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb37f6-1b2f-4d99-9969-0c9b29bf8011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.536014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a0fb37f6-1b2f-4d99-9969-0c9b29bf8011 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:58.539043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a0fb37f6-1b2f-4d99-9969-0c9b29bf8011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:58.584208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735756ef-f2f0-415a-a2ec-e81bcf833da4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.596140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.597054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.599587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.599587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.600534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.602502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.637030 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2738/5478] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:58 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:03:58.641939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.646508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:58.664348 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2741/5479] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:03:58.670132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6e24d-96eb-400e-830b-6d7866fddc71 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.678510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6e24d-96eb-400e-830b-6d7866fddc71 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.680060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6e24d-96eb-400e-830b-6d7866fddc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.695787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f89fa-67d0-4228-a485-0a3874e9e066 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.712991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.713672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.713871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.714141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.714905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.717525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.729108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-80a6e24d-96eb-400e-830b-6d7866fddc71 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:58.730360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-80a6e24d-96eb-400e-830b-6d7866fddc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:58.740799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2739/5480] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:58.741936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.751305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2742/5481] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:58.754718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a75f7-1b9c-4084-b99a-b64eef3a82d8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.759979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6e24d-96eb-400e-830b-6d7866fddc71 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.775212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.777624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.779106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.779599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] PATH_INFO: `/v3/projects/52e29d12afb3431caddf0b22198fefba/users/516d394441e740cc8031ef073d0c52a3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.790545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6e24d-96eb-400e-830b-6d7866fddc71 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.807888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.809269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.809642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.810243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.811082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:03:58.812042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.815381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e29d12afb3431caddf0b22198fefba, user_id=516d394441e740cc8031ef073d0c52a3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.819831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.821446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:58.847544 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2743/5482] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:03:58.850702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.852686 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2740/5483] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:58 2022] PUT /identity/v3/projects/52e29d12afb3431caddf0b22198fefba/users/516d394441e740cc8031ef073d0c52a3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:58.856198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:58.869727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ed5d2-0eaf-47bf-8298-833e35350a3a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:58.952895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:58.953618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:58.953904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:58.954179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:58.954904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:58.956948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.000778 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2744/5484] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:03:58 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:59.005144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:59.022379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16f45a-a3dd-4dfd-90c6-8aed1906890d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.176463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a9c3a-1ae1-443a-8cef-276f5e7c3a03 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.190171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.192485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.193839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.194128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.201228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.201228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.203033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.204938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.204938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.205558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.206400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.209304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.225943 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2741/5485] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:59.230406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:59.267266 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2745/5486] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:03:59 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:03:59.268508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:59.269508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d012b0d-3b12-4a9b-b09a-71c6a7d4ae72 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.292709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08726211-24fb-4acf-8707-ec79efae6e4e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.298163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2670ab-429b-4e98-8c5a-19841163396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.299069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2670ab-429b-4e98-8c5a-19841163396a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.299350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2670ab-429b-4e98-8c5a-19841163396a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.299628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2670ab-429b-4e98-8c5a-19841163396a admin admin] PATH_INFO: `/v3/projects/52e29d12afb3431caddf0b22198fefba/users/516d394441e740cc8031ef073d0c52a3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.300787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.301704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.302168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.302635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.303595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.305615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.306583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2670ab-429b-4e98-8c5a-19841163396a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e29d12afb3431caddf0b22198fefba, user_id=516d394441e740cc8031ef073d0c52a3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.309322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2670ab-429b-4e98-8c5a-19841163396a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.345103 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2746/5487] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:59.346203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:59.368949 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2742/5488] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:59 2022] PUT /identity/v3/projects/52e29d12afb3431caddf0b22198fefba/users/516d394441e740cc8031ef073d0c52a3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:59.370825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bc394-3359-469c-b4b2-9687fb03c33b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.371547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.373142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.374387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.447775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] MFA Rules not processed for user `516d394441e740cc8031ef073d0c52a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:59.449385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:59.496220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.496220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.496220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.497215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.497215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.498681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.522971 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2747/5489] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:03:59.524937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:59.552083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204da80-7203-4196-9a77-a04470c5b6a1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.565024 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2743/5490] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:59.567285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ca455-a9a7-4ca7-b066-ee697a71eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.568455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ca455-a9a7-4ca7-b066-ee697a71eb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.568748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ca455-a9a7-4ca7-b066-ee697a71eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.569027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ca455-a9a7-4ca7-b066-ee697a71eb32 admin admin] PATH_INFO: `/v3/projects/3eb6f72ad6d74a07a2dfe86fad801ec7/users/47d6db69f9fc429fb995db3b839d1cd6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.599377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ca455-a9a7-4ca7-b066-ee697a71eb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb6f72ad6d74a07a2dfe86fad801ec7, user_id=47d6db69f9fc429fb995db3b839d1cd6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.602988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ca455-a9a7-4ca7-b066-ee697a71eb32 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.613899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:59.615669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:59.631403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2748/5491] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:03:59 2022] PUT /identity/v3/projects/3eb6f72ad6d74a07a2dfe86fad801ec7/users/47d6db69f9fc429fb995db3b839d1cd6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:03:59.641239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.649515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.649795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.685364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] MFA Rules not processed for user `47d6db69f9fc429fb995db3b839d1cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:03:59.688264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:59.749269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de69ac5-166a-451f-92d2-4b0f725f0553 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.776747 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2749/5492] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:03:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:03:59.790366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:03:59.792678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:03:59.839740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.840416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.848600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.848600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.906353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6414c6-8454-47be-9829-4f830f40c753 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:03:59.917721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5590d7-e272-44df-8d55-81c3d4c706cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:03:59.918208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5590d7-e272-44df-8d55-81c3d4c706cd service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:03:59.918495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5590d7-e272-44df-8d55-81c3d4c706cd service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:03:59.921981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5590d7-e272-44df-8d55-81c3d4c706cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:03:59.938058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5590d7-e272-44df-8d55-81c3d4c706cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.940279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5590d7-e272-44df-8d55-81c3d4c706cd service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.948052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:03:59.949641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:03:59.958082 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2750/5493] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:03:59.964018 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2744/5494] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:03:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:04:00.405447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f4d7-cfe3-4e6f-a70c-1ab0c0846e77 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:00.406628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f4d7-cfe3-4e6f-a70c-1ab0c0846e77 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:00.407372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f4d7-cfe3-4e6f-a70c-1ab0c0846e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:00.473942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0120f4d7-cfe3-4e6f-a70c-1ab0c0846e77 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:00.475395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0120f4d7-cfe3-4e6f-a70c-1ab0c0846e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:00.631186 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2751/5495] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:02.864362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:02.942582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42d921-a1d6-4abf-9c94-02cc8bb3a2fa service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:02.957346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:02.957346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:02.957346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:02.957346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] PATH_INFO: `/v3/users/47d6db69f9fc429fb995db3b839d1cd6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:02.957877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d6db69f9fc429fb995db3b839d1cd6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:02.959130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:03.040262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d6db69f9fc429fb995db3b839d1cd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:03.054614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d6db69f9fc429fb995db3b839d1cd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:03.055721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d6db69f9fc429fb995db3b839d1cd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:03.058170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d6db69f9fc429fb995db3b839d1cd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:03.082415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d6db69f9fc429fb995db3b839d1cd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:03.115348 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2745/5496] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:04:02 2022] DELETE /identity/v3/users/47d6db69f9fc429fb995db3b839d1cd6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:03.121217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b22d-84a4-4927-b466-cb2fa6e0f2fb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:03.121699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b22d-84a4-4927-b466-cb2fa6e0f2fb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:03.121841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109b22d-84a4-4927-b466-cb2fa6e0f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:03.139449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e109b22d-84a4-4927-b466-cb2fa6e0f2fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:03.140762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e109b22d-84a4-4927-b466-cb2fa6e0f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:03.213342 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2752/5497] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:03.220099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:03.222291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:03.307573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba40ba8-4605-4cb3-bc4d-8509559811e9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:03.312148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011072-216a-4fe5-b014-64de018144f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:03.313052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011072-216a-4fe5-b014-64de018144f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:03.313728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011072-216a-4fe5-b014-64de018144f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:03.314379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011072-216a-4fe5-b014-64de018144f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:03.330367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011072-216a-4fe5-b014-64de018144f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:03.332558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011072-216a-4fe5-b014-64de018144f7 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:03.346961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2746/5498] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:04.049985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.050280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.050560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.055679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a745a-0464-4bb8-826b-8c16eaeb035d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.056203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a745a-0464-4bb8-826b-8c16eaeb035d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.056203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a745a-0464-4bb8-826b-8c16eaeb035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.072768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:04.074016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:04.090320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-353a745a-0464-4bb8-826b-8c16eaeb035d None None] MFA Rules not processed for user `887054d178de43b18a472fed2297659d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:04.093327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-353a745a-0464-4bb8-826b-8c16eaeb035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:04.186600 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2753/5499] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:04.188166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:04.191440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:04.214661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2747/5500] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:04.226427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f293e8-a949-47f3-bdd9-11a07f8d3ea5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:04.231924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:04.232959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.233234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.233502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] PATH_INFO: `/v3/projects/3eb6f72ad6d74a07a2dfe86fad801ec7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.234839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb6f72ad6d74a07a2dfe86fad801ec7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:04.236822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:04.310380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb6f72ad6d74a07a2dfe86fad801ec7', 'request_id': 'req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:04.318737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb6f72ad6d74a07a2dfe86fad801ec7', 'request_id': 'req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:04.328507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb6f72ad6d74a07a2dfe86fad801ec7', 'request_id': 'req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:04.341046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] The token cache is being invalidate because project 3eb6f72ad6d74a07a2dfe86fad801ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:04:04.341384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:04.342397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8deb5a1d-e3aa-4fe0-ae43-e92df8ba73c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:04.346830 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2754/5501] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:04:04 2022] DELETE /identity/v3/projects/3eb6f72ad6d74a07a2dfe86fad801ec7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:04.351631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3243d-9412-4a99-bdc0-160957a755c9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.351929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3243d-9412-4a99-bdc0-160957a755c9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.352212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3243d-9412-4a99-bdc0-160957a755c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.370537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a2b3243d-9412-4a99-bdc0-160957a755c9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:04.372038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a2b3243d-9412-4a99-bdc0-160957a755c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:04.446502 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2748/5502] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:04.456492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7e2c4-009b-4e8e-80c9-3efcee4f4950 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.456840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7e2c4-009b-4e8e-80c9-3efcee4f4950 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.457621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7e2c4-009b-4e8e-80c9-3efcee4f4950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.500873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-54d7e2c4-009b-4e8e-80c9-3efcee4f4950 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:04.502906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54d7e2c4-009b-4e8e-80c9-3efcee4f4950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:04.516114 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2755/5503] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:04.521880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3243d-9412-4a99-bdc0-160957a755c9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:04.534497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3243d-9412-4a99-bdc0-160957a755c9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:04.539598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:04.540344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.540694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.541269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.542719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:04:04.543257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:04.545374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:04.568060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7e2c4-009b-4e8e-80c9-3efcee4f4950 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:04.570987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2749/5504] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:04:04.578255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7e2c4-009b-4e8e-80c9-3efcee4f4950 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:04.584294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:04.585653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.585842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.586120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.586841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:04.589032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:04.627319 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2756/5505] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:04:04 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:04:04.631990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:04.643851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf69d5-6fc6-49e3-967b-703ed736775e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:04.733138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:04.733836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.734117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.735115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.735839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:04.737832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:04.766174 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2750/5506] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:04:04 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:04:04.771377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:04.789119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6746f-224e-4338-a6ee-f95f76aaa1bd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:04.794689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:04.795746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.796281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.796587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.797439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:04.799256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:04.818543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:04.824649 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2757/5507] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:04:04.830326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6605d4-e190-42d9-b206-0b4289a03493 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:04.836486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0e3a-3f8c-44f7-9b93-dc4269702661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:04.837592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0e3a-3f8c-44f7-9b93-dc4269702661 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.838144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0e3a-3f8c-44f7-9b93-dc4269702661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.838522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0e3a-3f8c-44f7-9b93-dc4269702661 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.839397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0e3a-3f8c-44f7-9b93-dc4269702661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:04.841133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0e3a-3f8c-44f7-9b93-dc4269702661 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:04.858231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:04.864127 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2751/5508] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:04:04.871266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0caa1c-42b5-4967-a78c-a0f19da7427d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:04.877861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:04.878853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.880032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.880419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] PATH_INFO: `/v3/projects/17f1e26eb0cc42eea75d5194838b50f5/users/b18ec20bcd654015b37eb90758427e1e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:04.899450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f1e26eb0cc42eea75d5194838b50f5, user_id=b18ec20bcd654015b37eb90758427e1e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:04.902701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:04.933543 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2758/5509] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:04:04 2022] PUT /identity/v3/projects/17f1e26eb0cc42eea75d5194838b50f5/users/b18ec20bcd654015b37eb90758427e1e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:04.949736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:04.959468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:04.959970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:05.016852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] MFA Rules not processed for user `b18ec20bcd654015b37eb90758427e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:05.018261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:05.101547 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2752/5510] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:05.113049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:05.115704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:05.203330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d0a58-c5d6-4c82-afbc-79e8d0716861 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:05.207503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b1d3b-b41c-44ed-9393-1f0d61d5c622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:05.208259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1d3b-b41c-44ed-9393-1f0d61d5c622 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:05.208616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1d3b-b41c-44ed-9393-1f0d61d5c622 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:05.208964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b1d3b-b41c-44ed-9393-1f0d61d5c622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:05.227594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b1d3b-b41c-44ed-9393-1f0d61d5c622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:05.229476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b1d3b-b41c-44ed-9393-1f0d61d5c622 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:05.253357 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2759/5511] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:05.463166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:05.473662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:05.571372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72592cfe-30a0-4db2-a91e-37ebb0613e71 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:05.577714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:05.579820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:05.580690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:05.581698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] PATH_INFO: `/v3/users/5c56a70155934f04bd210da8fe704d42` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:05.587529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c56a70155934f04bd210da8fe704d42)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:05.592268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:05.671550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c56a70155934f04bd210da8fe704d42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:05.681533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c56a70155934f04bd210da8fe704d42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:05.682418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c56a70155934f04bd210da8fe704d42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:05.683336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c56a70155934f04bd210da8fe704d42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:05.706296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dc67d5a4-f037-403b-b4a2-e31185739101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c56a70155934f04bd210da8fe704d42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:05.723772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:05.724067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:05.724351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:05.766262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2753/5512] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:04:05 2022] DELETE /identity/v3/users/5c56a70155934f04bd210da8fe704d42 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:05.770805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:05.771221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:05.772287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:05.776969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:05.778762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:05.903275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:05.905207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:05.958199 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2760/5513] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:06.071290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2754/5514] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:06.086349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:06.087830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:06.201933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7be76-85aa-4a65-b09c-dd278caa2b49 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:06.208280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:06.211379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:06.211900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:06.212586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:06.229663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:06.231271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:06.245989 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2761/5515] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:06.543366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:06.546745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:06.679468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b7a3e-170d-465d-a7b8-aed463a2b82f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:06.684362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7d703-b8b7-449b-bf54-ece60245fe62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:06.685291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d703-b8b7-449b-bf54-ece60245fe62 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:06.685573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d703-b8b7-449b-bf54-ece60245fe62 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:06.685846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d703-b8b7-449b-bf54-ece60245fe62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:06.687721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1cb7d703-b8b7-449b-bf54-ece60245fe62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:06.707805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d703-b8b7-449b-bf54-ece60245fe62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:06.709430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d703-b8b7-449b-bf54-ece60245fe62 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:06.734353 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2755/5516] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:06.800104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:06.801605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:06.825718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2004e5b-bbb0-484d-86ce-81ff2af8fe3f service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:06.830810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:06.832621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:06.832918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:06.833330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] PATH_INFO: `/v3/projects/9676372a53d94601901a452d36962ce4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:06.834639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9676372a53d94601901a452d36962ce4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:06.836691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:06.891836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d081f-7d1d-4894-82d5-2fab97483048 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:06.892173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d081f-7d1d-4894-82d5-2fab97483048 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:06.892490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d081f-7d1d-4894-82d5-2fab97483048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:06.923700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-424d081f-7d1d-4894-82d5-2fab97483048 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:06.923700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-424d081f-7d1d-4894-82d5-2fab97483048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:06.930679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9676372a53d94601901a452d36962ce4', 'request_id': 'req-cbf4063d-660b-4e11-8c00-63bb5e4771c4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:06.940750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9676372a53d94601901a452d36962ce4', 'request_id': 'req-cbf4063d-660b-4e11-8c00-63bb5e4771c4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:06.979230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9676372a53d94601901a452d36962ce4', 'request_id': 'req-cbf4063d-660b-4e11-8c00-63bb5e4771c4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.006786 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2756/5517] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:07.026229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] The token cache is being invalidate because project 9676372a53d94601901a452d36962ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:04:07.026892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.027900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cbf4063d-660b-4e11-8c00-63bb5e4771c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.031422 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2762/5518] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:04:06 2022] DELETE /identity/v3/projects/9676372a53d94601901a452d36962ce4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:07.035972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d081f-7d1d-4894-82d5-2fab97483048 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:07.091973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:07.092491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:07.092645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:07.121121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] MFA Rules not processed for user `b18ec20bcd654015b37eb90758427e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:07.122013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:07.130520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d081f-7d1d-4894-82d5-2fab97483048 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:07.136578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:07.137608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:07.138045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:07.138474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] PATH_INFO: `/v3/users/516d394441e740cc8031ef073d0c52a3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:07.139906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516d394441e740cc8031ef073d0c52a3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:07.142822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:07.205272 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2763/5519] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:04:07.224329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516d394441e740cc8031ef073d0c52a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.235087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516d394441e740cc8031ef073d0c52a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.235841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516d394441e740cc8031ef073d0c52a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.236551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516d394441e740cc8031ef073d0c52a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.248001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f0b6e5fb-2c9b-47c8-8889-cc5c164cb610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516d394441e740cc8031ef073d0c52a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:07.282044 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2757/5520] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:04:07 2022] DELETE /identity/v3/users/516d394441e740cc8031ef073d0c52a3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:08.117289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:08.121167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:08.141101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bd403-df73-4333-9eb6-388fe2679989 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:08.231996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:08.235558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.236076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.236550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] PATH_INFO: `/v3/projects/52e29d12afb3431caddf0b22198fefba` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.238108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e29d12afb3431caddf0b22198fefba)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:08.240341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:08.331478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e29d12afb3431caddf0b22198fefba', 'request_id': 'req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:08.340470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e29d12afb3431caddf0b22198fefba', 'request_id': 'req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:08.350578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e29d12afb3431caddf0b22198fefba', 'request_id': 'req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:08.377161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] The token cache is being invalidate because project 52e29d12afb3431caddf0b22198fefba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:04:08.386277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:08.387089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1a33bda1-fa9c-4945-bbdd-06eae21c3dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:08.392964 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2764/5521] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:04:08 2022] DELETE /identity/v3/projects/52e29d12afb3431caddf0b22198fefba => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:08.395659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a76822-8145-49db-bc52-28045dd267bc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.396194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a76822-8145-49db-bc52-28045dd267bc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.396329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a76822-8145-49db-bc52-28045dd267bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.441867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b8a76822-8145-49db-bc52-28045dd267bc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:08.443365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b8a76822-8145-49db-bc52-28045dd267bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:08.491530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6a246-a6e0-4dcf-8b2c-1dfcab2082c0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.491960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6a246-a6e0-4dcf-8b2c-1dfcab2082c0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.492347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6a246-a6e0-4dcf-8b2c-1dfcab2082c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.511654 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2758/5522] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:08.520309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7d86e-edb7-41f5-9cd6-9ffef0c99bf3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.520603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7d86e-edb7-41f5-9cd6-9ffef0c99bf3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.520890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7d86e-edb7-41f5-9cd6-9ffef0c99bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.532567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-46a6a246-a6e0-4dcf-8b2c-1dfcab2082c0 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:08.535256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-46a6a246-a6e0-4dcf-8b2c-1dfcab2082c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:08.559271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-95e7d86e-edb7-41f5-9cd6-9ffef0c99bf3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:08.560744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-95e7d86e-edb7-41f5-9cd6-9ffef0c99bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:08.570027 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2759/5523] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:08.573742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7d86e-edb7-41f5-9cd6-9ffef0c99bf3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:08.589834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7d86e-edb7-41f5-9cd6-9ffef0c99bf3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:08.596146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:08.597635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.598132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.599162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.600327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:04:08.600961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:08.603611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:08.622915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2765/5524] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:04:08.626836 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2760/5525] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:04:08.628102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6a246-a6e0-4dcf-8b2c-1dfcab2082c0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:08.641637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6a246-a6e0-4dcf-8b2c-1dfcab2082c0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:08.654579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:08.656469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.656826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.657127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.658802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:08.660800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:08.734135 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2766/5526] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:04:08 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:04:08.735097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:08.745827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2f68-5b52-4649-9255-90b9ce28dba1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:08.813616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:08.814300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.814584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.815034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.815729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:08.817782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:08.840054 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2761/5527] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:04:08 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:04:08.843862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:08.855431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc7a3d-2399-48d6-8c96-52dc284f54ce admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:08.862938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:08.864503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.864829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.865116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.865844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:08.867854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:08.880809 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2767/5528] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:04:08.884802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:08.897349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759343e-22dc-4874-a49d-345def9ecfa3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:08.904112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b8e06-2593-4fb7-a2a6-c002046d1aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:08.905033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8e06-2593-4fb7-a2a6-c002046d1aeb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.905565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8e06-2593-4fb7-a2a6-c002046d1aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.905948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b8e06-2593-4fb7-a2a6-c002046d1aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.907285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b8e06-2593-4fb7-a2a6-c002046d1aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:08.909310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b8e06-2593-4fb7-a2a6-c002046d1aeb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:08.920759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2762/5529] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:04:08.924972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:08.936439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0335d-5c6c-4ba3-a8a8-4ada8de790d4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:08.941477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023867-fb58-41dd-ba49-31437f7f0a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:08.942495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023867-fb58-41dd-ba49-31437f7f0a9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:08.943029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023867-fb58-41dd-ba49-31437f7f0a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:08.943542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023867-fb58-41dd-ba49-31437f7f0a9a admin admin] PATH_INFO: `/v3/projects/3782d9da13c44a67a66be545e352dcf8/users/a3c56710438b4defbcd03c332ff24bb7/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:08.964889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023867-fb58-41dd-ba49-31437f7f0a9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3782d9da13c44a67a66be545e352dcf8, user_id=a3c56710438b4defbcd03c332ff24bb7, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:08.968607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023867-fb58-41dd-ba49-31437f7f0a9a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:09.005769 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2768/5530] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:04:08 2022] PUT /identity/v3/projects/3782d9da13c44a67a66be545e352dcf8/users/a3c56710438b4defbcd03c332ff24bb7/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:09.017778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:09.018131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:09.018346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:09.053774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] MFA Rules not processed for user `a3c56710438b4defbcd03c332ff24bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:09.071070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:09.168467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e979d-7165-4473-9a29-9c82fd8b3c6d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:09.168991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e979d-7165-4473-9a29-9c82fd8b3c6d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:09.168991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e979d-7165-4473-9a29-9c82fd8b3c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:09.194541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c76e979d-7165-4473-9a29-9c82fd8b3c6d None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:09.196355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c76e979d-7165-4473-9a29-9c82fd8b3c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:09.270161 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2763/5531] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:09.320819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:09.324972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:09.349393 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2769/5532] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:04:09.418516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd989f-fb60-4ad9-a143-0903ca446e39 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:09.427480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:09.428782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:09.429069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:09.429347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:09.454598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:09.458131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:09.475865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2764/5533] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:04:10.764315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58fb69-44b2-4d22-8189-db1c1e37e4ee None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:10.764838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58fb69-44b2-4d22-8189-db1c1e37e4ee None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:10.764952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58fb69-44b2-4d22-8189-db1c1e37e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:10.790567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0d58fb69-44b2-4d22-8189-db1c1e37e4ee None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:10.797210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0d58fb69-44b2-4d22-8189-db1c1e37e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:10.809957 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2770/5534] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:12.459061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:12.463998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:12.484935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd402c33-9009-4556-b625-96f4bf1e666e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:12.491377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed6976-4aa7-4920-9c62-65c1674bd7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:12.492579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed6976-4aa7-4920-9c62-65c1674bd7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:12.492825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed6976-4aa7-4920-9c62-65c1674bd7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:12.494556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed6976-4aa7-4920-9c62-65c1674bd7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:12.497198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b5ed6976-4aa7-4920-9c62-65c1674bd7d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:12.577738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed6976-4aa7-4920-9c62-65c1674bd7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:12.580127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed6976-4aa7-4920-9c62-65c1674bd7d4 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:12.600099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2765/5535] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:12.670505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40867f-93ae-4d34-a048-426540ed56b2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:12.671022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40867f-93ae-4d34-a048-426540ed56b2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:12.671096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40867f-93ae-4d34-a048-426540ed56b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:12.693131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0e40867f-93ae-4d34-a048-426540ed56b2 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:12.694585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e40867f-93ae-4d34-a048-426540ed56b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:12.702086 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2771/5536] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:13.778614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc1b5d-7d9b-4b07-885a-f51c98ce63ad None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:13.779145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc1b5d-7d9b-4b07-885a-f51c98ce63ad None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:13.779310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc1b5d-7d9b-4b07-885a-f51c98ce63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:13.797572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1cdc1b5d-7d9b-4b07-885a-f51c98ce63ad None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:13.798805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1cdc1b5d-7d9b-4b07-885a-f51c98ce63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:13.806037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2766/5537] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:20.313874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570a02-d341-46c5-b8e6-b6e371eee862 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:20.314363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570a02-d341-46c5-b8e6-b6e371eee862 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:20.314451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570a02-d341-46c5-b8e6-b6e371eee862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:20.332150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8e570a02-d341-46c5-b8e6-b6e371eee862 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:20.333347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8e570a02-d341-46c5-b8e6-b6e371eee862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:20.340185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2772/5538] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:04:20.840705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78103b-27c4-4e05-8635-2cef213f7b34 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:20.841148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78103b-27c4-4e05-8635-2cef213f7b34 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:20.841333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78103b-27c4-4e05-8635-2cef213f7b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:20.881728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8c78103b-27c4-4e05-8635-2cef213f7b34 None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:20.883126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8c78103b-27c4-4e05-8635-2cef213f7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:20.892011 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2767/5539] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:23.149632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:23.150959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:23.151495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:23.193737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] MFA Rules not processed for user `4fb48e4d50184d2e97674324027d9ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:23.199099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:23.317865 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2773/5540] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:27.985018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e3c8-404a-4db4-960b-74fdab999d21 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:27.985492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e3c8-404a-4db4-960b-74fdab999d21 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:27.985592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4e3c8-404a-4db4-960b-74fdab999d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:28.015451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d8b4e3c8-404a-4db4-960b-74fdab999d21 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:28.019696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d8b4e3c8-404a-4db4-960b-74fdab999d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:28.100632 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2768/5541] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:04:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:28.125491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:28.127592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:28.207502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8ecee-dbb3-4a85-b990-d548d4f01e1d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:28.215078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:28.215967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:28.216435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:28.217121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:28.228066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:28.229709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:28.238065 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2774/5542] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:04:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:04:28.863904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2946e4a-e41f-44c6-94c3-01ed36b76043 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:28.864207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2946e4a-e41f-44c6-94c3-01ed36b76043 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:28.864682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2946e4a-e41f-44c6-94c3-01ed36b76043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:28.890218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e2946e4a-e41f-44c6-94c3-01ed36b76043 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:28.891624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e2946e4a-e41f-44c6-94c3-01ed36b76043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:28.912574 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2769/5543] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:04:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:28.927075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:28.945468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa17b0-e56f-4c3f-819b-b3f7afe0d2f6 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:28.953142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:28.954480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:28.954890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:28.955609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:28.966149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:28.968059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:28.978449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2775/5544] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:04:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:04:29.315703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666937-7305-4cbe-85f2-83e24f96a1a7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:29.316165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666937-7305-4cbe-85f2-83e24f96a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:29.316349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666937-7305-4cbe-85f2-83e24f96a1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:29.340259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4c666937-7305-4cbe-85f2-83e24f96a1a7 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:29.342001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4c666937-7305-4cbe-85f2-83e24f96a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:29.356148 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2770/5545] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:04:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:29.370603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:29.384370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb37124-8c86-4032-82f3-fac664c2a3bd service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:29.389990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:29.390652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:29.390972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:29.391522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:29.400503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:29.402113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:29.412616 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2776/5546] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:04:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:04:29.797593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70889-a49f-4cba-b325-03f245bb3570 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:29.797881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70889-a49f-4cba-b325-03f245bb3570 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:29.798154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70889-a49f-4cba-b325-03f245bb3570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:29.818608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9bd70889-a49f-4cba-b325-03f245bb3570 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:29.819855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9bd70889-a49f-4cba-b325-03f245bb3570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:29.829043 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2771/5547] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:04:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:29.842239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:29.856295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d8d19-817e-49ca-bce6-ba5109a3110b service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:29.864488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:29.865646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:29.865995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:29.866373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:29.876763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:29.879433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:29.888638 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2777/5548] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:04:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:04:31.776774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89181-7e6e-411d-b8ef-d151500b437e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:31.777280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89181-7e6e-411d-b8ef-d151500b437e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:31.777357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89181-7e6e-411d-b8ef-d151500b437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:31.795104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ecb89181-7e6e-411d-b8ef-d151500b437e None None] MFA Rules not processed for user `e6abaee58e2540e090b6f53b6f6ef587`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:31.796355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ecb89181-7e6e-411d-b8ef-d151500b437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:31.804051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2772/5549] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:32.262883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:32.264932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:32.344379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3baffe3-5e51-4103-b03d-18edc133199a service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:32.350269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:32.351184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:32.351622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:32.352095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] PATH_INFO: `/v3/users/b18ec20bcd654015b37eb90758427e1e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:32.353479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18ec20bcd654015b37eb90758427e1e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:32.355638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:32.411560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18ec20bcd654015b37eb90758427e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:32.412594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18ec20bcd654015b37eb90758427e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:32.423586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18ec20bcd654015b37eb90758427e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:32.424672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18ec20bcd654015b37eb90758427e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:32.434178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18ec20bcd654015b37eb90758427e1e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:32.454858 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2778/5550] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:04:32 2022] DELETE /identity/v3/users/b18ec20bcd654015b37eb90758427e1e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:32.458413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:32.458715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:32.459054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:32.479234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:32.480732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:32.548597 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2773/5551] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:32.558340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:32.560052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:32.628574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd0c64-8d6d-4d6c-ae6b-5baaea7845d2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:32.632225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcb783-f931-47bd-8b7f-560d3cf3ebc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:32.632871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcb783-f931-47bd-8b7f-560d3cf3ebc7 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:32.633149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcb783-f931-47bd-8b7f-560d3cf3ebc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:32.633446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcb783-f931-47bd-8b7f-560d3cf3ebc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:32.642908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcb783-f931-47bd-8b7f-560d3cf3ebc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:32.644934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcb783-f931-47bd-8b7f-560d3cf3ebc7 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:32.654848 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2779/5552] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:32.845997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:32.847579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:32.872220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c825a48-70c4-4094-97d7-a7b002563e45 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:32.877825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:32.882027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:32.882027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:32.882027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] PATH_INFO: `/v3/projects/17f1e26eb0cc42eea75d5194838b50f5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:32.882027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f1e26eb0cc42eea75d5194838b50f5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:32.883275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:32.980522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f1e26eb0cc42eea75d5194838b50f5', 'request_id': 'req-59178ca3-e577-4735-9b90-b13c743fdd59'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:32.989128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f1e26eb0cc42eea75d5194838b50f5', 'request_id': 'req-59178ca3-e577-4735-9b90-b13c743fdd59'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:33.003725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f1e26eb0cc42eea75d5194838b50f5', 'request_id': 'req-59178ca3-e577-4735-9b90-b13c743fdd59'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:33.020606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] The token cache is being invalidate because project 17f1e26eb0cc42eea75d5194838b50f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:04:33.021272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:33.022047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59178ca3-e577-4735-9b90-b13c743fdd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:04:33.025913 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2774/5553] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:04:32 2022] DELETE /identity/v3/projects/17f1e26eb0cc42eea75d5194838b50f5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:33.031472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1e94-92ed-445a-8307-b57a381c648b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.032064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1e94-92ed-445a-8307-b57a381c648b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.032559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1e94-92ed-445a-8307-b57a381c648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.053373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6e9b1e94-92ed-445a-8307-b57a381c648b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:33.055893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6e9b1e94-92ed-445a-8307-b57a381c648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:33.128979 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2780/5554] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:33.137859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc08f-442c-49ef-8962-fe6018f7d55c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.138378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc08f-442c-49ef-8962-fe6018f7d55c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.138909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc08f-442c-49ef-8962-fe6018f7d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.161022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e8bdc08f-442c-49ef-8962-fe6018f7d55c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:33.163320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8bdc08f-442c-49ef-8962-fe6018f7d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:33.176574 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2775/5555] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:33.186421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b1e94-92ed-445a-8307-b57a381c648b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.203565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b1e94-92ed-445a-8307-b57a381c648b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.213041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.213041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.213041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.213041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.213382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:04:33.213382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.213714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.228816 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2781/5556] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:04:33.233164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc08f-442c-49ef-8962-fe6018f7d55c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.245015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc08f-442c-49ef-8962-fe6018f7d55c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.251403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.252132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.252681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.253862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.254949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.257074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.297566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.298737 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2776/5557] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:04:33 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:04:33.316085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da402-9cfe-4375-ab85-7d8e2f59b3cf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.396008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.396763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.397042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.397510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.398388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.400564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.426604 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2782/5558] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:04:33 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:04:33.430656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.443352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e252a-6e15-4db6-949c-a58166fcb2a6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.450614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.451641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.453424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.453982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.455163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.457921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.475745 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2777/5559] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:04:33.479586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.493632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59ee2f-f7ec-4b3e-95dc-8b42a9932f38 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.509728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9c47f-ff7f-4871-b1d5-c235c69acc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.510412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9c47f-ff7f-4871-b1d5-c235c69acc35 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.510701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9c47f-ff7f-4871-b1d5-c235c69acc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.511013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9c47f-ff7f-4871-b1d5-c235c69acc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.511957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9c47f-ff7f-4871-b1d5-c235c69acc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.515122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9c47f-ff7f-4871-b1d5-c235c69acc35 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.530725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2783/5560] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:04:33.531902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.545293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992701c9-edad-4c3f-acdf-0345fa698cfa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.552893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.554105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.554105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.554403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] PATH_INFO: `/v3/projects/0c313e966d334c26afa43b480ab20fb0/users/96077bbd65b9449a8b679c2ebb35bdd6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.571064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c313e966d334c26afa43b480ab20fb0, user_id=96077bbd65b9449a8b679c2ebb35bdd6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.573825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.589974 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2778/5561] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:04:33 2022] PUT /identity/v3/projects/0c313e966d334c26afa43b480ab20fb0/users/96077bbd65b9449a8b679c2ebb35bdd6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:04:33.601584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507be1-979d-40b3-b040-1d2c93c832e6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.601882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507be1-979d-40b3-b040-1d2c93c832e6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.602164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07507be1-979d-40b3-b040-1d2c93c832e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.629362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-07507be1-979d-40b3-b040-1d2c93c832e6 None None] MFA Rules not processed for user `96077bbd65b9449a8b679c2ebb35bdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:33.630817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-07507be1-979d-40b3-b040-1d2c93c832e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:33.708844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2784/5562] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:33.713246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.772818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d967e-2256-43ea-b66c-1d14456a5a74 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.777576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.778239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.778529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.778852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.779543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.781471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.807580 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2779/5563] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:04:33 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:04:33.811993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507be1-979d-40b3-b040-1d2c93c832e6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.823110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07507be1-979d-40b3-b040-1d2c93c832e6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.879176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.879851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.880140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.880423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.881103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.883057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.905205 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2785/5564] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:04:33 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:04:33.906401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.917486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7f784-2d5f-441f-9c2e-da029a705350 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.922165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.922866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.923155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.923436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.924162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.926368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:33.937266 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2780/5565] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:04:33.941313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:33.951466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b89ee-72b7-435c-98d4-9e48d00b7a5e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:33.957624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:33.958512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:33.958822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:33.959172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] PATH_INFO: `/v3/projects/23a13a3b2129408f8c3dd879e607478d/users/2af2d3cdc86e4f39bf7867d3c41c806b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:33.977116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a13a3b2129408f8c3dd879e607478d, user_id=2af2d3cdc86e4f39bf7867d3c41c806b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:33.981178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:34.003353 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2786/5566] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:04:33 2022] PUT /identity/v3/projects/23a13a3b2129408f8c3dd879e607478d/users/2af2d3cdc86e4f39bf7867d3c41c806b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:04:34.004517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:34.015821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20794e23-0cfe-4019-a0a3-1794fa73380d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:34.078520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f68971-6e8e-4ee8-a3d7-80547d5fff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:34.079232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f68971-6e8e-4ee8-a3d7-80547d5fff36 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:34.079547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f68971-6e8e-4ee8-a3d7-80547d5fff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:34.079808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f68971-6e8e-4ee8-a3d7-80547d5fff36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:34.080513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f68971-6e8e-4ee8-a3d7-80547d5fff36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:34.083474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f68971-6e8e-4ee8-a3d7-80547d5fff36 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:34.095466 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2781/5567] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:04:34.100093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:34.110615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510724b-08be-407c-bacd-98e550567abf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:34.115298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:34.116174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:34.116457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:34.116731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] PATH_INFO: `/v3/projects/23a13a3b2129408f8c3dd879e607478d/users/2af2d3cdc86e4f39bf7867d3c41c806b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:34.118903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a13a3b2129408f8c3dd879e607478d, user_id=2af2d3cdc86e4f39bf7867d3c41c806b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:34.121556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:34.133142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2787/5568] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:04:34 2022] PUT /identity/v3/projects/23a13a3b2129408f8c3dd879e607478d/users/2af2d3cdc86e4f39bf7867d3c41c806b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:04:34.144231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52529fe-af89-46d6-b059-8b2f7ff01f67 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:34.144623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52529fe-af89-46d6-b059-8b2f7ff01f67 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:34.144911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52529fe-af89-46d6-b059-8b2f7ff01f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:34.171689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e52529fe-af89-46d6-b059-8b2f7ff01f67 None None] MFA Rules not processed for user `2af2d3cdc86e4f39bf7867d3c41c806b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:34.172911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e52529fe-af89-46d6-b059-8b2f7ff01f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:34.243331 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2782/5569] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:34.254106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:34.255842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:34.317958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7a170-9679-4e24-a063-6ffd48d2ae6a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:34.321895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798faf8-4d9d-4cd8-9b88-6c75b2edb277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:34.322691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798faf8-4d9d-4cd8-9b88-6c75b2edb277 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:34.323057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798faf8-4d9d-4cd8-9b88-6c75b2edb277 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:34.324418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798faf8-4d9d-4cd8-9b88-6c75b2edb277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:34.385350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798faf8-4d9d-4cd8-9b88-6c75b2edb277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:34.387030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798faf8-4d9d-4cd8-9b88-6c75b2edb277 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:34.398688 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2788/5570] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:37.175084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52529fe-af89-46d6-b059-8b2f7ff01f67 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:37.188240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52529fe-af89-46d6-b059-8b2f7ff01f67 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:37.192614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed80a1-4e4a-4126-9089-62668544c3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:37.199612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed80a1-4e4a-4126-9089-62668544c3cd service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:37.199612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed80a1-4e4a-4126-9089-62668544c3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:37.199612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed80a1-4e4a-4126-9089-62668544c3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:37.210309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed80a1-4e4a-4126-9089-62668544c3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:37.212186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed80a1-4e4a-4126-9089-62668544c3cd service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:37.226123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2783/5571] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:04:39.522401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadefb6-3bcb-48dc-96fb-fbae32e69aeb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:39.523024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadefb6-3bcb-48dc-96fb-fbae32e69aeb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:39.523858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadefb6-3bcb-48dc-96fb-fbae32e69aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:39.549273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-adadefb6-3bcb-48dc-96fb-fbae32e69aeb None None] MFA Rules not processed for user `8cdc0c878f6e4e5da2a2848d63a02f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:39.555642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-adadefb6-3bcb-48dc-96fb-fbae32e69aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:39.688473 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2789/5572] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:46.081701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:46.082177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:46.082995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:46.113775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] MFA Rules not processed for user `96077bbd65b9449a8b679c2ebb35bdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:46.115200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:46.152216 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2784/5573] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:04:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:53.514009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:53.514493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:53.514588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:53.532946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:04:53.534212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:53.619532 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2790/5574] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:04:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:04:53.629315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:53.631310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:53.743555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2239ac-8441-4d25-82b2-f76aee66a956 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:53.753733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:53.757928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:53.758754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:53.759416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:53.772592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:53.774238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:53.790305 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2785/5575] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:04:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:04:54.036443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:04:54.038983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:54.054571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daed6d-f961-4e76-a36c-b2c6eebbbcef None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:04:54.058238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:04:54.058938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:04:54.059496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:04:54.059777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:04:54.061727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:04:54.076976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:04:54.078628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:04:54.104677 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2791/5576] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:04:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:12.662883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:12.665250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:12.786407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ab6ea-c687-46ea-bf16-07802ca3cc62 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:12.791574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:12.792813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:12.793265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:12.793699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:12.796760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:12.905246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:12.906724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:12.922424 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2786/5577] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:13.005801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:13.018904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f4dd-8023-4a54-9c54-4cce2cf05915 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:13.023323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:13.024016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:13.024301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:13.024574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:13.026922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:13.043461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:13.045384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:13.057839 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2792/5578] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:13.143222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:13.154520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e57cbe-e95f-44a8-a603-4ec90daf6615 service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:13.159527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:13.160260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:13.160606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:13.160886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:13.162857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:13.178291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:13.180029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:13.193244 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2787/5579] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:13.397963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:13.404039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:13.487718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f5bf6-a85d-47c1-9081-069f39baeb28 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:13.498445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8cdd7-1506-4da0-8667-9fbec1fd587c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:13.499063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8cdd7-1506-4da0-8667-9fbec1fd587c service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:13.499621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8cdd7-1506-4da0-8667-9fbec1fd587c service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:13.500075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8cdd7-1506-4da0-8667-9fbec1fd587c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:13.502553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2d8cdd7-1506-4da0-8667-9fbec1fd587c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:13.568786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8cdd7-1506-4da0-8667-9fbec1fd587c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:13.570457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8cdd7-1506-4da0-8667-9fbec1fd587c service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:13.582021 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2793/5580] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:13.728317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:13.740736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c58477-5f98-4229-8c0d-6258abb87490 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:13.749579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:13.750495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:13.752403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:13.752935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:13.755304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:13.832865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:13.834455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:13.844942 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2788/5581] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:17.601247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:17.601753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:17.601852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:17.629429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:17.630644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:17.639729 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2794/5582] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:05:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:17.655069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:17.670524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2f54-c756-426c-bf5a-43522e71a50c service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:17.675975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:17.676856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:17.677531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:17.677991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:17.688828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:17.690793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:17.700317 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2789/5583] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:05:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:05:25.341396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:25.343471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:25.379179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9493e2-e784-40f8-8320-f87e8527916c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:25.399506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:25.400846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:25.401535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:25.401968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] PATH_INFO: `/v3/users/5ea5d144165a4e129de242905439e951` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:25.403647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea5d144165a4e129de242905439e951)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:25.406162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:25.503276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea5d144165a4e129de242905439e951'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:25.504992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea5d144165a4e129de242905439e951'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:25.534495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea5d144165a4e129de242905439e951'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:25.536424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea5d144165a4e129de242905439e951'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:25.555742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-82a27c24-5317-4c96-8ac1-1b95af74334b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea5d144165a4e129de242905439e951'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:25.594843 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2795/5584] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:25 2022] DELETE /identity/v3/users/5ea5d144165a4e129de242905439e951 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:26.374511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:26.419491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33ed93-c248-4a91-b76d-66c8e4367d3a service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:26.587741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:26.591688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:26.592114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:26.592564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] PATH_INFO: `/v3/projects/81e5c5d849ea4fc59d5c4fc58b31530f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:26.596584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e5c5d849ea4fc59d5c4fc58b31530f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:26.598814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:26.716623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e5c5d849ea4fc59d5c4fc58b31530f', 'request_id': 'req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:26.735032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e5c5d849ea4fc59d5c4fc58b31530f', 'request_id': 'req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:26.751845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e5c5d849ea4fc59d5c4fc58b31530f', 'request_id': 'req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:26.770363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] The token cache is being invalidate because project 81e5c5d849ea4fc59d5c4fc58b31530f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:26.772733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:26.776088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dff93fa0-8b59-46cc-9947-41a7d89e4f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:26.781299 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2790/5585] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:26 2022] DELETE /identity/v3/projects/81e5c5d849ea4fc59d5c4fc58b31530f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:26.790529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af333-b8c0-4ccc-8481-ffca885c6580 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:26.791323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af333-b8c0-4ccc-8481-ffca885c6580 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:26.791323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3af333-b8c0-4ccc-8481-ffca885c6580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:26.826342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1d3af333-b8c0-4ccc-8481-ffca885c6580 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:26.827739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1d3af333-b8c0-4ccc-8481-ffca885c6580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:26.980759 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2796/5586] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:26.990799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0b2fd-fa25-4546-974f-b78b8888611a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:26.991657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0b2fd-fa25-4546-974f-b78b8888611a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:26.992434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0b2fd-fa25-4546-974f-b78b8888611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.039035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-24f0b2fd-fa25-4546-974f-b78b8888611a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:27.046035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-24f0b2fd-fa25-4546-974f-b78b8888611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:27.064824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2791/5587] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:27.065051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3af333-b8c0-4ccc-8481-ffca885c6580 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.080717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3af333-b8c0-4ccc-8481-ffca885c6580 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.090552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.091390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.091760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.092389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.094342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:05:27.094682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.097126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.136821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2797/5588] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:27.141004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0b2fd-fa25-4546-974f-b78b8888611a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.161278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0b2fd-fa25-4546-974f-b78b8888611a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.168423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.169511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.169906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.170265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.172551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.176145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.240856 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2792/5589] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:27 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:27.242526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.256371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acc511-d920-4f0e-b645-7e336aac6e20 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.358878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.358878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.358878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.358878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.359247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.359247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.395780 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2798/5590] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:27 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:27.401727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.420644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8493-73c7-4717-965c-e7416e801511 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.427053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.428023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.428323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.428765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.429894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.431556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.443750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2793/5591] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:27.447884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.461020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53577b-283d-4df0-babf-c0845db1c46d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.466905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93d7ce-6bd4-4a7b-9fe6-d7be92ab3a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.467787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d7ce-6bd4-4a7b-9fe6-d7be92ab3a60 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.468222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d7ce-6bd4-4a7b-9fe6-d7be92ab3a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.468661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d7ce-6bd4-4a7b-9fe6-d7be92ab3a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.469540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93d7ce-6bd4-4a7b-9fe6-d7be92ab3a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.472025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93d7ce-6bd4-4a7b-9fe6-d7be92ab3a60 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.484562 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2799/5592] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:27.488994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.498932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cdb12-0f54-43d5-ac04-ae1e40a164f8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.503714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.504591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.504873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.505145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] PATH_INFO: `/v3/projects/40feb4fa55d4433da4d3ad9e517dfa15/users/c7018155fa274dee9c964c53196510fd/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.521946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40feb4fa55d4433da4d3ad9e517dfa15, user_id=c7018155fa274dee9c964c53196510fd, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.524743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.548934 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2794/5593] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:27 2022] PUT /identity/v3/projects/40feb4fa55d4433da4d3ad9e517dfa15/users/c7018155fa274dee9c964c53196510fd/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:27.551475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f01e3-9238-4536-9f92-bdaa888f07bf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.551769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f01e3-9238-4536-9f92-bdaa888f07bf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.552048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f01e3-9238-4536-9f92-bdaa888f07bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.594121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6a4f01e3-9238-4536-9f92-bdaa888f07bf None None] MFA Rules not processed for user `c7018155fa274dee9c964c53196510fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:27.595296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6a4f01e3-9238-4536-9f92-bdaa888f07bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:27.682225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2800/5594] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:27.686602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.772094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4508b-d149-4860-ba23-b8067ee7a300 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.778942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.779806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.780255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.780663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.781645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.783924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.790897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ee8a-1148-4920-aa7d-f74f5b4ce4d3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.791786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ee8a-1148-4920-aa7d-f74f5b4ce4d3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.792261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ee8a-1148-4920-aa7d-f74f5b4ce4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.815931 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2795/5595] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:27 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:27.819316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8a50ee8a-1148-4920-aa7d-f74f5b4ce4d3 None None] MFA Rules not processed for user `887054d178de43b18a472fed2297659d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:27.820749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.820916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a50ee8a-1148-4920-aa7d-f74f5b4ce4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:27.922381 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2801/5596] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:27.927228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426672c9-78d7-4029-bc3d-187d047d6a75 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.933832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.934389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.934675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.935056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.935685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.937837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:27.971685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ee8a-1148-4920-aa7d-f74f5b4ce4d3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:27.977582 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2796/5597] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:27 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:27.983502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ee8a-1148-4920-aa7d-f74f5b4ce4d3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:27.989182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:27.989853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:27.990136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:27.990499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:27.991338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:27.992932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.007308 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2802/5598] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:28.009582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.029157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e46fb-4411-446a-bf1f-5b5926f3289f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.049193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.050143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.050437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.050710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] PATH_INFO: `/v3/projects/c250d95c7d514d98bad743e4e4d5b398/users/607575ff2ef14ef3bcc7928543680636/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.070352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c250d95c7d514d98bad743e4e4d5b398, user_id=607575ff2ef14ef3bcc7928543680636, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.073219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.106106 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2797/5599] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:28 2022] PUT /identity/v3/projects/c250d95c7d514d98bad743e4e4d5b398/users/607575ff2ef14ef3bcc7928543680636/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:28.110546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.123616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e03b4-f796-43eb-a192-d32e97c815c0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.188183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fda44c-b366-43e7-a817-65692c86450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.189599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda44c-b366-43e7-a817-65692c86450d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.189989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda44c-b366-43e7-a817-65692c86450d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.190368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fda44c-b366-43e7-a817-65692c86450d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.191232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda44c-b366-43e7-a817-65692c86450d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.192957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fda44c-b366-43e7-a817-65692c86450d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.203825 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2803/5600] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:28.207945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.220293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77253-c601-4a02-a698-865d00b3dcad admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.225214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.226507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.226507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.226917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] PATH_INFO: `/v3/projects/c250d95c7d514d98bad743e4e4d5b398/users/607575ff2ef14ef3bcc7928543680636/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.229136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c250d95c7d514d98bad743e4e4d5b398, user_id=607575ff2ef14ef3bcc7928543680636, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.231993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.245513 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2798/5601] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:28 2022] PUT /identity/v3/projects/c250d95c7d514d98bad743e4e4d5b398/users/607575ff2ef14ef3bcc7928543680636/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:28.254484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b01c-4e7c-4f3b-aaf1-37b6755c8df8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.254805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b01c-4e7c-4f3b-aaf1-37b6755c8df8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.255091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b01c-4e7c-4f3b-aaf1-37b6755c8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.284084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8f64b01c-4e7c-4f3b-aaf1-37b6755c8df8 None None] MFA Rules not processed for user `607575ff2ef14ef3bcc7928543680636`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:28.285335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8f64b01c-4e7c-4f3b-aaf1-37b6755c8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:28.405685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.416985 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2804/5602] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:28.427901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5e313-2bad-4a7c-ac25-0ef8db0a9142 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.435950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.436964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.437319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.437667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.438511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.439661 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:28.439661 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:05:28.439661 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:05:28.441131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.496197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b01c-4e7c-4f3b-aaf1-37b6755c8df8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.503203 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2799/5603] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:05:28 2022] POST /identity/v3/regions => generated 224 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:28.508060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b01c-4e7c-4f3b-aaf1-37b6755c8df8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.529027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.529709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.530571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.530889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.531622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.533340 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:28.533340 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:05:28.533340 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:05:28.534254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.582827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2805/5604] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:05:28 2022] POST /identity/v3/regions => generated 223 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:28.584460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.596493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9871d0-d717-4152-8abd-7117de159067 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.612346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.613284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.613572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.613923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/ca971f58-d67a-451c-bed8-a35d6d3f5ea9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.615140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:create_region(region_id=ca971f58-d67a-451c-bed8-a35d6d3f5ea9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.616593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.637736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2800/5605] 10.222.0.32 () {60 vars in 1258 bytes} [Sat May 7 22:05:28 2022] PUT /identity/v3/regions/ca971f58-d67a-451c-bed8-a35d6d3f5ea9 => generated 232 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:28.641950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.654190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2127250-637e-4564-83f8-0e1936da3ea3 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.673166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.674690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.675086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.675424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/ca971f58-d67a-451c-bed8-a35d6d3f5ea9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.676143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ca971f58-d67a-451c-bed8-a35d6d3f5ea9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.677240 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:28.677240 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:05:28.677240 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:05:28.678631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.714285 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2806/5606] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:05:28 2022] DELETE /identity/v3/regions/ca971f58-d67a-451c-bed8-a35d6d3f5ea9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:28.720696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.736152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e5a04-b6dc-4eed-860f-374b7b225afb tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.758964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.760381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.760680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.760959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.761735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.763492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.789389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2801/5607] 10.222.0.32 () {60 vars in 1149 bytes} [Sat May 7 22:05:28 2022] POST /identity/v3/regions => generated 253 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:28.793395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.806731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7858e3-50cf-4944-b558-18f27ad03403 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.824783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.825627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.825919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.826201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.826968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:update_region(region_id=49be1b7f1ff6491bb8d06a3ec4214133)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.828101 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:28.828101 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:05:28.828101 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:05:28.828990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.861889 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2807/5608] 10.222.0.32 () {60 vars in 1249 bytes} [Sat May 7 22:05:28 2022] PATCH /identity/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133 => generated 254 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:28.867144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.887356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53db791-e6fe-46d0-8462-7e85b7609ed2 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.908744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.910087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.910652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.911171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.913115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:get_region(region_id=49be1b7f1ff6491bb8d06a3ec4214133)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.914552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:28.926636 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2802/5609] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:05:28 2022] GET /identity/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133 => generated 254 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:28.930676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:28.946510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059f44-5341-4f32-b060-d4c1dac50f52 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:28.953586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:28.954710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:28.955049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:28.955430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:28.956197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:delete_region(region_id=49be1b7f1ff6491bb8d06a3ec4214133)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:28.958187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.006654 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2808/5610] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:28 2022] DELETE /identity/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:29.010912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.030497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a2749-e4fb-49d0-9117-04a15027984f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.070547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.071240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.071541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.071804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.072475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.073977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.081064 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2803/5611] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 22:05:29 2022] GET /identity/v3/regions => generated 669 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:29.084676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.097755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e29de-5db4-43f6-ae0a-39ca11de699f tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.108422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.112435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.112435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.112693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.113396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:delete_region(region_id=49be1b7f1ff6491bb8d06a3ec4214133)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.114997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Could not find region: 49be1b7f1ff6491bb8d06a3ec4214133.: keystone.exception.RegionNotFound: Could not find region: 49be1b7f1ff6491bb8d06a3ec4214133. May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 49be1b7f1ff6491bb8d06a3ec4214133. May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:05:29.156933 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 49be1b7f1ff6491bb8d06a3ec4214133. May 07 22:05:29.158686 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:29.165752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.172514 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2809/5612] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:29 2022] DELETE /identity/v3/regions/49be1b7f1ff6491bb8d06a3ec4214133 => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:05:29.177370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a2566-77dc-4ab0-b22d-bb5b8987c0c6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.186821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.187779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.188412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.188919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.190449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.194070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.202381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2804/5613] 10.222.0.32 () {58 vars in 1127 bytes} [Sat May 7 22:05:29 2022] GET /identity/v3/regions => generated 669 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:29.207367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.225880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978e6a9-1ca5-42d7-a001-d2d16755131d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.234861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.236153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.236745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.237343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.238095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.240707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.273477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2810/5614] 10.222.0.32 () {60 vars in 1149 bytes} [Sat May 7 22:05:29 2022] POST /identity/v3/regions => generated 254 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:29.276114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.299570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e995a1-402f-44c9-82c7-9b717733ca6d tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.323316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.324688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.324979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.325265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.325971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Adding query filter params (parent_region_id=64855ba052954a498e164805c8cf4184) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:05:29.326281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.327549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.336077 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2805/5615] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:05:29 2022] GET /identity/v3/regions?parent_region_id=64855ba052954a498e164805c8cf4184 => generated 400 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:29.340505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.355178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c9c0b-da67-4644-afc3-c14c5c1f0ea6 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.365005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.379733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.379733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.379733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/6bd415d2f9264798b0cf9e05e6c625e8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.379733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:delete_region(region_id=6bd415d2f9264798b0cf9e05e6c625e8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.382834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.415949 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2811/5616] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:29 2022] DELETE /identity/v3/regions/6bd415d2f9264798b0cf9e05e6c625e8 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:29.422852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.436579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a038c-3dfd-4fe3-b6b6-0efdf17f8b80 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.452695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.453887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.454182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.455252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/23266d2c1233438cac0fec31256c8b61` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.455914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:delete_region(region_id=23266d2c1233438cac0fec31256c8b61)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.456940 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:29.456940 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:05:29.456940 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:05:29.457851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.481122 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2806/5617] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:29 2022] DELETE /identity/v3/regions/23266d2c1233438cac0fec31256c8b61 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:29.485225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.498381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2286e-f041-41fe-9fce-032b08681f40 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.527013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '607575ff2ef14ef3bcc7928543680636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c250d95c7d514d98bad743e4e4d5b398', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.528620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.528921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.529205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] PATH_INFO: `/v3/regions/64855ba052954a498e164805c8cf4184` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.530078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorizing `identity:delete_region(region_id=64855ba052954a498e164805c8cf4184)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.532623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.539846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.541816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:29.565070 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2812/5618] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:29 2022] DELETE /identity/v3/regions/64855ba052954a498e164805c8cf4184 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:29.568680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.655043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f10ce3-8690-4cc8-b867-ec2c6aeeccd7 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.676521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.679370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.679660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.681287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] PATH_INFO: `/v3/users/a3c56710438b4defbcd03c332ff24bb7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.683206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c56710438b4defbcd03c332ff24bb7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.685982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.722261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187307a-11fa-4d93-a555-c60fc5764d73 tempest-RegionsTestJSON-775117987 tempest-RegionsTestJSON-775117987-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:29.729055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:29.729713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.730014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.731476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] PATH_INFO: `/v3/users/c7018155fa274dee9c964c53196510fd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.732703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7018155fa274dee9c964c53196510fd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:29.734682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:29.744908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c56710438b4defbcd03c332ff24bb7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.752894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c56710438b4defbcd03c332ff24bb7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.753693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c56710438b4defbcd03c332ff24bb7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.754328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c56710438b4defbcd03c332ff24bb7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.761711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0257fc9a-283a-496d-b72f-753534205acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c56710438b4defbcd03c332ff24bb7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.784475 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2807/5619] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:29 2022] DELETE /identity/v3/users/a3c56710438b4defbcd03c332ff24bb7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:29.789249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.789755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.790108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.791672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7018155fa274dee9c964c53196510fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.793152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7018155fa274dee9c964c53196510fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.801048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7018155fa274dee9c964c53196510fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.802095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7018155fa274dee9c964c53196510fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.811410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7631c6cc-59f1-4304-b2cc-0fb2d5351ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7018155fa274dee9c964c53196510fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:29.812699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:29.813996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:29.833124 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2813/5620] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:29 2022] DELETE /identity/v3/users/c7018155fa274dee9c964c53196510fd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:29.840213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76f43-66b3-4f9e-9fd2-9ef834915391 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:29.840579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76f43-66b3-4f9e-9fd2-9ef834915391 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:29.840924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76f43-66b3-4f9e-9fd2-9ef834915391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:29.881237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a2a76f43-66b3-4f9e-9fd2-9ef834915391 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:29.882680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2a76f43-66b3-4f9e-9fd2-9ef834915391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:29.910161 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2808/5621] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:29.919440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:29.921271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:30.003689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2814/5622] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:30.015738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76f43-66b3-4f9e-9fd2-9ef834915391 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:30.043963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f53f4-8f5d-441c-bd07-74029fb241c6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:30.115047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76f43-66b3-4f9e-9fd2-9ef834915391 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:30.117818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:30.118598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:30.119435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:30.120277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:30.124261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:30.126536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:30.127023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:30.127411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:30.134167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:30.141386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:30.143731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:30.149331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:30.159527 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2815/5623] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:30.211364 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2809/5624] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:30.597214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:30.599010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:30.612925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb9dec-28af-4d6b-962b-fabae888ab70 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:30.619728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:30.620668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:30.621021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:30.621377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] PATH_INFO: `/v3/projects/40feb4fa55d4433da4d3ad9e517dfa15` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:30.622716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40feb4fa55d4433da4d3ad9e517dfa15)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:30.624767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:30.687785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40feb4fa55d4433da4d3ad9e517dfa15', 'request_id': 'req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.701350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40feb4fa55d4433da4d3ad9e517dfa15', 'request_id': 'req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.710862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40feb4fa55d4433da4d3ad9e517dfa15', 'request_id': 'req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.722619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] The token cache is being invalidate because project 40feb4fa55d4433da4d3ad9e517dfa15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:30.722953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.723605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.725427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:30.725928 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2816/5625] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:30 2022] DELETE /identity/v3/projects/40feb4fa55d4433da4d3ad9e517dfa15 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:30.727940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:30.729110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:30.730740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:30.763783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd78c34-b05f-4eba-90a4-f66f799b14ee service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:30.839224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8de1b-6dce-4a17-b3a1-4873ab5e0023 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:30.845541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:30.847412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:30.848678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:30.849063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] PATH_INFO: `/v3/users/607575ff2ef14ef3bcc7928543680636` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:30.850627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607575ff2ef14ef3bcc7928543680636)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:30.853263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:30.865852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:30.867957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:30.868613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:30.869114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] PATH_INFO: `/v3/projects/3782d9da13c44a67a66be545e352dcf8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:30.871238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3782d9da13c44a67a66be545e352dcf8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:30.873727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:30.926309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607575ff2ef14ef3bcc7928543680636'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.927039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607575ff2ef14ef3bcc7928543680636'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.934964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607575ff2ef14ef3bcc7928543680636'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.935621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607575ff2ef14ef3bcc7928543680636'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.935869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3782d9da13c44a67a66be545e352dcf8', 'request_id': 'req-a4ff441b-1335-4b70-8350-23a703eebdd7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.943319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3782d9da13c44a67a66be545e352dcf8', 'request_id': 'req-a4ff441b-1335-4b70-8350-23a703eebdd7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.944581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-982a75f9-cb69-4209-b8d9-35aba379e993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607575ff2ef14ef3bcc7928543680636'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.951848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3782d9da13c44a67a66be545e352dcf8', 'request_id': 'req-a4ff441b-1335-4b70-8350-23a703eebdd7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.963566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] The token cache is being invalidate because project 3782d9da13c44a67a66be545e352dcf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:30.963932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.964585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a4ff441b-1335-4b70-8350-23a703eebdd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:30.970974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2817/5626] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:30 2022] DELETE /identity/v3/users/607575ff2ef14ef3bcc7928543680636 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:30.971614 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2810/5627] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:30 2022] DELETE /identity/v3/projects/3782d9da13c44a67a66be545e352dcf8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:30.982068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4986-147d-4011-8059-7e49f8bc92f2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:30.982431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4986-147d-4011-8059-7e49f8bc92f2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:30.982856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e4986-147d-4011-8059-7e49f8bc92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.005343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f03e4986-147d-4011-8059-7e49f8bc92f2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:31.006721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f03e4986-147d-4011-8059-7e49f8bc92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:31.081767 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2818/5628] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:31.087336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490bf45-ef4d-4fc5-8e7e-f3ae8819790c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.088994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490bf45-ef4d-4fc5-8e7e-f3ae8819790c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.089845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490bf45-ef4d-4fc5-8e7e-f3ae8819790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.125477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6490bf45-ef4d-4fc5-8e7e-f3ae8819790c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:31.128483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6490bf45-ef4d-4fc5-8e7e-f3ae8819790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:31.141912 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2811/5629] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:31.148671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e4986-147d-4011-8059-7e49f8bc92f2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.165761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e4986-147d-4011-8059-7e49f8bc92f2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.171354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.171965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.172253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.172528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.173817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:05:31.174125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.175770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.195145 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2819/5630] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:31.199516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490bf45-ef4d-4fc5-8e7e-f3ae8819790c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.215338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490bf45-ef4d-4fc5-8e7e-f3ae8819790c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.240402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.241215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.241690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.244451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.245778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.247901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.322944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2812/5631] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:31 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:31.323820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.335843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb65a5-e329-4ca8-84b0-b8dbdbd7e519 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.469076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.469766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.471053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.471337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.472254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.474524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.510378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.521874 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2820/5632] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:31 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:31.524570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c11c-c564-425e-829b-a142a1ef4ba9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.530214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.530914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.531294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.531570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.533065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.539001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.540814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:31.544190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.556904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dc0ab-5101-4a92-8635-dae7dcbcebee admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.562722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.564179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.564179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.564348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] PATH_INFO: `/v3/projects/c250d95c7d514d98bad743e4e4d5b398` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.573016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c250d95c7d514d98bad743e4e4d5b398)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.576406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.614728 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2813/5633] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:31.626088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.645722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7edf5d-b80e-434e-9cd7-a3e4ea666886 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.670179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c250d95c7d514d98bad743e4e4d5b398', 'request_id': 'req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:31.685182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c250d95c7d514d98bad743e4e4d5b398', 'request_id': 'req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:31.704001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c250d95c7d514d98bad743e4e4d5b398', 'request_id': 'req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:31.740797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] The token cache is being invalidate because project c250d95c7d514d98bad743e4e4d5b398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:31.741101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:31.745545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-13f71b96-e6aa-4f6b-904c-9169b0cb3f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:31.748211 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2821/5634] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:31 2022] DELETE /identity/v3/projects/c250d95c7d514d98bad743e4e4d5b398 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:31.752696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.752993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.753279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.783783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6baf-705c-4853-9b19-dcf980b855e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.784462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6baf-705c-4853-9b19-dcf980b855e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.784754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6baf-705c-4853-9b19-dcf980b855e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.785034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6baf-705c-4853-9b19-dcf980b855e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.785763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6baf-705c-4853-9b19-dcf980b855e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.786521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:31.787593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6baf-705c-4853-9b19-dcf980b855e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.788731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:31.800202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2814/5635] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:31.808141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2822/5636] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:31.809532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.811207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:31.811469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f1bf-35f4-4f2e-b01a-f689ea431323 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.812128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f1bf-35f4-4f2e-b01a-f689ea431323 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.812519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f1bf-35f4-4f2e-b01a-f689ea431323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.824830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940189-2cee-47a8-9eff-8f4025be596a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.834689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3521f1bf-35f4-4f2e-b01a-f689ea431323 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:31.835970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3521f1bf-35f4-4f2e-b01a-f689ea431323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:31.841785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.842713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.843093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.843444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] PATH_INFO: `/v3/projects/9da4f11a17fa45cab1e10a17394d39cd/users/b0f3bdbaf7704a11b5078307c3c9b7ed/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.845777 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2815/5637] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:31.850450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521f1bf-35f4-4f2e-b01a-f689ea431323 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.861893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da4f11a17fa45cab1e10a17394d39cd, user_id=b0f3bdbaf7704a11b5078307c3c9b7ed, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.862524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521f1bf-35f4-4f2e-b01a-f689ea431323 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.864677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.867533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963b8b6-cc06-4e9f-bf91-0f54be711a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.868232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b8b6-cc06-4e9f-bf91-0f54be711a59 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.868880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b8b6-cc06-4e9f-bf91-0f54be711a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.868880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963b8b6-cc06-4e9f-bf91-0f54be711a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.869511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963b8b6-cc06-4e9f-bf91-0f54be711a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:05:31.869837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963b8b6-cc06-4e9f-bf91-0f54be711a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.871568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963b8b6-cc06-4e9f-bf91-0f54be711a59 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:31.882817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2823/5638] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:31 2022] PUT /identity/v3/projects/9da4f11a17fa45cab1e10a17394d39cd/users/b0f3bdbaf7704a11b5078307c3c9b7ed/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:31.890667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2816/5639] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:31.894021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:31.895575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213875a6-e7f5-48ee-b0ab-2a81f72cbbcd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.895972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213875a6-e7f5-48ee-b0ab-2a81f72cbbcd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.896375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213875a6-e7f5-48ee-b0ab-2a81f72cbbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.928875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-213875a6-e7f5-48ee-b0ab-2a81f72cbbcd None None] MFA Rules not processed for user `b0f3bdbaf7704a11b5078307c3c9b7ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:31.930380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-213875a6-e7f5-48ee-b0ab-2a81f72cbbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:31.964148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea09051-26e4-4d13-afe4-d22c35a23255 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:31.975681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:31.976253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:31.976541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:31.977417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:31.978124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:31.980106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.007343 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2817/5640] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:32.013196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2824/5641] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:31 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:32.014865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213875a6-e7f5-48ee-b0ab-2a81f72cbbcd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.019597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.021377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:32.029525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213875a6-e7f5-48ee-b0ab-2a81f72cbbcd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.095308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ecece-c54f-4012-813b-c9e1432469d9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.100008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.100785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.101586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.101586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.123075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.123711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.124000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.124281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.125233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.128952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.161186 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2818/5642] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:32 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:32.162476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.181694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb566ac8-ec6d-4267-8c51-3a139bbf2e0f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.182682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.184604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.188242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.189788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.190345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.190877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.193348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.199677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.206856 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2825/5643] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:32.212823 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2819/5644] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:32.219337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.231828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65eac-8f83-4f18-98ff-acbd6f5ed415 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.237848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1b180-02b2-46ab-8911-7b5fd2c8e802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.238539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b180-02b2-46ab-8911-7b5fd2c8e802 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.239009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b180-02b2-46ab-8911-7b5fd2c8e802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.239287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b180-02b2-46ab-8911-7b5fd2c8e802 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.240075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1b180-02b2-46ab-8911-7b5fd2c8e802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.241703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1b180-02b2-46ab-8911-7b5fd2c8e802 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.254800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2826/5645] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:32.259734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.276239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03aee55-2e4a-45f0-82f2-85adffcc5fd1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.287586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.290593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.290905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.291230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] PATH_INFO: `/v3/projects/6b63fb8760694d5886d283268a438487/users/eed49cf09ec54f0ba027e51d9a7eeae1/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.336719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b63fb8760694d5886d283268a438487, user_id=eed49cf09ec54f0ba027e51d9a7eeae1, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.349088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.374377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2820/5646] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:32 2022] PUT /identity/v3/projects/6b63fb8760694d5886d283268a438487/users/eed49cf09ec54f0ba027e51d9a7eeae1/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:32.385461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe85a-9c82-4721-a8d7-12388320ba56 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.385826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe85a-9c82-4721-a8d7-12388320ba56 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.386111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe85a-9c82-4721-a8d7-12388320ba56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.424642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e56fe85a-9c82-4721-a8d7-12388320ba56 None None] MFA Rules not processed for user `eed49cf09ec54f0ba027e51d9a7eeae1`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:32.426626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e56fe85a-9c82-4721-a8d7-12388320ba56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:32.548795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.552580 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2827/5647] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:32.679312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c6a54-a97f-4153-b104-f8ecee9c414f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.685920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.686677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.687069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.687610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.688617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.691022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.736854 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2821/5648] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:32 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:32.740817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe85a-9c82-4721-a8d7-12388320ba56 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.763705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe85a-9c82-4721-a8d7-12388320ba56 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.844071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.845438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.845741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.846088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.847054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.849348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.876345 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2828/5649] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:32 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:32.878414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.890644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2961dd-cf31-4e25-a7f7-a89ef0d9b7d1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.896738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.897750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.898178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.898502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.899472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.901263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.920363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:32.921459 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2822/5650] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:32.943212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7ffec-f0f9-4c55-80ee-74c150cd2e2b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:32.943212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:32.943212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:32.943212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:32.943615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] PATH_INFO: `/v3/projects/04818d2bdae04f5985fe1deb791d842e/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:32.974446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04818d2bdae04f5985fe1deb791d842e, user_id=3bcf2a87c91647b39f3a5d5562baa531, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:32.978912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:32.999507 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2829/5651] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:32 2022] PUT /identity/v3/projects/04818d2bdae04f5985fe1deb791d842e/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:33.004629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.022331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31d4d-9fb0-4e09-93cd-e389be5f1071 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:33.188295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a23429-f7cc-48ef-8724-a54b71cc9747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:33.189917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23429-f7cc-48ef-8724-a54b71cc9747 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.191296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23429-f7cc-48ef-8724-a54b71cc9747 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.191754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23429-f7cc-48ef-8724-a54b71cc9747 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.192655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a23429-f7cc-48ef-8724-a54b71cc9747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:33.194456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a23429-f7cc-48ef-8724-a54b71cc9747 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:33.221482 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2823/5652] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:33.225664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.238817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8086ef8-127b-49f7-9cb9-7add40119148 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:33.244209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:33.245117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.245405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.245688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] PATH_INFO: `/v3/projects/04818d2bdae04f5985fe1deb791d842e/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.248368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04818d2bdae04f5985fe1deb791d842e, user_id=3bcf2a87c91647b39f3a5d5562baa531, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:33.251375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:33.271276 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2830/5653] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:33 2022] PUT /identity/v3/projects/04818d2bdae04f5985fe1deb791d842e/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:33.276717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4ea2c-ac0a-4c6b-81e4-1180a78214a2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.277016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4ea2c-ac0a-4c6b-81e4-1180a78214a2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.277375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4ea2c-ac0a-4c6b-81e4-1180a78214a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.342242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c6b4ea2c-ac0a-4c6b-81e4-1180a78214a2 None None] MFA Rules not processed for user `3bcf2a87c91647b39f3a5d5562baa531`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:33.344390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c6b4ea2c-ac0a-4c6b-81e4-1180a78214a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:33.460943 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2824/5654] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:33.467503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.534172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7280a-8d86-4199-b690-c15e07d42948 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:33.539745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:33.540577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.540956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.541321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.542162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:33.544405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:33.575258 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2831/5655] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:33 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:33.579879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4ea2c-ac0a-4c6b-81e4-1180a78214a2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.591428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4ea2c-ac0a-4c6b-81e4-1180a78214a2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:33.661853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:33.662539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.662858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.663141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.663839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:33.665933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:33.690995 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2825/5656] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:33 2022] POST /identity/v3/users => generated 285 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:33.693134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.706922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b12204-0844-46f1-8555-769d1864384e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:33.715319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:33.717258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.718013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.718469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.719511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:33.721843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:33.738812 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2832/5657] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:05:33.740926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.750986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffb45c-05ef-4aa8-8179-8bbebc1c5f5c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:33.762853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda721d8-b499-4125-bde0-fc307627d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:33.762853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda721d8-b499-4125-bde0-fc307627d315 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.762853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda721d8-b499-4125-bde0-fc307627d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.762853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda721d8-b499-4125-bde0-fc307627d315 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.763342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda721d8-b499-4125-bde0-fc307627d315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:33.763342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda721d8-b499-4125-bde0-fc307627d315 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:33.772747 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2826/5658] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:33.777020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.801105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc5610-55b7-4571-b029-3de91feaff40 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:33.806070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:33.807074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.807548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.807885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] PATH_INFO: `/v3/projects/41743b47c88440d898929624efab6d00/users/d2ef1601bb3443b89887d6d60e255dd5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.824142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=41743b47c88440d898929624efab6d00, user_id=d2ef1601bb3443b89887d6d60e255dd5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:33.826871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:33.840522 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2833/5659] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:33 2022] PUT /identity/v3/projects/41743b47c88440d898929624efab6d00/users/d2ef1601bb3443b89887d6d60e255dd5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:33.850683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d484-d101-498a-8101-9b961fd6d12f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.851080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d484-d101-498a-8101-9b961fd6d12f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.851437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96d484-d101-498a-8101-9b961fd6d12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:33.878599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8e96d484-d101-498a-8101-9b961fd6d12f None None] MFA Rules not processed for user `d2ef1601bb3443b89887d6d60e255dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:33.879911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8e96d484-d101-498a-8101-9b961fd6d12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:33.949983 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2827/5660] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:33.955488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:33.970691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:33.974576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:33.975158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.003368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:34.005130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:34.049770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfe14b-74fe-483c-b03a-510c6967c2cc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.056550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.057338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.057630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.057906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.059615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.061415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.097688 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2834/5661] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:05:33 2022] POST /identity/v3/domains => generated 276 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:34.099106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.128552 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2828/5662] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:05:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:34.159485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.164412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:34.189804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a2fda-8138-4c28-be64-ef51d67a6c45 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.200189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.200189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.200189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.200559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.200559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.200559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.221765 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2835/5663] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:05:34 2022] POST /identity/v3/roles => generated 239 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:34.222825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.234610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f413eae5-6e3d-4d68-9660-fc0af1c5a3af tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.242868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.243853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.246473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.246473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9/users/d2ef1601bb3443b89887d6d60e255dd5/roles/602f5bc57df74d8ab6b8f610e2ca5e0c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.261174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=d5153307488a4c9a9be7bd9e6cc9f1c9, user_id=d2ef1601bb3443b89887d6d60e255dd5, role_id=602f5bc57df74d8ab6b8f610e2ca5e0c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.266428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.280096 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2836/5664] 10.222.0.32 () {60 vars in 1479 bytes} [Sat May 7 22:05:34 2022] PUT /identity/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9/users/d2ef1601bb3443b89887d6d60e255dd5/roles/602f5bc57df74d8ab6b8f610e2ca5e0c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:34.284870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.326013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5496939-516d-4f03-bb04-6172204abed5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.377227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53601cd0-ac99-45fd-baa4-7e65ae3ef54c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.388630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.391273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.391651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.392273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.394400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.398259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.416022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.416681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.417644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.417925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.424255 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2837/5665] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:05:34 2022] POST /identity/v3/domains => generated 276 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:34.428199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.508395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.509470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cce1a3-080d-465f-9272-5c15b50ea7fd tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.510030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.516444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.517211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.517499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.517855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.518562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.520322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.520869 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2829/5666] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 22:05:34.537657 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2838/5667] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:05:34 2022] POST /identity/v3/roles => generated 240 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:34.541928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.556588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1383d-4cc6-4441-aa86-43404de59a10 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.561979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.562998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.563361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.567191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.568077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.570136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.600389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2830/5668] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:05:34 2022] POST /identity/v3/groups => generated 324 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:34.604614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.617349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2c44c-215f-4749-b153-06c8b66a7b16 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.622666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.623763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.624125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.624486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups/b60a06dcc57944638c64c05aa0b66328/users/d2ef1601bb3443b89887d6d60e255dd5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.631930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b60a06dcc57944638c64c05aa0b66328, user_id=d2ef1601bb3443b89887d6d60e255dd5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.634198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.674826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2839/5669] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:05:34 2022] PUT /identity/v3/groups/b60a06dcc57944638c64c05aa0b66328/users/d2ef1601bb3443b89887d6d60e255dd5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:34.677221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.691873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2df836-d2b4-4364-a780-fe5647623356 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.804489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.806550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.806911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.807237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/5496ac0c3d95463cb61296e667d78c23/groups/b60a06dcc57944638c64c05aa0b66328/roles/c0ff7363447f40d5800c7a83144f9900` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.810750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5496ac0c3d95463cb61296e667d78c23, group_id=b60a06dcc57944638c64c05aa0b66328, role_id=c0ff7363447f40d5800c7a83144f9900)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.815884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.843336 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2831/5670] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:34 2022] PUT /identity/v3/domains/5496ac0c3d95463cb61296e667d78c23/groups/b60a06dcc57944638c64c05aa0b66328/roles/c0ff7363447f40d5800c7a83144f9900 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:34.848241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.866965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4dd52-b3bc-46d8-8511-b36e8a872b42 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:34.944710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:34.947424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:34.947424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:34.947424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:34.947424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:34.958079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:34.978866 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2840/5671] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:05:34 2022] POST /identity/v3/domains => generated 277 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:34.983429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:34.995183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb8595-0452-41d8-9d29-468e2f80d937 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.069099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.070384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.070798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.071798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.072662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.074451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:35.103808 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2832/5672] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:05:34 2022] POST /identity/v3/roles => generated 240 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:35.105526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:35.121658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b36859-4b60-472b-a54b-d60bd4421429 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.127504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.128635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.129076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.129995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/c04f67073ea24b088c6729b91a40a6e5/users/d2ef1601bb3443b89887d6d60e255dd5/roles/779fd3b097384a6897049b55ecd42496` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.150245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c04f67073ea24b088c6729b91a40a6e5, user_id=d2ef1601bb3443b89887d6d60e255dd5, role_id=779fd3b097384a6897049b55ecd42496)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.164122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:35.224482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2841/5673] 10.222.0.32 () {60 vars in 1479 bytes} [Sat May 7 22:05:35 2022] PUT /identity/v3/domains/c04f67073ea24b088c6729b91a40a6e5/users/d2ef1601bb3443b89887d6d60e255dd5/roles/779fd3b097384a6897049b55ecd42496 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:35.224943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:35.240419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16709cd-6326-49c4-ad4a-587ef12d4156 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.325682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.326321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.326609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.326968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.327709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.329388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:35.347381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2833/5674] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:05:35 2022] POST /identity/v3/domains => generated 277 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:35.351318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:35.369137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b5ed9-e720-440c-ab3f-746cd80d58f4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.463802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.464583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.464794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.465220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.465965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.469159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:35.503556 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2842/5675] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:05:35 2022] POST /identity/v3/roles => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:35.503988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:35.515379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2124a-c0bf-43bd-a4d1-bba002002133 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.521310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.522115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.522852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.522852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.523906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.526048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:35.552139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2834/5676] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:05:35 2022] POST /identity/v3/groups => generated 327 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:35.556605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:35.567350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9507e3-559f-4f26-b96c-b92307859b5f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.572233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.573327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.573679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.574422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups/f6d3e5ba1fd24734a287b59330cb8671/users/d2ef1601bb3443b89887d6d60e255dd5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.580917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f6d3e5ba1fd24734a287b59330cb8671, user_id=d2ef1601bb3443b89887d6d60e255dd5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.583039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:35.608609 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2843/5677] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:05:35 2022] PUT /identity/v3/groups/f6d3e5ba1fd24734a287b59330cb8671/users/d2ef1601bb3443b89887d6d60e255dd5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:35.612608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:35.623687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601e04b-772b-4bae-a6b1-85e99d4b5c95 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.697210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.698481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.698905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.699237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/01a8b806f51f48598a66dc6273d4d259/groups/f6d3e5ba1fd24734a287b59330cb8671/roles/50ccd12343e54742b5650c55c8b2b736` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.702464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=01a8b806f51f48598a66dc6273d4d259, group_id=f6d3e5ba1fd24734a287b59330cb8671, role_id=50ccd12343e54742b5650c55c8b2b736)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.706113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:35.729127 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2835/5678] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:35 2022] PUT /identity/v3/domains/01a8b806f51f48598a66dc6273d4d259/groups/f6d3e5ba1fd24734a287b59330cb8671/roles/50ccd12343e54742b5650c55c8b2b736 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:35.733718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:35.882184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1160a-2de0-448d-aec3-c366599ec4ae tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:35.973238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ef1601bb3443b89887d6d60e255dd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41743b47c88440d898929624efab6d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:35.973892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:35.974173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:35.974458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] PATH_INFO: `/v3/auth/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:35.975146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:35.976230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:36.057321 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2844/5679] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 22:05:35 2022] GET /identity/v3/auth/domains => generated 1174 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:05:36.058102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:36.159147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd395-b74a-476d-af2a-63217742a055 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:36.164663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:36.165714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:36.166073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:36.166953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/01a8b806f51f48598a66dc6273d4d259/groups/f6d3e5ba1fd24734a287b59330cb8671/roles/50ccd12343e54742b5650c55c8b2b736` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:36.169176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=01a8b806f51f48598a66dc6273d4d259, group_id=f6d3e5ba1fd24734a287b59330cb8671, role_id=50ccd12343e54742b5650c55c8b2b736)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:36.172052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:36.180600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role 50ccd12343e54742b5650c55c8b2b736 was removed from group f6d3e5ba1fd24734a287b59330cb8671 on domain 01a8b806f51f48598a66dc6273d4d259. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:36.180981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.181749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.205538 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2836/5680] 10.222.0.32 () {58 vars in 1466 bytes} [Sat May 7 22:05:36 2022] DELETE /identity/v3/domains/01a8b806f51f48598a66dc6273d4d259/groups/f6d3e5ba1fd24734a287b59330cb8671/roles/50ccd12343e54742b5650c55c8b2b736 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:36.210821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:36.216482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:36.233833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44b64-2cf4-4b38-b897-cd3052a3818c tempest-TokensV3TestJSON-1333754431 tempest-TokensV3TestJSON-1333754431-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:36.306181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:36.307218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:36.308056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:36.308056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups/f6d3e5ba1fd24734a287b59330cb8671/users/d2ef1601bb3443b89887d6d60e255dd5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:36.310348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f6d3e5ba1fd24734a287b59330cb8671, user_id=d2ef1601bb3443b89887d6d60e255dd5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:36.312398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:36.324071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd2ef1601bb3443b89887d6d60e255dd5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.342399 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2845/5681] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:05:36 2022] DELETE /identity/v3/groups/f6d3e5ba1fd24734a287b59330cb8671/users/d2ef1601bb3443b89887d6d60e255dd5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:36.346836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:36.357603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d079-cf0e-451d-bd21-b3841b780499 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:36.417738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:36.418697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:36.419080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:36.419430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups/f6d3e5ba1fd24734a287b59330cb8671` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:36.420807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f6d3e5ba1fd24734a287b59330cb8671)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:36.423427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:36.471639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2837/5682] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:05:36 2022] DELETE /identity/v3/groups/f6d3e5ba1fd24734a287b59330cb8671 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:36.476005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:36.487407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc425b-028d-458b-961d-0d894f918304 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:36.566456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:36.567514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:36.567873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:36.568221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles/50ccd12343e54742b5650c55c8b2b736` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:36.572439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_role(role_id=50ccd12343e54742b5650c55c8b2b736)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:36.572439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:36.617997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role 50ccd12343e54742b5650c55c8b2b736 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:36.618191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.621054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.623224 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2846/5683] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:36 2022] DELETE /identity/v3/roles/50ccd12343e54742b5650c55c8b2b736 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:36.627281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:36.629774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:36.643249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd08f85-969a-4c76-aa94-4a1ebe16226a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:36.713335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:36.714222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:36.714511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:36.714892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/01a8b806f51f48598a66dc6273d4d259` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:36.716264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=01a8b806f51f48598a66dc6273d4d259)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:36.717943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:36.749771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '01a8b806f51f48598a66dc6273d4d259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.749771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '01a8b806f51f48598a66dc6273d4d259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.775928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '01a8b806f51f48598a66dc6273d4d259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.776551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '01a8b806f51f48598a66dc6273d4d259'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.784379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:36.784892 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2838/5684] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:36 2022] PATCH /identity/v3/domains/01a8b806f51f48598a66dc6273d4d259 => generated 278 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:36.794805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c4cf-5fea-431a-a949-da6acdbed1eb tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:36.861814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:36.862956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:36.863311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:36.863599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/01a8b806f51f48598a66dc6273d4d259` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:36.881480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=01a8b806f51f48598a66dc6273d4d259)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:36.883297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:36.909279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '01a8b806f51f48598a66dc6273d4d259'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.912987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '01a8b806f51f48598a66dc6273d4d259'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.971080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a8b806f51f48598a66dc6273d4d259', 'request_id': 'req-e95bdd90-012f-4d1e-8057-1aefac2d486c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.980055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a8b806f51f48598a66dc6273d4d259', 'request_id': 'req-e95bdd90-012f-4d1e-8057-1aefac2d486c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:36.989788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a8b806f51f48598a66dc6273d4d259', 'request_id': 'req-e95bdd90-012f-4d1e-8057-1aefac2d486c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.003477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] The token cache is being invalidate because project 01a8b806f51f48598a66dc6273d4d259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:37.003831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.005173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.017875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '01a8b806f51f48598a66dc6273d4d259', 'request_id': 'req-e95bdd90-012f-4d1e-8057-1aefac2d486c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.021704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '01a8b806f51f48598a66dc6273d4d259', 'request_id': 'req-e95bdd90-012f-4d1e-8057-1aefac2d486c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.022522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '01a8b806f51f48598a66dc6273d4d259', 'request_id': 'req-e95bdd90-012f-4d1e-8057-1aefac2d486c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.034657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:37.035229 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2847/5685] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:36 2022] DELETE /identity/v3/domains/01a8b806f51f48598a66dc6273d4d259 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:37.036266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:37.053215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7547ee-f506-47a3-9ca6-99ac61578d78 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:37.125493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:37.126477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:37.126868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:37.127245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/c04f67073ea24b088c6729b91a40a6e5/users/d2ef1601bb3443b89887d6d60e255dd5/roles/779fd3b097384a6897049b55ecd42496` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:37.129760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c04f67073ea24b088c6729b91a40a6e5, user_id=d2ef1601bb3443b89887d6d60e255dd5, role_id=779fd3b097384a6897049b55ecd42496)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:37.133793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:37.138987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role 779fd3b097384a6897049b55ecd42496 was removed from user d2ef1601bb3443b89887d6d60e255dd5 on domain c04f67073ea24b088c6729b91a40a6e5. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:37.139159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.139815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.177109 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2839/5686] 10.222.0.32 () {58 vars in 1463 bytes} [Sat May 7 22:05:37 2022] DELETE /identity/v3/domains/c04f67073ea24b088c6729b91a40a6e5/users/d2ef1601bb3443b89887d6d60e255dd5/roles/779fd3b097384a6897049b55ecd42496 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:37.181135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:37.182693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:37.198600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bdd90-012f-4d1e-8057-1aefac2d486c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:37.291090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:37.292222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:37.292695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:37.293451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles/779fd3b097384a6897049b55ecd42496` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:37.295480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_role(role_id=779fd3b097384a6897049b55ecd42496)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:37.298474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:37.358990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role 779fd3b097384a6897049b55ecd42496 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:37.359378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.360863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.366216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2848/5687] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:37 2022] DELETE /identity/v3/roles/779fd3b097384a6897049b55ecd42496 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:37.367406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:37.369371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:37.390124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04077c0-69fe-4600-9964-accf573526e5 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:37.459395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:37.460539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:37.461149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:37.461598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/c04f67073ea24b088c6729b91a40a6e5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:37.463201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c04f67073ea24b088c6729b91a40a6e5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:37.465016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:37.495494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.497842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.538683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.538683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.540742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:37.540875 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2840/5688] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:37 2022] PATCH /identity/v3/domains/c04f67073ea24b088c6729b91a40a6e5 => generated 278 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:37.542955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:37.559227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4b81-7b85-406a-bcdc-f7c5e8b13af0 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:37.656533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:37.657494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:37.657781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:37.658058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/c04f67073ea24b088c6729b91a40a6e5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:37.670075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c04f67073ea24b088c6729b91a40a6e5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:37.671808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:37.707218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.710512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.764214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5', 'request_id': 'req-1dbb6210-a0d5-409f-af14-6713c0be7757'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.772568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5', 'request_id': 'req-1dbb6210-a0d5-409f-af14-6713c0be7757'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.782629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5', 'request_id': 'req-1dbb6210-a0d5-409f-af14-6713c0be7757'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.797222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] The token cache is being invalidate because project c04f67073ea24b088c6729b91a40a6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:37.797517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.799446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.808772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5', 'request_id': 'req-1dbb6210-a0d5-409f-af14-6713c0be7757'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.813079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5', 'request_id': 'req-1dbb6210-a0d5-409f-af14-6713c0be7757'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.814548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c04f67073ea24b088c6729b91a40a6e5', 'request_id': 'req-1dbb6210-a0d5-409f-af14-6713c0be7757'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.827564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:37.829191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:37.831933 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2849/5689] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:37 2022] DELETE /identity/v3/domains/c04f67073ea24b088c6729b91a40a6e5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:37.844232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511933-3e39-472c-96ee-c63bd896b55b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:37.913472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:37.914585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:37.914912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:37.915198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/5496ac0c3d95463cb61296e667d78c23/groups/b60a06dcc57944638c64c05aa0b66328/roles/c0ff7363447f40d5800c7a83144f9900` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:37.918363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5496ac0c3d95463cb61296e667d78c23, group_id=b60a06dcc57944638c64c05aa0b66328, role_id=c0ff7363447f40d5800c7a83144f9900)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:37.923654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:37.929503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role c0ff7363447f40d5800c7a83144f9900 was removed from group b60a06dcc57944638c64c05aa0b66328 on domain 5496ac0c3d95463cb61296e667d78c23. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:37.929871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.930612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:37.948736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2841/5690] 10.222.0.32 () {58 vars in 1466 bytes} [Sat May 7 22:05:37 2022] DELETE /identity/v3/domains/5496ac0c3d95463cb61296e667d78c23/groups/b60a06dcc57944638c64c05aa0b66328/roles/c0ff7363447f40d5800c7a83144f9900 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:37.952869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:37.954807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:37.967751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb6210-a0d5-409f-af14-6713c0be7757 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:38.025486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:38.026402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:38.026691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:38.027022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups/b60a06dcc57944638c64c05aa0b66328/users/d2ef1601bb3443b89887d6d60e255dd5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:38.028751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=b60a06dcc57944638c64c05aa0b66328, user_id=d2ef1601bb3443b89887d6d60e255dd5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:38.030676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:38.038628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd2ef1601bb3443b89887d6d60e255dd5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.053087 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2850/5691] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:05:37 2022] DELETE /identity/v3/groups/b60a06dcc57944638c64c05aa0b66328/users/d2ef1601bb3443b89887d6d60e255dd5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:38.057456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:38.059211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:38.071553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c71ad8-bc0d-4b30-9c9d-5902426d9171 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:38.125086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:38.125968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:38.126537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:38.126537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/groups/b60a06dcc57944638c64c05aa0b66328` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:38.127851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b60a06dcc57944638c64c05aa0b66328)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:38.129757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:38.169976 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2842/5692] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:05:38 2022] DELETE /identity/v3/groups/b60a06dcc57944638c64c05aa0b66328 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:38.175282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:38.187473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e15b6-1e5e-4fa4-ab8a-fae8409adfc2 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:38.249658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:38.250513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:38.250820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:38.251125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles/c0ff7363447f40d5800c7a83144f9900` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:38.252600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c0ff7363447f40d5800c7a83144f9900)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:38.254256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:38.291839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role c0ff7363447f40d5800c7a83144f9900 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:38.292232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.293171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.295854 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2851/5693] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:38 2022] DELETE /identity/v3/roles/c0ff7363447f40d5800c7a83144f9900 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:38.300748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:38.302483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:38.316014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f70e15-1bf2-4d8e-b954-5ebac158f816 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:38.378207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:38.379116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:38.379396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:38.379671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/5496ac0c3d95463cb61296e667d78c23` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:38.381003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5496ac0c3d95463cb61296e667d78c23)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:38.382610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:38.402857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5496ac0c3d95463cb61296e667d78c23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.403630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5496ac0c3d95463cb61296e667d78c23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.429898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5496ac0c3d95463cb61296e667d78c23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.430507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5496ac0c3d95463cb61296e667d78c23'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.433028 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2843/5694] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:38 2022] PATCH /identity/v3/domains/5496ac0c3d95463cb61296e667d78c23 => generated 277 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:38.437212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:38.447870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c69809-694f-46a4-af1d-661196c7373a tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:38.507601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:38.508541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:38.508828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:38.509101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/5496ac0c3d95463cb61296e667d78c23` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:38.520959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5496ac0c3d95463cb61296e667d78c23)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:38.523688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:38.551407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5496ac0c3d95463cb61296e667d78c23'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.556425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5496ac0c3d95463cb61296e667d78c23'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.613386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5496ac0c3d95463cb61296e667d78c23', 'request_id': 'req-090bbf75-fbed-43da-abcb-0739c67a85ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.623941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5496ac0c3d95463cb61296e667d78c23', 'request_id': 'req-090bbf75-fbed-43da-abcb-0739c67a85ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.634074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5496ac0c3d95463cb61296e667d78c23', 'request_id': 'req-090bbf75-fbed-43da-abcb-0739c67a85ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.646324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] The token cache is being invalidate because project 5496ac0c3d95463cb61296e667d78c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:38.646618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.647473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.655488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5496ac0c3d95463cb61296e667d78c23', 'request_id': 'req-090bbf75-fbed-43da-abcb-0739c67a85ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.659838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5496ac0c3d95463cb61296e667d78c23', 'request_id': 'req-090bbf75-fbed-43da-abcb-0739c67a85ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.661446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5496ac0c3d95463cb61296e667d78c23', 'request_id': 'req-090bbf75-fbed-43da-abcb-0739c67a85ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.670832 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2852/5695] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:38 2022] DELETE /identity/v3/domains/5496ac0c3d95463cb61296e667d78c23 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:38.672663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:38.674284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:38.689352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6e965-391c-4a97-95c9-b39ac465aa4d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:38.751371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:38.752525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:38.752645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:38.752924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9/users/d2ef1601bb3443b89887d6d60e255dd5/roles/602f5bc57df74d8ab6b8f610e2ca5e0c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:38.755727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=d5153307488a4c9a9be7bd9e6cc9f1c9, user_id=d2ef1601bb3443b89887d6d60e255dd5, role_id=602f5bc57df74d8ab6b8f610e2ca5e0c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:38.758378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:38.764840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role 602f5bc57df74d8ab6b8f610e2ca5e0c was removed from user d2ef1601bb3443b89887d6d60e255dd5 on domain d5153307488a4c9a9be7bd9e6cc9f1c9. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:38.765037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.765665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.790049 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2844/5696] 10.222.0.32 () {58 vars in 1463 bytes} [Sat May 7 22:05:38 2022] DELETE /identity/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9/users/d2ef1601bb3443b89887d6d60e255dd5/roles/602f5bc57df74d8ab6b8f610e2ca5e0c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:38.791127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:38.812014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:38.858912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bbf75-fbed-43da-abcb-0739c67a85ba tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:38.929009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:38.929878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:38.930280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:38.930917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles/602f5bc57df74d8ab6b8f610e2ca5e0c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:38.932434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_role(role_id=602f5bc57df74d8ab6b8f610e2ca5e0c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:38.934308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:38.972211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role 602f5bc57df74d8ab6b8f610e2ca5e0c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:38.972495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.973159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:38.975024 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2853/5697] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:38 2022] DELETE /identity/v3/roles/602f5bc57df74d8ab6b8f610e2ca5e0c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:38.979077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:38.980540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:38.993651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f55e33-aade-4dbc-af8d-0adf86a8cb33 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:39.103637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:39.104779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:39.105220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:39.105689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:39.107366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d5153307488a4c9a9be7bd9e6cc9f1c9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:39.109143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:39.133993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.135458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.171758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.173843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.177811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2845/5698] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:38 2022] PATCH /identity/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9 => generated 277 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:39.181671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:39.184292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:39.220461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e9f9-e851-4f3e-ac4b-0519a1f2684b tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:39.280227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:39.281245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:39.281391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:39.281637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:39.299674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d5153307488a4c9a9be7bd9e6cc9f1c9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:39.304714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:39.360716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.366319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.453847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9', 'request_id': 'req-aea8adba-ece9-4516-921d-d60f02b218aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.465720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9', 'request_id': 'req-aea8adba-ece9-4516-921d-d60f02b218aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.478404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9', 'request_id': 'req-aea8adba-ece9-4516-921d-d60f02b218aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.502003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] The token cache is being invalidate because project d5153307488a4c9a9be7bd9e6cc9f1c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:39.503121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.507645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.542311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9', 'request_id': 'req-aea8adba-ece9-4516-921d-d60f02b218aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.545949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9', 'request_id': 'req-aea8adba-ece9-4516-921d-d60f02b218aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.547283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd5153307488a4c9a9be7bd9e6cc9f1c9', 'request_id': 'req-aea8adba-ece9-4516-921d-d60f02b218aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.553398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2854/5699] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:39 2022] DELETE /identity/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:39.559248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:39.561562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:39.576163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f4ddc-026d-46a8-8a91-e47ee7854a06 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:39.655444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:39.656177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:39.656464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:39.656887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:39.658890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:39.661254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:39.674747 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2846/5700] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:39.678880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:39.680393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:39.701579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8adba-ece9-4516-921d-d60f02b218aa tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:39.706907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:39.707794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:39.708535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:39.708535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects/6b63fb8760694d5886d283268a438487/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:39.710348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6b63fb8760694d5886d283268a438487, user_id=3bcf2a87c91647b39f3a5d5562baa531, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:39.714349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:39.726663 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2855/5701] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:39 2022] PUT /identity/v3/projects/6b63fb8760694d5886d283268a438487/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:39.730519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:39.746322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d06cd-7bf4-44a4-b809-60145a75b321 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:39.821672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:39.822328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:39.822612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:39.822991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:39.835469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:39.837050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:39.894561 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2847/5702] 10.222.0.32 () {58 vars in 1145 bytes} [Sat May 7 22:05:39 2022] GET /identity/v3/auth/projects => generated 826 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:39.898621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:39.909791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faaec3-564c-4d0a-8aa7-f80af4c0d1f3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:39.916593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:39.917612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:39.917997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:39.918457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects/6b63fb8760694d5886d283268a438487/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:39.920590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6b63fb8760694d5886d283268a438487, user_id=3bcf2a87c91647b39f3a5d5562baa531, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:39.924495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:39.941821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role c9eb15c85a974dd28e3374b8d701947e was removed from user 3bcf2a87c91647b39f3a5d5562baa531 on project 6b63fb8760694d5886d283268a438487. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:39.942149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.942891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:39.969874 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2856/5703] 10.222.0.32 () {58 vars in 1466 bytes} [Sat May 7 22:05:39 2022] DELETE /identity/v3/projects/6b63fb8760694d5886d283268a438487/users/3bcf2a87c91647b39f3a5d5562baa531/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:39.971109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:39.973067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:39.987290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43137fe-0ec9-48f0-83e0-c37edd2d76e6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.047655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.048860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.049145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.049417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.050097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.052064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.073192 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2848/5704] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:39 2022] POST /identity/v3/users => generated 321 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:40.080413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.102481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d5b91-7a30-44f3-967c-bc64f80a00b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.107342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.108301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.108594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.108875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.109563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.112046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.139190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2857/5705] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:40 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:40.143432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.153269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6a8bf-d147-42e7-bf2a-3ec39df8180f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.209111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.214158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.214158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.214158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.214158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.214158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.241685 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2849/5706] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:40 2022] POST /identity/v3/projects => generated 363 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:40.242998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.253881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0db55-77cd-485f-b0b4-053864123f3f tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.309377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.310037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.310319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.310595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.311363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.312948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.326605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2858/5707] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:05:40 2022] POST /identity/v3/roles => generated 239 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:40.330571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.343213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904fe0c-0b4f-4173-ba79-d6428655447c tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.348855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ebd961-4822-4393-b3e7-b9c3cc17c6f6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.350171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebd961-4822-4393-b3e7-b9c3cc17c6f6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.350669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebd961-4822-4393-b3e7-b9c3cc17c6f6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.351207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ebd961-4822-4393-b3e7-b9c3cc17c6f6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects/b745d42f8a91416481b87f953fa74e38/users/a336971295b9449baada0529a824bbb9/roles/b6ffce6528c14c90ab39d06a28f97180` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.369768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebd961-4822-4393-b3e7-b9c3cc17c6f6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b745d42f8a91416481b87f953fa74e38, user_id=a336971295b9449baada0529a824bbb9, role_id=b6ffce6528c14c90ab39d06a28f97180)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.372902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ebd961-4822-4393-b3e7-b9c3cc17c6f6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.388837 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2850/5708] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:40 2022] PUT /identity/v3/projects/b745d42f8a91416481b87f953fa74e38/users/a336971295b9449baada0529a824bbb9/roles/b6ffce6528c14c90ab39d06a28f97180 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:40.392896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.403619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11eca5-9609-437b-8a12-e1d7b336c5c4 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.489865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f2d71-fd80-4806-b1ea-994ee04b74d1 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.491082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2d71-fd80-4806-b1ea-994ee04b74d1 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.491586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2d71-fd80-4806-b1ea-994ee04b74d1 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.492046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2d71-fd80-4806-b1ea-994ee04b74d1 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects/baca5ee9bee74ed79279125d32397459/users/a336971295b9449baada0529a824bbb9/roles/b6ffce6528c14c90ab39d06a28f97180` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.508600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f2d71-fd80-4806-b1ea-994ee04b74d1 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:create_grant(project_id=baca5ee9bee74ed79279125d32397459, user_id=a336971295b9449baada0529a824bbb9, role_id=b6ffce6528c14c90ab39d06a28f97180)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.512387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f2d71-fd80-4806-b1ea-994ee04b74d1 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.529528 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2859/5709] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:40 2022] PUT /identity/v3/projects/baca5ee9bee74ed79279125d32397459/users/a336971295b9449baada0529a824bbb9/roles/b6ffce6528c14c90ab39d06a28f97180 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:40.531650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4eeef-b506-44cc-8449-ec3a27ddfc59 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.532003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4eeef-b506-44cc-8449-ec3a27ddfc59 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.532937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4eeef-b506-44cc-8449-ec3a27ddfc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.574534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5da4eeef-b506-44cc-8449-ec3a27ddfc59 None None] MFA Rules not processed for user `a336971295b9449baada0529a824bbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:40.575959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5da4eeef-b506-44cc-8449-ec3a27ddfc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:40.580632 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2851/5710] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:40 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:05:40.584946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135f69-80d3-4353-9340-bf5a610ca60d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.585243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135f69-80d3-4353-9340-bf5a610ca60d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.585527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135f69-80d3-4353-9340-bf5a610ca60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.605298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ac135f69-80d3-4353-9340-bf5a610ca60d None None] MFA Rules not processed for user `a336971295b9449baada0529a824bbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:40.606495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac135f69-80d3-4353-9340-bf5a610ca60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:40.689524 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2860/5711] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:40 2022] POST /identity/v3/auth/tokens => generated 3213 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 07 22:05:40.694179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4eeef-b506-44cc-8449-ec3a27ddfc59 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.756838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4eeef-b506-44cc-8449-ec3a27ddfc59 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.761369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.762018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.762331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.762609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.771343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.773302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.789184 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2852/5712] 10.222.0.32 () {56 vars in 1307 bytes} [Sat May 7 22:05:40 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:40.795613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573216f-d795-4f6d-b636-1f922975be00 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.795613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573216f-d795-4f6d-b636-1f922975be00 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.795613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573216f-d795-4f6d-b636-1f922975be00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.808604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7573216f-d795-4f6d-b636-1f922975be00 None None] MFA Rules not processed for user `a336971295b9449baada0529a824bbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:40.809731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7573216f-d795-4f6d-b636-1f922975be00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:40.869931 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2861/5713] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:40 2022] POST /identity/v3/auth/tokens => generated 3213 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 07 22:05:40.874107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.883820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf87e4-627c-4a60-a3bd-a274761b75d8 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:40.888782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:40.889636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:40.889922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:40.890204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/roles/b6ffce6528c14c90ab39d06a28f97180` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:40.892586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b6ffce6528c14c90ab39d06a28f97180)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:40.894200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:40.930839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invalidating the token cache because role b6ffce6528c14c90ab39d06a28f97180 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:40.931483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:40.932167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:40.934385 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2853/5714] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:40 2022] DELETE /identity/v3/roles/b6ffce6528c14c90ab39d06a28f97180 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:40.938613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573216f-d795-4f6d-b636-1f922975be00 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:40.949898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573216f-d795-4f6d-b636-1f922975be00 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.004614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.005469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.005758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.006039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects/baca5ee9bee74ed79279125d32397459` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.007330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_project(project_id=baca5ee9bee74ed79279125d32397459)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:41.009188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:41.061287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baca5ee9bee74ed79279125d32397459', 'request_id': 'req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.068722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baca5ee9bee74ed79279125d32397459', 'request_id': 'req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.076291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baca5ee9bee74ed79279125d32397459', 'request_id': 'req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.091186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] The token cache is being invalidate because project baca5ee9bee74ed79279125d32397459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:41.091186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.091872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.093689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2862/5715] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:40 2022] DELETE /identity/v3/projects/baca5ee9bee74ed79279125d32397459 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:41.103318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.107798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:41.122731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8bded-5609-46d1-a689-b632eee44c8d tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.180450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.181319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.181737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.181905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects/baca5ee9bee74ed79279125d32397459` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.190888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_project(project_id=baca5ee9bee74ed79279125d32397459)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:41.192633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Could not find project: baca5ee9bee74ed79279125d32397459.: keystone.exception.ProjectNotFound: Could not find project: baca5ee9bee74ed79279125d32397459. May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 07 22:05:41.214299 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: baca5ee9bee74ed79279125d32397459. May 07 22:05:41.215234 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:05:41.216094 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2854/5716] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:41 2022] DELETE /identity/v3/projects/baca5ee9bee74ed79279125d32397459 => generated 113 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:05:41.220801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.222292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:41.234891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bf7b2-2254-4260-9cb2-dae0d8a34ac7 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.239593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.240435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.240722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.241001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/projects/b745d42f8a91416481b87f953fa74e38` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.242186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b745d42f8a91416481b87f953fa74e38)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:41.244140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:41.289824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b745d42f8a91416481b87f953fa74e38', 'request_id': 'req-81627229-9dfa-4fa7-927d-b8ad5e0cc439'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.297315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b745d42f8a91416481b87f953fa74e38', 'request_id': 'req-81627229-9dfa-4fa7-927d-b8ad5e0cc439'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.304219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b745d42f8a91416481b87f953fa74e38', 'request_id': 'req-81627229-9dfa-4fa7-927d-b8ad5e0cc439'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.315108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] The token cache is being invalidate because project b745d42f8a91416481b87f953fa74e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:41.315398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.316059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.317658 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2863/5717] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:41 2022] DELETE /identity/v3/projects/b745d42f8a91416481b87f953fa74e38 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:41.321744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.323471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:41.337848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebc04c-d09b-48ff-9bff-d3d53819a8d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.393229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.394092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.394375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.394656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/users/a336971295b9449baada0529a824bbb9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.395883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a336971295b9449baada0529a824bbb9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:41.397803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:41.461224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a336971295b9449baada0529a824bbb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.469137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a336971295b9449baada0529a824bbb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.470009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a336971295b9449baada0529a824bbb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.470655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a336971295b9449baada0529a824bbb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.491616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a336971295b9449baada0529a824bbb9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:41.510631 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2855/5718] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:41 2022] DELETE /identity/v3/users/a336971295b9449baada0529a824bbb9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:41.515686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.528178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627229-9dfa-4fa7-927d-b8ad5e0cc439 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.615378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.616327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.616612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.617023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/01a8b806f51f48598a66dc6273d4d259` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.637891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Could not find domain: 01a8b806f51f48598a66dc6273d4d259.: keystone.exception.DomainNotFound: Could not find domain: 01a8b806f51f48598a66dc6273d4d259. May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 01a8b806f51f48598a66dc6273d4d259. May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:05:41.653782 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:05:41.654916 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 01a8b806f51f48598a66dc6273d4d259. May 07 22:05:41.656772 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:41.659115 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2864/5719] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:41 2022] PATCH /identity/v3/domains/01a8b806f51f48598a66dc6273d4d259 => generated 112 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:05:41.660547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.661551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:41.681363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8a25d-3a22-4b62-8a1a-f0cdb53d1645 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.687020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.687913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.688198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.689404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/c04f67073ea24b088c6729b91a40a6e5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.696936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Could not find domain: c04f67073ea24b088c6729b91a40a6e5.: keystone.exception.DomainNotFound: Could not find domain: c04f67073ea24b088c6729b91a40a6e5. May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c04f67073ea24b088c6729b91a40a6e5. May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:05:41.708623 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:05:41.709622 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c04f67073ea24b088c6729b91a40a6e5. May 07 22:05:41.710641 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:05:41.711819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2856/5720] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:41 2022] PATCH /identity/v3/domains/c04f67073ea24b088c6729b91a40a6e5 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:05:41.714552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.737276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c21e09-2d03-4279-8db4-f16d071825b6 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.743523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.745297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.745670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.746316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/5496ac0c3d95463cb61296e667d78c23` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.758174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Could not find domain: 5496ac0c3d95463cb61296e667d78c23.: keystone.exception.DomainNotFound: Could not find domain: 5496ac0c3d95463cb61296e667d78c23. May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5496ac0c3d95463cb61296e667d78c23. May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:05:41.772184 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:05:41.773306 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5496ac0c3d95463cb61296e667d78c23. May 07 22:05:41.774149 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:05:41.775624 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2865/5721] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:41 2022] PATCH /identity/v3/domains/5496ac0c3d95463cb61296e667d78c23 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 22:05:41.778457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.792901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e5d5e-d7ad-4f6c-af14-bfc071a01276 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.800059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccf399-e274-4bdf-93c2-d08fa2ca33d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bcf2a87c91647b39f3a5d5562baa531', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04818d2bdae04f5985fe1deb791d842e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.802259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf399-e274-4bdf-93c2-d08fa2ca33d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.802650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf399-e274-4bdf-93c2-d08fa2ca33d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.803157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccf399-e274-4bdf-93c2-d08fa2ca33d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] PATH_INFO: `/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.815446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccf399-e274-4bdf-93c2-d08fa2ca33d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-24ccf399-e274-4bdf-93c2-d08fa2ca33d3 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Could not find domain: d5153307488a4c9a9be7bd9e6cc9f1c9.: keystone.exception.DomainNotFound: Could not find domain: d5153307488a4c9a9be7bd9e6cc9f1c9. May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d5153307488a4c9a9be7bd9e6cc9f1c9. May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:05:41.827413 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:05:41.828524 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d5153307488a4c9a9be7bd9e6cc9f1c9. May 07 22:05:41.829786 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:05:41.831025 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2857/5722] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:05:41 2022] PATCH /identity/v3/domains/d5153307488a4c9a9be7bd9e6cc9f1c9 => generated 112 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:05:41.834453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:41.836857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:41.920979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc16be-af5d-455e-b7ff-24e1c8e96420 tempest-TokensV3TestJSON-510165307 tempest-TokensV3TestJSON-510165307-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:41.926973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:41.928542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:41.928928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:41.929269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] PATH_INFO: `/v3/users/eed49cf09ec54f0ba027e51d9a7eeae1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:41.931265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed49cf09ec54f0ba027e51d9a7eeae1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:41.933808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:42.009662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed49cf09ec54f0ba027e51d9a7eeae1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:42.010440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed49cf09ec54f0ba027e51d9a7eeae1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:42.018801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed49cf09ec54f0ba027e51d9a7eeae1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:42.020008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed49cf09ec54f0ba027e51d9a7eeae1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:42.033965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed49cf09ec54f0ba027e51d9a7eeae1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:42.060747 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2866/5723] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:41 2022] DELETE /identity/v3/users/eed49cf09ec54f0ba027e51d9a7eeae1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:42.065858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429e3d-c11a-4017-a23b-34fa4ec0ee1a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:42.066096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429e3d-c11a-4017-a23b-34fa4ec0ee1a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:42.066386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9429e3d-c11a-4017-a23b-34fa4ec0ee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:42.112908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c9429e3d-c11a-4017-a23b-34fa4ec0ee1a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:42.114373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c9429e3d-c11a-4017-a23b-34fa4ec0ee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:42.218826 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2858/5724] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:42.234142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:42.238908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:42.325444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3828e2-34cc-47a2-9dec-e57566e26523 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:42.330354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:42.331891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:42.332513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:42.332893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:42.344707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:42.346324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:42.361019 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2867/5725] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:44.055355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43401f07-b066-446a-a3cb-22965369e75f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:44.055833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43401f07-b066-446a-a3cb-22965369e75f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:44.055913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43401f07-b066-446a-a3cb-22965369e75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:44.076643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-43401f07-b066-446a-a3cb-22965369e75f None None] MFA Rules not processed for user `4fb48e4d50184d2e97674324027d9ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:44.078551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-43401f07-b066-446a-a3cb-22965369e75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:44.091962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:44.094174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:44.120180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc68c8-c0dd-4d21-be35-cf03c06e1c09 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:44.129999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:44.131552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:44.132579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:44.133170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] PATH_INFO: `/v3/projects/6b63fb8760694d5886d283268a438487` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:44.170959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b63fb8760694d5886d283268a438487)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:44.175129 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2859/5726] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:44.181477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:44.268631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b63fb8760694d5886d283268a438487', 'request_id': 'req-f3e5801e-b011-4269-9551-9942a6b4de8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.276151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b63fb8760694d5886d283268a438487', 'request_id': 'req-f3e5801e-b011-4269-9551-9942a6b4de8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.300094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b63fb8760694d5886d283268a438487', 'request_id': 'req-f3e5801e-b011-4269-9551-9942a6b4de8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.317766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] The token cache is being invalidate because project 6b63fb8760694d5886d283268a438487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:44.317766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.319234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.327662 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2868/5727] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:44 2022] DELETE /identity/v3/projects/6b63fb8760694d5886d283268a438487 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:44.328838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43401f07-b066-446a-a3cb-22965369e75f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:44.350218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43401f07-b066-446a-a3cb-22965369e75f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:44.518925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:44.520076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:44.520508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:44.520953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] PATH_INFO: `/v3/users/3bcf2a87c91647b39f3a5d5562baa531` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:44.522373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bcf2a87c91647b39f3a5d5562baa531)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:44.524905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:44.609321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bcf2a87c91647b39f3a5d5562baa531'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.628494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bcf2a87c91647b39f3a5d5562baa531'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.629598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bcf2a87c91647b39f3a5d5562baa531'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.631829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bcf2a87c91647b39f3a5d5562baa531'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.651070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bcf2a87c91647b39f3a5d5562baa531'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:44.688354 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2860/5728] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:44 2022] DELETE /identity/v3/users/3bcf2a87c91647b39f3a5d5562baa531 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:45.655465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:45.660329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:45.688068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5801e-b011-4269-9551-9942a6b4de8a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:45.879494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:45.880370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:45.880655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:45.881575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] PATH_INFO: `/v3/projects/04818d2bdae04f5985fe1deb791d842e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:45.883104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04818d2bdae04f5985fe1deb791d842e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:45.885272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:45.986002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04818d2bdae04f5985fe1deb791d842e', 'request_id': 'req-d8ca661d-83f1-45ee-9518-5e89692b1fc5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:45.995036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04818d2bdae04f5985fe1deb791d842e', 'request_id': 'req-d8ca661d-83f1-45ee-9518-5e89692b1fc5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.010267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04818d2bdae04f5985fe1deb791d842e', 'request_id': 'req-d8ca661d-83f1-45ee-9518-5e89692b1fc5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.026471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] The token cache is being invalidate because project 04818d2bdae04f5985fe1deb791d842e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:46.027092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.028089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.030372 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2869/5729] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:45 2022] DELETE /identity/v3/projects/04818d2bdae04f5985fe1deb791d842e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:46.034516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:46.038360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:46.057110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d9578-cca4-480b-a8bd-e0d0eefef59c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:46.182671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:46.187312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:46.187312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:46.187789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] PATH_INFO: `/v3/users/d2ef1601bb3443b89887d6d60e255dd5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:46.192691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ef1601bb3443b89887d6d60e255dd5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:46.197739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:46.301935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ef1601bb3443b89887d6d60e255dd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.318031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ef1601bb3443b89887d6d60e255dd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.319764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ef1601bb3443b89887d6d60e255dd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.320430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ef1601bb3443b89887d6d60e255dd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.346060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ef1601bb3443b89887d6d60e255dd5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:46.396722 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2861/5730] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:46 2022] DELETE /identity/v3/users/d2ef1601bb3443b89887d6d60e255dd5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:47.494197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:47.495868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:47.511125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:47.512796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:47.616419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404fe2d-31db-48ba-ba67-5dcb16e024b7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:47.640027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:47.641380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:47.642012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:47.642451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] PATH_INFO: `/v3/projects/41743b47c88440d898929624efab6d00` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:47.645813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41743b47c88440d898929624efab6d00)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:47.648340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:47.659294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca661d-83f1-45ee-9518-5e89692b1fc5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:47.752313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41743b47c88440d898929624efab6d00', 'request_id': 'req-e823c77c-37b4-4601-aa01-fea0c6934f8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:47.768948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897c679-d5da-4d28-a52c-50f20f071957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:47.769619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897c679-d5da-4d28-a52c-50f20f071957 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:47.769910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897c679-d5da-4d28-a52c-50f20f071957 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:47.770189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897c679-d5da-4d28-a52c-50f20f071957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:47.772084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f897c679-d5da-4d28-a52c-50f20f071957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:47.775117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41743b47c88440d898929624efab6d00', 'request_id': 'req-e823c77c-37b4-4601-aa01-fea0c6934f8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:47.786663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41743b47c88440d898929624efab6d00', 'request_id': 'req-e823c77c-37b4-4601-aa01-fea0c6934f8d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:47.816684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] The token cache is being invalidate because project 41743b47c88440d898929624efab6d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:47.817320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:47.818073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:47.823752 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2862/5731] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:47 2022] DELETE /identity/v3/projects/41743b47c88440d898929624efab6d00 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:47.823752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:47.823752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:47.927547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897c679-d5da-4d28-a52c-50f20f071957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:47.928784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897c679-d5da-4d28-a52c-50f20f071957 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:47.939100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823c77c-37b4-4601-aa01-fea0c6934f8d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:47.945478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed0d45-73d9-4a67-aafc-30e64491405b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:47.946733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0d45-73d9-4a67-aafc-30e64491405b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:47.947609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0d45-73d9-4a67-aafc-30e64491405b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:47.948450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed0d45-73d9-4a67-aafc-30e64491405b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:47.953619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7bed0d45-73d9-4a67-aafc-30e64491405b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:47.983471 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2870/5732] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:47.987146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b400f-5b06-431f-b72f-49ca11318d4d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:47.987376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b400f-5b06-431f-b72f-49ca11318d4d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:47.987668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b400f-5b06-431f-b72f-49ca11318d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.033761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-350b400f-5b06-431f-b72f-49ca11318d4d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:48.035274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-350b400f-5b06-431f-b72f-49ca11318d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:48.060264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed0d45-73d9-4a67-aafc-30e64491405b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:48.064304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed0d45-73d9-4a67-aafc-30e64491405b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:48.088603 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2863/5733] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:48.153190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2871/5734] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:48.155172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45147-15de-4dea-8667-6b1483b3b382 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.155465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45147-15de-4dea-8667-6b1483b3b382 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.155744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b45147-15de-4dea-8667-6b1483b3b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.184092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e5b45147-15de-4dea-8667-6b1483b3b382 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:48.187271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e5b45147-15de-4dea-8667-6b1483b3b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:48.201646 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2864/5735] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:48.207974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b400f-5b06-431f-b72f-49ca11318d4d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:48.222764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b400f-5b06-431f-b72f-49ca11318d4d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:48.229550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:48.230310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.230666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.231091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.232185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:05:48.232567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:48.234513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:48.259155 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2872/5736] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:48.263407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45147-15de-4dea-8667-6b1483b3b382 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:48.276843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b45147-15de-4dea-8667-6b1483b3b382 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:48.290032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18b3c-31d0-4122-93ae-3207002789e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:48.292175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18b3c-31d0-4122-93ae-3207002789e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.292462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18b3c-31d0-4122-93ae-3207002789e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.292744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18b3c-31d0-4122-93ae-3207002789e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.293464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc18b3c-31d0-4122-93ae-3207002789e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:48.296123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc18b3c-31d0-4122-93ae-3207002789e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:48.348245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:48.349132 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2865/5737] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:48 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:48.370507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3a09e-0036-49ed-ba82-dbef951e8ea2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:48.483348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f50d-fea2-4ab6-bf9a-c01112c80883 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.483932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f50d-fea2-4ab6-bf9a-c01112c80883 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.484455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f50d-fea2-4ab6-bf9a-c01112c80883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.525720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-87b8f50d-fea2-4ab6-bf9a-c01112c80883 None None] MFA Rules not processed for user `96077bbd65b9449a8b679c2ebb35bdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:48.532815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-87b8f50d-fea2-4ab6-bf9a-c01112c80883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:48.543451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:48.547568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.547874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.548171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.549136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:48.554938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:48.600802 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2873/5738] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:48 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:48.605617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:48.632075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a229-8d3a-4e78-bd24-93204540662b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:48.644945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:48.646283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.646723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.647198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.648209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:48.650799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:48.682253 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2874/5739] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:48.683440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:48.700230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304c11d-1708-4bd8-a37d-b064d5ae67ed admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:48.707340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da34c7-38ac-4ee9-aa64-2d192f0c393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:48.708124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da34c7-38ac-4ee9-aa64-2d192f0c393d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.708506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da34c7-38ac-4ee9-aa64-2d192f0c393d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.708861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da34c7-38ac-4ee9-aa64-2d192f0c393d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.709662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da34c7-38ac-4ee9-aa64-2d192f0c393d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:48.711417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da34c7-38ac-4ee9-aa64-2d192f0c393d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:48.724722 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2875/5741] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:48.724961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2866/5741] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:48.746116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8f50d-fea2-4ab6-bf9a-c01112c80883 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:48.769731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8f50d-fea2-4ab6-bf9a-c01112c80883 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:48.780552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:48.786549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.787677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.788402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] PATH_INFO: `/v3/projects/a45099f69bc94ba3b93e171e858bf476/users/0d27810fdf5a4b8c8e70e40ca71bfe6c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.838160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45099f69bc94ba3b93e171e858bf476, user_id=0d27810fdf5a4b8c8e70e40ca71bfe6c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:48.842336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:48.879015 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2867/5742] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:48 2022] PUT /identity/v3/projects/a45099f69bc94ba3b93e171e858bf476/users/0d27810fdf5a4b8c8e70e40ca71bfe6c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:48.891156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40c06-1463-440b-b8f6-e7008a9412bf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:48.892354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40c06-1463-440b-b8f6-e7008a9412bf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:48.892727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce40c06-1463-440b-b8f6-e7008a9412bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:48.942903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dce40c06-1463-440b-b8f6-e7008a9412bf None None] MFA Rules not processed for user `0d27810fdf5a4b8c8e70e40ca71bfe6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:48.944359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dce40c06-1463-440b-b8f6-e7008a9412bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:49.017868 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2876/5743] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:49.022511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:49.121037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7c204-07a0-4ea0-b449-f44658fad67b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:49.129920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766184-c329-49e4-887a-af23938d197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:49.131086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766184-c329-49e4-887a-af23938d197e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:49.131735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766184-c329-49e4-887a-af23938d197e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:49.132353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766184-c329-49e4-887a-af23938d197e admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:49.133433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80766184-c329-49e4-887a-af23938d197e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:49.140064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80766184-c329-49e4-887a-af23938d197e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:49.178363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2868/5744] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:49 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:49.182605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce40c06-1463-440b-b8f6-e7008a9412bf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:49.198179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce40c06-1463-440b-b8f6-e7008a9412bf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:49.304463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:49.305275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:49.305656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:49.306032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:49.306913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:49.310176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:49.339843 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2877/5745] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:49 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:49.341767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766184-c329-49e4-887a-af23938d197e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:49.357632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766184-c329-49e4-887a-af23938d197e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:49.366004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:49.371993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:49.372428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:49.372723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:49.373491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:49.375194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:49.419818 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2869/5746] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:49.424222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:49.442649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd7f1a-687e-4238-b4fe-8913f204299b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:49.451255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:49.452457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:49.452926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:49.453373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] PATH_INFO: `/v3/projects/ff926d16f7804546849c9d97ef427b8d/users/f0ec5d14e4cd4a8c955f9133dde46d73/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:49.503764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff926d16f7804546849c9d97ef427b8d, user_id=f0ec5d14e4cd4a8c955f9133dde46d73, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:49.506878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:49.539958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2878/5747] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:49 2022] PUT /identity/v3/projects/ff926d16f7804546849c9d97ef427b8d/users/f0ec5d14e4cd4a8c955f9133dde46d73/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:49.543922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:49.555811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19ba25-cb7f-4afb-b277-8c709902573c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:49.680024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729434f-fdea-42f9-9b31-a7b826f45d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:49.680716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729434f-fdea-42f9-9b31-a7b826f45d62 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:49.681658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729434f-fdea-42f9-9b31-a7b826f45d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:49.681958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729434f-fdea-42f9-9b31-a7b826f45d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:49.682980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729434f-fdea-42f9-9b31-a7b826f45d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:49.685179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729434f-fdea-42f9-9b31-a7b826f45d62 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:49.712300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:49.723230 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2870/5748] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:05:49.726223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf41c65-339b-436e-a00a-8a1f6b3b5e94 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:49.744805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:49.746173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:49.746497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:49.746883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] PATH_INFO: `/v3/projects/ff926d16f7804546849c9d97ef427b8d/users/f0ec5d14e4cd4a8c955f9133dde46d73/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:49.753488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff926d16f7804546849c9d97ef427b8d, user_id=f0ec5d14e4cd4a8c955f9133dde46d73, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:49.756400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:49.798024 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2879/5749] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:49 2022] PUT /identity/v3/projects/ff926d16f7804546849c9d97ef427b8d/users/f0ec5d14e4cd4a8c955f9133dde46d73/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:49.801313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f831a0-b5f8-49e5-a703-ebcff3372237 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:49.801770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f831a0-b5f8-49e5-a703-ebcff3372237 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:49.802237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f831a0-b5f8-49e5-a703-ebcff3372237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:49.862627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b4f831a0-b5f8-49e5-a703-ebcff3372237 None None] MFA Rules not processed for user `f0ec5d14e4cd4a8c955f9133dde46d73`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:49.864105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b4f831a0-b5f8-49e5-a703-ebcff3372237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:50.058705 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2871/5750] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:50.064592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:50.090949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38835e-4d20-466a-b0db-933cf3bc5cb3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:50.095914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:50.096935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:50.097355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:50.097706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:50.098493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:50.101594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:50.140444 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2880/5751] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:50 2022] POST /identity/v3/projects => generated 360 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:50.146209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f831a0-b5f8-49e5-a703-ebcff3372237 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:50.162258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f831a0-b5f8-49e5-a703-ebcff3372237 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:50.272847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:50.274231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:50.274906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:50.275204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:50.275966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:50.278987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:50.327160 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2872/5752] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:50 2022] POST /identity/v3/users => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:50.329349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:50.341929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e0d5-d651-4de6-9e1e-023d96c4f90c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:50.351908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:50.355026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:50.355785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:50.356929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/b8624e0f83e244acbc91e038071ca4b4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:50.384103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:get_user(user_id=b8624e0f83e244acbc91e038071ca4b4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:50.388470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:50.396901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:50.398482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2881/5753] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:05:50 2022] GET /identity/v3/users/b8624e0f83e244acbc91e038071ca4b4 => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:50.422253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8971ed-4cae-47d1-a3ba-08738530fb8e tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:50.436939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:50.437872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:50.440637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:50.440891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/b8624e0f83e244acbc91e038071ca4b4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:50.445047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b8624e0f83e244acbc91e038071ca4b4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:50.447527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:50.907550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8624e0f83e244acbc91e038071ca4b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:50.919371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8624e0f83e244acbc91e038071ca4b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:50.919757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8624e0f83e244acbc91e038071ca4b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:50.921010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8624e0f83e244acbc91e038071ca4b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:50.950392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8624e0f83e244acbc91e038071ca4b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:50.976530 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2873/5754] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:50 2022] DELETE /identity/v3/users/b8624e0f83e244acbc91e038071ca4b4 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:50.981332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:50.984060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:51.004638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580ecd5-1bf4-423a-a0a1-8287d20f1c18 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:51.122464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:51.123585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:51.124018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:51.124443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/bbb5095fe1364ea18e31c0d72c5bc1ea` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:51.126556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbb5095fe1364ea18e31c0d72c5bc1ea)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:51.128872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:51.214906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb5095fe1364ea18e31c0d72c5bc1ea', 'request_id': 'req-c69d4b9f-7c51-4d75-84c1-df82300c6284'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.222608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb5095fe1364ea18e31c0d72c5bc1ea', 'request_id': 'req-c69d4b9f-7c51-4d75-84c1-df82300c6284'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.237424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb5095fe1364ea18e31c0d72c5bc1ea', 'request_id': 'req-c69d4b9f-7c51-4d75-84c1-df82300c6284'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.253590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] The token cache is being invalidate because project bbb5095fe1364ea18e31c0d72c5bc1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:51.255032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.257716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.264695 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2882/5755] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:50 2022] DELETE /identity/v3/projects/bbb5095fe1364ea18e31c0d72c5bc1ea => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:51.265391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:51.276564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee404f7-800b-4030-b219-9a2608de5188 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:51.411459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:51.412225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:51.412706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:51.413207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:51.414384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:51.416423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:51.477210 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2874/5756] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:51 2022] POST /identity/v3/projects => generated 357 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:51.479274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:51.480746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:51.505166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d4b9f-7c51-4d75-84c1-df82300c6284 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:51.581905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:51.584158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:51.687302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:51.688158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:51.688551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:51.688756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:51.690629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:51.692049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:51.715692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f571-575e-4dd1-8b55-fc6e900efcf0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:51.732636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:51.735944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:51.736441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:51.736965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] PATH_INFO: `/v3/users/b0f3bdbaf7704a11b5078307c3c9b7ed` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:51.739958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f3bdbaf7704a11b5078307c3c9b7ed)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:51.744720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2883/5757] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:51 2022] POST /identity/v3/users => generated 414 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:51.747279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:51.747763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:51.761139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f80a2-149f-4ed5-b8e7-77be15083742 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:51.774918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:51.777523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:51.778548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:51.780356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:51.781606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:51.784231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:51.812213 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2884/5758] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:05:51 2022] POST /identity/v3/roles => generated 239 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:51.816065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:51.820973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f3bdbaf7704a11b5078307c3c9b7ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.827639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fa487-d5c5-4e8f-8047-c684fc6245f0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:51.830301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f3bdbaf7704a11b5078307c3c9b7ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.831570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f3bdbaf7704a11b5078307c3c9b7ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.832424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f3bdbaf7704a11b5078307c3c9b7ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.840490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:51.843147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:51.845652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:51.846066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/e96a24c12d4544b38a30a616892bdefe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:51.846481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6be42846-ba42-4520-92fe-81ad75074fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f3bdbaf7704a11b5078307c3c9b7ed'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:51.872374 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2875/5759] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:51 2022] DELETE /identity/v3/users/b0f3bdbaf7704a11b5078307c3c9b7ed => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:51.874202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:51.874491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:51.874761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:51.883835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:get_user(user_id=e96a24c12d4544b38a30a616892bdefe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:51.886133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:51.896958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:51.897757 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2885/5760] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:05:51 2022] GET /identity/v3/users/e96a24c12d4544b38a30a616892bdefe => generated 414 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:51.898909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:51.901583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:51.903533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:51.919889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad22e-3c1b-42dd-b5b1-de7436687660 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:51.978366 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2876/5761] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:51.988376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:51.990028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:52.002450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.003364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.004169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.004453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/roles/34ac560c9f3642c1ae3514f048043ec7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.006858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:get_role(role_id=34ac560c9f3642c1ae3514f048043ec7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.008256 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:52.008256 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:05:52.008256 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:05:52.009174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.013447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2886/5762] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:05:51 2022] GET /identity/v3/roles/34ac560c9f3642c1ae3514f048043ec7 => generated 239 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:52.014884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.027866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46e02b-c533-47bd-859f-d5c3a1a34301 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.034341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.035907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.036336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.036625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.037332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.039260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.066869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c2805-137f-4cdf-8020-1b95c69c8ea3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.071935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.072924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.073458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.073935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.079115 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2887/5763] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:52 2022] POST /identity/v3/projects => generated 359 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:52.082288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.090517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.095259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.123906 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2877/5764] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:05:52.162312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d0337-8bb0-4ddb-851e-6002eedc8eb5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.168952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.170495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.170811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.171207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/2025ca3e09574d69b328f261bcce4506` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.172531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:get_project(project_id=2025ca3e09574d69b328f261bcce4506)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.175622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.177642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2888/5765] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:52 2022] GET /identity/v3/projects/2025ca3e09574d69b328f261bcce4506 => generated 359 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:52.182306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.195390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d361e2-0d8b-4195-a8c4-65438ddf8f9e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.200138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.201424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.201424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.201668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/2025ca3e09574d69b328f261bcce4506/users/e96a24c12d4544b38a30a616892bdefe/roles/34ac560c9f3642c1ae3514f048043ec7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.205418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2025ca3e09574d69b328f261bcce4506, user_id=e96a24c12d4544b38a30a616892bdefe, role_id=34ac560c9f3642c1ae3514f048043ec7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.208337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.229028 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2878/5766] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:52 2022] PUT /identity/v3/projects/2025ca3e09574d69b328f261bcce4506/users/e96a24c12d4544b38a30a616892bdefe/roles/34ac560c9f3642c1ae3514f048043ec7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:52.233101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.250061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b2e1a-8ea4-4e8c-995b-0b43f5f7bb27 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.333053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.333995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.334441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.335171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.335886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.337944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.375395 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2889/5767] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:52 2022] POST /identity/v3/projects => generated 360 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:52.379374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.390019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853e1ed-96de-4047-b988-b6219d1eaf1f tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.442928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.446988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:52.473129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.473462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.473625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.473900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/4d2db11bcb3247019f6bfbd6fe8ff850` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.476208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:get_project(project_id=4d2db11bcb3247019f6bfbd6fe8ff850)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.480480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.488731 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2879/5768] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:05:52 2022] GET /identity/v3/projects/4d2db11bcb3247019f6bfbd6fe8ff850 => generated 360 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:52.489398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.507251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5a6b7-fd25-429a-8469-ffd17a92e3a7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.517337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.518246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.518527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.518842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/4d2db11bcb3247019f6bfbd6fe8ff850/users/e96a24c12d4544b38a30a616892bdefe/roles/34ac560c9f3642c1ae3514f048043ec7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.531858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4d2db11bcb3247019f6bfbd6fe8ff850, user_id=e96a24c12d4544b38a30a616892bdefe, role_id=34ac560c9f3642c1ae3514f048043ec7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.534569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.555809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2880/5769] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:52 2022] PUT /identity/v3/projects/4d2db11bcb3247019f6bfbd6fe8ff850/users/e96a24c12d4544b38a30a616892bdefe/roles/34ac560c9f3642c1ae3514f048043ec7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:52.559916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.598046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d2060e-4641-4caf-8c99-a2dbdc1fd767 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.662646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746e9e3-6d1a-4a7b-a7e3-e66c94939ae5 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.667819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.668960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.669251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.669528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/e96a24c12d4544b38a30a616892bdefe/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.673741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=e96a24c12d4544b38a30a616892bdefe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.676064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.694078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.695766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.696257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.696714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] PATH_INFO: `/v3/projects/9da4f11a17fa45cab1e10a17394d39cd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.698726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da4f11a17fa45cab1e10a17394d39cd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.701459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.715216 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2881/5770] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:05:52 2022] GET /identity/v3/users/e96a24c12d4544b38a30a616892bdefe/projects => generated 843 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:52.719346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.739442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e5d67-e400-451a-b9bb-fcc50aafb3eb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.748497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.749999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.752173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.753039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/4d2db11bcb3247019f6bfbd6fe8ff850` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.754721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4d2db11bcb3247019f6bfbd6fe8ff850)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:52.757592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:52.760976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da4f11a17fa45cab1e10a17394d39cd', 'request_id': 'req-5168db81-1b92-4969-896e-2a6c6df133ce'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.768227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da4f11a17fa45cab1e10a17394d39cd', 'request_id': 'req-5168db81-1b92-4969-896e-2a6c6df133ce'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.776306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da4f11a17fa45cab1e10a17394d39cd', 'request_id': 'req-5168db81-1b92-4969-896e-2a6c6df133ce'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.795263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] The token cache is being invalidate because project 9da4f11a17fa45cab1e10a17394d39cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:52.795879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.797014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5168db81-1b92-4969-896e-2a6c6df133ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.800345 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2890/5771] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:52 2022] DELETE /identity/v3/projects/9da4f11a17fa45cab1e10a17394d39cd => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:52.805852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284785e6-57cd-455e-9a9b-96a9d733606b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.806140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284785e6-57cd-455e-9a9b-96a9d733606b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.806445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284785e6-57cd-455e-9a9b-96a9d733606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.831052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2db11bcb3247019f6bfbd6fe8ff850', 'request_id': 'req-bb324bf9-c012-423a-ac75-563e422fc61d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.833114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-284785e6-57cd-455e-9a9b-96a9d733606b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:52.834533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-284785e6-57cd-455e-9a9b-96a9d733606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:52.837547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2db11bcb3247019f6bfbd6fe8ff850', 'request_id': 'req-bb324bf9-c012-423a-ac75-563e422fc61d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.847947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2db11bcb3247019f6bfbd6fe8ff850', 'request_id': 'req-bb324bf9-c012-423a-ac75-563e422fc61d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.877373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] The token cache is being invalidate because project 4d2db11bcb3247019f6bfbd6fe8ff850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:52.877591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.878325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:52.887797 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2882/5772] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:52 2022] DELETE /identity/v3/projects/4d2db11bcb3247019f6bfbd6fe8ff850 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:52.888823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.890231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:52.919847 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2891/5773] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:52.927655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46c8fa-f27b-4149-8ff5-0ca02a3d3728 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.928071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46c8fa-f27b-4149-8ff5-0ca02a3d3728 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.928534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46c8fa-f27b-4149-8ff5-0ca02a3d3728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.952593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-de46c8fa-f27b-4149-8ff5-0ca02a3d3728 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:52.954249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de46c8fa-f27b-4149-8ff5-0ca02a3d3728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:52.967787 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2892/5774] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:52.969007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46c8fa-f27b-4149-8ff5-0ca02a3d3728 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:52.980431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46c8fa-f27b-4149-8ff5-0ca02a3d3728 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.994350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:52.995422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb324bf9-c012-423a-ac75-563e422fc61d tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:52.996742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:52.996742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:52.996742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:52.998090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:05:52.998466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.001374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.022625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2893/5775] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:53.026988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.029372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.030363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.030730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.034174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/2025ca3e09574d69b328f261bcce4506` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.038347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2025ca3e09574d69b328f261bcce4506)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.042074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.043190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0bd3a-f919-4cba-8d8e-405a9455e8df admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.057621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.060122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.061819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.062483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.063846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.070621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.123141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2025ca3e09574d69b328f261bcce4506', 'request_id': 'req-cf102640-27f4-4f4e-b218-4843112bf3ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.129602 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2894/5776] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:53 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:53.132392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2025ca3e09574d69b328f261bcce4506', 'request_id': 'req-cf102640-27f4-4f4e-b218-4843112bf3ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.133937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.150622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2025ca3e09574d69b328f261bcce4506', 'request_id': 'req-cf102640-27f4-4f4e-b218-4843112bf3ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.189197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] The token cache is being invalidate because project 2025ca3e09574d69b328f261bcce4506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:53.189492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.190218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.194801 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2883/5777] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:52 2022] DELETE /identity/v3/projects/2025ca3e09574d69b328f261bcce4506 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:53.198980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.203166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:53.220099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510d755-7fd0-49d3-8927-76318461867f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.226665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.227511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.227799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.228074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.230127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.233459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.271913 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2895/5778] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:53 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:53.273535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.275914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:53.292919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9900af-439c-4ee5-a494-bb6edfcb8843 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.302336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.303430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.303722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.304001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.304742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.305397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf102640-27f4-4f4e-b218-4843112bf3ae tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.306505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.323020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2896/5779] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:53 2022] GET /identity/v3/roles => generated 1650 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:53.324464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.337639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54bd33-d1e1-4136-8c56-403f7f6e8008 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.343924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.345160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.346054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.346347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.348806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.352284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.370815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2897/5780] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:53 2022] GET /identity/v3/roles => generated 1650 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:53.373557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.384513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9039-efb0-459c-9864-5bfdde218611 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.389586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb2b45-c5ba-4b02-b9cc-528777611ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.390721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb2b45-c5ba-4b02-b9cc-528777611ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.391052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb2b45-c5ba-4b02-b9cc-528777611ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.391342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb2b45-c5ba-4b02-b9cc-528777611ccd admin admin] PATH_INFO: `/v3/projects/300defb645794c6fac3ab824a1aeb2af/users/5a10315c2f674a3a966ad0b7cd6c97b8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.393017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.394446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.396086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.396937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/roles/34ac560c9f3642c1ae3514f048043ec7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.398885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_role(role_id=34ac560c9f3642c1ae3514f048043ec7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.410909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb2b45-c5ba-4b02-b9cc-528777611ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=300defb645794c6fac3ab824a1aeb2af, user_id=5a10315c2f674a3a966ad0b7cd6c97b8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.411861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.414298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb2b45-c5ba-4b02-b9cc-528777611ccd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.434944 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2898/5781] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:53 2022] PUT /identity/v3/projects/300defb645794c6fac3ab824a1aeb2af/users/5a10315c2f674a3a966ad0b7cd6c97b8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:53.446678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.447046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.447339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.459217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invalidating the token cache because role 34ac560c9f3642c1ae3514f048043ec7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:53.459914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.460843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.466794 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2884/5782] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:53 2022] DELETE /identity/v3/roles/34ac560c9f3642c1ae3514f048043ec7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:53.467967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.470106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:53.480591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] MFA Rules not processed for user `5a10315c2f674a3a966ad0b7cd6c97b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:53.482118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:53.560695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402619dc-c6b0-4869-8808-e46d8d5a351c tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.568596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.569858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.570072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.570358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/e96a24c12d4544b38a30a616892bdefe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.572192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e96a24c12d4544b38a30a616892bdefe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.574608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.577334 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2899/5783] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:53.585384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.588239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:53.639626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96a24c12d4544b38a30a616892bdefe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.651412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96a24c12d4544b38a30a616892bdefe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.652749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96a24c12d4544b38a30a616892bdefe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.654319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96a24c12d4544b38a30a616892bdefe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.667803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96a24c12d4544b38a30a616892bdefe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.683602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497e0ba-146e-438a-a53e-59969ca784fd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.688697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.689602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.690092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.690567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.693545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:53.702942 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2885/5784] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:53 2022] DELETE /identity/v3/users/e96a24c12d4544b38a30a616892bdefe => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:53.707165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.707355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.708742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:53.709531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.721571 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2900/5785] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:05:53.785158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7ed23-773e-434f-8999-dc9a6b216072 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.790716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.791634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.791921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.792200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/f7490a019ec340bba1b16ffcdf0b3d0e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.793580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7490a019ec340bba1b16ffcdf0b3d0e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.796232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:53.859804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7490a019ec340bba1b16ffcdf0b3d0e', 'request_id': 'req-387c1fe5-c765-4b03-bd35-52b821140cb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.869014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7490a019ec340bba1b16ffcdf0b3d0e', 'request_id': 'req-387c1fe5-c765-4b03-bd35-52b821140cb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.877732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7490a019ec340bba1b16ffcdf0b3d0e', 'request_id': 'req-387c1fe5-c765-4b03-bd35-52b821140cb3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.889938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] The token cache is being invalidate because project f7490a019ec340bba1b16ffcdf0b3d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:53.890640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.891572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-387c1fe5-c765-4b03-bd35-52b821140cb3 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:53.893540 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2886/5786] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:53 2022] DELETE /identity/v3/projects/f7490a019ec340bba1b16ffcdf0b3d0e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:53.899998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:53.912788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d2225-80ad-4b30-8d1d-346cdef774b9 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:53.986124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:53.987112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:53.987394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:53.987674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:53.989013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:update_user(user_id=0d27810fdf5a4b8c8e70e40ca71bfe6c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:53.990032 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:53.990032 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:05:53.990032 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:05:53.991933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:54.028269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.038901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invalidating the token cache because user 0d27810fdf5a4b8c8e70e40ca71bfe6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:54.039197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.039824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.045485 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2901/5787] 10.222.0.32 () {60 vars in 1242 bytes} [Sat May 7 22:05:53 2022] PATCH /identity/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:54.047334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e8da0-2502-4141-88ea-dc1eebf5149b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:54.048354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e8da0-2502-4141-88ea-dc1eebf5149b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:54.048459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e8da0-2502-4141-88ea-dc1eebf5149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:54.092074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-587e8da0-2502-4141-88ea-dc1eebf5149b None None] MFA Rules not processed for user `0d27810fdf5a4b8c8e70e40ca71bfe6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:54.092436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-587e8da0-2502-4141-88ea-dc1eebf5149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:54.096691 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2887/5788] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:54 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:05:54.108301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:54.119746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:54.137247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98321441-7411-47fe-9557-28770ed36e88 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:54.145184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:54.147434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:54.147953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:54.148512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:54.150593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:update_user(user_id=0d27810fdf5a4b8c8e70e40ca71bfe6c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:54.164768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:54.211028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.220539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invalidating the token cache because user 0d27810fdf5a4b8c8e70e40ca71bfe6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:54.221159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.222081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb6fba14-454c-4d22-aa20-d239e70bc5c0 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.224375 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2902/5789] 10.222.0.32 () {60 vars in 1242 bytes} [Sat May 7 22:05:54 2022] PATCH /identity/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c => generated 297 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:54.234920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e8da0-2502-4141-88ea-dc1eebf5149b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:54.255251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e8da0-2502-4141-88ea-dc1eebf5149b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:54.260348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:54.261217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:54.261504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:54.261780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:54.276968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:update_user(user_id=0d27810fdf5a4b8c8e70e40ca71bfe6c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:54.278131 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:05:54.278131 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:05:54.278131 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:05:54.279395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:54.319958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.331811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invalidating the token cache because user 0d27810fdf5a4b8c8e70e40ca71bfe6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:54.332196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.333012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.341910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35f10-01e9-433d-be75-08c7d6a03ee4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:54.341910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35f10-01e9-433d-be75-08c7d6a03ee4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:54.342149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba35f10-01e9-433d-be75-08c7d6a03ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:54.346653 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2888/5790] 10.222.0.32 () {60 vars in 1242 bytes} [Sat May 7 22:05:54 2022] PATCH /identity/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c => generated 297 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:54.377759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6ba35f10-01e9-433d-be75-08c7d6a03ee4 None None] MFA Rules not processed for user `0d27810fdf5a4b8c8e70e40ca71bfe6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:54.379280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6ba35f10-01e9-433d-be75-08c7d6a03ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:54.387465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:54.388985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:54.392253 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2903/5791] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:54 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:05:54.405547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d732b-edee-4f12-ab39-be74a052d4a2 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:54.412897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:54.413882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:54.414178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:54.414458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:54.417023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:update_user(user_id=0d27810fdf5a4b8c8e70e40ca71bfe6c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:54.419206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:54.471711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.487086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invalidating the token cache because user 0d27810fdf5a4b8c8e70e40ca71bfe6c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:54.487496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.488088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.490590 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2889/5792] 10.222.0.32 () {60 vars in 1242 bytes} [Sat May 7 22:05:54 2022] PATCH /identity/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c => generated 297 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:54.495821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35f10-01e9-433d-be75-08c7d6a03ee4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:54.519092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba35f10-01e9-433d-be75-08c7d6a03ee4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:54.529077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438584b0-c3f0-4c49-b2a7-b6b49fc971ff tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:54.529896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438584b0-c3f0-4c49-b2a7-b6b49fc971ff tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:54.530205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438584b0-c3f0-4c49-b2a7-b6b49fc971ff tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:54.530465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438584b0-c3f0-4c49-b2a7-b6b49fc971ff tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:54.531214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438584b0-c3f0-4c49-b2a7-b6b49fc971ff tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:54.533730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438584b0-c3f0-4c49-b2a7-b6b49fc971ff tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:54.570435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:54.572321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:54.573959 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2904/5793] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:05:54 2022] POST /identity/v3/users => generated 264 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:54.588277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3714d-418e-44d9-9fbc-7f802b535cbf tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:54.600753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc5afe-5ba1-41ff-9b41-cd102e04c579 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:54.601692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5afe-5ba1-41ff-9b41-cd102e04c579 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:54.601977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5afe-5ba1-41ff-9b41-cd102e04c579 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:54.602248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5afe-5ba1-41ff-9b41-cd102e04c579 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/d444d39ccf1d439cbf9dd0b51002be69/password` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:54.731158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6dcc5afe-5ba1-41ff-9b41-cd102e04c579 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd444d39ccf1d439cbf9dd0b51002be69'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:54.746662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2890/5794] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:05:54 2022] POST /identity/v3/users/d444d39ccf1d439cbf9dd0b51002be69/password => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:55.752785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17dd92-6fbe-4b49-a9e2-f4f42d112944 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:55.753310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17dd92-6fbe-4b49-a9e2-f4f42d112944 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:55.753570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17dd92-6fbe-4b49-a9e2-f4f42d112944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:55.780229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e17dd92-6fbe-4b49-a9e2-f4f42d112944 None None] MFA Rules not processed for user `d444d39ccf1d439cbf9dd0b51002be69`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:55.782056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e17dd92-6fbe-4b49-a9e2-f4f42d112944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:55.791004 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2905/5795] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:55 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 22:05:55.794936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc5afe-5ba1-41ff-9b41-cd102e04c579 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:55.806920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc5afe-5ba1-41ff-9b41-cd102e04c579 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:55.824248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:55.824941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:55.825216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:55.825494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:55.852445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:55.855456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:55.869036 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2891/5796] 10.222.0.32 () {56 vars in 1262 bytes} [Sat May 7 22:05:55 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 22:05:55.869134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17dd92-6fbe-4b49-a9e2-f4f42d112944 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:55.886997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17dd92-6fbe-4b49-a9e2-f4f42d112944 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:55.892865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:55.894200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:55.894972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:55.895770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/d444d39ccf1d439cbf9dd0b51002be69` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:55.898561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d444d39ccf1d439cbf9dd0b51002be69)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:55.903554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:55.979291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd444d39ccf1d439cbf9dd0b51002be69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:55.984112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd444d39ccf1d439cbf9dd0b51002be69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:55.992625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd444d39ccf1d439cbf9dd0b51002be69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:55.993633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd444d39ccf1d439cbf9dd0b51002be69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.025543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd444d39ccf1d439cbf9dd0b51002be69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.077057 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2906/5797] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:55 2022] DELETE /identity/v3/users/d444d39ccf1d439cbf9dd0b51002be69 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:05:56.082456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:56.100107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348052a-0cad-476d-b98a-b0862cf34790 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:56.217395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:56.220294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:56.220587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:56.220869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:56.221870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:56.225528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:56.279554 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2892/5798] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:56 2022] POST /identity/v3/users => generated 364 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:05:56.283995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:56.285752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:56.308345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83bd1f-7aab-429c-a2dd-969abc3b8cdb tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:56.316449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:56.321618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:56.323505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:56.324158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:56.326322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:56.329257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:56.398229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:56.399022 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2907/5799] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:56 2022] POST /identity/v3/projects => generated 358 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:56.414465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d4271-778d-4a5c-af43-6ca075b9eb8b tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:56.559041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:56.562917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:56.563409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:56.563924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/ddb738745aeb48e687a30bd7e9f01acd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:56.583512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:update_user(user_id=ddb738745aeb48e687a30bd7e9f01acd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:56.587664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:56.634727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:56.644300 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2893/5800] 10.222.0.32 () {60 vars in 1243 bytes} [Sat May 7 22:05:56 2022] PATCH /identity/v3/users/ddb738745aeb48e687a30bd7e9f01acd => generated 522 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:56.663347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f202-d971-46a4-8574-5a8dea2ee3e7 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:56.680122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:56.682084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:56.682444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:56.683667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/ddb738745aeb48e687a30bd7e9f01acd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:56.702129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:get_user(user_id=ddb738745aeb48e687a30bd7e9f01acd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:56.705291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:56.710201 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2908/5801] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:05:56 2022] GET /identity/v3/users/ddb738745aeb48e687a30bd7e9f01acd => generated 388 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:05:56.711655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:56.728606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2253a9-efef-4e7e-acfb-2768c931b766 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:56.734755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:56.735879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:56.736167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:56.736444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/projects/45aff31bb3f345fb9a2be2e905c57b7b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:56.737654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45aff31bb3f345fb9a2be2e905c57b7b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:56.739642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:56.794324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45aff31bb3f345fb9a2be2e905c57b7b', 'request_id': 'req-49b6b79d-5705-4d88-8808-3f9ed1264ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.802630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45aff31bb3f345fb9a2be2e905c57b7b', 'request_id': 'req-49b6b79d-5705-4d88-8808-3f9ed1264ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.811224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45aff31bb3f345fb9a2be2e905c57b7b', 'request_id': 'req-49b6b79d-5705-4d88-8808-3f9ed1264ab8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.822465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] The token cache is being invalidate because project 45aff31bb3f345fb9a2be2e905c57b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:56.822870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.823685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.829173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2894/5802] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:56 2022] DELETE /identity/v3/projects/45aff31bb3f345fb9a2be2e905c57b7b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:56.830275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:56.832381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:56.847355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ceec8-0cd9-4607-a52e-bad180852e24 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:56.883550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:56.885666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:56.928126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0ec5d14e4cd4a8c955f9133dde46d73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff926d16f7804546849c9d97ef427b8d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:56.929109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:56.929408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:56.929688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] PATH_INFO: `/v3/users/ddb738745aeb48e687a30bd7e9f01acd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:56.931017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ddb738745aeb48e687a30bd7e9f01acd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:56.933361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:56.958873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6b79d-5705-4d88-8808-3f9ed1264ab8 tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:56.964115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:56.966010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:56.966475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:56.966975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] PATH_INFO: `/v3/users/e6abaee58e2540e090b6f53b6f6ef587` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:56.968478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6abaee58e2540e090b6f53b6f6ef587)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:56.970684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:56.979282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb738745aeb48e687a30bd7e9f01acd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.980208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb738745aeb48e687a30bd7e9f01acd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.987622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb738745aeb48e687a30bd7e9f01acd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.988341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb738745aeb48e687a30bd7e9f01acd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:56.997044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb738745aeb48e687a30bd7e9f01acd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.021582 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2909/5803] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:56 2022] DELETE /identity/v3/users/ddb738745aeb48e687a30bd7e9f01acd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:57.023066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.024483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:57.027914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6abaee58e2540e090b6f53b6f6ef587'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.037852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6abaee58e2540e090b6f53b6f6ef587'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.038628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6abaee58e2540e090b6f53b6f6ef587'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.039602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6abaee58e2540e090b6f53b6f6ef587'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.049183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6abaee58e2540e090b6f53b6f6ef587'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.071759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2895/5804] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:56 2022] DELETE /identity/v3/users/e6abaee58e2540e090b6f53b6f6ef587 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:57.101184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11ca27-c129-46b0-a959-a94ba8db27ce tempest-UsersV3TestJSON-1051012491 tempest-UsersV3TestJSON-1051012491-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.159573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.160451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.160803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.161156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] PATH_INFO: `/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.175927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d27810fdf5a4b8c8e70e40ca71bfe6c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.178395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.249695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.252027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.261163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.261916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.266325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.268222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:57.282160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e869937-d106-4b06-b69f-5f01b00ad583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d27810fdf5a4b8c8e70e40ca71bfe6c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.283669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d9118-d9b2-46ee-99e4-157330da4788 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.288916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.289903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.290292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.290800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] PATH_INFO: `/v3/projects/8cdcd8ea83db42c996b9c0cb8bac89aa` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.292138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cdcd8ea83db42c996b9c0cb8bac89aa)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.294251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.321982 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2910/5805] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:57 2022] DELETE /identity/v3/users/0d27810fdf5a4b8c8e70e40ca71bfe6c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:57.326537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.326973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.327336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.344076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:57.345394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:57.348491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'request_id': 'req-1c262121-72d6-40b9-90ef-43fcfa184422'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.354723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'request_id': 'req-1c262121-72d6-40b9-90ef-43fcfa184422'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.368854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cdcd8ea83db42c996b9c0cb8bac89aa', 'request_id': 'req-1c262121-72d6-40b9-90ef-43fcfa184422'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.385368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] The token cache is being invalidate because project 8cdcd8ea83db42c996b9c0cb8bac89aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:57.385687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.388058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c262121-72d6-40b9-90ef-43fcfa184422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:57.390760 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2896/5806] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:57 2022] DELETE /identity/v3/projects/8cdcd8ea83db42c996b9c0cb8bac89aa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:57.396383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934637-b387-473a-bd9b-0fcf57b34516 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.396383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934637-b387-473a-bd9b-0fcf57b34516 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.398269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934637-b387-473a-bd9b-0fcf57b34516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.409921 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2911/5807] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:57.419754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.421380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:57.423887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-65934637-b387-473a-bd9b-0fcf57b34516 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:57.425251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65934637-b387-473a-bd9b-0fcf57b34516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:57.434389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2897/5808] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:57.442127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0863-7d45-454c-bbf1-9b4873293f38 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.442493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0863-7d45-454c-bbf1-9b4873293f38 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.442866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0863-7d45-454c-bbf1-9b4873293f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.463287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-db6b0863-7d45-454c-bbf1-9b4873293f38 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:57.464650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db6b0863-7d45-454c-bbf1-9b4873293f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:57.473610 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2898/5809] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:57.477833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0863-7d45-454c-bbf1-9b4873293f38 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.485952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b464f4-63bd-4543-933a-4ca384ed1cf9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.488300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0863-7d45-454c-bbf1-9b4873293f38 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.490284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.490959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.491238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.491639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.494198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.494987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.495365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.495742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.496566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:05:57.496967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.498674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.502193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.503660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.511979 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2899/5810] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:05:57.516170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.516428 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2912/5811] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:05:57.527715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d83250-3799-4076-be2e-aeced83455f0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.533768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.534531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.534870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.535497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.536090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.539661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.595816 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2900/5812] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:05:57 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:57.600014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.610581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784a36e-aa1d-48c0-a8fb-630b7532f108 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.674574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.675033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.675347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.675596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.676402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.678365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.701344 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2913/5813] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:05:57 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:05:57.705012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.717444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d6682-2d72-49e0-9185-b09323e4c5fe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.723309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.723840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.724132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.724416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.725221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.726907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.748484 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2901/5814] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:57.752517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.763217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa0435-8cfd-40a9-abea-7091e0205538 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.768857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c8dc9-2280-41fd-83dc-655846cbea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.769532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c8dc9-2280-41fd-83dc-655846cbea90 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.769816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c8dc9-2280-41fd-83dc-655846cbea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.770943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c8dc9-2280-41fd-83dc-655846cbea90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.771674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c8dc9-2280-41fd-83dc-655846cbea90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.773468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c8dc9-2280-41fd-83dc-655846cbea90 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.785816 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2914/5815] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:05:57.791730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.804407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fa8e6-85b3-4ee9-9f01-10ee471b44da admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:57.810839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:57.811874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.812221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.812560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] PATH_INFO: `/v3/projects/634f90235a944d1490c6239364071d28/users/1e5e10b43c6e40edb8a4808dd6013382/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.832115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] RBAC: Authorizing `identity:create_grant(project_id=634f90235a944d1490c6239364071d28, user_id=1e5e10b43c6e40edb8a4808dd6013382, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:57.835016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:57.858239 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2902/5816] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:05:57 2022] PUT /identity/v3/projects/634f90235a944d1490c6239364071d28/users/1e5e10b43c6e40edb8a4808dd6013382/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:57.860699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:57.861194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:57.861612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:57.882698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:57.883977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:57.960636 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2915/5817] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:57.988683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:57.990935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:58.066555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437515c-0afb-4859-a192-b5d3b753263c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:58.071010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:58.071974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:58.072263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:58.072561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:58.085008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:58.086530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:58.099532 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2903/5818] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:05:58.176109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:58.179459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:58.193230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1ea59-71ba-47f3-9fce-6fe088d8eb4f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:58.241282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:58.242211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:58.242499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:58.242806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] PATH_INFO: `/v3/projects/a45099f69bc94ba3b93e171e858bf476` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:58.245360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45099f69bc94ba3b93e171e858bf476)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:58.246638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:58.299126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45099f69bc94ba3b93e171e858bf476', 'request_id': 'req-d30b4286-229a-4edd-8d1e-aac767637067'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.305969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45099f69bc94ba3b93e171e858bf476', 'request_id': 'req-d30b4286-229a-4edd-8d1e-aac767637067'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.317849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45099f69bc94ba3b93e171e858bf476', 'request_id': 'req-d30b4286-229a-4edd-8d1e-aac767637067'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.331459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] The token cache is being invalidate because project a45099f69bc94ba3b93e171e858bf476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:58.331758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.332530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.334217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2916/5819] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:58 2022] DELETE /identity/v3/projects/a45099f69bc94ba3b93e171e858bf476 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:58.339347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:58.361351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200f18e-69d9-4b57-8757-45718e2dc9e5 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:58.438719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:58.439881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:58.440320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:58.440887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] PATH_INFO: `/v3/users/f0ec5d14e4cd4a8c955f9133dde46d73` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:58.442363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ec5d14e4cd4a8c955f9133dde46d73)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:58.444998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:58.511357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ec5d14e4cd4a8c955f9133dde46d73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.521759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ec5d14e4cd4a8c955f9133dde46d73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.522682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ec5d14e4cd4a8c955f9133dde46d73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.523342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ec5d14e4cd4a8c955f9133dde46d73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.535440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c48a5a4c-25c8-4005-9dd6-af3aae26db9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ec5d14e4cd4a8c955f9133dde46d73'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:58.563846 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2904/5820] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:05:58 2022] DELETE /identity/v3/users/f0ec5d14e4cd4a8c955f9133dde46d73 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:59.476996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:05:59.479285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:59.516403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b4286-229a-4edd-8d1e-aac767637067 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:05:59.650058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:05:59.651149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:59.651535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:59.652053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] PATH_INFO: `/v3/projects/ff926d16f7804546849c9d97ef427b8d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:59.654285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff926d16f7804546849c9d97ef427b8d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:05:59.673843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:05:59.693827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6919-bd58-435b-841e-345623a330f6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:59.694397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6919-bd58-435b-841e-345623a330f6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:59.694397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d6919-bd58-435b-841e-345623a330f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:59.729145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cb1d6919-bd58-435b-841e-345623a330f6 None None] MFA Rules not processed for user `1e5e10b43c6e40edb8a4808dd6013382`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:59.730803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cb1d6919-bd58-435b-841e-345623a330f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:59.777463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff926d16f7804546849c9d97ef427b8d', 'request_id': 'req-0e00f43a-f0a3-44a6-a498-5fa13876189a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:59.817019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff926d16f7804546849c9d97ef427b8d', 'request_id': 'req-0e00f43a-f0a3-44a6-a498-5fa13876189a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:59.829917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff926d16f7804546849c9d97ef427b8d', 'request_id': 'req-0e00f43a-f0a3-44a6-a498-5fa13876189a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:59.843580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] The token cache is being invalidate because project ff926d16f7804546849c9d97ef427b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:05:59.843871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:59.844752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e00f43a-f0a3-44a6-a498-5fa13876189a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:05:59.846466 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2917/5821] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:05:59 2022] DELETE /identity/v3/projects/ff926d16f7804546849c9d97ef427b8d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:05:59.855753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d071d-ded3-4d21-8727-88b32345e932 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:59.856256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d071d-ded3-4d21-8727-88b32345e932 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:59.856743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d071d-ded3-4d21-8727-88b32345e932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:59.879755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e60d071d-ded3-4d21-8727-88b32345e932 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:59.881914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e60d071d-ded3-4d21-8727-88b32345e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:05:59.887829 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2905/5822] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:05:59.963850 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2918/5823] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:05:59.973524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c660ca-0051-4746-9f20-41fe0e6fce6c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:05:59.974098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c660ca-0051-4746-9f20-41fe0e6fce6c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:05:59.974414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c660ca-0051-4746-9f20-41fe0e6fce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:05:59.995872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-90c660ca-0051-4746-9f20-41fe0e6fce6c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:05:59.997445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90c660ca-0051-4746-9f20-41fe0e6fce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:00.023458 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2906/5824] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:00.027655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d071d-ded3-4d21-8727-88b32345e932 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.039981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d071d-ded3-4d21-8727-88b32345e932 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.053996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.054301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.054591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.054906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.055776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:00.056086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.058416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.084974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2919/5825] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:00.089050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c660ca-0051-4746-9f20-41fe0e6fce6c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.102412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c660ca-0051-4746-9f20-41fe0e6fce6c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.114938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.115625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.115910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.116486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.117105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.119645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.155715 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2907/5826] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:00 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:00.156893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.169562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5734d-7d2d-4e58-be24-9b07236081e8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.256641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.257430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.257719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.257999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.258699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.261623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.292269 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2920/5827] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:00 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:00.294046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.309352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d29548-a831-40aa-a5c4-d38557913c8b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.315578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.316545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.316679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.317590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.318582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.320858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.336817 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2908/5828] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:00.339103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.352576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450fdd-7325-4bb0-a406-67e6bcd89142 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.361610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.362698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.363286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.363669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] PATH_INFO: `/v3/projects/c20e40489b6e4e9d8a90cc38c6c04d5a/users/be5816b09b91419c87abbde5b8a939fd/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.388171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20e40489b6e4e9d8a90cc38c6c04d5a, user_id=be5816b09b91419c87abbde5b8a939fd, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.391340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.414118 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2921/5829] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:00 2022] PUT /identity/v3/projects/c20e40489b6e4e9d8a90cc38c6c04d5a/users/be5816b09b91419c87abbde5b8a939fd/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:00.418493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.435825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c98bc-e424-4adb-9143-979cf7c55e28 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.545122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34fafa-8000-4de2-8916-1bd912c2bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.545824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fafa-8000-4de2-8916-1bd912c2bcba admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.546109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fafa-8000-4de2-8916-1bd912c2bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.546385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34fafa-8000-4de2-8916-1bd912c2bcba admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.547757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34fafa-8000-4de2-8916-1bd912c2bcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.549976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34fafa-8000-4de2-8916-1bd912c2bcba admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.568487 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2909/5830] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:00.571989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.596082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c3dae-e2c3-4a91-b80e-34f7003b1ef3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.607020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.609000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.614059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.614547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] PATH_INFO: `/v3/projects/c20e40489b6e4e9d8a90cc38c6c04d5a/users/be5816b09b91419c87abbde5b8a939fd/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.618047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20e40489b6e4e9d8a90cc38c6c04d5a, user_id=be5816b09b91419c87abbde5b8a939fd, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.621685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.637293 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2922/5831] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:00 2022] PUT /identity/v3/projects/c20e40489b6e4e9d8a90cc38c6c04d5a/users/be5816b09b91419c87abbde5b8a939fd/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:00.649096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.649357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.649616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.691697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] MFA Rules not processed for user `be5816b09b91419c87abbde5b8a939fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:00.693969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:00.802438 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2910/5832] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:00.806860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.838955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:00.841120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:00.926043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a340c-a884-4212-b493-c02af8197dd0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.936307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.937203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.937536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.939809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] PATH_INFO: `/v3/users/1e5e10b43c6e40edb8a4808dd6013382` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.941096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5e10b43c6e40edb8a4808dd6013382)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.943124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:00.948153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283af1c9-7471-413e-aa0e-81a177e1d887 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:00.961094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:00.962848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:00.963334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:00.963715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:00.964574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:00.967291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:01.013905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5e10b43c6e40edb8a4808dd6013382'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.020557 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2923/5833] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:00 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:01.024129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:01.029966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5e10b43c6e40edb8a4808dd6013382'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.033117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5e10b43c6e40edb8a4808dd6013382'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.036088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5e10b43c6e40edb8a4808dd6013382'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.051341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5e10b43c6e40edb8a4808dd6013382'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.083498 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2911/5834] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:00 2022] DELETE /identity/v3/users/1e5e10b43c6e40edb8a4808dd6013382 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:01.119010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6e30c-2350-481d-b4b2-5dfc0c53a178 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:01.199779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:01.202866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.203948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.204686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.206561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:01.208792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:01.242373 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2924/5835] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:01 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:01.246412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:01.248531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:01.278903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb4a4a-1aaf-455b-974e-e1594a99b859 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:01.296708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:01.298364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.298763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.299178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.300383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:01.302791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:01.323673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2912/5836] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:01.328233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:01.356032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:01.357359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a20119-34a1-4b8c-b40d-ca231f8eb435 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:01.360105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:01.374089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:01.375704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.377594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.378227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.379196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:01.382265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:01.388149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b960c-864f-4dd1-b75e-04c3e2e40fa9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:01.398615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:01.399524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.399800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.400079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] PATH_INFO: `/v3/projects/634f90235a944d1490c6239364071d28` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.404204 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2925/5837] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:01.408334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:01.412023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634f90235a944d1490c6239364071d28)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:01.416392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:01.424609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55d1f4-e020-428e-b361-d2adf95dc249 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:01.435395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dfff4-a90e-4b65-bb78-1dbf0f623053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:01.439121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dfff4-a90e-4b65-bb78-1dbf0f623053 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.439686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dfff4-a90e-4b65-bb78-1dbf0f623053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.439978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dfff4-a90e-4b65-bb78-1dbf0f623053 admin admin] PATH_INFO: `/v3/projects/a416d52f88f0427c84f580e33adf65a5/users/4054ab6abab54aa3b57ca17188862451/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.477253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dfff4-a90e-4b65-bb78-1dbf0f623053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a416d52f88f0427c84f580e33adf65a5, user_id=4054ab6abab54aa3b57ca17188862451, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:01.483926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dfff4-a90e-4b65-bb78-1dbf0f623053 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:01.511510 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2926/5838] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:01 2022] PUT /identity/v3/projects/a416d52f88f0427c84f580e33adf65a5/users/4054ab6abab54aa3b57ca17188862451/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:01.517611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634f90235a944d1490c6239364071d28', 'request_id': 'req-bf743dfb-5a8f-4dda-919b-e4e950b567f2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.525751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.526341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.526925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.534737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634f90235a944d1490c6239364071d28', 'request_id': 'req-bf743dfb-5a8f-4dda-919b-e4e950b567f2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.557831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634f90235a944d1490c6239364071d28', 'request_id': 'req-bf743dfb-5a8f-4dda-919b-e4e950b567f2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.583279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] The token cache is being invalidate because project 634f90235a944d1490c6239364071d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:01.583841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.586397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf743dfb-5a8f-4dda-919b-e4e950b567f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:01.589364 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2913/5839] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:01 2022] DELETE /identity/v3/projects/634f90235a944d1490c6239364071d28 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:01.595850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18347-d3f9-4ccc-981b-088a23bee43d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.595850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18347-d3f9-4ccc-981b-088a23bee43d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.596261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18347-d3f9-4ccc-981b-088a23bee43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.628241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] MFA Rules not processed for user `4054ab6abab54aa3b57ca17188862451`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:01.634483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:01.638326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a2c18347-d3f9-4ccc-981b-088a23bee43d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:01.639742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a2c18347-d3f9-4ccc-981b-088a23bee43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:01.780618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2914/5840] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:01.785100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef655-4b2c-4a03-9cdb-3f22054fcc14 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:01.786394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef655-4b2c-4a03-9cdb-3f22054fcc14 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:01.787004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef655-4b2c-4a03-9cdb-3f22054fcc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:01.789374 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2927/5841] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:01.805270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:01.807048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:01.847234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-036ef655-4b2c-4a03-9cdb-3f22054fcc14 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:01.853510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-036ef655-4b2c-4a03-9cdb-3f22054fcc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:01.965240 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2915/5842] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:01.970444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ef655-4b2c-4a03-9cdb-3f22054fcc14 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:01.992553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ef655-4b2c-4a03-9cdb-3f22054fcc14 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:01.999577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832299a3-bec7-4f12-8799-b274809418a9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:02.005049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.005794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.006578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.007152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.009250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:02.010355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.011425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.011889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.013010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.013922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:02.017391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.031281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.090541 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2916/5843] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:02.092242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:02.113569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcad47-0d6f-4943-8012-24e91097dced admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:02.127131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.127794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.128717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.128971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.129505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.130000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.131429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.133976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.144782 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2928/5844] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:02.145652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:02.156953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:02.232335 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2917/5845] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:02 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:02.238738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:02.362720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb757-cdb3-4132-b260-0edecf186eea admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:02.367873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.368556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.368833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.369105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.369795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.371119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88013fbc-54d3-49e5-bee5-ceb022a6a4b0 service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:02.372829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.408498 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2918/5846] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:02 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:02.412973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:02.438391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569195c-000f-4593-99b0-c01ea384dd48 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:02.449287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.449975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.450261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.450541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.451307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.452949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.481394 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2919/5847] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:02.482344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:02.504668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa93f3-dfaf-43ce-8ad2-4c53c4a2d953 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:02.519104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.519804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.520088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.520369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.532263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.533947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.576068 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2920/5848] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:02.577037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:02.577318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868afcd-e409-4d35-a8fd-ea9b8bdcb31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.579780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868afcd-e409-4d35-a8fd-ea9b8bdcb31d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.580075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868afcd-e409-4d35-a8fd-ea9b8bdcb31d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.580351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868afcd-e409-4d35-a8fd-ea9b8bdcb31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.586312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6868afcd-e409-4d35-a8fd-ea9b8bdcb31d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:02.611525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d9949-d3ec-4928-b445-ff44b361fd62 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:02.619350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868afcd-e409-4d35-a8fd-ea9b8bdcb31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.621433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868afcd-e409-4d35-a8fd-ea9b8bdcb31d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.631033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:02.631962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.632252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.632537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] PATH_INFO: `/v3/projects/c7e5a2168e424b8c93abb1f9430260ca/users/48b7588bae874e4696e9e5d8ee506891/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.645998 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2929/5849] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:02.662821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e5a2168e424b8c93abb1f9430260ca, user_id=48b7588bae874e4696e9e5d8ee506891, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:02.666332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:02.688768 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2921/5850] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:02 2022] PUT /identity/v3/projects/c7e5a2168e424b8c93abb1f9430260ca/users/48b7588bae874e4696e9e5d8ee506891/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:02.700473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:02.700916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:02.701304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:02.738357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] MFA Rules not processed for user `48b7588bae874e4696e9e5d8ee506891`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:02.739834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:02.862868 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2930/5851] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:02.877953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:02.882252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:03.023489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:03.024917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:03.068617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa15afa-29b5-4b96-b8af-913fa7339292 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:03.086878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:03.087958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:03.087958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:03.088358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:03.108763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:03.112240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:03.133808 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2922/5852] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:03.166335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecee4f-73f0-4800-ab75-96b86c742a5d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:03.171454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:03.173381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:03.173740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:03.174135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] PATH_INFO: `/v3/users/be5816b09b91419c87abbde5b8a939fd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:03.175559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5816b09b91419c87abbde5b8a939fd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:03.178733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:03.183508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:03.195796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef5da-aef2-40c1-a2ad-c5f99276a237 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:03.215302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:03.215302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:03.215302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:03.215302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] PATH_INFO: `/v3/users/48b7588bae874e4696e9e5d8ee506891` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:03.215632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b7588bae874e4696e9e5d8ee506891)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:03.216349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:03.276592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b7588bae874e4696e9e5d8ee506891'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.285525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b7588bae874e4696e9e5d8ee506891'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.286540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b7588bae874e4696e9e5d8ee506891'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.287577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b7588bae874e4696e9e5d8ee506891'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.287818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5816b09b91419c87abbde5b8a939fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.288672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5816b09b91419c87abbde5b8a939fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.300480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-453f322e-89db-44ef-a597-1bce057c2506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b7588bae874e4696e9e5d8ee506891'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.303017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5816b09b91419c87abbde5b8a939fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.304756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5816b09b91419c87abbde5b8a939fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.329222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-184f48ba-12ab-4135-a78a-119f43f387c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5816b09b91419c87abbde5b8a939fd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:03.349491 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2923/5853] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:03 2022] DELETE /identity/v3/users/48b7588bae874e4696e9e5d8ee506891 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:03.351156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:03.351448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:03.351815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:03.385642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2931/5854] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:03 2022] DELETE /identity/v3/users/be5816b09b91419c87abbde5b8a939fd => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:03.395113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:03.395247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:03.395465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:03.431944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:03.433448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:03.440012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:03.442118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:03.537767 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2932/5855] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:03.559541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:03.560983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:03.573199 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2924/5856] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:03.587572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:03.589181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:03.634064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5edc5b-67e9-4454-b6a1-fb7505e08e73 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:03.655363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:03.656010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:03.656227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:03.657574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:03.671586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:03.673963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:03.688020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2933/5857] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:03.716759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afc174-6293-4597-b470-0bcf477cd33f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:03.727853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:03.728503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:03.728791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:03.729234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:03.745622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:03.750710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:03.771088 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2925/5858] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:04.389866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:04.392331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:04.408429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2abd32-d7b7-4f3c-b063-3e20dd31d11d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:04.413887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:04.414720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:04.415047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:04.415526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] PATH_INFO: `/v3/projects/c7e5a2168e424b8c93abb1f9430260ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:04.417056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e5a2168e424b8c93abb1f9430260ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:04.419383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:04.480558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e5a2168e424b8c93abb1f9430260ca', 'request_id': 'req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.487854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e5a2168e424b8c93abb1f9430260ca', 'request_id': 'req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.496912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e5a2168e424b8c93abb1f9430260ca', 'request_id': 'req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.504192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:04.506290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:04.521866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] The token cache is being invalidate because project c7e5a2168e424b8c93abb1f9430260ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:04.522335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.523279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-14fb9ad4-ac47-481d-8c30-a1533bd6b63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.525573 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2934/5859] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:04 2022] DELETE /identity/v3/projects/c7e5a2168e424b8c93abb1f9430260ca => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:04.526301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c611a57-fcf3-4e16-ba30-d446f3a9125d service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:04.532519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb07c3d-fea7-47ad-9ba3-4ad048d3dab0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:04.533268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb07c3d-fea7-47ad-9ba3-4ad048d3dab0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:04.534304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb07c3d-fea7-47ad-9ba3-4ad048d3dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:04.589737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fbb07c3d-fea7-47ad-9ba3-4ad048d3dab0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:04.591194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fbb07c3d-fea7-47ad-9ba3-4ad048d3dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:04.593879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:04.596544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:04.597184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:04.597603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] PATH_INFO: `/v3/projects/c20e40489b6e4e9d8a90cc38c6c04d5a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:04.599136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20e40489b6e4e9d8a90cc38c6c04d5a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:04.607083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2935/5860] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:04.607280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:04.608724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a53f6-cdba-4705-800f-fa68420b6824 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:04.609020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a53f6-cdba-4705-800f-fa68420b6824 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:04.609301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a53f6-cdba-4705-800f-fa68420b6824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:04.637335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c11a53f6-cdba-4705-800f-fa68420b6824 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:04.638622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c11a53f6-cdba-4705-800f-fa68420b6824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:04.649623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2936/5861] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:04.653729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a53f6-cdba-4705-800f-fa68420b6824 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:04.664550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a53f6-cdba-4705-800f-fa68420b6824 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:04.678285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20e40489b6e4e9d8a90cc38c6c04d5a', 'request_id': 'req-b82a620d-79d6-42e2-b7ae-b656208dd895'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.691188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20e40489b6e4e9d8a90cc38c6c04d5a', 'request_id': 'req-b82a620d-79d6-42e2-b7ae-b656208dd895'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.704698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20e40489b6e4e9d8a90cc38c6c04d5a', 'request_id': 'req-b82a620d-79d6-42e2-b7ae-b656208dd895'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.731716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] The token cache is being invalidate because project c20e40489b6e4e9d8a90cc38c6c04d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:04.732011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.733503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.736555 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2926/5862] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:04 2022] DELETE /identity/v3/projects/c20e40489b6e4e9d8a90cc38c6c04d5a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:04.739870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:04.740934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:04.741378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:04.741920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:04.743070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:04.743333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:04.743612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:04.745876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:04.752095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:04.771087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a620d-79d6-42e2-b7ae-b656208dd895 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:04.777701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:04.779041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:04.779461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:04.779809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] PATH_INFO: `/v3/users/4054ab6abab54aa3b57ca17188862451` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:04.781497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4054ab6abab54aa3b57ca17188862451)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:04.781631 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2937/5863] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:06:04.782502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:04.784598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:04.785234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:04.808782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f788-c56a-4b36-b17c-b48fab7be298 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:04.821833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:04.825298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:04.825941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:04.826351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:04.827264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:04.831245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:04.860309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4054ab6abab54aa3b57ca17188862451'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.871965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4054ab6abab54aa3b57ca17188862451'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.872163 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2938/5864] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:04 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:04.872264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4054ab6abab54aa3b57ca17188862451'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.873612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:04.874417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4054ab6abab54aa3b57ca17188862451'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.879770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:04.885769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4054ab6abab54aa3b57ca17188862451'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:04.913498 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2927/5865] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:04 2022] DELETE /identity/v3/users/4054ab6abab54aa3b57ca17188862451 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:04.997311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8c2d8-7809-4c50-90b9-92b52ca39a7a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.096890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.097692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.098042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.098655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.102969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.105537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.143344 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2939/5866] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:04 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:05.145440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.176758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f9336-09a5-44e2-b912-99efdd47536b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.185705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.186397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.186679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.186994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.188323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.190032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.205593 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2928/5867] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:05.209454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.222343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679915c-c013-4cab-8330-3cbc6a9882d8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.228170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef979-ca01-47e9-8587-a2fba6d1fe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.229179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef979-ca01-47e9-8587-a2fba6d1fe29 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.229692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef979-ca01-47e9-8587-a2fba6d1fe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.230128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef979-ca01-47e9-8587-a2fba6d1fe29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.231090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef979-ca01-47e9-8587-a2fba6d1fe29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.235753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef979-ca01-47e9-8587-a2fba6d1fe29 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.275130 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2940/5868] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:05.279649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.311308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5fbb3-f311-4fb1-bbb2-80515e3bd080 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.316965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.317909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.318202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.318480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] PATH_INFO: `/v3/projects/8b560e42947e4c13b708b737ab5841f5/users/d5b9a0c69be64b3b97af28d5c82b07c9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.342079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b560e42947e4c13b708b737ab5841f5, user_id=d5b9a0c69be64b3b97af28d5c82b07c9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.345240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.360039 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2929/5869] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:05 2022] PUT /identity/v3/projects/8b560e42947e4c13b708b737ab5841f5/users/d5b9a0c69be64b3b97af28d5c82b07c9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:05.370285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.370581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.370918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.401840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] MFA Rules not processed for user `d5b9a0c69be64b3b97af28d5c82b07c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:05.403145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:05.519522 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2941/5870] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:05.526424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.582088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.583738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:05.635718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c81fd-ca36-41df-81d7-55cefb1844f0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.640498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.641214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.641500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.641779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.642487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.644489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.655796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90eb1f-cea8-4caa-bfc2-102c42c83568 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.661608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.662577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.662936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.663251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] PATH_INFO: `/v3/projects/a416d52f88f0427c84f580e33adf65a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.664571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a416d52f88f0427c84f580e33adf65a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.666722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.674245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2930/5871] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:05 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:05.678024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.725041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a416d52f88f0427c84f580e33adf65a5', 'request_id': 'req-f9263d50-c61e-46ce-8dc5-623c293867dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:05.732523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a416d52f88f0427c84f580e33adf65a5', 'request_id': 'req-f9263d50-c61e-46ce-8dc5-623c293867dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:05.743499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a416d52f88f0427c84f580e33adf65a5', 'request_id': 'req-f9263d50-c61e-46ce-8dc5-623c293867dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:05.755283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0349543-05a3-43ef-bbae-0a9fa1bee5c4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.757274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] The token cache is being invalidate because project a416d52f88f0427c84f580e33adf65a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:05.757625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:05.758292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f9263d50-c61e-46ce-8dc5-623c293867dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:05.764883 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2942/5872] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:05 2022] DELETE /identity/v3/projects/a416d52f88f0427c84f580e33adf65a5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:05.767410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b4b0-a440-44c5-b7c7-6f8dc80fcb6e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.767709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b4b0-a440-44c5-b7c7-6f8dc80fcb6e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.767993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b4b0-a440-44c5-b7c7-6f8dc80fcb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.790580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0a10b4b0-a440-44c5-b7c7-6f8dc80fcb6e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:05.792029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0a10b4b0-a440-44c5-b7c7-6f8dc80fcb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:05.826493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.827686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.828167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.828488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.829183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.833939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.862705 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2931/5873] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:05 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:05.865500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.868083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:05.879141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2943/5874] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:05.883133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0ebe0-d7b6-4378-96c4-9f6d4ec682e8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.883427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0ebe0-d7b6-4378-96c4-9f6d4ec682e8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.883863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0ebe0-d7b6-4378-96c4-9f6d4ec682e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.888007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7260b9-6c2f-4b8d-a10b-e1d255d94b74 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.894278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.895275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.895714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.896144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.897188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.899194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.907309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-40e0ebe0-d7b6-4378-96c4-9f6d4ec682e8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:05.908739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-40e0ebe0-d7b6-4378-96c4-9f6d4ec682e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:05.912069 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2932/5875] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:05.916480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.923800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2944/5876] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:05.930821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0ebe0-d7b6-4378-96c4-9f6d4ec682e8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.941156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc945b3f-9043-477c-a09b-8d8adbd1ed24 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.949860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0ebe0-d7b6-4378-96c4-9f6d4ec682e8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:05.950056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.951850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.952135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.952486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] PATH_INFO: `/v3/projects/4d438ab70f2c40098fcd11bd235fdebf/users/1933dcb8c9964715ac036955d06957be/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.955538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:05.957448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:05.957448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:05.957448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:05.957718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:05.957849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.959601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.976065 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2945/5877] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:05.979647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:05.980721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d438ab70f2c40098fcd11bd235fdebf, user_id=1933dcb8c9964715ac036955d06957be, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:05.984141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:05.997078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff6c67-e470-4ddd-adac-065201e64d08 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.003762 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2933/5878] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:05 2022] PUT /identity/v3/projects/4d438ab70f2c40098fcd11bd235fdebf/users/1933dcb8c9964715ac036955d06957be/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:06.007852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.083738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.084591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.085000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.085621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.086407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.088491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.137322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aad8a9-5ce7-4427-afc9-977d8aa370d1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.143053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.143740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.144432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.144713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.145486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.147198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.149135 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2946/5879] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:05 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:06.153907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.166591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2934/5880] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:06.170655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.186303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36352ac4-162d-41ce-a978-e370883ad34d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.313728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d7bbb-7ed7-42e1-81d7-a881eb833f05 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.329004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.329904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.330417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.330726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.331761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.334406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.350515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567bd93-2aa9-4285-824b-67d5eaec019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.352118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567bd93-2aa9-4285-824b-67d5eaec019d admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.352599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567bd93-2aa9-4285-824b-67d5eaec019d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.353068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567bd93-2aa9-4285-824b-67d5eaec019d admin admin] PATH_INFO: `/v3/projects/4d438ab70f2c40098fcd11bd235fdebf/users/1933dcb8c9964715ac036955d06957be/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.365368 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2947/5881] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:06 2022] POST /identity/v3/users => generated 280 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:06.372410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.380881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567bd93-2aa9-4285-824b-67d5eaec019d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d438ab70f2c40098fcd11bd235fdebf, user_id=1933dcb8c9964715ac036955d06957be, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.387924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567bd93-2aa9-4285-824b-67d5eaec019d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.397193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abda4df-62b1-4227-8b0f-27f44ed4729f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.414466 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2935/5882] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:06 2022] PUT /identity/v3/projects/4d438ab70f2c40098fcd11bd235fdebf/users/1933dcb8c9964715ac036955d06957be/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:06.426441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d7e29-8bd1-425f-9a94-2f585e2680b6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.426921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d7e29-8bd1-425f-9a94-2f585e2680b6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.427206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d7e29-8bd1-425f-9a94-2f585e2680b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.508790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cd8d7e29-8bd1-425f-9a94-2f585e2680b6 None None] MFA Rules not processed for user `1933dcb8c9964715ac036955d06957be`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:06.510046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cd8d7e29-8bd1-425f-9a94-2f585e2680b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:06.558322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.559189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.559473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.560464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.560632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.562354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.577278 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2948/5883] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:06.582034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.597627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4609f-f969-41b3-9637-afe6d999b957 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.605347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.606268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.606560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.606863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.607597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.611387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.623255 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2936/5884] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:06.630817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2949/5885] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:06.633331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.633456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d7e29-8bd1-425f-9a94-2f585e2680b6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.645274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d7e29-8bd1-425f-9a94-2f585e2680b6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.650520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544afe52-de0a-4ff9-843f-001626874b1a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.655481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb9fde-0d62-4a70-9298-67c85839a865 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.656856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9fde-0d62-4a70-9298-67c85839a865 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.657232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9fde-0d62-4a70-9298-67c85839a865 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.657351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.657620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb9fde-0d62-4a70-9298-67c85839a865 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.658249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.658516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb9fde-0d62-4a70-9298-67c85839a865 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.658629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.658841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] PATH_INFO: `/v3/projects/5f3a78288892492dadd3727f74cd3973/users/f82dac71338748cc9752ef6be000c98c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.660661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb9fde-0d62-4a70-9298-67c85839a865 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.681601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3a78288892492dadd3727f74cd3973, user_id=f82dac71338748cc9752ef6be000c98c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.687127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.716464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2950/5886] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:06 2022] PUT /identity/v3/projects/5f3a78288892492dadd3727f74cd3973/users/f82dac71338748cc9752ef6be000c98c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:06.721108 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2937/5887] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:06 2022] POST /identity/v3/projects => generated 350 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:06.725084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.729180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10366da-1cdd-4576-b157-249ad4d494dc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.730013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10366da-1cdd-4576-b157-249ad4d494dc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.731227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10366da-1cdd-4576-b157-249ad4d494dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.764438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e10366da-1cdd-4576-b157-249ad4d494dc None None] MFA Rules not processed for user `f82dac71338748cc9752ef6be000c98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:06.767814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e10366da-1cdd-4576-b157-249ad4d494dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:06.828174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae8050-8df4-4cb0-9849-fa03eaa30206 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.848698 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2938/5888] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:06.860801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10366da-1cdd-4576-b157-249ad4d494dc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:06.915225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.915890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.916172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.916470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.917131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.919678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.939844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10366da-1cdd-4576-b157-249ad4d494dc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:06.945464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:06.946342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:06.946719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:06.947097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] PATH_INFO: `/v3/users/f82dac71338748cc9752ef6be000c98c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:06.948317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82dac71338748cc9752ef6be000c98c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:06.950475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:06.960252 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2951/5889] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:06 2022] POST /identity/v3/projects => generated 351 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:06.964362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.006091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82dac71338748cc9752ef6be000c98c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.018327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82dac71338748cc9752ef6be000c98c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.019118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82dac71338748cc9752ef6be000c98c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.020241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82dac71338748cc9752ef6be000c98c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.031925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1c5843a4-b5ed-4b38-9477-948dcb0e86b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82dac71338748cc9752ef6be000c98c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.060532 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2939/5890] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:06 2022] DELETE /identity/v3/users/f82dac71338748cc9752ef6be000c98c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:07.061804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.062912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.063344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.072351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a37ac4-d517-4d61-895d-8cd5fc68834b tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.095430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:07.096670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:07.148729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.149922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.150369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.150974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/users/d5b9a0c69be64b3b97af28d5c82b07c9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.152407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:get_user(user_id=d5b9a0c69be64b3b97af28d5c82b07c9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.154787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.157033 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2952/5891] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:06:06 2022] GET /identity/v3/users/d5b9a0c69be64b3b97af28d5c82b07c9 => generated 288 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:07.162257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.164475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:07.181221 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2940/5892] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:07.196295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75a12e-38c8-4006-9965-a2138ac12d22 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.201389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.207810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:07.222657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.223672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.225166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.227315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.228833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.232301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.257220 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2953/5893] 10.222.0.32 () {60 vars in 1161 bytes} [Sat May 7 22:06:07 2022] POST /identity/v3/credentials => generated 430 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:07.261907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.283635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3558129-f4f6-4fc0-9646-5ce5db683923 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.295336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.296647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.297115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.298171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials/a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.313983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b67a-262b-4f01-9c98-961a390f961c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.321867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.324184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.324184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.324184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.324184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.325688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.325688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.328177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.340905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.342814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.343249 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2954/5894] 10.222.0.32 () {60 vars in 1357 bytes} [Sat May 7 22:06:07 2022] PATCH /identity/v3/credentials/a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440 => generated 436 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:07.347992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.357254 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2941/5895] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:07.367233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f1a57-f1bf-49aa-b66d-8f61040a69e3 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.378377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.380806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.381933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.383478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials/a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.385482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.387607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.390566 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2955/5896] 10.222.0.32 () {58 vars in 1334 bytes} [Sat May 7 22:06:07 2022] GET /identity/v3/credentials/a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440 => generated 436 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:06:07.396574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.418269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1ac06-5a39-46da-8e2f-821649d1e367 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.428389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.430372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.431325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.432558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials/a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.436836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.442315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.483674 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2942/5897] 10.222.0.32 () {58 vars in 1337 bytes} [Sat May 7 22:06:07 2022] DELETE /identity/v3/credentials/a233815172f66f26269fdd2e3c24c58bf7ce6bf28a31521d5f6790648de52440 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:07.490467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.505066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078bb6c-ec2a-4572-84a3-f92dceccb28f tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.511456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.512279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.512693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.513070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.513897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.517264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.543510 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2956/5898] 10.222.0.32 () {60 vars in 1161 bytes} [Sat May 7 22:06:07 2022] POST /identity/v3/credentials => generated 430 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:07.547810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.570185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a9e98-88cf-48c7-b1fc-382341e1c163 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.576991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.579751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.579751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.579751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.580038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.581921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.605524 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2943/5899] 10.222.0.32 () {60 vars in 1161 bytes} [Sat May 7 22:06:07 2022] POST /identity/v3/credentials => generated 428 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:07.609799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.623384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075149b5-2798-4fd3-b3b5-504a3fe8b682 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.632455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.633542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.634267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.634659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.636004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.638215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.649557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.651446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.653010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.654587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.657509 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2957/5900] 10.222.0.32 () {58 vars in 1139 bytes} [Sat May 7 22:06:07 2022] GET /identity/v3/credentials => generated 943 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:06:07.662533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.674762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243108ac-8376-4670-920a-e19684c3aa18 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.682197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.683571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.684378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.684378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials/48fef392505f33e633353922a8d8ed7d6b3fc144673bd34bde6d116a101826fa` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.688739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=48fef392505f33e633353922a8d8ed7d6b3fc144673bd34bde6d116a101826fa)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.691955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.719657 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2944/5901] 10.222.0.32 () {58 vars in 1337 bytes} [Sat May 7 22:06:07 2022] DELETE /identity/v3/credentials/48fef392505f33e633353922a8d8ed7d6b3fc144673bd34bde6d116a101826fa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:07.720509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.733193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafed086-240c-49a7-aec8-4a0750e01491 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.740600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.741947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.743121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.744887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/credentials/f5124100cccc07c66f28326c92da6654b5ad1b2f3de6f668ec39e9ed5b52f0dd` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.747597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f5124100cccc07c66f28326c92da6654b5ad1b2f3de6f668ec39e9ed5b52f0dd)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.752880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.795212 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2958/5902] 10.222.0.32 () {58 vars in 1337 bytes} [Sat May 7 22:06:07 2022] DELETE /identity/v3/credentials/f5124100cccc07c66f28326c92da6654b5ad1b2f3de6f668ec39e9ed5b52f0dd => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:07.806661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.820037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03e8cf-1c10-4a24-847b-8350e0a50f26 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.827937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:07.828957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:07.829242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:07.829521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/projects/59af583c1edf420494b95f4c4d4d71ac` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:07.831396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:delete_project(project_id=59af583c1edf420494b95f4c4d4d71ac)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:07.833873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:07.885475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.885475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:07.910457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fdc54-b420-4124-9d96-325ec2220297 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:07.912630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59af583c1edf420494b95f4c4d4d71ac', 'request_id': 'req-d9958309-3409-4ab5-8240-50a135658c65'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.929848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59af583c1edf420494b95f4c4d4d71ac', 'request_id': 'req-d9958309-3409-4ab5-8240-50a135658c65'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.942036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59af583c1edf420494b95f4c4d4d71ac', 'request_id': 'req-d9958309-3409-4ab5-8240-50a135658c65'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.979022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] The token cache is being invalidate because project 59af583c1edf420494b95f4c4d4d71ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:07.979352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.981912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:07.985107 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2945/5903] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:07 2022] DELETE /identity/v3/projects/59af583c1edf420494b95f4c4d4d71ac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:07.988725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:07.990356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:08.002584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.003930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.004327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.004710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] PATH_INFO: `/v3/projects/5f3a78288892492dadd3727f74cd3973` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.006442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3a78288892492dadd3727f74cd3973)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.008929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.084056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3a78288892492dadd3727f74cd3973', 'request_id': 'req-a1854b38-088d-4ce1-ae7f-0f135f0a458b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.091864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3a78288892492dadd3727f74cd3973', 'request_id': 'req-a1854b38-088d-4ce1-ae7f-0f135f0a458b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.102913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9958309-3409-4ab5-8240-50a135658c65 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.104714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3a78288892492dadd3727f74cd3973', 'request_id': 'req-a1854b38-088d-4ce1-ae7f-0f135f0a458b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.127856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] The token cache is being invalidate because project 5f3a78288892492dadd3727f74cd3973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:08.128312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.129551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1854b38-088d-4ce1-ae7f-0f135f0a458b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.134871 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2959/5904] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:07 2022] DELETE /identity/v3/projects/5f3a78288892492dadd3727f74cd3973 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:08.136982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560823d9-d4e1-4594-8012-8cbd973f2cbd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.137585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560823d9-d4e1-4594-8012-8cbd973f2cbd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.138176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560823d9-d4e1-4594-8012-8cbd973f2cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.168000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-560823d9-d4e1-4594-8012-8cbd973f2cbd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:08.169943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-560823d9-d4e1-4594-8012-8cbd973f2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:08.210346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1933dcb8c9964715ac036955d06957be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d438ab70f2c40098fcd11bd235fdebf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.212475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.215074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.215655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] PATH_INFO: `/v3/projects/2bb4cde0078f41308128e8325dbd8efe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.217410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2bb4cde0078f41308128e8325dbd8efe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.220366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.286898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2960/5905] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:08.290469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb4cde0078f41308128e8325dbd8efe', 'request_id': 'req-aa10772d-a01b-43e8-b2b9-02791f9eead4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.294966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1049495-ecbc-414f-8b93-ce4860704b4e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.295465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1049495-ecbc-414f-8b93-ce4860704b4e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.296479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1049495-ecbc-414f-8b93-ce4860704b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.301296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb4cde0078f41308128e8325dbd8efe', 'request_id': 'req-aa10772d-a01b-43e8-b2b9-02791f9eead4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.315750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb4cde0078f41308128e8325dbd8efe', 'request_id': 'req-aa10772d-a01b-43e8-b2b9-02791f9eead4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.322265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b1049495-ecbc-414f-8b93-ce4860704b4e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:08.323868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b1049495-ecbc-414f-8b93-ce4860704b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:08.333390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] The token cache is being invalidate because project 2bb4cde0078f41308128e8325dbd8efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:08.333883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.335848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.339342 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2946/5906] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:07 2022] DELETE /identity/v3/projects/2bb4cde0078f41308128e8325dbd8efe => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:08.343575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.350982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:08.412101 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2961/5907] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:08.416217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1049495-ecbc-414f-8b93-ce4860704b4e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.429859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1049495-ecbc-414f-8b93-ce4860704b4e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.435044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.436186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.436803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.437091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.437877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:08.438339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.440600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.456564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2962/5908] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:08.460758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.469651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10772d-a01b-43e8-b2b9-02791f9eead4 tempest-CredentialsTestJSON-525561778 tempest-CredentialsTestJSON-525561778-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.472651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dff7b-2b55-4088-bb4e-d66935941c89 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.474689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.475775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.476133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.476599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] PATH_INFO: `/v3/users/d5b9a0c69be64b3b97af28d5c82b07c9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.477771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.477907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b9a0c69be64b3b97af28d5c82b07c9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.478598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.481010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.481010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.481010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.481275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.481848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.514809 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2963/5909] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:08 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:08.519073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.539198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b9a0c69be64b3b97af28d5c82b07c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.546281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b9a0c69be64b3b97af28d5c82b07c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.547230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b9a0c69be64b3b97af28d5c82b07c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.548192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b9a0c69be64b3b97af28d5c82b07c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.557462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aaf72073-1e39-4d26-b792-a3a3884ebaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b9a0c69be64b3b97af28d5c82b07c9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:08.584802 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2947/5910] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:08 2022] DELETE /identity/v3/users/d5b9a0c69be64b3b97af28d5c82b07c9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:08.589446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.589737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.590378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.590750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1084a9-4b64-4d82-b00d-086c06166d75 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.609825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:08.611177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:08.655468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.657942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.658483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.658996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.659925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.662417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.687074 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2948/5911] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:08.694969 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2964/5912] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:08 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:08.696869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.698367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:08.700445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.710399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:08.727818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64002c1-7b6c-447c-9fbe-a317be9f31bd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.744326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.745410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.745410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.745612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.746274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.748189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.760917 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2965/5913] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:08.766421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.779295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d37462-7103-4f7e-9557-14da87359620 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.787504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.788442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.788816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.789132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.789938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.791687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.793581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fbd07-d37f-48b6-ac0f-faa3b9f3114c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.797630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749ea5a-b73d-4b6d-96df-8ed8817591e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.798556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749ea5a-b73d-4b6d-96df-8ed8817591e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.799010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749ea5a-b73d-4b6d-96df-8ed8817591e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.799290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749ea5a-b73d-4b6d-96df-8ed8817591e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.810941 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2966/5914] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:08.814845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:08.825464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749ea5a-b73d-4b6d-96df-8ed8817591e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.827191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749ea5a-b73d-4b6d-96df-8ed8817591e3 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.828997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0ab28-ce55-4099-a548-5b6b280ce45b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:08.834744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:08.835007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.835272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.835576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] PATH_INFO: `/v3/projects/ce437da8ed074d9abe878fd4db8d1783/users/5c4c90465a92429091a414daf917d8a6/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.841546 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2949/5915] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:08.852505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce437da8ed074d9abe878fd4db8d1783, user_id=5c4c90465a92429091a414daf917d8a6, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:08.855408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:08.870520 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2967/5916] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:08 2022] PUT /identity/v3/projects/ce437da8ed074d9abe878fd4db8d1783/users/5c4c90465a92429091a414daf917d8a6/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:08.883278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd08c7e-e27b-43a8-a1a6-0016bb9a2f9f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:08.883278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd08c7e-e27b-43a8-a1a6-0016bb9a2f9f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:08.883677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd08c7e-e27b-43a8-a1a6-0016bb9a2f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:08.916388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cdd08c7e-e27b-43a8-a1a6-0016bb9a2f9f None None] MFA Rules not processed for user `5c4c90465a92429091a414daf917d8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:08.917958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cdd08c7e-e27b-43a8-a1a6-0016bb9a2f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:09.022944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2950/5917] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:09.024085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.113328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b2cc6-8089-4829-b6d8-4b713f14ea9d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.118327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.119107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.119453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.119797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.120634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.122670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.154056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2968/5918] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:09 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:09.158569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd08c7e-e27b-43a8-a1a6-0016bb9a2f9f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.172439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd08c7e-e27b-43a8-a1a6-0016bb9a2f9f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.241409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.242089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.242371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.242647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.243373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.245312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.269396 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2951/5919] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:09 2022] POST /identity/v3/users => generated 306 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:09.273525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.287185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb499b6-e338-4796-b5e1-e29a10ac14a2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.293144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.293841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.294168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.294584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.295346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.297502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.315512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.316163 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2969/5920] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:09.317859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:09.320266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.332000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23282f92-4940-4dc2-8d1e-93fb57c5acc7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.336472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef098ce-6753-4aa5-8edd-9588579f4279 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.336770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.337684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.338030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.338408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] PATH_INFO: `/v3/projects/fa4a04f1cd3f45aaa34d35d5d2c208ca/users/21a4e6cd9d7e4e4da8a70018d9589057/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.343185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.344663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.344970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.345353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] PATH_INFO: `/v3/projects/8b560e42947e4c13b708b737ab5841f5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.347240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b560e42947e4c13b708b737ab5841f5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.350142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.360528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4a04f1cd3f45aaa34d35d5d2c208ca, user_id=21a4e6cd9d7e4e4da8a70018d9589057, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.364080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.379967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2970/5921] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:09 2022] PUT /identity/v3/projects/fa4a04f1cd3f45aaa34d35d5d2c208ca/users/21a4e6cd9d7e4e4da8a70018d9589057/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:09.383782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.415002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b560e42947e4c13b708b737ab5841f5', 'request_id': 'req-618c71b5-ce23-4eea-b637-505d6bbabe65'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.423638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b560e42947e4c13b708b737ab5841f5', 'request_id': 'req-618c71b5-ce23-4eea-b637-505d6bbabe65'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.433736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b560e42947e4c13b708b737ab5841f5', 'request_id': 'req-618c71b5-ce23-4eea-b637-505d6bbabe65'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.445297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] The token cache is being invalidate because project 8b560e42947e4c13b708b737ab5841f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:09.445684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.446416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.448468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2952/5922] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:09 2022] DELETE /identity/v3/projects/8b560e42947e4c13b708b737ab5841f5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:09.452343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.454035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:09.456901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981522a-cac2-4e9e-9b14-38520a3b7ce0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.526372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.527207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.527739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.527886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c71b5-ce23-4eea-b637-505d6bbabe65 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.528294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.529266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.530923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.533415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.534490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.534862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.535202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] PATH_INFO: `/v3/users/1933dcb8c9964715ac036955d06957be` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.536500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1933dcb8c9964715ac036955d06957be)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.538719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.550637 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2971/5923] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:09.551674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.554986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:09.570044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460b653-c05d-4528-a9eb-02c56a927d62 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.580804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1df488-0178-4834-a661-2518de9ec14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.582220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1df488-0178-4834-a661-2518de9ec14f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.583364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1df488-0178-4834-a661-2518de9ec14f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.583754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1df488-0178-4834-a661-2518de9ec14f admin admin] PATH_INFO: `/v3/projects/fa4a04f1cd3f45aaa34d35d5d2c208ca/users/21a4e6cd9d7e4e4da8a70018d9589057/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.586729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1df488-0178-4834-a661-2518de9ec14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4a04f1cd3f45aaa34d35d5d2c208ca, user_id=21a4e6cd9d7e4e4da8a70018d9589057, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.589919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1df488-0178-4834-a661-2518de9ec14f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.598862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1933dcb8c9964715ac036955d06957be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.603489 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2972/5924] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:09 2022] PUT /identity/v3/projects/fa4a04f1cd3f45aaa34d35d5d2c208ca/users/21a4e6cd9d7e4e4da8a70018d9589057/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:09.607434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1933dcb8c9964715ac036955d06957be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.608326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1933dcb8c9964715ac036955d06957be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.609277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1933dcb8c9964715ac036955d06957be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.615793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.616445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.617120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.621182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1933dcb8c9964715ac036955d06957be'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:09.642400 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2953/5925] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:09 2022] DELETE /identity/v3/users/1933dcb8c9964715ac036955d06957be => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:09.653407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] MFA Rules not processed for user `21a4e6cd9d7e4e4da8a70018d9589057`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:09.654820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:09.759562 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2973/5926] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:09.777304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:09.779463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:09.864095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f469d8-fdea-44ab-9ec1-2fac3380e09f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:09.867927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:09.868732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:09.869022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:09.869299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:09.871206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:09.949060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:09.950848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:09.961408 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2954/5927] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:10.662112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:10.664609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:10.694413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:10.696096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:10.770821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0aa98-53af-4a35-89aa-a0844a915045 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:10.777737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:10.778797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:10.779304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:10.779786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] PATH_INFO: `/v3/projects/4d438ab70f2c40098fcd11bd235fdebf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:10.781253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d438ab70f2c40098fcd11bd235fdebf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:10.783445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:10.833143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae3f13-ec34-46f1-9f8d-463934147810 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:10.848803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d438ab70f2c40098fcd11bd235fdebf', 'request_id': 'req-89a57153-fdd8-431c-a955-144024a6e956'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:10.856429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d438ab70f2c40098fcd11bd235fdebf', 'request_id': 'req-89a57153-fdd8-431c-a955-144024a6e956'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:10.867109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d438ab70f2c40098fcd11bd235fdebf', 'request_id': 'req-89a57153-fdd8-431c-a955-144024a6e956'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:10.886020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] The token cache is being invalidate because project 4d438ab70f2c40098fcd11bd235fdebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:10.886561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:10.887542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-89a57153-fdd8-431c-a955-144024a6e956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:10.889242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2974/5928] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:10 2022] DELETE /identity/v3/projects/4d438ab70f2c40098fcd11bd235fdebf => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:10.894421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a728-a5bc-47a6-87ab-7253a4282ed3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:10.895913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a728-a5bc-47a6-87ab-7253a4282ed3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:10.897088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446a728-a5bc-47a6-87ab-7253a4282ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:10.927928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e446a728-a5bc-47a6-87ab-7253a4282ed3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:10.929284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e446a728-a5bc-47a6-87ab-7253a4282ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:10.938716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:10.939812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:10.940269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:10.940799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:10.942999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:11.029010 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2975/5929] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:11.055586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.060779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.078322 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2955/5930] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:11.111908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e916e9-96b9-42f1-b12e-ff8d19bc8514 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.112191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e916e9-96b9-42f1-b12e-ff8d19bc8514 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.112762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e916e9-96b9-42f1-b12e-ff8d19bc8514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.137235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-21e916e9-96b9-42f1-b12e-ff8d19bc8514 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:11.138438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21e916e9-96b9-42f1-b12e-ff8d19bc8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:11.149565 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2976/5931] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:11.154292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.170059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f169bc-b3f9-421b-ae77-4ba11334a769 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:11.181320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:11.182252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.182426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.182687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.184012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:11.184318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.193359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.217676 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2956/5932] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:11.222434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e916e9-96b9-42f1-b12e-ff8d19bc8514 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.233579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e916e9-96b9-42f1-b12e-ff8d19bc8514 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:11.241022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:11.242025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.242469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.242995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.244044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.246822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.282183 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2977/5933] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:11 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:11.286823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.303879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44801bc-e80f-4fd2-ac1b-fa46e7be7582 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:11.408891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:11.409875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.410311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.410728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.411644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.416284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.460904 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2957/5934] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:11 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:11.464543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.477253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42068-135f-4e9a-b312-4afab1643f10 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:11.484852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:11.486032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.487266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.489245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.489879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.491750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.506621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2978/5935] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:11.507701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.526371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6889af-ad33-44c5-959a-fc1aa384e860 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:11.533417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c2ef3-5054-4262-a48c-3581e8a46ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:11.534443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2ef3-5054-4262-a48c-3581e8a46ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.534930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2ef3-5054-4262-a48c-3581e8a46ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.535360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2ef3-5054-4262-a48c-3581e8a46ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.536306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c2ef3-5054-4262-a48c-3581e8a46ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.538272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c2ef3-5054-4262-a48c-3581e8a46ba1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.551760 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2958/5936] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:11.556103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.575068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd349df-0ab3-4b29-90f8-b534a385103d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:11.582194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:11.583999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.584518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.584839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] PATH_INFO: `/v3/projects/b6e9acaa77eb48e4adef32904b4f61a8/users/0451d47830164f29b26a87398c44ec70/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.608914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e9acaa77eb48e4adef32904b4f61a8, user_id=0451d47830164f29b26a87398c44ec70, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.615251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.640105 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2979/5937] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:11 2022] PUT /identity/v3/projects/b6e9acaa77eb48e4adef32904b4f61a8/users/0451d47830164f29b26a87398c44ec70/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:11.650547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a6fd4-7e0d-49de-a7ff-3c418411a0b3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.650794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a6fd4-7e0d-49de-a7ff-3c418411a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.651144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a6fd4-7e0d-49de-a7ff-3c418411a0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.693245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6c0a6fd4-7e0d-49de-a7ff-3c418411a0b3 None None] MFA Rules not processed for user `0451d47830164f29b26a87398c44ec70`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:11.694838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6c0a6fd4-7e0d-49de-a7ff-3c418411a0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:11.820650 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2959/5938] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:11.826020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.903824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd157852-0b81-41a2-8ec2-91f27f1af13e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:11.909773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:11.910450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:11.910737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:11.911132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:11.912343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:11.913828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:11.945697 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2980/5939] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:11 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:11.950486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a6fd4-7e0d-49de-a7ff-3c418411a0b3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:11.965319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a6fd4-7e0d-49de-a7ff-3c418411a0b3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.051921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.053124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.053578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.053857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.055197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.056589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.095548 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2960/5940] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:11 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:12.096964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.107621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b569e-8c0b-4ed3-b301-461641b11809 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.112828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.113642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.113906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.114250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.115109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.117465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.134301 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2981/5941] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:12.135441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.153216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b598dbd-7dd0-439d-ba7b-1db9e639005c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.161160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.162201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.162593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.163008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] PATH_INFO: `/v3/projects/780d1738f9534f63a751c3ab45ecec6f/users/12f416e2e9c049288e24f0f695171ca4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.179194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780d1738f9534f63a751c3ab45ecec6f, user_id=12f416e2e9c049288e24f0f695171ca4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.182266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.207160 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2961/5942] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:12 2022] PUT /identity/v3/projects/780d1738f9534f63a751c3ab45ecec6f/users/12f416e2e9c049288e24f0f695171ca4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:12.211037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.222603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c732c33-917a-4296-9bb4-2ec2a8188d16 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.312187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e1d45-2ea1-4a99-be18-59089d54cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.313451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1d45-2ea1-4a99-be18-59089d54cf76 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.313775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1d45-2ea1-4a99-be18-59089d54cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.314043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e1d45-2ea1-4a99-be18-59089d54cf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.314822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e1d45-2ea1-4a99-be18-59089d54cf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.316825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e1d45-2ea1-4a99-be18-59089d54cf76 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.331844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2982/5943] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:12.337802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.357866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca9221-75de-4799-9a4c-cc5f29307496 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.364306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.365477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.365996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.366421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] PATH_INFO: `/v3/projects/780d1738f9534f63a751c3ab45ecec6f/users/12f416e2e9c049288e24f0f695171ca4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.370499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] RBAC: Authorizing `identity:create_grant(project_id=780d1738f9534f63a751c3ab45ecec6f, user_id=12f416e2e9c049288e24f0f695171ca4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.373520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.392018 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2962/5944] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:12 2022] PUT /identity/v3/projects/780d1738f9534f63a751c3ab45ecec6f/users/12f416e2e9c049288e24f0f695171ca4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:12.409167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fb5ca-bf5d-4d8a-85d4-da12f1ca3d7f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.409494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fb5ca-bf5d-4d8a-85d4-da12f1ca3d7f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.409917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fb5ca-bf5d-4d8a-85d4-da12f1ca3d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.447132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a46fb5ca-bf5d-4d8a-85d4-da12f1ca3d7f None None] MFA Rules not processed for user `12f416e2e9c049288e24f0f695171ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:12.448632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a46fb5ca-bf5d-4d8a-85d4-da12f1ca3d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:12.542906 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2983/5945] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:12.555721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.577025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c35109-f8ae-4472-8393-6ffb2670929b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.585623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.585623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.586066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.586524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.587682 ncdv-master-1 devstack@keystone.service[91075]: WARNING oslo_log.versionutils [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 07 22:06:12.588346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.590707 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:12.590707 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:06:12.590707 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:06:12.592174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.627633 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2963/5946] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:06:12 2022] POST /identity/v3/policies => generated 230 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:12.637398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fb5ca-bf5d-4d8a-85d4-da12f1ca3d7f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.650870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fb5ca-bf5d-4d8a-85d4-da12f1ca3d7f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.659034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.660535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.660885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.661169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies/86fd1e91082a4ceb91327548cb8bbfc8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.662237 ncdv-master-1 devstack@keystone.service[91076]: WARNING oslo_log.versionutils [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 07 22:06:12.662954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=86fd1e91082a4ceb91327548cb8bbfc8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.664398 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:12.664398 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:06:12.664398 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:06:12.665640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.696160 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2984/5947] 10.222.0.32 () {60 vars in 1251 bytes} [Sat May 7 22:06:12 2022] PATCH /identity/v3/policies/86fd1e91082a4ceb91327548cb8bbfc8 => generated 237 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:12.700030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.712503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16b0ba-8ebc-4cf7-9a1b-b7469e465e8e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.727640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.728531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.729023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.729649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies/86fd1e91082a4ceb91327548cb8bbfc8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.731268 ncdv-master-1 devstack@keystone.service[91075]: WARNING oslo_log.versionutils [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 07 22:06:12.737524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=86fd1e91082a4ceb91327548cb8bbfc8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.739065 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:12.739065 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:06:12.739065 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:06:12.740316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.760814 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2964/5948] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:06:12 2022] GET /identity/v3/policies/86fd1e91082a4ceb91327548cb8bbfc8 => generated 237 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:06:12.766158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.786654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282218f7-69ff-44fb-8349-492ce656b3f0 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.796430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.798525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.799014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.799618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies/86fd1e91082a4ceb91327548cb8bbfc8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.800600 ncdv-master-1 devstack@keystone.service[91076]: WARNING oslo_log.versionutils [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 07 22:06:12.801411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=86fd1e91082a4ceb91327548cb8bbfc8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.803924 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:12.803924 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:06:12.803924 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:06:12.805441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.836230 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2985/5949] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:12 2022] DELETE /identity/v3/policies/86fd1e91082a4ceb91327548cb8bbfc8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:12.837297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.849426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c615f-1ac9-4b4a-8232-fb0691efd23d tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.855341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.856227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.856674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.857106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.858478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.861150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.890307 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2965/5950] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:06:12 2022] POST /identity/v3/policies => generated 230 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:12.895239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.913978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674b46-17ca-4e04-a5f9-84a3a58f4c4f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.920423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.922372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.922834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.923403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.924622 ncdv-master-1 devstack@keystone.service[91076]: WARNING oslo_log.versionutils [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 07 22:06:12.925525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.927723 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:12.927723 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:06:12.927723 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:06:12.929458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:12.962712 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2986/5951] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:06:12 2022] POST /identity/v3/policies => generated 228 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:12.966798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:12.979882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536f0ea-b63d-40c3-a259-3b0a00b014fd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:12.986513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:12.987393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:12.988139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:12.988449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:12.990838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:12.993809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:13.015160 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2966/5952] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:06:12 2022] POST /identity/v3/policies => generated 230 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:13.019745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:13.033174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50d019-04fd-4604-8ee3-75584cc1783b tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:13.039700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:13.041339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:13.041866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:13.043009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:13.044174 ncdv-master-1 devstack@keystone.service[91076]: WARNING oslo_log.versionutils [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 07 22:06:13.044986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:13.047044 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:13.047044 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:06:13.047044 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:06:13.049268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:13.060779 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2987/5953] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 22:06:13 2022] GET /identity/v3/policies => generated 764 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:13.066744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:13.080786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b625e-263d-4eb3-82a6-8673ffa729dd tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:13.087169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:13.088477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:13.089000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:13.089286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies/8e86a27b25304315a2e547efc640fc22` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:13.090093 ncdv-master-1 devstack@keystone.service[91075]: WARNING oslo_log.versionutils [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. May 07 22:06:13.090718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8e86a27b25304315a2e547efc640fc22)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:13.092055 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:06:13.092055 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:06:13.092055 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:06:13.093478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:13.110892 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2967/5954] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:13 2022] DELETE /identity/v3/policies/8e86a27b25304315a2e547efc640fc22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:13.115285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:13.128805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662b234-1e62-4f02-8d9e-749b0b9b5703 tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:13.135665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:13.136624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:13.137009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:13.137356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies/a2437d5706a94f299e6d0650bf73a5bf` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:13.138681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=a2437d5706a94f299e6d0650bf73a5bf)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:13.141311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:13.157389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2988/5955] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:13 2022] DELETE /identity/v3/policies/a2437d5706a94f299e6d0650bf73a5bf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:13.161636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:13.172943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ca5c-8c76-4bba-9028-110e6e74fe7a tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:13.177867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a176b6c-f963-4612-8b38-0131be5c0c0f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12f416e2e9c049288e24f0f695171ca4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '780d1738f9534f63a751c3ab45ecec6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:13.178959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176b6c-f963-4612-8b38-0131be5c0c0f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:13.179240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176b6c-f963-4612-8b38-0131be5c0c0f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:13.179519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a176b6c-f963-4612-8b38-0131be5c0c0f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] PATH_INFO: `/v3/policies/8049c693bb7649c5bcd3bb7b71acaced` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:13.180648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176b6c-f963-4612-8b38-0131be5c0c0f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=8049c693bb7649c5bcd3bb7b71acaced)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:13.182543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a176b6c-f963-4612-8b38-0131be5c0c0f tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:13.204703 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2968/5956] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:13 2022] DELETE /identity/v3/policies/8049c693bb7649c5bcd3bb7b71acaced => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:13.210654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:13.294421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163af169-2ae3-4e8b-a426-1fac8cde610e tempest-PoliciesTestJSON-2062630228 tempest-PoliciesTestJSON-2062630228-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:13.299948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:13.300952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:13.301454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:13.301835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] PATH_INFO: `/v3/users/0451d47830164f29b26a87398c44ec70` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:13.303623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0451d47830164f29b26a87398c44ec70)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:13.306642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:13.375306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0451d47830164f29b26a87398c44ec70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:13.376357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0451d47830164f29b26a87398c44ec70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:13.387505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0451d47830164f29b26a87398c44ec70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:13.388958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0451d47830164f29b26a87398c44ec70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:13.403030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0451d47830164f29b26a87398c44ec70'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:13.432700 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2989/5957] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:13 2022] DELETE /identity/v3/users/0451d47830164f29b26a87398c44ec70 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:13.438037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:13.438550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:13.439464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:13.469170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:13.471102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:13.553344 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2969/5958] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:13.570808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:13.573949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:13.663099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071fa1d-ea09-451c-a7f1-9862b4a007d6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:13.668882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:13.669808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:13.670121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:13.670408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:13.701925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:13.703492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:13.728194 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2990/5959] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:14.536779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:14.538573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:14.564668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245096e-b5e0-49ed-83b5-d09106e82463 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:14.576262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:14.577254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:14.577644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:14.579654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] PATH_INFO: `/v3/projects/b6e9acaa77eb48e4adef32904b4f61a8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:14.582308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e9acaa77eb48e4adef32904b4f61a8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:14.587189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:14.717219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e9acaa77eb48e4adef32904b4f61a8', 'request_id': 'req-5ccb925b-0822-4150-b495-e22db7113b3f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:14.732186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e9acaa77eb48e4adef32904b4f61a8', 'request_id': 'req-5ccb925b-0822-4150-b495-e22db7113b3f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:14.743975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e9acaa77eb48e4adef32904b4f61a8', 'request_id': 'req-5ccb925b-0822-4150-b495-e22db7113b3f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:14.761405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] The token cache is being invalidate because project b6e9acaa77eb48e4adef32904b4f61a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:14.761628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:14.762290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:14.764429 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2970/5960] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:14 2022] DELETE /identity/v3/projects/b6e9acaa77eb48e4adef32904b4f61a8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:14.768869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:14.781853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0b6b-1de4-4237-9515-99cf0e786df2 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:14.935165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:14.936213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:14.936823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:14.937793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] PATH_INFO: `/v3/users/12f416e2e9c049288e24f0f695171ca4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:14.939304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f416e2e9c049288e24f0f695171ca4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:14.941469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:15.015119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f416e2e9c049288e24f0f695171ca4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.017007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f416e2e9c049288e24f0f695171ca4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.034392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f416e2e9c049288e24f0f695171ca4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.035274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f416e2e9c049288e24f0f695171ca4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.043519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-60bdfc58-ab0d-448a-9aff-3e593bb8f219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f416e2e9c049288e24f0f695171ca4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.080683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2991/5961] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:14 2022] DELETE /identity/v3/users/12f416e2e9c049288e24f0f695171ca4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:15.755463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:15.757828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:15.781733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb925b-0822-4150-b495-e22db7113b3f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:15.868494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:15.869456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:15.869952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:15.870448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] PATH_INFO: `/v3/projects/780d1738f9534f63a751c3ab45ecec6f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:15.872014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] RBAC: Authorizing `identity:delete_project(project_id=780d1738f9534f63a751c3ab45ecec6f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:15.874147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:15.935254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780d1738f9534f63a751c3ab45ecec6f', 'request_id': 'req-773cd584-44a9-4451-b124-d757e4b7771c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.942311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780d1738f9534f63a751c3ab45ecec6f', 'request_id': 'req-773cd584-44a9-4451-b124-d757e4b7771c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.952010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780d1738f9534f63a751c3ab45ecec6f', 'request_id': 'req-773cd584-44a9-4451-b124-d757e4b7771c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.966205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] The token cache is being invalidate because project 780d1738f9534f63a751c3ab45ecec6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:15.966698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.968192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-773cd584-44a9-4451-b124-d757e4b7771c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:15.971266 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2971/5962] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:15 2022] DELETE /identity/v3/projects/780d1738f9534f63a751c3ab45ecec6f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:15.976982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b3328-0fc3-482a-8da2-c7e38f84dc11 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:15.977428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b3328-0fc3-482a-8da2-c7e38f84dc11 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:15.978001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b3328-0fc3-482a-8da2-c7e38f84dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.001840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8c7b3328-0fc3-482a-8da2-c7e38f84dc11 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:16.004263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8c7b3328-0fc3-482a-8da2-c7e38f84dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:16.076890 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2992/5963] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:16.087004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb240c5-c20a-48a2-a66a-e937ff8037e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.087490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb240c5-c20a-48a2-a66a-e937ff8037e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.087949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb240c5-c20a-48a2-a66a-e937ff8037e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.121373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0cb240c5-c20a-48a2-a66a-e937ff8037e6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:16.122586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0cb240c5-c20a-48a2-a66a-e937ff8037e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:16.135228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2972/5964] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:16.136731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b3328-0fc3-482a-8da2-c7e38f84dc11 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.147834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b3328-0fc3-482a-8da2-c7e38f84dc11 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.152693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.153635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.154038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.154422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.155292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:16.155824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.158116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.179719 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2993/5965] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:16.184164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb240c5-c20a-48a2-a66a-e937ff8037e6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.193707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb240c5-c20a-48a2-a66a-e937ff8037e6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.208628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.209812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.210162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.210787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.211573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.213583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.256859 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2973/5966] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:16 2022] POST /identity/v3/projects => generated 359 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:16.260925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.272648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24bf7-4f43-4d03-ba5e-f77980bb1a99 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.345267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.345949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.346239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.346523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.347250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.349302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.372601 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2994/5967] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:16 2022] POST /identity/v3/users => generated 280 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:16.376433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.387378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b866b-4b57-4d1a-a247-f52bcdabb938 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.392632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.393317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.393611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.393914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.394738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.396632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.413277 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2974/5968] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:16.417031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.430470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d27fb-a024-4a42-9072-f5161275b4a0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.436330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9baeb7-7360-409d-8c54-7365db923fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.437246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9baeb7-7360-409d-8c54-7365db923fda admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.437598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9baeb7-7360-409d-8c54-7365db923fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.438114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9baeb7-7360-409d-8c54-7365db923fda admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.439074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9baeb7-7360-409d-8c54-7365db923fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.440776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9baeb7-7360-409d-8c54-7365db923fda admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.457102 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2995/5969] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:16.461209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.472668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8083794e-febf-4094-b95b-7cdcdfdad4bb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.478016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f355f-11e3-4f02-b63b-c66bc28b80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.478950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f355f-11e3-4f02-b63b-c66bc28b80b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.479238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f355f-11e3-4f02-b63b-c66bc28b80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.480474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f355f-11e3-4f02-b63b-c66bc28b80b8 admin admin] PATH_INFO: `/v3/projects/38c013c728684047854fe897e588eda8/users/dbb5edaafadf4dec84ce55a98cc24347/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.501565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f355f-11e3-4f02-b63b-c66bc28b80b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c013c728684047854fe897e588eda8, user_id=dbb5edaafadf4dec84ce55a98cc24347, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.504706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f355f-11e3-4f02-b63b-c66bc28b80b8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.520467 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2975/5970] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:16 2022] PUT /identity/v3/projects/38c013c728684047854fe897e588eda8/users/dbb5edaafadf4dec84ce55a98cc24347/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:16.531706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7650719-0db9-454f-a28e-9e6cee653413 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.533349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7650719-0db9-454f-a28e-9e6cee653413 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.533912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7650719-0db9-454f-a28e-9e6cee653413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.565064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f7650719-0db9-454f-a28e-9e6cee653413 None None] MFA Rules not processed for user `dbb5edaafadf4dec84ce55a98cc24347`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:16.566716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f7650719-0db9-454f-a28e-9e6cee653413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:16.647978 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2996/5971] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:16 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:16.653062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8379-65d6-4471-8c14-f6a7a577e4a9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.653731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8379-65d6-4471-8c14-f6a7a577e4a9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.654418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a8379-65d6-4471-8c14-f6a7a577e4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.676181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dd0a8379-65d6-4471-8c14-f6a7a577e4a9 None None] MFA Rules not processed for user `dbb5edaafadf4dec84ce55a98cc24347`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:16.677534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd0a8379-65d6-4471-8c14-f6a7a577e4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:16.681484 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2976/5972] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:16 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:06:16.687315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1290815-fef0-4645-acc0-f7bd244c5124 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.687775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1290815-fef0-4645-acc0-f7bd244c5124 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.688227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1290815-fef0-4645-acc0-f7bd244c5124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.708854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c1290815-fef0-4645-acc0-f7bd244c5124 None None] MFA Rules not processed for user `dbb5edaafadf4dec84ce55a98cc24347`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:16.710803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1290815-fef0-4645-acc0-f7bd244c5124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:16.723147 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2997/5973] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:16 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:06:16.727180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8379-65d6-4471-8c14-f6a7a577e4a9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.739581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a8379-65d6-4471-8c14-f6a7a577e4a9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.744327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5edaafadf4dec84ce55a98cc24347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c013c728684047854fe897e588eda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.744765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.745046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.745323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.752398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorizing `identity:check_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.754042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.766659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2977/5974] 10.222.0.32 () {56 vars in 1263 bytes} [Sat May 7 22:06:16 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) May 07 22:06:16.767527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1290815-fef0-4645-acc0-f7bd244c5124 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.787659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1290815-fef0-4645-acc0-f7bd244c5124 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.793763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5edaafadf4dec84ce55a98cc24347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c013c728684047854fe897e588eda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.794514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.795151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.795440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.802101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.819219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.837040 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2998/5975] 10.222.0.32 () {56 vars in 1262 bytes} [Sat May 7 22:06:16 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 07 22:06:16.838526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.850030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b75d6-48b8-498c-bd07-66451d321286 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.861982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924c59a-5e16-475a-9d4f-2ae897755c04 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5edaafadf4dec84ce55a98cc24347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c013c728684047854fe897e588eda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.863579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924c59a-5e16-475a-9d4f-2ae897755c04 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.864010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924c59a-5e16-475a-9d4f-2ae897755c04 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.864302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924c59a-5e16-475a-9d4f-2ae897755c04 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.879398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924c59a-5e16-475a-9d4f-2ae897755c04 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:16.881012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924c59a-5e16-475a-9d4f-2ae897755c04 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:16.897903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2978/5976] 10.222.0.32 () {56 vars in 1265 bytes} [Sat May 7 22:06:16 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:16.902027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:16.913311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75157d9f-b675-425a-a217-bf2596facc08 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:16.918161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5edaafadf4dec84ce55a98cc24347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c013c728684047854fe897e588eda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:16.918807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.919241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.919858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.922420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') May 07 22:06:16.959741 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.check_revocation(token) May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 07 22:06:16.960904 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 07 22:06:16.962898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:16.962898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:16.962898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 07 22:06:16.962898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 07 22:06:16.962898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 07 22:06:16.962898 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:06:16.962898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 2999/5977] 10.222.0.32 () {56 vars in 1263 bytes} [Sat May 7 22:06:16 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) May 07 22:06:16.967115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b563e-8749-4b2e-89c7-af25b63dedc2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:16.967416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b563e-8749-4b2e-89c7-af25b63dedc2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:16.967701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b563e-8749-4b2e-89c7-af25b63dedc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:16.984980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dd1b563e-8749-4b2e-89c7-af25b63dedc2 None None] MFA Rules not processed for user `dbb5edaafadf4dec84ce55a98cc24347`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:16.986291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd1b563e-8749-4b2e-89c7-af25b63dedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:16.989842 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2979/5978] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:16 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:06:16.993917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:17.003679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2c789-f57b-4f16-b83b-069b81e1ab1e tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:17.009525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5edaafadf4dec84ce55a98cc24347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c013c728684047854fe897e588eda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:17.010169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:17.010478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:17.010758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:17.018024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:17.019927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:17.025894 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3000/5979] 10.222.0.32 () {56 vars in 1262 bytes} [Sat May 7 22:06:16 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 07 22:06:17.029816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b563e-8749-4b2e-89c7-af25b63dedc2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:17.041466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b563e-8749-4b2e-89c7-af25b63dedc2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:17.045544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5edaafadf4dec84ce55a98cc24347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c013c728684047854fe897e588eda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:17.046188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:17.046478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:17.046832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:17.053731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:17.055313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:17.071343 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2980/5980] 10.222.0.32 () {56 vars in 1265 bytes} [Sat May 7 22:06:17 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:17.075510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:17.086490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679bdd9-cb37-46c2-9a83-15c0948eca39 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:17.091517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68121b-c920-4ce1-85cf-26b737fb3e79 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbb5edaafadf4dec84ce55a98cc24347', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38c013c728684047854fe897e588eda8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:17.092943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68121b-c920-4ce1-85cf-26b737fb3e79 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:17.093275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68121b-c920-4ce1-85cf-26b737fb3e79 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:17.093581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68121b-c920-4ce1-85cf-26b737fb3e79 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:17.095833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1b68121b-c920-4ce1-85cf-26b737fb3e79 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-1b68121b-c920-4ce1-85cf-26b737fb3e79 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 07 22:06:17.109082 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.check_revocation(token) May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 07 22:06:17.110022 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 07 22:06:17.111035 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:06:17.111035 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:06:17.111035 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 07 22:06:17.111035 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 07 22:06:17.111035 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 07 22:06:17.111035 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:06:17.111035 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3001/5981] 10.222.0.32 () {56 vars in 1262 bytes} [Sat May 7 22:06:17 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 07 22:06:17.116514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:17.200976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215fb03-ac07-43a4-be6e-072155f8c919 tempest-TokensV3Test-755133571 tempest-TokensV3Test-755133571-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:17.208145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:17.209026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:17.209802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:17.210243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] PATH_INFO: `/v3/users/dbb5edaafadf4dec84ce55a98cc24347` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:17.218591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb5edaafadf4dec84ce55a98cc24347)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:17.220620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:17.273528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb5edaafadf4dec84ce55a98cc24347'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:17.283587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb5edaafadf4dec84ce55a98cc24347'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:17.287252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb5edaafadf4dec84ce55a98cc24347'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:17.288248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb5edaafadf4dec84ce55a98cc24347'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:17.299633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb5edaafadf4dec84ce55a98cc24347'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:17.330601 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2981/5982] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:17 2022] DELETE /identity/v3/users/dbb5edaafadf4dec84ce55a98cc24347 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:17.335144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:17.335441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:17.335753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:17.355531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:17.356757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:17.436853 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3002/5983] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:17.445441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:17.446953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:17.528875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e436-3485-4cd0-a5df-fce8cb1b6002 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:17.534015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fa64e-7179-4a23-a73c-7122628c56b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:17.534827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa64e-7179-4a23-a73c-7122628c56b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:17.535112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa64e-7179-4a23-a73c-7122628c56b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:17.535399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa64e-7179-4a23-a73c-7122628c56b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:17.545945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fa64e-7179-4a23-a73c-7122628c56b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:17.548009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fa64e-7179-4a23-a73c-7122628c56b2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:17.558622 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2982/5984] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:18.004192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.005795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.019800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db37ba-8bc7-44e8-b8aa-73ad4b12a963 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.025671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.026540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.027023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.027483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] PATH_INFO: `/v3/projects/38c013c728684047854fe897e588eda8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.029139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c013c728684047854fe897e588eda8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.031960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.092522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c013c728684047854fe897e588eda8', 'request_id': 'req-fd00c460-e684-41a0-b1c1-8da6ff983d1c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.099806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c013c728684047854fe897e588eda8', 'request_id': 'req-fd00c460-e684-41a0-b1c1-8da6ff983d1c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.110714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c013c728684047854fe897e588eda8', 'request_id': 'req-fd00c460-e684-41a0-b1c1-8da6ff983d1c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.122646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] The token cache is being invalidate because project 38c013c728684047854fe897e588eda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:18.130710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.130710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fd00c460-e684-41a0-b1c1-8da6ff983d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.130710 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3003/5985] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:18 2022] DELETE /identity/v3/projects/38c013c728684047854fe897e588eda8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:18.132507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c636b2a-9db9-4159-8788-3c4a7754475c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.132961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c636b2a-9db9-4159-8788-3c4a7754475c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.133309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c636b2a-9db9-4159-8788-3c4a7754475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.162012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0c636b2a-9db9-4159-8788-3c4a7754475c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:18.163256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0c636b2a-9db9-4159-8788-3c4a7754475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.227436 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2983/5986] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:18.236618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7ab1-252f-49a4-8fd8-46bbc2190952 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.236914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7ab1-252f-49a4-8fd8-46bbc2190952 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.237201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f7ab1-252f-49a4-8fd8-46bbc2190952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.260452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bf0f7ab1-252f-49a4-8fd8-46bbc2190952 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:18.263056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bf0f7ab1-252f-49a4-8fd8-46bbc2190952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.273526 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3004/5987] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:18.277712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c636b2a-9db9-4159-8788-3c4a7754475c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.288427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c636b2a-9db9-4159-8788-3c4a7754475c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.293228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.293934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.294224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.294501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.295429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:18.295740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.297400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.313040 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2984/5988] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:18.314327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f7ab1-252f-49a4-8fd8-46bbc2190952 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.335959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f7ab1-252f-49a4-8fd8-46bbc2190952 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.342007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.342892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.343096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.343528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.346869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.347122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.380566 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3005/5989] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:18 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:18.384684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.396468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77729f8-16f3-4ea7-8660-52ad1402cf22 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.492564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.493302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.493476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.493781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.494557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.496663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.521058 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2985/5990] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:18 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:18.525166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.537004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406089f-d42e-445b-8e04-99638c3a0b27 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.545196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.546313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.546837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.547276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.548942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.550718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.564651 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3006/5991] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:18.568408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.586395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155b02-03f2-48c3-aa4c-0594d71f60c4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.602101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.603476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.604175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.604461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.604738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.605473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.607158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.607578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.633798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47cfb-75bb-4bd1-81fa-3ee6d45c793b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.640099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2986/5992] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:18.644575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.644839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.645712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.652515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.653064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] PATH_INFO: `/v3/users/5c4c90465a92429091a414daf917d8a6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.655865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4c90465a92429091a414daf917d8a6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.658307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.660408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afa692-9188-4a29-8264-27b90a996cee admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:18.667475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963759ae-e268-45a4-8de5-ad36020bc66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:18.668564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963759ae-e268-45a4-8de5-ad36020bc66b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.668829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963759ae-e268-45a4-8de5-ad36020bc66b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.669108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963759ae-e268-45a4-8de5-ad36020bc66b admin admin] PATH_INFO: `/v3/projects/66348bef44fa488f834375fa96127ac9/users/776362ac4de7439b92df1d7d1622e1c8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.689065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963759ae-e268-45a4-8de5-ad36020bc66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66348bef44fa488f834375fa96127ac9, user_id=776362ac4de7439b92df1d7d1622e1c8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:18.692078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963759ae-e268-45a4-8de5-ad36020bc66b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:18.718847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2987/5993] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:18 2022] PUT /identity/v3/projects/66348bef44fa488f834375fa96127ac9/users/776362ac4de7439b92df1d7d1622e1c8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:18.730129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.730433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.730741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.749196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4c90465a92429091a414daf917d8a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.751078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4c90465a92429091a414daf917d8a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.768892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4c90465a92429091a414daf917d8a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.770986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4c90465a92429091a414daf917d8a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.795112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e161419e-8a07-4069-9f00-b1be4429bcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4c90465a92429091a414daf917d8a6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:18.799754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] MFA Rules not processed for user `776362ac4de7439b92df1d7d1622e1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:18.802081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.869810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3007/5994] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:18 2022] DELETE /identity/v3/users/5c4c90465a92429091a414daf917d8a6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:18.874421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:18.875454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:18.875812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:18.896042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2988/5995] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:18.897669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:18.899639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.908550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.910469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.979525 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3008/5996] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:18.990819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:18.993764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:18.998845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a9ee6-b4f1-4f49-93a7-17335647916b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.074010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.074862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.075193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.075542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.088836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440132f8-9656-4483-80ee-2e8b1275cf52 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.093189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.093837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.094116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.094392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.104010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.105450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.115909 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3009/5997] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:19.121711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.123073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.134448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.135962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.146185 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2989/5998] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:19.147059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.148384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.164022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49183e63-4cd7-4a0d-a978-31db9a6a9760 service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.171632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.172936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.173685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.173685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] PATH_INFO: `/v3/users/5a10315c2f674a3a966ad0b7cd6c97b8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.175495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a10315c2f674a3a966ad0b7cd6c97b8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.179621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.238128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cd63c-b525-4b85-abd8-f51c5fb5bfbb service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.246374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.247285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.247626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a10315c2f674a3a966ad0b7cd6c97b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.247913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.248352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.250688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.256961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a10315c2f674a3a966ad0b7cd6c97b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.257793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a10315c2f674a3a966ad0b7cd6c97b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.258782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a10315c2f674a3a966ad0b7cd6c97b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.270164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-235f2236-3841-4674-b36c-96664dcb307a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a10315c2f674a3a966ad0b7cd6c97b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.290814 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2990/5999] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:19 2022] DELETE /identity/v3/users/5a10315c2f674a3a966ad0b7cd6c97b8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:19.294577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.295337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.295337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.319657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:19.320887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.339422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.341182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.373502 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3010/6000] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:19.374476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.376606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.391905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086b7cc-619f-4d4b-803b-af12549c55f8 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.450538 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2991/6001] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:19.460432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.462558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.480563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.481489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.481780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.482177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] PATH_INFO: `/v3/projects/ce437da8ed074d9abe878fd4db8d1783` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.483645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce437da8ed074d9abe878fd4db8d1783)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.485617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.547620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd7ba1-926b-4e17-8081-d3dc640e9044 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.547812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce437da8ed074d9abe878fd4db8d1783', 'request_id': 'req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.558283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce437da8ed074d9abe878fd4db8d1783', 'request_id': 'req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.568089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce437da8ed074d9abe878fd4db8d1783', 'request_id': 'req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.581886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] The token cache is being invalidate because project ce437da8ed074d9abe878fd4db8d1783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:19.581886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.582602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.585229 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3011/6002] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:19 2022] DELETE /identity/v3/projects/ce437da8ed074d9abe878fd4db8d1783 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:19.586764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.588483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.603986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.604648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.605044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.605322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.608215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.666321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49db19-de8a-4e6f-b206-1c6c58f9a63a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.673152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.674446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.675021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.675448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] PATH_INFO: `/v3/users/776362ac4de7439b92df1d7d1622e1c8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.681438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.683415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.684795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776362ac4de7439b92df1d7d1622e1c8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.688019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.696711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2992/6003] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:19.698545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.705096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.724137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacafb1-70d4-4bfc-85ab-0947b063d60d service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:19.739552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:19.741206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.743746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.743746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] PATH_INFO: `/v3/users/21a4e6cd9d7e4e4da8a70018d9589057` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.745838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a4e6cd9d7e4e4da8a70018d9589057)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:19.748368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:19.760860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776362ac4de7439b92df1d7d1622e1c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.761608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776362ac4de7439b92df1d7d1622e1c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.770428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776362ac4de7439b92df1d7d1622e1c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.771643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776362ac4de7439b92df1d7d1622e1c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.782150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-daa451fa-db11-479d-97bf-9d414a983d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776362ac4de7439b92df1d7d1622e1c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.806623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3012/6004] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:19 2022] DELETE /identity/v3/users/776362ac4de7439b92df1d7d1622e1c8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:19.811645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:19.812743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:19.813589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:19.819245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a4e6cd9d7e4e4da8a70018d9589057'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.839143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:19.840576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a4e6cd9d7e4e4da8a70018d9589057'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.840915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.841409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a4e6cd9d7e4e4da8a70018d9589057'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.842118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a4e6cd9d7e4e4da8a70018d9589057'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.854439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a4e6cd9d7e4e4da8a70018d9589057'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:19.876480 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2993/6005] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:19 2022] DELETE /identity/v3/users/21a4e6cd9d7e4e4da8a70018d9589057 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:19.936005 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3013/6006] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:19.949271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.951342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.965778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:19.967308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:19.982795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654e0e-88a5-4905-9bf8-8fce22fef755 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.044663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee78065-80d4-4920-a092-8914d91c5a50 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.050564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.051266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.051555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.051984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.063492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.064454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.064939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.065301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] PATH_INFO: `/v3/projects/300defb645794c6fac3ab824a1aeb2af` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.066746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300defb645794c6fac3ab824a1aeb2af)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.069218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.128784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.130704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.141824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2994/6007] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:20.143433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.143632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300defb645794c6fac3ab824a1aeb2af', 'request_id': 'req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.145515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.151922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300defb645794c6fac3ab824a1aeb2af', 'request_id': 'req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.160626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee93225-35bf-4303-b448-8fc913dd5f5b service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.162514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300defb645794c6fac3ab824a1aeb2af', 'request_id': 'req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.174875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] The token cache is being invalidate because project 300defb645794c6fac3ab824a1aeb2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:20.175701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.177404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74b9af86-e098-4d33-a412-b1aa1c8ec5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.181692 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3014/6008] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:19 2022] DELETE /identity/v3/projects/300defb645794c6fac3ab824a1aeb2af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:20.186664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59499af-97d6-41c1-832f-756bf7a26223 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.187109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59499af-97d6-41c1-832f-756bf7a26223 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.187490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59499af-97d6-41c1-832f-756bf7a26223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.207649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f59499af-97d6-41c1-832f-756bf7a26223 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:20.208993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f59499af-97d6-41c1-832f-756bf7a26223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.225868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.226924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.227212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.227494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] PATH_INFO: `/v3/projects/fa4a04f1cd3f45aaa34d35d5d2c208ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.228729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4a04f1cd3f45aaa34d35d5d2c208ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.230682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.289704 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3015/6009] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:20.289907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4a04f1cd3f45aaa34d35d5d2c208ca', 'request_id': 'req-7e6daa69-8977-4ec3-84f5-f00c9eac078a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.291085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4a04f1cd3f45aaa34d35d5d2c208ca', 'request_id': 'req-7e6daa69-8977-4ec3-84f5-f00c9eac078a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.291884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18cdda-b03e-4034-b740-e901aeb04b6b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.292183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18cdda-b03e-4034-b740-e901aeb04b6b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.292603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18cdda-b03e-4034-b740-e901aeb04b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.300137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4a04f1cd3f45aaa34d35d5d2c208ca', 'request_id': 'req-7e6daa69-8977-4ec3-84f5-f00c9eac078a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.312115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] The token cache is being invalidate because project fa4a04f1cd3f45aaa34d35d5d2c208ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:20.312651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.313371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7e6daa69-8977-4ec3-84f5-f00c9eac078a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.314624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8a18cdda-b03e-4034-b740-e901aeb04b6b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:20.319833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a18cdda-b03e-4034-b740-e901aeb04b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.320001 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2995/6010] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:20 2022] DELETE /identity/v3/projects/fa4a04f1cd3f45aaa34d35d5d2c208ca => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:20.321363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3981f-64d9-4600-9bcf-c7b5457dac1d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.322017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3981f-64d9-4600-9bcf-c7b5457dac1d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.322017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3981f-64d9-4600-9bcf-c7b5457dac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.341989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f9e3981f-64d9-4600-9bcf-c7b5457dac1d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:20.344385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f9e3981f-64d9-4600-9bcf-c7b5457dac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.388598 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3016/6011] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:20.392905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18cdda-b03e-4034-b740-e901aeb04b6b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.404049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18cdda-b03e-4034-b740-e901aeb04b6b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.409664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.410467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.411029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.411402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.412288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:20.412706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.414806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.431356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3017/6012] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:20.433034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.438909 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2996/6013] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:20.441789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6509716-46b1-4d80-ba9a-3b7d28a1e604 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.442083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6509716-46b1-4d80-ba9a-3b7d28a1e604 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.442369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6509716-46b1-4d80-ba9a-3b7d28a1e604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.444086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c52d-e2d8-4efa-82c5-b5f02f66d32e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.449770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.450870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.450870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.451416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.453271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.455846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.462932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a6509716-46b1-4d80-ba9a-3b7d28a1e604 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:20.464617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a6509716-46b1-4d80-ba9a-3b7d28a1e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.475857 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2997/6014] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:20.478360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6509716-46b1-4d80-ba9a-3b7d28a1e604 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.488441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6509716-46b1-4d80-ba9a-3b7d28a1e604 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.490947 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3018/6015] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:20.492380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.552974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.553650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.553938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.554976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.555712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:20.556025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.557649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.565772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c91e2-29eb-4cf7-8917-28689630313e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.569263 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2998/6016] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:06:20.570963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.571631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.571915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.572191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.572414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.572966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.574207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.574942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.588385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188ffc9-b5ff-4bf4-b033-3628bc07344c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.594803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.595689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.596145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.596488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] PATH_INFO: `/v3/projects/66348bef44fa488f834375fa96127ac9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.597800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=66348bef44fa488f834375fa96127ac9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.598522 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3019/6017] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:20.599447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.599797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.609298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351753a-fa78-4b95-851d-ba9634fb816f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.614010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.614721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.615035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.615315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.615995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.617895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.644282 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3020/6018] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:20.645871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.648425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66348bef44fa488f834375fa96127ac9', 'request_id': 'req-41390a6f-566b-4258-b72c-a0e6a8a3d69d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.655089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66348bef44fa488f834375fa96127ac9', 'request_id': 'req-41390a6f-566b-4258-b72c-a0e6a8a3d69d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.664071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66348bef44fa488f834375fa96127ac9', 'request_id': 'req-41390a6f-566b-4258-b72c-a0e6a8a3d69d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.674763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] The token cache is being invalidate because project 66348bef44fa488f834375fa96127ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:20.675352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.676007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:20.678573 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 2999/6019] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:20 2022] DELETE /identity/v3/projects/66348bef44fa488f834375fa96127ac9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:20.679468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.680723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.712922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9966-71af-497a-b5f9-dba40ff3e97c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.717702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d8ece-bef5-4418-b7bd-8a1449d102f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.718928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d8ece-bef5-4418-b7bd-8a1449d102f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.719236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d8ece-bef5-4418-b7bd-8a1449d102f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.719710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d8ece-bef5-4418-b7bd-8a1449d102f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.720439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d8ece-bef5-4418-b7bd-8a1449d102f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.722055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d8ece-bef5-4418-b7bd-8a1449d102f9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.731704 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3021/6020] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:20.732902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.733437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.733437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.745107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41390a6f-566b-4258-b72c-a0e6a8a3d69d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.751392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f289e6c-fad7-4150-88a3-e64382cf773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.752160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289e6c-fad7-4150-88a3-e64382cf773e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.752469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289e6c-fad7-4150-88a3-e64382cf773e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.752753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f289e6c-fad7-4150-88a3-e64382cf773e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.753389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:20.753591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f289e6c-fad7-4150-88a3-e64382cf773e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.754632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.755711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f289e6c-fad7-4150-88a3-e64382cf773e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.764075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3022/6021] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:20.764883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.771948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.784466 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3000/6022] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:20.785129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd4627-1df6-4c00-9718-21b76a025f17 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.786093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44ef27-7bc5-49cd-90f2-8f52a14a20aa None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.786386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44ef27-7bc5-49cd-90f2-8f52a14a20aa None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.786853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44ef27-7bc5-49cd-90f2-8f52a14a20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.792247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.793033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.793482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.793857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.794744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.796503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.805217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6b44ef27-7bc5-49cd-90f2-8f52a14a20aa None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:20.806462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b44ef27-7bc5-49cd-90f2-8f52a14a20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.811851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3023/6023] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:20.811851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.821029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d586b-99a8-4826-a86f-39b5952ce1cf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.824480 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3001/6024] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:20.824480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44ef27-7bc5-49cd-90f2-8f52a14a20aa None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.829176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.829943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.830298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.830734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.831720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.833606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.835097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44ef27-7bc5-49cd-90f2-8f52a14a20aa None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.841406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.842285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.842569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.842874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] PATH_INFO: `/v3/projects/d26a7d8e07ba4e6686b20931dffd92a5/users/86b1a4ba3b494ee38061ddad96c74620/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.844477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3024/6025] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:20.845510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.855824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97509-ccf3-40f8-a804-034677e0e5b9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.858686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26a7d8e07ba4e6686b20931dffd92a5, user_id=86b1a4ba3b494ee38061ddad96c74620, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.860500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.861150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.861435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.861710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.861928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.862425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:20.862730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.864603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.878113 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3025/6026] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:20.878891 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3002/6027] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:20 2022] PUT /identity/v3/projects/d26a7d8e07ba4e6686b20931dffd92a5/users/86b1a4ba3b494ee38061ddad96c74620/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:20.879343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.883962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.889507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3093-712d-4b54-a88d-a44d9b750ccb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.946276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c3e4-a827-40ba-9ae0-dfe1cb563bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.947123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c3e4-a827-40ba-9ae0-dfe1cb563bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.947689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c3e4-a827-40ba-9ae0-dfe1cb563bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.947819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c3e4-a827-40ba-9ae0-dfe1cb563bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.948163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bef4fc-12e5-4f8d-9389-e43374350dfb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:20.948637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c3e4-a827-40ba-9ae0-dfe1cb563bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.950350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c3e4-a827-40ba-9ae0-dfe1cb563bb0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.954505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:20.955359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.955651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.956000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.956764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:20.959459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:20.962129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3026/6028] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:20.963446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f52c-6a6d-46f2-8c60-2e6b0114cd3c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:20.963738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f52c-6a6d-46f2-8c60-2e6b0114cd3c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:20.964017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f52c-6a6d-46f2-8c60-2e6b0114cd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:20.983122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e544f52c-6a6d-46f2-8c60-2e6b0114cd3c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:20.984901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e544f52c-6a6d-46f2-8c60-2e6b0114cd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:20.993690 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3003/6029] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:20.993690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:20.996850 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3027/6030] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:20.997531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f52c-6a6d-46f2-8c60-2e6b0114cd3c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.014545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f52c-6a6d-46f2-8c60-2e6b0114cd3c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.067181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acd934-edb9-4278-aac9-3001e29dff53 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.072973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.073968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.074195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.074470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] PATH_INFO: `/v3/projects/2449f72b9a5c40b29a5d792bc609e239/users/50f9e5d13f0f4fcc8dd2c0a6fdffa417/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.082860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.084066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.084066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.084464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.085050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.087733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.090704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2449f72b9a5c40b29a5d792bc609e239, user_id=50f9e5d13f0f4fcc8dd2c0a6fdffa417, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.095009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.119378 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3028/6031] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:20 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:21.120431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.122522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:21.127537 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3004/6032] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:20 2022] PUT /identity/v3/projects/2449f72b9a5c40b29a5d792bc609e239/users/50f9e5d13f0f4fcc8dd2c0a6fdffa417/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:21.129238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.197324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a23a3-42d9-4576-b4a4-e26e5a0624a5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.206889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9bdb9e-127c-4ca4-a4a0-d41468e135f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.212669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d8cdd-a900-4aea-8451-f001be901629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.213343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d8cdd-a900-4aea-8451-f001be901629 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.213623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d8cdd-a900-4aea-8451-f001be901629 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.213894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d8cdd-a900-4aea-8451-f001be901629 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.214612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d8cdd-a900-4aea-8451-f001be901629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.216255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d8cdd-a900-4aea-8451-f001be901629 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.229887 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3005/6033] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:21.229887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ffb6-148d-44a1-9316-12100312716c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.229887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ffb6-148d-44a1-9316-12100312716c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.229887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ffb6-148d-44a1-9316-12100312716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.254338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.255044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.255327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.255602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.257210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9bc4ffb6-148d-44a1-9316-12100312716c None None] MFA Rules not processed for user `50f9e5d13f0f4fcc8dd2c0a6fdffa417`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:21.258657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9bc4ffb6-148d-44a1-9316-12100312716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:21.266301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.267820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.279073 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3029/6034] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:21.280723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.293622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95470211-4275-4bb7-95e5-1d90aba540bf service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.299021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.299852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.300101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.300606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.301354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.303172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.317692 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3030/6035] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:21.319819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.332181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54575083-9c0e-4370-9b60-cb3c8ed7f54e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.338075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb716d9-c8c3-4729-869f-a94797674b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.339403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb716d9-c8c3-4729-869f-a94797674b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.339738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb716d9-c8c3-4729-869f-a94797674b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.339859 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3006/6036] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:21.340362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb716d9-c8c3-4729-869f-a94797674b5d admin admin] PATH_INFO: `/v3/projects/aee95122df834bf98c0def46b9b7ef1c/users/03ee2bf6dc494fa1bac20a3a8d147534/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.345256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4ffb6-148d-44a1-9316-12100312716c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.356697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4ffb6-148d-44a1-9316-12100312716c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.361547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb716d9-c8c3-4729-869f-a94797674b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee95122df834bf98c0def46b9b7ef1c, user_id=03ee2bf6dc494fa1bac20a3a8d147534, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.365128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.365848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb716d9-c8c3-4729-869f-a94797674b5d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.365975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.366421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.366834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.367646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.370640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.385005 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3031/6037] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:21 2022] PUT /identity/v3/projects/aee95122df834bf98c0def46b9b7ef1c/users/03ee2bf6dc494fa1bac20a3a8d147534/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:21.396343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b39a-1e63-457c-a10b-877455265255 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.396739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b39a-1e63-457c-a10b-877455265255 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.397520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b39a-1e63-457c-a10b-877455265255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.411092 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3007/6038] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:21 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:21.418400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.438158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-54f9b39a-1e63-457c-a10b-877455265255 None None] MFA Rules not processed for user `03ee2bf6dc494fa1bac20a3a8d147534`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:21.440318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54f9b39a-1e63-457c-a10b-877455265255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:21.515923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6c3eb-0c20-4498-bed5-23233c373670 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.528030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.530374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.531542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.532637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.535713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.540772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.544818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3032/6039] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:21.548699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b39a-1e63-457c-a10b-877455265255 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.562576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b39a-1e63-457c-a10b-877455265255 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.571441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.572000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.572307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.574915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.575035 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3008/6040] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:21 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:21.575133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.575325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.577002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.589481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b9e93-a225-44d7-ac5f-ff5ee28e24d0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.596031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.596749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.597037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.597317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.598047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.600194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.613995 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3009/6041] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:21.618933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.636856 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3033/6042] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:21 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:21.639549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132645d-3685-4d46-838c-7a6150a3deaa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.641557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.737835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2340e-e18a-4f66-9c00-1ead7056c50d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.743022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.743502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.744139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.744139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.744359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.744450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.744665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.744921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.745028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] PATH_INFO: `/v3/projects/17cfc6fd78b745da8412e7e15d557cc0/users/14d1860f410c46438c8807061b10f9ab/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.747548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.772037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17cfc6fd78b745da8412e7e15d557cc0, user_id=14d1860f410c46438c8807061b10f9ab, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.775034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.785962 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3034/6043] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:21 2022] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:21.787519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.795951 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3010/6044] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:21 2022] PUT /identity/v3/projects/17cfc6fd78b745da8412e7e15d557cc0/users/14d1860f410c46438c8807061b10f9ab/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:21.800001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.811267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530f38-d45a-4f90-a229-68d46ee9325b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.897820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.898497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.898802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.899148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.899993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.902250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.916101 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3035/6045] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:21.916288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962dd0bd-93d6-4f53-8aa3-65a7a361b35c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.917544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.923620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.924576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.925004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.925467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.926201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.928120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.929541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c2972-2e8f-4f36-9047-d3dee5b82622 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.935283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.936379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.936697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.936947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] PATH_INFO: `/v3/projects/63879c14ac6945e7abeec4d2d8ea6dfc/users/dd658e2f63414e81866491e16e2f13ea/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.941437 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3011/6046] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:21.945370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.956409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374d521-d585-4152-bf34-30c2f6bcff73 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:21.957238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63879c14ac6945e7abeec4d2d8ea6dfc, user_id=dd658e2f63414e81866491e16e2f13ea, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.960047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.962404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600d0a6-c0f7-4982-aae0-38777b66a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:21.964218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600d0a6-c0f7-4982-aae0-38777b66a026 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.964762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600d0a6-c0f7-4982-aae0-38777b66a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.965092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600d0a6-c0f7-4982-aae0-38777b66a026 admin admin] PATH_INFO: `/v3/projects/17cfc6fd78b745da8412e7e15d557cc0/users/14d1860f410c46438c8807061b10f9ab/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:21.967573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600d0a6-c0f7-4982-aae0-38777b66a026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17cfc6fd78b745da8412e7e15d557cc0, user_id=14d1860f410c46438c8807061b10f9ab, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:21.971256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600d0a6-c0f7-4982-aae0-38777b66a026 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:21.977501 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3036/6047] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:21 2022] PUT /identity/v3/projects/63879c14ac6945e7abeec4d2d8ea6dfc/users/dd658e2f63414e81866491e16e2f13ea/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:21.981180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:21.985649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3012/6048] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:21 2022] PUT /identity/v3/projects/17cfc6fd78b745da8412e7e15d557cc0/users/14d1860f410c46438c8807061b10f9ab/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:21.996216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc81d-32c8-4a99-ab84-ecd936462f59 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:21.996590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc81d-32c8-4a99-ab84-ecd936462f59 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:21.996964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cc81d-32c8-4a99-ab84-ecd936462f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.038921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3c9cc81d-32c8-4a99-ab84-ecd936462f59 None None] MFA Rules not processed for user `14d1860f410c46438c8807061b10f9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:22.047469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3c9cc81d-32c8-4a99-ab84-ecd936462f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:22.065949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa05b9-e82f-4c62-abfa-b54d380f608b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.166294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.167173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.167462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.167741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.168522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.170344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.171290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3013/6049] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:22.175587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352290-8d0c-458a-9603-1b28c5487bfb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.175587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352290-8d0c-458a-9603-1b28c5487bfb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.175587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce352290-8d0c-458a-9603-1b28c5487bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.183186 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3037/6050] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:22.184380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.219043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ce352290-8d0c-458a-9603-1b28c5487bfb None None] MFA Rules not processed for user `86b1a4ba3b494ee38061ddad96c74620`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:22.220874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ce352290-8d0c-458a-9603-1b28c5487bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:22.262616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed09748-dbd3-4576-8097-6042b85fab1d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.267991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.268817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.269269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.269550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.279818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.281850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.291960 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3038/6051] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:22.293111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.297833 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3014/6052] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:22.302437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce352290-8d0c-458a-9603-1b28c5487bfb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.303821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae7bf3-ac62-421a-a241-1d2294e77be1 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.313095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd194-61da-4aa2-92ae-64c56776ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.315460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd194-61da-4aa2-92ae-64c56776ec11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.316190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd194-61da-4aa2-92ae-64c56776ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.317569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd194-61da-4aa2-92ae-64c56776ec11 admin admin] PATH_INFO: `/v3/projects/63879c14ac6945e7abeec4d2d8ea6dfc/users/dd658e2f63414e81866491e16e2f13ea/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.320744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd194-61da-4aa2-92ae-64c56776ec11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63879c14ac6945e7abeec4d2d8ea6dfc, user_id=dd658e2f63414e81866491e16e2f13ea, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.321706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce352290-8d0c-458a-9603-1b28c5487bfb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.324580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd194-61da-4aa2-92ae-64c56776ec11 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.333773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.334460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.334869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.335056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.335761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.337703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.342868 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3039/6053] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:22 2022] PUT /identity/v3/projects/63879c14ac6945e7abeec4d2d8ea6dfc/users/dd658e2f63414e81866491e16e2f13ea/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:22.351532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b4d0-2261-4f87-9ed0-80dee319448f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.351818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b4d0-2261-4f87-9ed0-80dee319448f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.352096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594b4d0-2261-4f87-9ed0-80dee319448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.369865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3015/6054] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:22 2022] POST /identity/v3/projects => generated 403 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:22.373499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.387457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6594b4d0-2261-4f87-9ed0-80dee319448f None None] MFA Rules not processed for user `dd658e2f63414e81866491e16e2f13ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:22.388668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6594b4d0-2261-4f87-9ed0-80dee319448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:22.448299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c88a7-68ae-49d4-8249-d17df5f3a7f7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.453446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.454126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.454415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.454790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.456873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.458867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.477318 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3040/6055] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:22.484536 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3016/6056] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:22 2022] POST /identity/v3/users => generated 308 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:22.488186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594b4d0-2261-4f87-9ed0-80dee319448f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.489372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.492036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:22.499514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594b4d0-2261-4f87-9ed0-80dee319448f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.505232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.505912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.506321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.506623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.507463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.509090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.523179 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3041/6057] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:22.526998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.542326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eef4e8-f943-40fc-9d8b-36fa1ccd1479 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.549804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.550717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.551123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.551474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] PATH_INFO: `/v3/projects/b7f022098c264aab916aa3633fbe7b20/users/32801a94897b4c9d83a1d193d321a9bb/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.578299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f022098c264aab916aa3633fbe7b20, user_id=32801a94897b4c9d83a1d193d321a9bb, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.581930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.582243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6280-9247-4094-857f-507a7daa3943 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.588381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.589418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.589821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.590194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.602929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.604811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.607330 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3042/6058] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:22 2022] PUT /identity/v3/projects/b7f022098c264aab916aa3633fbe7b20/users/32801a94897b4c9d83a1d193d321a9bb/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:22.608515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.619467 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3017/6059] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:22.687109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fc0ec-1a79-4d46-9b30-c008c7a9725a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.693647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc228025-28b8-4166-a51d-4841566e2f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.694546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc228025-28b8-4166-a51d-4841566e2f82 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.695073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc228025-28b8-4166-a51d-4841566e2f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.695505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc228025-28b8-4166-a51d-4841566e2f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.703520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc228025-28b8-4166-a51d-4841566e2f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.706888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc228025-28b8-4166-a51d-4841566e2f82 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.739580 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3043/6060] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:22.740686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:22.752877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b81252-dbef-4d09-8e7d-0b71a2a1891a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:22.758074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:22.759027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:22.759299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:22.759578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] PATH_INFO: `/v3/projects/b7f022098c264aab916aa3633fbe7b20/users/32801a94897b4c9d83a1d193d321a9bb/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:22.761874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f022098c264aab916aa3633fbe7b20, user_id=32801a94897b4c9d83a1d193d321a9bb, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:22.764622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:22.780214 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3018/6061] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:22 2022] PUT /identity/v3/projects/b7f022098c264aab916aa3633fbe7b20/users/32801a94897b4c9d83a1d193d321a9bb/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:24.474347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3842b-598f-4e5d-8f0f-18182e1012ec None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:24.474941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3842b-598f-4e5d-8f0f-18182e1012ec None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:24.474941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3842b-598f-4e5d-8f0f-18182e1012ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:24.511996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bcb3842b-598f-4e5d-8f0f-18182e1012ec None None] MFA Rules not processed for user `32801a94897b4c9d83a1d193d321a9bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:24.514083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bcb3842b-598f-4e5d-8f0f-18182e1012ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:24.643022 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3044/6062] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:25.319803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:25.432009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10cc58-4e26-4d7b-9dc5-caef67347c23 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:25.437802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:25.438678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:25.439011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:25.439292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] PATH_INFO: `/v3/users/03ee2bf6dc494fa1bac20a3a8d147534` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:25.440495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ee2bf6dc494fa1bac20a3a8d147534)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:25.442494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:25.497998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ee2bf6dc494fa1bac20a3a8d147534'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:25.508053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ee2bf6dc494fa1bac20a3a8d147534'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:25.509936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ee2bf6dc494fa1bac20a3a8d147534'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:25.511007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ee2bf6dc494fa1bac20a3a8d147534'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:25.520600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ee2bf6dc494fa1bac20a3a8d147534'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:25.540139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3019/6063] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:25 2022] DELETE /identity/v3/users/03ee2bf6dc494fa1bac20a3a8d147534 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:25.544895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:25.545421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:25.545646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:25.565599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:25.567392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:25.644270 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3045/6064] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:25.654191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:25.655850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:25.732927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275f310-01a5-412e-a0b6-9f9f52908d1c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:25.737465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:25.738338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:25.738725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:25.739141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:25.749382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:25.751510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:25.762226 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3020/6065] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:26.141987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:26.145869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:26.166542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c79a0d-9b47-4207-a079-9ba13f9263b9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:26.175153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:26.176191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:26.176577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:26.177118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] PATH_INFO: `/v3/users/86b1a4ba3b494ee38061ddad96c74620` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:26.178528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b1a4ba3b494ee38061ddad96c74620)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:26.181264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:26.236910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b1a4ba3b494ee38061ddad96c74620'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.237580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b1a4ba3b494ee38061ddad96c74620'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.246645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b1a4ba3b494ee38061ddad96c74620'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.247711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b1a4ba3b494ee38061ddad96c74620'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.262919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b1a4ba3b494ee38061ddad96c74620'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.288447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3046/6066] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:26 2022] DELETE /identity/v3/users/86b1a4ba3b494ee38061ddad96c74620 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:26.315235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:26.317756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:26.331455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ac3fe-e0d7-4b5f-960b-263d5d87777e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:26.394286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:26.395253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:26.395549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:26.395830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] PATH_INFO: `/v3/projects/aee95122df834bf98c0def46b9b7ef1c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:26.397063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee95122df834bf98c0def46b9b7ef1c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:26.399123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:26.458467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee95122df834bf98c0def46b9b7ef1c', 'request_id': 'req-c88be270-4c88-47fe-b986-7059b79da541'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.467014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee95122df834bf98c0def46b9b7ef1c', 'request_id': 'req-c88be270-4c88-47fe-b986-7059b79da541'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.476112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee95122df834bf98c0def46b9b7ef1c', 'request_id': 'req-c88be270-4c88-47fe-b986-7059b79da541'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.488004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] The token cache is being invalidate because project aee95122df834bf98c0def46b9b7ef1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:26.488379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.489603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.491287 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3021/6067] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:26 2022] DELETE /identity/v3/projects/aee95122df834bf98c0def46b9b7ef1c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:26.495601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:26.497496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:26.518366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0585245-d8b0-40ce-86d4-5a27e5d3862c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:26.527155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:26.528788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:26.607396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:26.608350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:26.608644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:26.608943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] PATH_INFO: `/v3/users/dd658e2f63414e81866491e16e2f13ea` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:26.610224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd658e2f63414e81866491e16e2f13ea)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:26.612904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:26.627091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88be270-4c88-47fe-b986-7059b79da541 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:26.633287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:26.634324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:26.634688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:26.635064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] PATH_INFO: `/v3/projects/d26a7d8e07ba4e6686b20931dffd92a5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:26.636317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26a7d8e07ba4e6686b20931dffd92a5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:26.638300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:26.677655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd658e2f63414e81866491e16e2f13ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.678502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd658e2f63414e81866491e16e2f13ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.690762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd658e2f63414e81866491e16e2f13ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.691886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd658e2f63414e81866491e16e2f13ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.704845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd658e2f63414e81866491e16e2f13ea'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.708200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26a7d8e07ba4e6686b20931dffd92a5', 'request_id': 'req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.714711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26a7d8e07ba4e6686b20931dffd92a5', 'request_id': 'req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.723892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26a7d8e07ba4e6686b20931dffd92a5', 'request_id': 'req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.724752 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3047/6068] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:26 2022] DELETE /identity/v3/users/dd658e2f63414e81866491e16e2f13ea => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:26.742698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] The token cache is being invalidate because project d26a7d8e07ba4e6686b20931dffd92a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:26.743472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.743700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.745896 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3022/6069] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:26 2022] DELETE /identity/v3/projects/d26a7d8e07ba4e6686b20931dffd92a5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:26.749684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:26.751272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:26.832747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f82c6-3626-4b1f-a1b3-edd918ae87d3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:26.838852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:26.839810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:26.840644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:26.840931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] PATH_INFO: `/v3/users/32801a94897b4c9d83a1d193d321a9bb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:26.842209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=32801a94897b4c9d83a1d193d321a9bb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:26.844421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:26.903156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32801a94897b4c9d83a1d193d321a9bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.904061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32801a94897b4c9d83a1d193d321a9bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.919921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32801a94897b4c9d83a1d193d321a9bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.921731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32801a94897b4c9d83a1d193d321a9bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.938091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32801a94897b4c9d83a1d193d321a9bb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:26.969878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3048/6070] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:26 2022] DELETE /identity/v3/users/32801a94897b4c9d83a1d193d321a9bb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:27.109887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.111499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:27.191060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7ed56-03c7-4d85-b8c1-5b7c143d18ab admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.216773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.218236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:27.263142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.264073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.264362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.265748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] PATH_INFO: `/v3/projects/63879c14ac6945e7abeec4d2d8ea6dfc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.265876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63879c14ac6945e7abeec4d2d8ea6dfc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.267931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.298707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea7f18-045d-4135-a42c-8e2738d5b0fa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.305723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.307513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.307513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.307513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] PATH_INFO: `/v3/projects/b7f022098c264aab916aa3633fbe7b20` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.312457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f022098c264aab916aa3633fbe7b20)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.316107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.331934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63879c14ac6945e7abeec4d2d8ea6dfc', 'request_id': 'req-7c75c945-dfea-4897-8bd7-4ce2e0702544'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.339954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63879c14ac6945e7abeec4d2d8ea6dfc', 'request_id': 'req-7c75c945-dfea-4897-8bd7-4ce2e0702544'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.354366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63879c14ac6945e7abeec4d2d8ea6dfc', 'request_id': 'req-7c75c945-dfea-4897-8bd7-4ce2e0702544'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.364410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] The token cache is being invalidate because project 63879c14ac6945e7abeec4d2d8ea6dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:27.364751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.365420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c75c945-dfea-4897-8bd7-4ce2e0702544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.367150 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3023/6071] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:27 2022] DELETE /identity/v3/projects/63879c14ac6945e7abeec4d2d8ea6dfc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:27.371915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c22953-acd1-481a-a877-fe6bb2c049f2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.372190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c22953-acd1-481a-a877-fe6bb2c049f2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.375465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c22953-acd1-481a-a877-fe6bb2c049f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.387992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f022098c264aab916aa3633fbe7b20', 'request_id': 'req-4ffa78a1-56e2-4163-8653-619ccd3e9093'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.395122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-36c22953-acd1-481a-a877-fe6bb2c049f2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:27.395609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f022098c264aab916aa3633fbe7b20', 'request_id': 'req-4ffa78a1-56e2-4163-8653-619ccd3e9093'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.396645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-36c22953-acd1-481a-a877-fe6bb2c049f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:27.407065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f022098c264aab916aa3633fbe7b20', 'request_id': 'req-4ffa78a1-56e2-4163-8653-619ccd3e9093'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.423875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] The token cache is being invalidate because project b7f022098c264aab916aa3633fbe7b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:27.424447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.425390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ffa78a1-56e2-4163-8653-619ccd3e9093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:27.427683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3049/6072] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:27 2022] DELETE /identity/v3/projects/b7f022098c264aab916aa3633fbe7b20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:27.432485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753201c-47c5-49fa-b747-3468474de2d3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.433042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753201c-47c5-49fa-b747-3468474de2d3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.433583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753201c-47c5-49fa-b747-3468474de2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.455899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d753201c-47c5-49fa-b747-3468474de2d3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:27.457676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d753201c-47c5-49fa-b747-3468474de2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:27.487959 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3024/6073] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:27.489671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb000-38ce-415e-8809-3e55f89ef4c0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.489671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb000-38ce-415e-8809-3e55f89ef4c0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.489949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980fb000-38ce-415e-8809-3e55f89ef4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.509592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-980fb000-38ce-415e-8809-3e55f89ef4c0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:27.511458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-980fb000-38ce-415e-8809-3e55f89ef4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:27.523302 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3025/6074] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:27.524181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fb000-38ce-415e-8809-3e55f89ef4c0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.530377 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3050/6075] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:27.534747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980fb000-38ce-415e-8809-3e55f89ef4c0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.538667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2987fc-18b9-41d6-aff2-4700449d4077 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.539060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2987fc-18b9-41d6-aff2-4700449d4077 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.539452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2987fc-18b9-41d6-aff2-4700449d4077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.540132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.540871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.541154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.541431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.542169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:27.543714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.544402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.560390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cd2987fc-18b9-41d6-aff2-4700449d4077 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:27.561849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cd2987fc-18b9-41d6-aff2-4700449d4077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:27.567819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3026/6076] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:27.568869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.575857 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3051/6077] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:27.579888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2987fc-18b9-41d6-aff2-4700449d4077 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.585010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1ad6f-0af6-4a63-adcf-5862fbab9aa9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.591304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.592134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.592517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.592895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.594224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.594547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2987fc-18b9-41d6-aff2-4700449d4077 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.596410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.601391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.602577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.603041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.603469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.604353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:27.605040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.606840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.624231 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3052/6078] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:27.628404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.638827 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3027/6079] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:27.643477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.644450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac910e-3f6b-4de2-a4af-b478802ad14d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.721197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.722028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.722310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.723064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.723887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.726126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.742111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913c954-8c17-4839-aa51-83c5a3064446 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.748816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.749823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.750652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.751109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.752171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.755092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.759403 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3053/6080] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:27.761268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.788514 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3028/6081] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:27.791386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.805191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5add8-4e6b-4825-ab41-02eef0bc22a7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.844194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b04e44-dfc8-4bc5-a57f-ef7bd43511f9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.850725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.851537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.851901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.852383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.853112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.855255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.881429 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3054/6082] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:27 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:27.885788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.896043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.896776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.897068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.897473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.898245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.899898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.900364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7cd1b-5ab9-4d07-af1c-40723fe04bde admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.906978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.907947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.908334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.908612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.909797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.911596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.917395 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3029/6083] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:27.919217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.926655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3055/6084] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:27.930590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.932158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf327e0-55f7-4c4a-a070-d51f14567d62 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.938128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.939033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.939402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.939948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.940791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.943067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.949469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09287df7-6d5f-4deb-96d7-e60bdc007207 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:27.956957 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3030/6085] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:27.960440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:27.961126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:27.961283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:27.961422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:27.961668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:27.962496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:27.964573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:27.983447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3056/6086] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:27.990178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.003807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125e54-51c5-4253-a516-3d2971dfce67 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.024259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850af86-da51-4e08-8a4c-349ec42148b3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.031368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e334c-a80a-41a8-bba1-b5771ee82458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.032999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e334c-a80a-41a8-bba1-b5771ee82458 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.035394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda55fd-99fa-4067-aa55-916a83531bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.036231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e334c-a80a-41a8-bba1-b5771ee82458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.036382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda55fd-99fa-4067-aa55-916a83531bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.036656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda55fd-99fa-4067-aa55-916a83531bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.036881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda55fd-99fa-4067-aa55-916a83531bf5 admin admin] PATH_INFO: `/v3/projects/33764df0564341698b9b91b89083aea2/users/bb57cab1ec584d6cb0f814fc9a89550f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.039340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e334c-a80a-41a8-bba1-b5771ee82458 admin admin] PATH_INFO: `/v3/projects/c3928192a2d34e3aa29c4bc173f32a48/users/dd1b670c79544a45b2ca9722d90b36b3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.069057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda55fd-99fa-4067-aa55-916a83531bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33764df0564341698b9b91b89083aea2, user_id=bb57cab1ec584d6cb0f814fc9a89550f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.071859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda55fd-99fa-4067-aa55-916a83531bf5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.084663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e334c-a80a-41a8-bba1-b5771ee82458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3928192a2d34e3aa29c4bc173f32a48, user_id=dd1b670c79544a45b2ca9722d90b36b3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.087267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e334c-a80a-41a8-bba1-b5771ee82458 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.105147 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3031/6087] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:27 2022] PUT /identity/v3/projects/c3928192a2d34e3aa29c4bc173f32a48/users/dd1b670c79544a45b2ca9722d90b36b3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:28.117142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.117577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.117926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.123164 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3057/6088] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:27 2022] PUT /identity/v3/projects/33764df0564341698b9b91b89083aea2/users/bb57cab1ec584d6cb0f814fc9a89550f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:28.141255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bce27-707c-4159-ba7f-b154d6c47e83 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.142067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bce27-707c-4159-ba7f-b154d6c47e83 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.142358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bce27-707c-4159-ba7f-b154d6c47e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.173461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] MFA Rules not processed for user `dd1b670c79544a45b2ca9722d90b36b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:28.178005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:28.214976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b13bce27-707c-4159-ba7f-b154d6c47e83 None None] MFA Rules not processed for user `bb57cab1ec584d6cb0f814fc9a89550f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:28.216228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b13bce27-707c-4159-ba7f-b154d6c47e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:28.311343 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3032/6089] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:28.323864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.325449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:28.333080 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3058/6090] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:28.334301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bce27-707c-4159-ba7f-b154d6c47e83 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.399735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d6bab-b756-41a8-b450-9b006e0c00a1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.403497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.404453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.404453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.404693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.433096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bce27-707c-4159-ba7f-b154d6c47e83 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.439449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.440904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.441803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.442513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.443463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.443647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.445829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.447745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.451832 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3033/6091] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:28.482692 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3059/6092] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:28 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:28.486653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.499867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451b646-aa7c-4813-9927-fc2ec70b57e7 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.562618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.563506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.563831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.564154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.565032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.567205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.591551 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3034/6093] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:28 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:28.592761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.611382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d840d4e-4dfd-4ef1-bb2f-b1035cdbf2b3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.616212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.616905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.617962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.617962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.618165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.619818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.636429 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3060/6094] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:28.637482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.648687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876d3f2-d243-4d29-90a1-ba2300f8db56 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.653528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.654492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.654877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.655156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] PATH_INFO: `/v3/projects/8024b7c139f9470cb76cc8d1b03ca728/users/f0576dea05714456a0fd84fe34ef5746/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.671082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8024b7c139f9470cb76cc8d1b03ca728, user_id=f0576dea05714456a0fd84fe34ef5746, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.674378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.688957 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3035/6095] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:28 2022] PUT /identity/v3/projects/8024b7c139f9470cb76cc8d1b03ca728/users/f0576dea05714456a0fd84fe34ef5746/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:28.693041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.703273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e882d7-670f-4c6e-af21-35ae690c4b20 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.765721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f91d-820f-421e-b01c-5cba52b1f0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.766391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f91d-820f-421e-b01c-5cba52b1f0df admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.766672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f91d-820f-421e-b01c-5cba52b1f0df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.766988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f91d-820f-421e-b01c-5cba52b1f0df admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.767704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29f91d-820f-421e-b01c-5cba52b1f0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.769329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29f91d-820f-421e-b01c-5cba52b1f0df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.780500 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3061/6096] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:28.783230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.793335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03c8c7-dfe2-4e12-9830-49b596d30a46 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:28.798579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:28.799594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.799796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.800263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] PATH_INFO: `/v3/projects/8024b7c139f9470cb76cc8d1b03ca728/users/f0576dea05714456a0fd84fe34ef5746/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.803090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8024b7c139f9470cb76cc8d1b03ca728, user_id=f0576dea05714456a0fd84fe34ef5746, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:28.805803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:28.817469 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3036/6097] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:28 2022] PUT /identity/v3/projects/8024b7c139f9470cb76cc8d1b03ca728/users/f0576dea05714456a0fd84fe34ef5746/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:28.827013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9d272-50d9-45ee-b1af-1656d989932c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:28.828250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9d272-50d9-45ee-b1af-1656d989932c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:28.828693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9d272-50d9-45ee-b1af-1656d989932c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:28.865399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0dd9d272-50d9-45ee-b1af-1656d989932c None None] MFA Rules not processed for user `f0576dea05714456a0fd84fe34ef5746`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:28.867321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0dd9d272-50d9-45ee-b1af-1656d989932c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:28.942176 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3062/6098] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:28.954523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:28.956443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:29.023884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6fac86-dd7c-42a6-93a2-b3d2c71bdca8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:29.027652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:29.028301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:29.028586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:29.028863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:29.038733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:29.040348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:29.050999 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3037/6099] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:29.148383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9d272-50d9-45ee-b1af-1656d989932c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:29.163633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9d272-50d9-45ee-b1af-1656d989932c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:29.167452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:29.168227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:29.168651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:29.169029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:29.253344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:29.254995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:29.265924 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3063/6100] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:29.793751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:29.795236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:29.929720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65371d22-d483-4be8-ad7f-c5f5a6bb4f2d service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:29.936944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14d1860f410c46438c8807061b10f9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cfc6fd78b745da8412e7e15d557cc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:29.937621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:29.937909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:29.938189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:29.939106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:29.940081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:29.941728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:29.959318 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3038/6101] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:29.960844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:29.973737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720c13f-f968-4068-9d93-a21955b32a24 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:29.978354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14d1860f410c46438c8807061b10f9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cfc6fd78b745da8412e7e15d557cc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:29.979531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:29.979993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:29.980432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:29.981275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:29.983376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:30.022316 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3064/6102] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:29 2022] POST /identity/v3/projects => generated 348 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:30.026162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:30.038181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab0786-c0f5-4ccf-a132-ca05c9bdd8cb tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:30.131880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14d1860f410c46438c8807061b10f9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cfc6fd78b745da8412e7e15d557cc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:30.132537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:30.132823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:30.133102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:30.133827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:30.134134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:30.136264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:30.152476 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3039/6103] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:31.121721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:31.138558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39bd39-199b-44be-aa38-582969e12910 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:31.154370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14d1860f410c46438c8807061b10f9ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17cfc6fd78b745da8412e7e15d557cc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:31.155610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:31.156063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:31.156518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] PATH_INFO: `/v3/projects/2c04db674e144c0faf33fe450a39e9f5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:31.163369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c04db674e144c0faf33fe450a39e9f5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:31.165705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:31.281852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c04db674e144c0faf33fe450a39e9f5', 'request_id': 'req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:31.298596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c04db674e144c0faf33fe450a39e9f5', 'request_id': 'req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:31.329460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c04db674e144c0faf33fe450a39e9f5', 'request_id': 'req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:31.345531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] The token cache is being invalidate because project 2c04db674e144c0faf33fe450a39e9f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:31.346097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:31.347203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:31.355385 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3065/6104] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:31 2022] DELETE /identity/v3/projects/2c04db674e144c0faf33fe450a39e9f5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:31.368211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:31.375463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:31.470850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498364d-ef56-4387-be88-43584b960e61 tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:31.539597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1c221-ac06-4ed9-b220-43db49e7e007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:31.540551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c221-ac06-4ed9-b220-43db49e7e007 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:31.540993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c221-ac06-4ed9-b220-43db49e7e007 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:31.541637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1c221-ac06-4ed9-b220-43db49e7e007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:31.544191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2cb1c221-ac06-4ed9-b220-43db49e7e007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:31.676544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1c221-ac06-4ed9-b220-43db49e7e007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:31.679888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1c221-ac06-4ed9-b220-43db49e7e007 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:31.697500 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3040/6105] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:32.670751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:32.672829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:32.765595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11cd97-8042-4e6a-93cc-6db9e66dca4d tempest-RoutersIpV6AdminTest-1215230536 tempest-RoutersIpV6AdminTest-1215230536-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:32.771713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:32.773786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:32.774307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:32.774848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] PATH_INFO: `/v3/users/bb57cab1ec584d6cb0f814fc9a89550f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:32.776825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb57cab1ec584d6cb0f814fc9a89550f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:32.783602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:32.886997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb57cab1ec584d6cb0f814fc9a89550f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:32.887667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb57cab1ec584d6cb0f814fc9a89550f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:32.909472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb57cab1ec584d6cb0f814fc9a89550f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:32.910505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb57cab1ec584d6cb0f814fc9a89550f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:32.924094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb57cab1ec584d6cb0f814fc9a89550f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:32.956733 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3066/6106] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:32 2022] DELETE /identity/v3/users/bb57cab1ec584d6cb0f814fc9a89550f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:32.962241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:32.963258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:32.963693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:32.987395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:32.988936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:33.088583 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3041/6107] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:33.140877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:33.143511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:33.253324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2c341-36a3-41fa-ae39-2eec143a495b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:33.260037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:33.261383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:33.266324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:33.266717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:33.286348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:33.288816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:33.303130 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3067/6108] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:34.425001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:34.428063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:34.461500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f4972-ea9f-47d0-ae46-e09ff0c73170 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:34.488779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:34.489920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:34.490308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:34.490690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] PATH_INFO: `/v3/projects/33764df0564341698b9b91b89083aea2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:34.494225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] RBAC: Authorizing `identity:delete_project(project_id=33764df0564341698b9b91b89083aea2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:34.496801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:34.604967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33764df0564341698b9b91b89083aea2', 'request_id': 'req-724866e9-84b6-4d7b-9770-f251c94b668f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.616382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33764df0564341698b9b91b89083aea2', 'request_id': 'req-724866e9-84b6-4d7b-9770-f251c94b668f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.634908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33764df0564341698b9b91b89083aea2', 'request_id': 'req-724866e9-84b6-4d7b-9770-f251c94b668f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.650503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] The token cache is being invalidate because project 33764df0564341698b9b91b89083aea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:34.650829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.651503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.655989 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3042/6109] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:34 2022] DELETE /identity/v3/projects/33764df0564341698b9b91b89083aea2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:34.657227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:34.668264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa60d1-5b4e-4ea2-9454-8c632fd5ae94 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:34.756500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:34.757591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:34.758045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:34.758570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] PATH_INFO: `/v3/users/f0576dea05714456a0fd84fe34ef5746` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:34.760316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0576dea05714456a0fd84fe34ef5746)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:34.763166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:34.855174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0576dea05714456a0fd84fe34ef5746'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.856288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0576dea05714456a0fd84fe34ef5746'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.866859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0576dea05714456a0fd84fe34ef5746'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.867858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0576dea05714456a0fd84fe34ef5746'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.881806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cccd67f-e6e2-443f-9c31-17a1d6e845aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0576dea05714456a0fd84fe34ef5746'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:34.912561 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3068/6110] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:34 2022] DELETE /identity/v3/users/f0576dea05714456a0fd84fe34ef5746 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:36.252889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:36.254346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:36.267926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724866e9-84b6-4d7b-9770-f251c94b668f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:36.364382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:36.365609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:36.366002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:36.366562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] PATH_INFO: `/v3/projects/8024b7c139f9470cb76cc8d1b03ca728` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:36.369021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8024b7c139f9470cb76cc8d1b03ca728)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:36.371635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:36.461827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8024b7c139f9470cb76cc8d1b03ca728', 'request_id': 'req-d582614c-b136-4e8e-91d9-24726e5be0c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:36.473122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8024b7c139f9470cb76cc8d1b03ca728', 'request_id': 'req-d582614c-b136-4e8e-91d9-24726e5be0c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:36.490702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8024b7c139f9470cb76cc8d1b03ca728', 'request_id': 'req-d582614c-b136-4e8e-91d9-24726e5be0c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:36.506457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] The token cache is being invalidate because project 8024b7c139f9470cb76cc8d1b03ca728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:36.507445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:36.508368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d582614c-b136-4e8e-91d9-24726e5be0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:36.518673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3043/6111] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:36 2022] DELETE /identity/v3/projects/8024b7c139f9470cb76cc8d1b03ca728 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:36.526838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309af88-3790-40b1-9818-44935c9d7d94 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:36.527839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309af88-3790-40b1-9818-44935c9d7d94 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:36.528133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309af88-3790-40b1-9818-44935c9d7d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:36.566698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a309af88-3790-40b1-9818-44935c9d7d94 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:36.569916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a309af88-3790-40b1-9818-44935c9d7d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:36.649899 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3069/6112] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:36.657908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b3fd-b97a-4092-b248-24c4af3472cb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:36.658291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b3fd-b97a-4092-b248-24c4af3472cb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:36.658643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b3fd-b97a-4092-b248-24c4af3472cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:36.694171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-09a5b3fd-b97a-4092-b248-24c4af3472cb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:36.696502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-09a5b3fd-b97a-4092-b248-24c4af3472cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:36.720888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3044/6113] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:36.725031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309af88-3790-40b1-9818-44935c9d7d94 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:36.738623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309af88-3790-40b1-9818-44935c9d7d94 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:36.751807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:36.752750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:36.753541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:36.754029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:36.755103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:36.755738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:36.758625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:36.775738 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3070/6114] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:36.777009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5b3fd-b97a-4092-b248-24c4af3472cb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:36.788070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5b3fd-b97a-4092-b248-24c4af3472cb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:36.802667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:36.803397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:36.803689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:36.803968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:36.804822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:36.808997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:36.866677 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3045/6115] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:36 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:36.870866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:36.884049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9a6d-a113-43b2-b766-95e63bf9b8df admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:36.957908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:36.959542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:36.961044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:36.961044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:36.961044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:36.963771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:36.995090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:36.995855 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3071/6116] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:36 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:37.007309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b625693-9051-4288-9b24-60da81050ae7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.012603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:37.013299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.013585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.014004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.015305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:37.017178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:37.032680 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3046/6117] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:37.034087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.054132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04aa11-ecfa-4c79-bc14-8d043e4ea32f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.061026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854456d3-fbb7-407e-8703-23b7877750c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:37.062220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854456d3-fbb7-407e-8703-23b7877750c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.062737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854456d3-fbb7-407e-8703-23b7877750c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.063215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854456d3-fbb7-407e-8703-23b7877750c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.064170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854456d3-fbb7-407e-8703-23b7877750c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:37.066099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854456d3-fbb7-407e-8703-23b7877750c7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:37.085836 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3072/6118] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:37.087816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.102910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb72429-76db-491f-abf9-edfd29d78215 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.107991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:37.108876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.109258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.109564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] PATH_INFO: `/v3/projects/f274edce0ada480290355a5f3076d430/users/3ca9586e8c234764a3639310fbefff4b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.134492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f274edce0ada480290355a5f3076d430, user_id=3ca9586e8c234764a3639310fbefff4b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:37.134798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:37.151402 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3047/6119] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:37 2022] PUT /identity/v3/projects/f274edce0ada480290355a5f3076d430/users/3ca9586e8c234764a3639310fbefff4b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:37.166122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1343e-6d87-446f-885e-a92dd06eb277 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.166420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1343e-6d87-446f-885e-a92dd06eb277 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.166753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1343e-6d87-446f-885e-a92dd06eb277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.203388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a2c1343e-6d87-446f-885e-a92dd06eb277 None None] MFA Rules not processed for user `3ca9586e8c234764a3639310fbefff4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:37.204624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2c1343e-6d87-446f-885e-a92dd06eb277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:37.292578 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3073/6120] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:37.297285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.407929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c319-69b0-4abd-a3ea-fe67888c2418 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.425872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:37.426977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.432289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.433702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.435852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:37.441299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:37.493252 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3048/6121] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:37 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:37.497419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1343e-6d87-446f-885e-a92dd06eb277 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.512910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1343e-6d87-446f-885e-a92dd06eb277 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.586740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:37.588586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.589155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.589651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.590807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:37.594174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:37.637777 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3074/6122] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:37 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:37.642544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.664783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382062e-8c77-4714-85ca-ed429e25b380 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.674033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:37.675378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.675861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.676097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.676737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:37.679975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:37.708773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3049/6123] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:37.712709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.724863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13510320-034b-4d4d-b860-7776cbbbd1a0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.734878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:37.737172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:37.738049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:37.738715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] PATH_INFO: `/v3/projects/a779d91cebed450181cfba59ca1e927b/users/c1e9185f797b4100aec0089d5163ef03/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:37.779419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a779d91cebed450181cfba59ca1e927b, user_id=c1e9185f797b4100aec0089d5163ef03, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:37.785391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:37.827671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3075/6124] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:37 2022] PUT /identity/v3/projects/a779d91cebed450181cfba59ca1e927b/users/c1e9185f797b4100aec0089d5163ef03/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:37.848853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.853640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:37.864237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411b5f7-d40a-4911-881b-7adaf047c163 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:37.888703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:38.007431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:38.009245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:38.009814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:38.010203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:38.011072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:38.012817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:38.032673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3050/6125] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:38.034394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:38.046988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c11a-3c67-474e-a670-bf6aad47dce8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:38.052178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f065-30e8-4084-9d7a-ab66741b0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:38.053536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f065-30e8-4084-9d7a-ab66741b0555 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:38.058906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f065-30e8-4084-9d7a-ab66741b0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:38.059201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f065-30e8-4084-9d7a-ab66741b0555 admin admin] PATH_INFO: `/v3/projects/a779d91cebed450181cfba59ca1e927b/users/c1e9185f797b4100aec0089d5163ef03/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:38.062191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f065-30e8-4084-9d7a-ab66741b0555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a779d91cebed450181cfba59ca1e927b, user_id=c1e9185f797b4100aec0089d5163ef03, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:38.065772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f065-30e8-4084-9d7a-ab66741b0555 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:38.080489 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3051/6126] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:38 2022] PUT /identity/v3/projects/a779d91cebed450181cfba59ca1e927b/users/c1e9185f797b4100aec0089d5163ef03/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:38.093838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:38.094456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:38.095060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:38.129398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb436-5754-4e1a-a346-5da7e754e331 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:38.157099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] MFA Rules not processed for user `c1e9185f797b4100aec0089d5163ef03`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:38.158632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:38.341450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a4fa-a07f-4616-86ad-1065ffd936f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:38.344578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a4fa-a07f-4616-86ad-1065ffd936f9 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:38.344578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a4fa-a07f-4616-86ad-1065ffd936f9 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:38.346536 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3052/6127] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:38.352603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a4fa-a07f-4616-86ad-1065ffd936f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:38.360160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-30e9a4fa-a07f-4616-86ad-1065ffd936f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:38.364307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:38.366142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:38.494483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb20966-059c-42b4-a8ad-16f4d83e315a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:38.502711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:38.504546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:38.504927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:38.505300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:38.508137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a4fa-a07f-4616-86ad-1065ffd936f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:38.510208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a4fa-a07f-4616-86ad-1065ffd936f9 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:38.518524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:38.521523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:38.542442 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3053/6128] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:38.547267 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3076/6129] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:38.628242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:38.632388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:38.662106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde03d4f-afa2-4865-9ae6-c65b45ee94e3 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:38.671826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:38.672671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:38.672941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:38.674446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:38.844918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:38.846387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:38.858820 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3054/6130] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:40.279146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:40.279683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:40.279683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:40.297862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] MFA Rules not processed for user `8cdc0c878f6e4e5da2a2848d63a02f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:40.299148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:40.310385 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3077/6131] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:42.219275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:42.222031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:42.342487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38383818-0375-44e2-a8bd-a6cf4a049323 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:42.353046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:42.353729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:42.354016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:42.354292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:42.361059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:42.373190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:42.375196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:42.573472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:42.574920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:42.600210 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3055/6132] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:42.632401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071c84-c12a-45a5-ba88-5b7be890176f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:42.646348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcd2fe-3395-4023-acbe-faefdc18e5db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:42.649904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcd2fe-3395-4023-acbe-faefdc18e5db service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:42.650370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcd2fe-3395-4023-acbe-faefdc18e5db service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:42.651019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcd2fe-3395-4023-acbe-faefdc18e5db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:42.656692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5dfcd2fe-3395-4023-acbe-faefdc18e5db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:42.681804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcd2fe-3395-4023-acbe-faefdc18e5db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:42.685668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcd2fe-3395-4023-acbe-faefdc18e5db service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:42.742260 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3078/6133] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:06:43.373152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:43.387337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f35df3-6fc3-4d49-aedd-5d97a855c9c6 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:43.394847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:43.395930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:43.396358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:43.396783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] PATH_INFO: `/v3/users/3ca9586e8c234764a3639310fbefff4b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:43.398318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca9586e8c234764a3639310fbefff4b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:43.401670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:43.469232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca9586e8c234764a3639310fbefff4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:43.479605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca9586e8c234764a3639310fbefff4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:43.480379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca9586e8c234764a3639310fbefff4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:43.480998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca9586e8c234764a3639310fbefff4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:43.494108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca9586e8c234764a3639310fbefff4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:43.531776 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3056/6134] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:43 2022] DELETE /identity/v3/users/3ca9586e8c234764a3639310fbefff4b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:43.537220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:43.537765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:43.537765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:43.562533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:43.564317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:43.638872 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3079/6135] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:43.648886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:43.651785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:43.736659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713cc9d8-9ea4-4940-9d42-4c82d8c75ec3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:43.742450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:43.743594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:43.744082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:43.744543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:43.760376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:43.762581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:43.776753 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3057/6136] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:44.499840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:44.501305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:44.642651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851393-a82f-4de4-842e-d640f92c07bf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:44.648811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:44.649928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:44.650424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:44.651800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:44.654488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:44.681317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:44.683900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:44.699536 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3080/6137] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:44.881445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:44.884557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:44.901605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af05400-52e0-4545-9458-442f47a4fd3d service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:44.907513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:44.908942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:44.909550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:44.909969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] PATH_INFO: `/v3/projects/f274edce0ada480290355a5f3076d430` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:44.911433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f274edce0ada480290355a5f3076d430)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:44.914092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:44.997682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f274edce0ada480290355a5f3076d430', 'request_id': 'req-69e81c38-4684-4126-bd49-f5e37e8ad5d0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.016046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f274edce0ada480290355a5f3076d430', 'request_id': 'req-69e81c38-4684-4126-bd49-f5e37e8ad5d0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.032486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f274edce0ada480290355a5f3076d430', 'request_id': 'req-69e81c38-4684-4126-bd49-f5e37e8ad5d0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.050643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] The token cache is being invalidate because project f274edce0ada480290355a5f3076d430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:45.051591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.053037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.055913 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3058/6138] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:44 2022] DELETE /identity/v3/projects/f274edce0ada480290355a5f3076d430 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:45.060375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:45.085936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db20317-06ed-481f-a080-cd393a921790 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:45.164669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:45.166053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:45.166497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:45.166991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] PATH_INFO: `/v3/users/c1e9185f797b4100aec0089d5163ef03` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:45.168622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e9185f797b4100aec0089d5163ef03)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:45.171573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:45.247727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e9185f797b4100aec0089d5163ef03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.250866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e9185f797b4100aec0089d5163ef03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.264975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e9185f797b4100aec0089d5163ef03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.266008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e9185f797b4100aec0089d5163ef03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.277376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dad2ff5d-71d1-41b7-918b-d68370da288a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e9185f797b4100aec0089d5163ef03'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:45.303335 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3081/6139] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:45 2022] DELETE /identity/v3/users/c1e9185f797b4100aec0089d5163ef03 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:46.821739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:46.823928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:46.848159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e81c38-4684-4126-bd49-f5e37e8ad5d0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:46.979859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:46.981081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:46.981531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:46.982255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] PATH_INFO: `/v3/projects/a779d91cebed450181cfba59ca1e927b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:46.983766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a779d91cebed450181cfba59ca1e927b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:46.986103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:47.079804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a779d91cebed450181cfba59ca1e927b', 'request_id': 'req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:47.103395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a779d91cebed450181cfba59ca1e927b', 'request_id': 'req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:47.125003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a779d91cebed450181cfba59ca1e927b', 'request_id': 'req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:47.148420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] The token cache is being invalidate because project a779d91cebed450181cfba59ca1e927b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:47.157900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:47.169232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc66294f-1c76-4f6e-8e1d-28e8f4976fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:47.172774 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3059/6140] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:46 2022] DELETE /identity/v3/projects/a779d91cebed450181cfba59ca1e927b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:47.178001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d48285-b453-4be2-ab2b-93da7e99588e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.180645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d48285-b453-4be2-ab2b-93da7e99588e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.181205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d48285-b453-4be2-ab2b-93da7e99588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.225587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f8d48285-b453-4be2-ab2b-93da7e99588e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:47.226868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f8d48285-b453-4be2-ab2b-93da7e99588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:47.329426 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3082/6141] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:47.337326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20cf6-3c5d-4261-a1c9-08bbe02387ae None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.337616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20cf6-3c5d-4261-a1c9-08bbe02387ae None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.339790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa20cf6-3c5d-4261-a1c9-08bbe02387ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.404690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6aa20cf6-3c5d-4261-a1c9-08bbe02387ae None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:47.406934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6aa20cf6-3c5d-4261-a1c9-08bbe02387ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:47.420251 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3060/6142] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:47.427125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d48285-b453-4be2-ab2b-93da7e99588e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:47.441061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d48285-b453-4be2-ab2b-93da7e99588e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:47.453339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:47.454122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.454409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.455041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.456948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:47.458525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:47.463255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:47.488774 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3083/6143] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:47.493280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20cf6-3c5d-4261-a1c9-08bbe02387ae None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:47.505441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa20cf6-3c5d-4261-a1c9-08bbe02387ae None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:47.524936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:47.525817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.526256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.526838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.527720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:47.535013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:47.580932 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3061/6144] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:47 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:47.584992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:47.601373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aa2d2-1509-473b-8d41-ff5d1e917f44 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:47.703038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:47.703207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.703501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.703812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.704556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:47.707979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:47.745216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3084/6145] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:47 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:06:47.746662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:47.762163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af5e5b-c1e0-45fa-bc8e-409c9e5d8108 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:47.789651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:47.790515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.790832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.791201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.792011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:47.793714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:47.824074 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3062/6146] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:47.824754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:47.841585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab0fad-0f6a-4bce-8540-299060eaa67d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:47.849865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2d430-cae8-4019-960b-a621779c1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:47.849865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2d430-cae8-4019-960b-a621779c1dee admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.850129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2d430-cae8-4019-960b-a621779c1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.850386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2d430-cae8-4019-960b-a621779c1dee admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.851508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2d430-cae8-4019-960b-a621779c1dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:47.863115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2d430-cae8-4019-960b-a621779c1dee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:47.891518 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3085/6147] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:47.893110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:47.926528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62e329-b0c7-4c4a-b148-27870fae060c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:47.940890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:47.944274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:47.944724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:47.945102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] PATH_INFO: `/v3/projects/a878ef559ce5410fbd0d1636507258fe/users/4e03c01990d947a286dda65768487e00/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:47.966567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a878ef559ce5410fbd0d1636507258fe, user_id=4e03c01990d947a286dda65768487e00, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:47.971607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.010464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3063/6148] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:47 2022] PUT /identity/v3/projects/a878ef559ce5410fbd0d1636507258fe/users/4e03c01990d947a286dda65768487e00/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:48.011547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abc1ef-6c1c-4b92-90d7-b81aab794aa2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.011895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abc1ef-6c1c-4b92-90d7-b81aab794aa2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.012184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abc1ef-6c1c-4b92-90d7-b81aab794aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.027155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:48.029787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:48.093730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-41abc1ef-6c1c-4b92-90d7-b81aab794aa2 None None] MFA Rules not processed for user `4e03c01990d947a286dda65768487e00`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:48.095025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-41abc1ef-6c1c-4b92-90d7-b81aab794aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:48.183141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3086/6149] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:48.187800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abc1ef-6c1c-4b92-90d7-b81aab794aa2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:48.189799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37586cb-219a-4d4c-a8e4-36a4960b0fb1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:48.196823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:48.197729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.198178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.198620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.201011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:48.220227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:48.222241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.239796 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3064/6150] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:48.322758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abc1ef-6c1c-4b92-90d7-b81aab794aa2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:48.339376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:48.340099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.340384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.340690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.341607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:48.344411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.398296 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3087/6151] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:48 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:48.402421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:48.417484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36637d75-3b04-46fd-9135-bc0e269016f1 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:48.529565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:48.530849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.531141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.531552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.532267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:48.534550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.562594 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3065/6152] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:48 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:48.567099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:48.582423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9d8b2-8a18-475a-bd98-187fca3f310b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:48.589819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:48.590732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.591232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.591806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.593330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:48.595310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.612660 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3088/6153] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:48.613987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:48.627784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647489b4-c8b4-4ebf-b127-4af6bcc9f506 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:48.633764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:48.634803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.635124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.635406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] PATH_INFO: `/v3/projects/214a504b247843519ddb3ea200df7e1e/users/7186b27f48cd43198b48049013c5d9d4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.651980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214a504b247843519ddb3ea200df7e1e, user_id=7186b27f48cd43198b48049013c5d9d4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:48.654820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.672809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3066/6154] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:48 2022] PUT /identity/v3/projects/214a504b247843519ddb3ea200df7e1e/users/7186b27f48cd43198b48049013c5d9d4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:48.674055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:48.685488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b9748-562b-46ac-803c-bf7626070321 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:48.752240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3df4d0-2e36-4b72-a2f5-dbfa25b83217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:48.753178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3df4d0-2e36-4b72-a2f5-dbfa25b83217 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.753615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3df4d0-2e36-4b72-a2f5-dbfa25b83217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.754041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3df4d0-2e36-4b72-a2f5-dbfa25b83217 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.756233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3df4d0-2e36-4b72-a2f5-dbfa25b83217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:48.760408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3df4d0-2e36-4b72-a2f5-dbfa25b83217 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.778489 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3089/6155] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:48.778874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:48.793873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3114c18-63e4-4863-a34f-6c380bb288a0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:48.804365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:48.805329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.805614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.805886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] PATH_INFO: `/v3/projects/214a504b247843519ddb3ea200df7e1e/users/7186b27f48cd43198b48049013c5d9d4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.808327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214a504b247843519ddb3ea200df7e1e, user_id=7186b27f48cd43198b48049013c5d9d4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:48.811574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:48.823065 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3067/6156] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:48 2022] PUT /identity/v3/projects/214a504b247843519ddb3ea200df7e1e/users/7186b27f48cd43198b48049013c5d9d4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:48.833047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74ca75-a239-46cd-9ee8-8d1378114467 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:48.834932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74ca75-a239-46cd-9ee8-8d1378114467 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:48.834932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74ca75-a239-46cd-9ee8-8d1378114467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:48.884706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fd74ca75-a239-46cd-9ee8-8d1378114467 None None] MFA Rules not processed for user `7186b27f48cd43198b48049013c5d9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:48.895842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fd74ca75-a239-46cd-9ee8-8d1378114467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:49.016167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3090/6157] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:49.028394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:49.031295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:49.157694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b0162-84a3-498e-8bc1-3b62f1cd6ed6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:49.164913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:49.166359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:49.166955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:49.167530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:49.186609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:49.189349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:49.210172 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3068/6158] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:49.354796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74ca75-a239-46cd-9ee8-8d1378114467 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:49.368896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74ca75-a239-46cd-9ee8-8d1378114467 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:49.372983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2df112-e986-4977-b18d-8b165a8639e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:49.373847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df112-e986-4977-b18d-8b165a8639e0 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:49.374282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df112-e986-4977-b18d-8b165a8639e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:49.374739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2df112-e986-4977-b18d-8b165a8639e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:49.450002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2df112-e986-4977-b18d-8b165a8639e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:49.452116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2df112-e986-4977-b18d-8b165a8639e0 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:49.464055 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3091/6159] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:52.483784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:52.621114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21b7e2-9dbc-4052-b204-1ee70da2daaf service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:52.636947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:52.638446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:52.638730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:52.640082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] PATH_INFO: `/v3/users/4e03c01990d947a286dda65768487e00` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:52.641640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e03c01990d947a286dda65768487e00)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:52.646054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:52.735705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e03c01990d947a286dda65768487e00'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:52.744109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e03c01990d947a286dda65768487e00'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:52.745478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e03c01990d947a286dda65768487e00'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:52.746088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e03c01990d947a286dda65768487e00'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:52.767565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e03c01990d947a286dda65768487e00'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:52.816134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3069/6160] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:52 2022] DELETE /identity/v3/users/4e03c01990d947a286dda65768487e00 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:52.820634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:52.821146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:52.821234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:52.848999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:52.850213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:52.946814 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3092/6161] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:52.977711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:52.980718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:53.048606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b4ed-65d6-4ed4-8cca-f5e5eb187c22 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:53.053759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:53.054645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:53.055032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:53.055382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:53.080444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:53.082915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:53.103341 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3070/6162] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:54.696105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:54.698182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:54.730726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f81aa4-66b6-4948-a5c9-ae440e50a1ae None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:54.743305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:54.744355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:54.744839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:54.745317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:54.747367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:54.782821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:54.797149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:54.821132 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3093/6163] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:55.416596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:55.419367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:55.447028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc72f3-4cb5-4799-9a9e-d71074560352 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:55.458740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:55.460496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:55.461099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:55.461534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] PATH_INFO: `/v3/projects/a878ef559ce5410fbd0d1636507258fe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:55.465777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a878ef559ce5410fbd0d1636507258fe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:55.468352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:55.574148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a878ef559ce5410fbd0d1636507258fe', 'request_id': 'req-08d4c59a-59a2-432e-be51-84319538af1e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.591735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a878ef559ce5410fbd0d1636507258fe', 'request_id': 'req-08d4c59a-59a2-432e-be51-84319538af1e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.604381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a878ef559ce5410fbd0d1636507258fe', 'request_id': 'req-08d4c59a-59a2-432e-be51-84319538af1e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.620560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] The token cache is being invalidate because project a878ef559ce5410fbd0d1636507258fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:55.621144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.631316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.633323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3071/6164] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:55 2022] DELETE /identity/v3/projects/a878ef559ce5410fbd0d1636507258fe => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:55.637468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:55.656475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84114e-e46e-49bc-84d4-d0956d7d30bd service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:55.790714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:55.797725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:55.798160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:55.799960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] PATH_INFO: `/v3/users/7186b27f48cd43198b48049013c5d9d4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:55.801641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7186b27f48cd43198b48049013c5d9d4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:55.803865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:55.898709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7186b27f48cd43198b48049013c5d9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.907166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7186b27f48cd43198b48049013c5d9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.915719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7186b27f48cd43198b48049013c5d9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.917215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7186b27f48cd43198b48049013c5d9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.947963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25a95cef-7127-4e7e-9420-1753ff3ecfd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7186b27f48cd43198b48049013c5d9d4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:55.993143 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3094/6165] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:55 2022] DELETE /identity/v3/users/7186b27f48cd43198b48049013c5d9d4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:57.155319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:57.162929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:57.228121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4c59a-59a2-432e-be51-84319538af1e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:57.362332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:57.363264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.363555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.363835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] PATH_INFO: `/v3/projects/214a504b247843519ddb3ea200df7e1e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.365297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=214a504b247843519ddb3ea200df7e1e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:57.367320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:57.429588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214a504b247843519ddb3ea200df7e1e', 'request_id': 'req-1b6cc084-a016-4225-a918-969488337c4a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:57.437195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214a504b247843519ddb3ea200df7e1e', 'request_id': 'req-1b6cc084-a016-4225-a918-969488337c4a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:57.446125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214a504b247843519ddb3ea200df7e1e', 'request_id': 'req-1b6cc084-a016-4225-a918-969488337c4a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:57.458022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] The token cache is being invalidate because project 214a504b247843519ddb3ea200df7e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:57.458447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:57.459457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1b6cc084-a016-4225-a918-969488337c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:57.461972 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3072/6166] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:57 2022] DELETE /identity/v3/projects/214a504b247843519ddb3ea200df7e1e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:57.466573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc585563-a00c-43f4-af4b-49f078662ec8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.467056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc585563-a00c-43f4-af4b-49f078662ec8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.467238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc585563-a00c-43f4-af4b-49f078662ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.493470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fc585563-a00c-43f4-af4b-49f078662ec8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:57.497264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fc585563-a00c-43f4-af4b-49f078662ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:57.591098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3095/6167] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:57.600651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdd4e-6079-4294-887b-6fffcd80420d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.601093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdd4e-6079-4294-887b-6fffcd80420d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.601479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdd4e-6079-4294-887b-6fffcd80420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.626302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-afbfdd4e-6079-4294-887b-6fffcd80420d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:57.628454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-afbfdd4e-6079-4294-887b-6fffcd80420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:57.645758 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3073/6168] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:57.653496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc585563-a00c-43f4-af4b-49f078662ec8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:57.667279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc585563-a00c-43f4-af4b-49f078662ec8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:57.673034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:57.673987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.674624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.675398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.676573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:57.677013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:57.678815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:57.696971 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3096/6169] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:57.702203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdd4e-6079-4294-887b-6fffcd80420d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:57.714541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdd4e-6079-4294-887b-6fffcd80420d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:57.721613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:57.722519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.722976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.723374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.724290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:57.727675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:57.779039 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3074/6170] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:57 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:57.780459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:57.791295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bfb20-7ace-4983-9fd5-1047bc3acada admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:57.876425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:57.876425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.876425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.876425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.876856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:57.879222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:57.907767 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3097/6171] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:57 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:57.913077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:57.925147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f310cac-ba5c-4bd5-821a-f79b8768af4c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:57.931548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:57.933096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.933514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.933794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.934526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:57.938055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:57.954315 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3075/6172] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:57.956874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:57.971568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ef37d-9589-48c4-b3dd-df1d26f80afc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:57.977395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:57.981091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:57.986133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:57.987251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:57.996287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:57.998440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:58.013627 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3098/6173] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:06:58.018410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:58.031203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145ba19-3f19-4583-9fca-79ae839b79e7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:58.039448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a199bfe-0fd5-494c-8ecc-3428ed3622ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:58.040345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199bfe-0fd5-494c-8ecc-3428ed3622ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:58.040626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199bfe-0fd5-494c-8ecc-3428ed3622ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:58.040905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a199bfe-0fd5-494c-8ecc-3428ed3622ff admin admin] PATH_INFO: `/v3/projects/10b9ce9c81e24948951560bcffd86ca8/users/8891584f9c184b42970a62594ce92c22/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:58.067698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199bfe-0fd5-494c-8ecc-3428ed3622ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b9ce9c81e24948951560bcffd86ca8, user_id=8891584f9c184b42970a62594ce92c22, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:58.073947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:58.076720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:58.090830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a199bfe-0fd5-494c-8ecc-3428ed3622ff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:58.102853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46b0e-eece-45ba-b0c1-c748fe4a9837 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:58.117652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:58.126057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:58.126485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:58.126712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] PATH_INFO: `/v3/users/887054d178de43b18a472fed2297659d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:58.135644 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3076/6174] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:58 2022] PUT /identity/v3/projects/10b9ce9c81e24948951560bcffd86ca8/users/8891584f9c184b42970a62594ce92c22/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:06:58.139055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131dfe7-f296-4e09-b559-a66be31c1902 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:58.139350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131dfe7-f296-4e09-b559-a66be31c1902 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:58.140195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131dfe7-f296-4e09-b559-a66be31c1902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:58.141840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=887054d178de43b18a472fed2297659d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:58.145721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:58.227595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4131dfe7-f296-4e09-b559-a66be31c1902 None None] MFA Rules not processed for user `8891584f9c184b42970a62594ce92c22`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:58.229437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4131dfe7-f296-4e09-b559-a66be31c1902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:58.265830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887054d178de43b18a472fed2297659d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:58.266860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887054d178de43b18a472fed2297659d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:58.276691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887054d178de43b18a472fed2297659d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:58.277780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887054d178de43b18a472fed2297659d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:58.295102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887054d178de43b18a472fed2297659d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:58.336918 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3099/6175] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:06:58 2022] DELETE /identity/v3/users/887054d178de43b18a472fed2297659d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:58.439406 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3077/6176] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:06:58.445985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:58.447863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:58.607639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c595bf4-f03c-451e-81e3-ad8de0c7ce21 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:58.620787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:58.621785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:58.625828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:58.626406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:58.628271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:58.632322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:58.683724 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3100/6177] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:58 2022] POST /identity/v3/projects => generated 389 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:58.685976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131dfe7-f296-4e09-b559-a66be31c1902 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:58.778730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:58.782619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:58.881578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131dfe7-f296-4e09-b559-a66be31c1902 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:58.941923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29e631-b557-44af-97b8-1fb51192c171 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:58.955118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:58.959144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:58.959503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:58.960157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] PATH_INFO: `/v3/projects/57990769f50b412194a108cdd627a767` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:58.963825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] RBAC: Authorizing `identity:delete_project(project_id=57990769f50b412194a108cdd627a767)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:58.972037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.011941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.015980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.016351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.016557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.017315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.019597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.053883 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3078/6178] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:58 2022] POST /identity/v3/users => generated 301 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:59.057895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.080076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76f00c-ddc5-4cb8-bf54-9013d0f3a35a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.098134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57990769f50b412194a108cdd627a767', 'request_id': 'req-83d67cd5-9418-4f8a-8ae7-22ce6303cede'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:59.105613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57990769f50b412194a108cdd627a767', 'request_id': 'req-83d67cd5-9418-4f8a-8ae7-22ce6303cede'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:59.117049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57990769f50b412194a108cdd627a767', 'request_id': 'req-83d67cd5-9418-4f8a-8ae7-22ce6303cede'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:59.132891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] The token cache is being invalidate because project 57990769f50b412194a108cdd627a767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:06:59.133237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:59.133974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83d67cd5-9418-4f8a-8ae7-22ce6303cede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:06:59.140673 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3101/6179] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:06:58 2022] DELETE /identity/v3/projects/57990769f50b412194a108cdd627a767 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:59.142386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687eae-3805-4971-8bd8-47030cae9979 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.142689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687eae-3805-4971-8bd8-47030cae9979 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.143015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687eae-3805-4971-8bd8-47030cae9979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.172049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.172356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dd687eae-3805-4971-8bd8-47030cae9979 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:59.172569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.172863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.173135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.173749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dd687eae-3805-4971-8bd8-47030cae9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:59.174014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.176778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.185512 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3102/6180] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:59.196089 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3079/6181] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:59.197434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.198500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509dbac-ac22-44ca-a3e5-60a4c94f1023 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.199114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509dbac-ac22-44ca-a3e5-60a4c94f1023 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.199475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509dbac-ac22-44ca-a3e5-60a4c94f1023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.201359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:59.217073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7153cd-d18c-4fdd-9aa9-a9b1b9c2479a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.223434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.224554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.225598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.225726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0509dbac-ac22-44ca-a3e5-60a4c94f1023 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:59.227477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0509dbac-ac22-44ca-a3e5-60a4c94f1023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:59.237754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] PATH_INFO: `/v3/projects/794043b9e12a47aa9a452b6b869aee3d/users/b94c6965fdbc439eae324f6e2d35e5b9/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.265161 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3103/6182] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:59.266980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=794043b9e12a47aa9a452b6b869aee3d, user_id=b94c6965fdbc439eae324f6e2d35e5b9, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.269368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509dbac-ac22-44ca-a3e5-60a4c94f1023 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.272495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.302813 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3080/6183] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:59 2022] PUT /identity/v3/projects/794043b9e12a47aa9a452b6b869aee3d/users/b94c6965fdbc439eae324f6e2d35e5b9/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:59.304162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.334183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509dbac-ac22-44ca-a3e5-60a4c94f1023 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.398433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd0ab4-671c-4b36-b909-625007a16d4f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.405130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.406402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.406877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.407384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.408329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.410243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.427637 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3081/6184] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:06:59.430314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.432771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:59.527534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.530116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.531694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.533268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.539275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:06:59.539990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.542657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.562555 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3104/6185] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:06:59.562555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.583710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c655b81-3a7e-45c7-bb59-d96b25f51fde admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.584189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d901bcd-27a5-4a29-92f4-20dc48af4eae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.593847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9d807-94ab-446d-9549-a00d5e1d5161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.594592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9d807-94ab-446d-9549-a00d5e1d5161 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.595117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9d807-94ab-446d-9549-a00d5e1d5161 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.595477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9d807-94ab-446d-9549-a00d5e1d5161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.595964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.597118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.597598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.597953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] PATH_INFO: `/v3/projects/794043b9e12a47aa9a452b6b869aee3d/users/b94c6965fdbc439eae324f6e2d35e5b9/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.598346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30b9d807-94ab-446d-9549-a00d5e1d5161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:59.603420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=794043b9e12a47aa9a452b6b869aee3d, user_id=b94c6965fdbc439eae324f6e2d35e5b9, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.609507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.630743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9d807-94ab-446d-9549-a00d5e1d5161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.633375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9d807-94ab-446d-9549-a00d5e1d5161 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.640946 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3105/6186] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:06:59 2022] PUT /identity/v3/projects/794043b9e12a47aa9a452b6b869aee3d/users/b94c6965fdbc439eae324f6e2d35e5b9/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:06:59.641890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.653596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3082/6187] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:06:59.655897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.656294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.656731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.699796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] MFA Rules not processed for user `b94c6965fdbc439eae324f6e2d35e5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:06:59.701303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:59.813673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3083/6188] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:06:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:06:59.821501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be0b55-dd4d-4e88-8016-59e622b78ead admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.829795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.830000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.830266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:06:59.830456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.831046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.831436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.832624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.835719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.879083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3106/6189] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:06:59 2022] POST /identity/v3/projects => generated 403 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:06:59.879972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:06:59.928764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77adc-ec1a-41dc-b6a3-f11a24943efc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.958255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59829e3e-35c5-4d82-b604-718a317326a8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:06:59.964439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:06:59.965231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:06:59.965896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:06:59.966031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:06:59.967617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:06:59.969563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:06:59.998842 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3107/6190] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:06:59 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:00.002031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.008905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d851a0-e73e-4962-9549-8a8435b4dfc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.009922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d851a0-e73e-4962-9549-8a8435b4dfc7 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.010354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d851a0-e73e-4962-9549-8a8435b4dfc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.010887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d851a0-e73e-4962-9549-8a8435b4dfc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.021015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef326ee-67a3-4101-bcaa-fbcc89ff5873 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.026596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.027484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.027781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.028202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.028953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.031143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.047015 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3108/6191] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:00.049148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.066345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f2573-f989-4e26-9196-e7121b976753 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.072802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.073663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.074096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.075275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.076049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.078364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.097676 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3109/6192] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:00.099141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.101657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d851a0-e73e-4962-9549-8a8435b4dfc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.104465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d851a0-e73e-4962-9549-8a8435b4dfc7 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.112368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3d2da-86f4-40ea-8f8b-89bf59b2038d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.117644 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3084/6193] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:06:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:07:00.118104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.119272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.119647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.120158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] PATH_INFO: `/v3/projects/9de3ebfb61864defbf6153b5151cff0d/users/f6b3711d234b4d9aaf243dbc0863e2ad/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.143766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de3ebfb61864defbf6153b5151cff0d, user_id=f6b3711d234b4d9aaf243dbc0863e2ad, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.150818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.179011 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3110/6194] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:00 2022] PUT /identity/v3/projects/9de3ebfb61864defbf6153b5151cff0d/users/f6b3711d234b4d9aaf243dbc0863e2ad/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:00.190425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634ac99-2cdf-4bb5-b479-89558f093b97 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.190686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634ac99-2cdf-4bb5-b479-89558f093b97 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.193140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634ac99-2cdf-4bb5-b479-89558f093b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.212101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.223391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.264776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b634ac99-2cdf-4bb5-b479-89558f093b97 None None] MFA Rules not processed for user `f6b3711d234b4d9aaf243dbc0863e2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:00.266790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b634ac99-2cdf-4bb5-b479-89558f093b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.409763 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3085/6195] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:00.410657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634ac99-2cdf-4bb5-b479-89558f093b97 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.415828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b3f33-7e56-4f0c-830f-dc9973a5b543 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.422765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.423698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.424880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.425167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] PATH_INFO: `/v3/users/dd1b670c79544a45b2ca9722d90b36b3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.428193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1b670c79544a45b2ca9722d90b36b3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.431255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.434544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634ac99-2cdf-4bb5-b479-89558f093b97 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.443441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.444657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.445129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.445669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] PATH_INFO: `/v3/users/8891584f9c184b42970a62594ce92c22` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.447132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8891584f9c184b42970a62594ce92c22)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.449106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.516787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1b670c79544a45b2ca9722d90b36b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.517973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1b670c79544a45b2ca9722d90b36b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.525509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1b670c79544a45b2ca9722d90b36b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.526545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1b670c79544a45b2ca9722d90b36b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.528067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8891584f9c184b42970a62594ce92c22'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.535544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1b670c79544a45b2ca9722d90b36b3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.537330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8891584f9c184b42970a62594ce92c22'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.538089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8891584f9c184b42970a62594ce92c22'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.538839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8891584f9c184b42970a62594ce92c22'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.546836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8891584f9c184b42970a62594ce92c22'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.558848 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3111/6196] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:00 2022] DELETE /identity/v3/users/dd1b670c79544a45b2ca9722d90b36b3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:00.560460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.562530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.567687 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3086/6197] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:00 2022] DELETE /identity/v3/users/8891584f9c184b42970a62594ce92c22 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:00.571255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.572840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.634832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09978c98-1623-4deb-adbe-cab5d9decc4f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.640506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c80b31-412f-4186-ab0f-9c5e67f3ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.641185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80b31-412f-4186-ab0f-9c5e67f3ac19 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.641467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80b31-412f-4186-ab0f-9c5e67f3ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.641746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80b31-412f-4186-ab0f-9c5e67f3ac19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.642560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a47a0-5459-4d3d-b284-1211c56ddf0e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.642701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c80b31-412f-4186-ab0f-9c5e67f3ac19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.644754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c80b31-412f-4186-ab0f-9c5e67f3ac19 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.647923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.648969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.649571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.649851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] PATH_INFO: `/v3/users/4fb48e4d50184d2e97674324027d9ec0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.651099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb48e4d50184d2e97674324027d9ec0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.653040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.678289 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3112/6198] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:00 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:00.678289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.678289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.678289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.697922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:00.699410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.707711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb48e4d50184d2e97674324027d9ec0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.722406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb48e4d50184d2e97674324027d9ec0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.723268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb48e4d50184d2e97674324027d9ec0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.725128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb48e4d50184d2e97674324027d9ec0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.743100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-59007fc6-58d5-4643-b33b-5cdfcf462dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb48e4d50184d2e97674324027d9ec0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:00.774199 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3087/6199] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:00 2022] DELETE /identity/v3/users/4fb48e4d50184d2e97674324027d9ec0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:00.777868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.778165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.778443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.789495 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3113/6200] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:00.790588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.793154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.804180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:00.805556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.840894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2452654-7456-4b99-a309-f7e7f0602868 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.898732 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3088/6201] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:00.899625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.901230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.940407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.941430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.941430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.941639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.942295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:00.944271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:00.975893 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3114/6202] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:00 2022] POST /identity/v3/users => generated 307 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:00.977319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:00.979681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:00.990318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b154e7-3554-48fc-8d5a-9e2e1a165c71 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:00.994748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:00.995439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:00.995718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:00.995992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:00.999254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20096b-8ad7-425e-94bb-d761d397465e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.003657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.004393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.004744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.005090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.007266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.008765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.020407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.021892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.032767 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3115/6203] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:01.033404 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3089/6204] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:01.033579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.050944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.052764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14ca28-6507-47b5-b395-6583b83ca2e3 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.053550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:01.063721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.064626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.064915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.065223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.065953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.067614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.086864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfcdbb-02b4-4c7c-bdf2-63b17dab8d8b service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.116187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3116/6205] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:01.119616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.119967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.121137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.121474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.121679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] PATH_INFO: `/v3/projects/8130c27f2b84434a8d6fa5032b67aa1e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.130466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8130c27f2b84434a8d6fa5032b67aa1e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.134845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.146193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d1a7d-dc3f-4ca4-8fb8-4af1dd3a2a5b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.154370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.156328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.156831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.158458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] PATH_INFO: `/v3/projects/21d4192b02384e008ee2fd1306f4460b/users/3df417006d2b4b739eb3aeae9d172827/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.187820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d4192b02384e008ee2fd1306f4460b, user_id=3df417006d2b4b739eb3aeae9d172827, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.191740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.219541 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3117/6206] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:01 2022] PUT /identity/v3/projects/21d4192b02384e008ee2fd1306f4460b/users/3df417006d2b4b739eb3aeae9d172827/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:01.220571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.269036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8130c27f2b84434a8d6fa5032b67aa1e', 'request_id': 'req-e64149d4-5b47-481d-975a-d4bb695cc3f4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.287451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8130c27f2b84434a8d6fa5032b67aa1e', 'request_id': 'req-e64149d4-5b47-481d-975a-d4bb695cc3f4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.304021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8130c27f2b84434a8d6fa5032b67aa1e', 'request_id': 'req-e64149d4-5b47-481d-975a-d4bb695cc3f4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.322405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] The token cache is being invalidate because project 8130c27f2b84434a8d6fa5032b67aa1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:01.322746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.323884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e64149d4-5b47-481d-975a-d4bb695cc3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.331181 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3090/6207] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:01 2022] DELETE /identity/v3/projects/8130c27f2b84434a8d6fa5032b67aa1e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:01.332818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672e1b-beb0-414b-9912-4c3e147e799c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.333165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672e1b-beb0-414b-9912-4c3e147e799c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.333347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68672e1b-beb0-414b-9912-4c3e147e799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.355387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-68672e1b-beb0-414b-9912-4c3e147e799c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:01.356829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68672e1b-beb0-414b-9912-4c3e147e799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:01.377755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e518d6f-2fb9-409a-b8e2-60c2576e142b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.478832 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3091/6208] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:01.479751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.480655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.481045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.481493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.482339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.484705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.485434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f043-1f04-4783-aa80-1124eec8f1e5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.485725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f043-1f04-4783-aa80-1124eec8f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.486005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3f043-1f04-4783-aa80-1124eec8f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.500884 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3118/6209] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:01.502391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.505135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:01.522760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad118f-1a8c-4430-badd-018f0dcab655 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.528439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4645836-504a-4b0e-af3c-8bfdbbd6ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.530129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645836-504a-4b0e-af3c-8bfdbbd6ac8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.530375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645836-504a-4b0e-af3c-8bfdbbd6ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.531328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645836-504a-4b0e-af3c-8bfdbbd6ac8b admin admin] PATH_INFO: `/v3/projects/21d4192b02384e008ee2fd1306f4460b/users/3df417006d2b4b739eb3aeae9d172827/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.532967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-63b3f043-1f04-4783-aa80-1124eec8f1e5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:01.535356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4645836-504a-4b0e-af3c-8bfdbbd6ac8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d4192b02384e008ee2fd1306f4460b, user_id=3df417006d2b4b739eb3aeae9d172827, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.536455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-63b3f043-1f04-4783-aa80-1124eec8f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:01.536641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4645836-504a-4b0e-af3c-8bfdbbd6ac8b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.568087 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3119/6210] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:01 2022] PUT /identity/v3/projects/21d4192b02384e008ee2fd1306f4460b/users/3df417006d2b4b739eb3aeae9d172827/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:01.570414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced5a3-6731-4d8c-a97a-4f1a29e08a72 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.573114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced5a3-6731-4d8c-a97a-4f1a29e08a72 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.573521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced5a3-6731-4d8c-a97a-4f1a29e08a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.614959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9dced5a3-6731-4d8c-a97a-4f1a29e08a72 None None] MFA Rules not processed for user `3df417006d2b4b739eb3aeae9d172827`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:01.616832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9dced5a3-6731-4d8c-a97a-4f1a29e08a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:01.632517 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3092/6211] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:01.636970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3f043-1f04-4783-aa80-1124eec8f1e5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.648028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3f043-1f04-4783-aa80-1124eec8f1e5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.654330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.657119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.657728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.658173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.659269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:01.660184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.662469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.711960 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3093/6212] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:07:01.713349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.715708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:01.732774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a461c-e1eb-4389-98e0-3faca7add759 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.739806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.740965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.741495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.741979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] PATH_INFO: `/v3/projects/c3928192a2d34e3aa29c4bc173f32a48` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.742627 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3120/6213] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:01.743971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dced5a3-6731-4d8c-a97a-4f1a29e08a72 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.748876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3928192a2d34e3aa29c4bc173f32a48)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.751395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.769776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dced5a3-6731-4d8c-a97a-4f1a29e08a72 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.785175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.785811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.786111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.790293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.791122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.793361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.822324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3928192a2d34e3aa29c4bc173f32a48', 'request_id': 'req-302c7fcf-4aa4-48ec-983d-4027d430b672'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.832313 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3121/6214] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:01 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:01.833136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.834751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3928192a2d34e3aa29c4bc173f32a48', 'request_id': 'req-302c7fcf-4aa4-48ec-983d-4027d430b672'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.844434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3928192a2d34e3aa29c4bc173f32a48', 'request_id': 'req-302c7fcf-4aa4-48ec-983d-4027d430b672'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.856623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] The token cache is being invalidate because project c3928192a2d34e3aa29c4bc173f32a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:01.857353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.857828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:01.860487 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3094/6215] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:01 2022] DELETE /identity/v3/projects/c3928192a2d34e3aa29c4bc173f32a48 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:01.861283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.863147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:01.924701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113aaf-92c1-4575-9dd9-29edf6f1cc15 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.940813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3df417006d2b4b739eb3aeae9d172827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d4192b02384e008ee2fd1306f4460b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:01.941209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7fcf-4aa4-48ec-983d-4027d430b672 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:01.941506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:01.941781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:01.942066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:01.942856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:01.944457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:01.966518 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3122/6216] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:01 2022] POST /identity/v3/roles => generated 239 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:01.968264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:01.970244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.030496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.032190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.032655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.032941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] PATH_INFO: `/v3/projects/10b9ce9c81e24948951560bcffd86ca8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.034213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b9ce9c81e24948951560bcffd86ca8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.037082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.062931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02140b46-707a-4cbb-8b44-d319001feed9 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.068283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f35571-54ba-4295-8cc5-9f0ed9abbae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.069143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35571-54ba-4295-8cc5-9f0ed9abbae9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.069434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35571-54ba-4295-8cc5-9f0ed9abbae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.069708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f35571-54ba-4295-8cc5-9f0ed9abbae9 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.070449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f35571-54ba-4295-8cc5-9f0ed9abbae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.072482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f35571-54ba-4295-8cc5-9f0ed9abbae9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.099726 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3123/6217] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:01 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:02.104485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.104781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.105180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.124980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:02.126321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.127612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b9ce9c81e24948951560bcffd86ca8', 'request_id': 'req-712c9fb8-cf91-4b22-83be-9573c5f6554e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.135830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b9ce9c81e24948951560bcffd86ca8', 'request_id': 'req-712c9fb8-cf91-4b22-83be-9573c5f6554e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.151172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b9ce9c81e24948951560bcffd86ca8', 'request_id': 'req-712c9fb8-cf91-4b22-83be-9573c5f6554e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.170672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] The token cache is being invalidate because project 10b9ce9c81e24948951560bcffd86ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:02.171056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.171875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.173699 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3095/6218] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:01 2022] DELETE /identity/v3/projects/10b9ce9c81e24948951560bcffd86ca8 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:02.175019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.176204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.225876 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3124/6219] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:02.226728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.232998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.245094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec244a-455c-4051-b97b-0c5252e2d153 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.255601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.257309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c9fb8-cf91-4b22-83be-9573c5f6554e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.257842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.258351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.259532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.260983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.262950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.263086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441466d-b45b-4c68-a562-0716f9061455 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3df417006d2b4b739eb3aeae9d172827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d4192b02384e008ee2fd1306f4460b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.265083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441466d-b45b-4c68-a562-0716f9061455 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.265370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441466d-b45b-4c68-a562-0716f9061455 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.265646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441466d-b45b-4c68-a562-0716f9061455 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] PATH_INFO: `/v3/projects/9de3ebfb61864defbf6153b5151cff0d/users/f6b3711d234b4d9aaf243dbc0863e2ad/roles/61bd2ad8714642cd9cfbea1561725d50` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.271573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441466d-b45b-4c68-a562-0716f9061455 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9de3ebfb61864defbf6153b5151cff0d, user_id=f6b3711d234b4d9aaf243dbc0863e2ad, role_id=61bd2ad8714642cd9cfbea1561725d50)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.277686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441466d-b45b-4c68-a562-0716f9061455 tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.293137 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3125/6220] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:02 2022] GET /identity/v3/roles => generated 1650 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:02.293137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.294558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.301537 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3096/6221] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:02 2022] PUT /identity/v3/projects/9de3ebfb61864defbf6153b5151cff0d/users/f6b3711d234b4d9aaf243dbc0863e2ad/roles/61bd2ad8714642cd9cfbea1561725d50 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:02.303162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d201e1-d963-4442-b06c-9a9fedb61cfc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.303621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d201e1-d963-4442-b06c-9a9fedb61cfc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.306235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d201e1-d963-4442-b06c-9a9fedb61cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.317202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0b26-e17e-4c9a-a8dc-14cde6555eb1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.333225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-93d201e1-d963-4442-b06c-9a9fedb61cfc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:02.334445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-93d201e1-d963-4442-b06c-9a9fedb61cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.404546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.406674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.407021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.407304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] PATH_INFO: `/v3/users/b94c6965fdbc439eae324f6e2d35e5b9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.408742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94c6965fdbc439eae324f6e2d35e5b9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.411309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.425596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3097/6222] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:02.426430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d201e1-d963-4442-b06c-9a9fedb61cfc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.443392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d201e1-d963-4442-b06c-9a9fedb61cfc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.449150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.449949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.450236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.450560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.451401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.453383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.466075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3098/6223] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:02 2022] GET /identity/v3/roles => generated 1650 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:02.467427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.474081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.482465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94c6965fdbc439eae324f6e2d35e5b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.484264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94c6965fdbc439eae324f6e2d35e5b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.494999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94c6965fdbc439eae324f6e2d35e5b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.496097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94c6965fdbc439eae324f6e2d35e5b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.508473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94c6965fdbc439eae324f6e2d35e5b9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:02.529818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3126/6224] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:02 2022] DELETE /identity/v3/users/b94c6965fdbc439eae324f6e2d35e5b9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:02.530896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.532384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.564607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7660fd-43ea-433d-b69d-eaf11fc063de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.604700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fbc08-6377-4703-a3bb-1b51f98cc844 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.610207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.610916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.611675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.611675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.612202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:02.612513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.614367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.631330 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3127/6225] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:02.632198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.634281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.648176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb9ae1-e67c-4038-bcdc-59612231dede admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.652482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce340c02-9972-427e-9528-267a118d5797 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b3711d234b4d9aaf243dbc0863e2ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de3ebfb61864defbf6153b5151cff0d', 'project_domain_id': 'default', 'roles': ['tempest-test_role-313305615', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.653434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce340c02-9972-427e-9528-267a118d5797 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.653734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce340c02-9972-427e-9528-267a118d5797 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.653996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce340c02-9972-427e-9528-267a118d5797 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] PATH_INFO: `/v3/users/f6b3711d234b4d9aaf243dbc0863e2ad/application_credentials` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.654762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce340c02-9972-427e-9528-267a118d5797 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] RBAC: Authorizing `identity:create_application_credential(user_id=f6b3711d234b4d9aaf243dbc0863e2ad)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.655583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.656052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce340c02-9972-427e-9528-267a118d5797 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.656612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.656932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.657306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] PATH_INFO: `/v3/projects/fa44fb7b4b2a45638e1af606b5199f69/users/30dc046a307a4cb28d9dbffdbade05a5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.687394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa44fb7b4b2a45638e1af606b5199f69, user_id=30dc046a307a4cb28d9dbffdbade05a5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.692194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.719357 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3128/6226] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:02 2022] PUT /identity/v3/projects/fa44fb7b4b2a45638e1af606b5199f69/users/30dc046a307a4cb28d9dbffdbade05a5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:02.719357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:02.799597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc29d5-4a2e-4901-a021-cf573854b68c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:02.806210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c841dc4-c68f-41d7-9b7d-827667a88db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:02.807733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841dc4-c68f-41d7-9b7d-827667a88db6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.808289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841dc4-c68f-41d7-9b7d-827667a88db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.808707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841dc4-c68f-41d7-9b7d-827667a88db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.809542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c841dc4-c68f-41d7-9b7d-827667a88db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:02.811741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c841dc4-c68f-41d7-9b7d-827667a88db6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:02.831521 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3099/6227] 10.222.0.32 () {60 vars in 1314 bytes} [Sat May 7 22:07:02 2022] POST /identity/v3/users/f6b3711d234b4d9aaf243dbc0863e2ad/application_credentials => generated 659 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:02.833748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84533-409f-421c-b70c-c2dca3c7f33b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.834039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84533-409f-421c-b70c-c2dca3c7f33b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.834411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa84533-409f-421c-b70c-c2dca3c7f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.850943 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3129/6228] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:02 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:02.852646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:02.853011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:02.853367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:02.875558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1aa84533-409f-421c-b70c-c2dca3c7f33b None None] MFA Rules not processed for user `30dc046a307a4cb28d9dbffdbade05a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:02.876822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1aa84533-409f-421c-b70c-c2dca3c7f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:02.882669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] MFA Rules not processed for user `f6b3711d234b4d9aaf243dbc0863e2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:02.884208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.003956 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3100/6229] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:03.004756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84533-409f-421c-b70c-c2dca3c7f33b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.037190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3130/6230] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:02 2022] POST /identity/v3/auth/tokens => generated 3386 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) May 07 22:07:03.038352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.039978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.080985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa84533-409f-421c-b70c-c2dca3c7f33b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.086184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.086891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.087179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.087449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.088132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.090072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.114129 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3101/6231] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:03 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:03.114393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3ac3d-28e1-4b36-b953-7c22ae44407b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.117910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.120060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.120212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.121184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.121543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.121898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] PATH_INFO: `/v3/projects/794043b9e12a47aa9a452b6b869aee3d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.123461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=794043b9e12a47aa9a452b6b869aee3d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.125569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.179155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794043b9e12a47aa9a452b6b869aee3d', 'request_id': 'req-d62c81bc-b7c0-4257-b3d6-46d509787b87'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.185840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794043b9e12a47aa9a452b6b869aee3d', 'request_id': 'req-d62c81bc-b7c0-4257-b3d6-46d509787b87'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.194718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794043b9e12a47aa9a452b6b869aee3d', 'request_id': 'req-d62c81bc-b7c0-4257-b3d6-46d509787b87'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.204108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b974-a16f-4247-9f11-b36e68d4a9c0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.207963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] The token cache is being invalidate because project 794043b9e12a47aa9a452b6b869aee3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:03.208259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.208922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.216445 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3131/6232] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:03 2022] DELETE /identity/v3/projects/794043b9e12a47aa9a452b6b869aee3d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:03.218563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.220280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.272669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bdeff-004a-4d57-a58e-705350db945a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.273351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdeff-004a-4d57-a58e-705350db945a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.273545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdeff-004a-4d57-a58e-705350db945a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.273908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdeff-004a-4d57-a58e-705350db945a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.276381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-857bdeff-004a-4d57-a58e-705350db945a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.296043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c81bc-b7c0-4257-b3d6-46d509787b87 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.300931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6b3711d234b4d9aaf243dbc0863e2ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de3ebfb61864defbf6153b5151cff0d', 'project_domain_id': 'default', 'roles': ['tempest-test_role-313305615', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.301876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.302165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.302444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] PATH_INFO: `/v3/users/f6b3711d234b4d9aaf243dbc0863e2ad/application_credentials/3e379c6c62664d6092ab21af82fe25ad` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.303712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] RBAC: Authorizing `identity:delete_application_credential(user_id=f6b3711d234b4d9aaf243dbc0863e2ad, application_credential_id=3e379c6c62664d6092ab21af82fe25ad)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.305239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.332446 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3132/6233] 10.222.0.32 () {58 vars in 1394 bytes} [Sat May 7 22:07:03 2022] DELETE /identity/v3/users/f6b3711d234b4d9aaf243dbc0863e2ad/application_credentials/3e379c6c62664d6092ab21af82fe25ad => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:03.333622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.335571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.348741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bdeff-004a-4d57-a58e-705350db945a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.350517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bdeff-004a-4d57-a58e-705350db945a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.360781 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3102/6234] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:03.362100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58fa8-c464-4ffd-9b46-436520f859bb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.362394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58fa8-c464-4ffd-9b46-436520f859bb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.362677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58fa8-c464-4ffd-9b46-436520f859bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.385534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-81c58fa8-c464-4ffd-9b46-436520f859bb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:03.386756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-81c58fa8-c464-4ffd-9b46-436520f859bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.413507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b275-97d6-4507-87d8-64b94b6d4661 tempest-ApplicationCredentialsV3AdminTest-1915946869 tempest-ApplicationCredentialsV3AdminTest-1915946869-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.418625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.419251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.419598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.420002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.420822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.422660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.433352 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3133/6235] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:03 2022] GET /identity/v3/roles => generated 1650 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:03.434008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.437111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.459478 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3103/6236] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:03.461711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c311a-8b02-49f3-9f31-25f567ffdedd None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.462288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c311a-8b02-49f3-9f31-25f567ffdedd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.463017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c311a-8b02-49f3-9f31-25f567ffdedd None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.465620 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3104/6237] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:07:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:07:03.466429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c311a-8b02-49f3-9f31-25f567ffdedd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.485623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c311a-8b02-49f3-9f31-25f567ffdedd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.492642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15c14a-e710-4353-aef9-4ddd9786d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.493317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c14a-e710-4353-aef9-4ddd9786d9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.493598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c14a-e710-4353-aef9-4ddd9786d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.493873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15c14a-e710-4353-aef9-4ddd9786d9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.494595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15c14a-e710-4353-aef9-4ddd9786d9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.496267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15c14a-e710-4353-aef9-4ddd9786d9e4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.510718 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3105/6238] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:03 2022] GET /identity/v3/roles => generated 1650 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:03.510718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.510718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.510718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.517837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9f22e-6676-4eb2-b432-baf445401a46 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.522619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3df417006d2b4b739eb3aeae9d172827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21d4192b02384e008ee2fd1306f4460b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.525687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.525687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.525687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] PATH_INFO: `/v3/roles/61bd2ad8714642cd9cfbea1561725d50` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.527205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: Authorizing `identity:delete_role(role_id=61bd2ad8714642cd9cfbea1561725d50)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.528834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.532076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:03.533660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.545302 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3106/6239] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:03.546874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 22:07:03.550400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.571131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.579765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Invalidating the token cache because role 61bd2ad8714642cd9cfbea1561725d50 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:03.580168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.580962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.583234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ab778-6aa3-427b-9bed-71a55f544604 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.583376 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3134/6240] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:03 2022] DELETE /identity/v3/roles/61bd2ad8714642cd9cfbea1561725d50 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:03.587759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.589441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.641855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30dc046a307a4cb28d9dbffdbade05a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa44fb7b4b2a45638e1af606b5199f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.643041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.643819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.644123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] PATH_INFO: `/v3/projects/fa44fb7b4b2a45638e1af606b5199f69` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.645057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorizing `identity:get_project(project_id=fa44fb7b4b2a45638e1af606b5199f69)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.647120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.649863 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3107/6241] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 22:07:03 2022] GET /identity/v3/projects/fa44fb7b4b2a45638e1af606b5199f69 => generated 363 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:03.650625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.653001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.662528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb59a7-6e75-4eaa-98b0-fb8a845d570f tempest-ApplicationCredentialsV3AdminTest-919006597 tempest-ApplicationCredentialsV3AdminTest-919006597-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.669750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f697987-2360-4e92-8c66-ce024f121f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.670837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697987-2360-4e92-8c66-ce024f121f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.671130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697987-2360-4e92-8c66-ce024f121f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.671413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697987-2360-4e92-8c66-ce024f121f08 admin admin] PATH_INFO: `/v3/projects/857cebb18791481798ed1576347f4a94/users/a064fb34df8a4b9abee8895c96bc19ab/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.673115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352689-db71-4747-86b9-df0107192ce2 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.679275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.679989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.680275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.680554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.681700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:03.682599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.683945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.688963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f697987-2360-4e92-8c66-ce024f121f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857cebb18791481798ed1576347f4a94, user_id=a064fb34df8a4b9abee8895c96bc19ab, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.692559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f697987-2360-4e92-8c66-ce024f121f08 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.699307 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3108/6242] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:03.706945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.710272 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3135/6243] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:03 2022] PUT /identity/v3/projects/857cebb18791481798ed1576347f4a94/users/a064fb34df8a4b9abee8895c96bc19ab/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:03.711459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d1ca-1ef2-4d0f-b188-402a833a5cf1 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.711748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d1ca-1ef2-4d0f-b188-402a833a5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.712027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d1ca-1ef2-4d0f-b188-402a833a5cf1 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.716530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.717898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3136/6244] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:07:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:07:03.718711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d1ca-1ef2-4d0f-b188-402a833a5cf1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:03.737620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f942c8-483c-4497-9419-f19887d9417f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.849303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.850200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.850503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.851641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] PATH_INFO: `/v3/users/f6b3711d234b4d9aaf243dbc0863e2ad` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.852257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d1ca-1ef2-4d0f-b188-402a833a5cf1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:03.852745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b3711d234b4d9aaf243dbc0863e2ad)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.855300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.865554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:03.866528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.867000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.867445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:03.868609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:03.870790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:03.913100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3137/6245] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:03 2022] POST /identity/v3/projects => generated 409 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:03.914302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 22:07:03.922707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b3711d234b4d9aaf243dbc0863e2ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.924933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:03.930871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b3711d234b4d9aaf243dbc0863e2ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.931621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b3711d234b4d9aaf243dbc0863e2ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.933066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b3711d234b4d9aaf243dbc0863e2ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.946526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1e71315a-f61d-45d2-9cf7-e482e886af15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b3711d234b4d9aaf243dbc0863e2ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:03.987046 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3109/6246] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:03 2022] DELETE /identity/v3/users/f6b3711d234b4d9aaf243dbc0863e2ad => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:03.989165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:03.989465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:03.989747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.045146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] MFA Rules not processed for user `a064fb34df8a4b9abee8895c96bc19ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:04.047403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.084426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.092946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.159832 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3110/6247] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:04.160794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.162492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.247862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b552a-65cc-421c-bab9-dd81faba4206 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:04.275156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaba8de-7093-406e-ab34-ec0373e91969 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:04.280193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480453ff-8534-4fe7-bdea-976622dc067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:04.280886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480453ff-8534-4fe7-bdea-976622dc067a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.281173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480453ff-8534-4fe7-bdea-976622dc067a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.281507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480453ff-8534-4fe7-bdea-976622dc067a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.282209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480453ff-8534-4fe7-bdea-976622dc067a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:04.285439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480453ff-8534-4fe7-bdea-976622dc067a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:04.330089 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3111/6248] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:04 2022] POST /identity/v3/users => generated 305 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:04.331892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478680e-0b4d-475e-9166-38528fc62a51 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.332186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478680e-0b4d-475e-9166-38528fc62a51 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.332789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478680e-0b4d-475e-9166-38528fc62a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.392233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7478680e-0b4d-475e-9166-38528fc62a51 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:04.393483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7478680e-0b4d-475e-9166-38528fc62a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.403423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30dc046a307a4cb28d9dbffdbade05a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa44fb7b4b2a45638e1af606b5199f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:04.405456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.405456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.405456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] PATH_INFO: `/v3/projects/fa44fb7b4b2a45638e1af606b5199f69` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.405930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorizing `identity:get_project(project_id=fa44fb7b4b2a45638e1af606b5199f69)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:04.408562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:04.411567 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3138/6249] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 22:07:03 2022] GET /identity/v3/projects/fa44fb7b4b2a45638e1af606b5199f69 => generated 363 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:04.412239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.413939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.425347 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3112/6250] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:04.427330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478680e-0b4d-475e-9166-38528fc62a51 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.466278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478680e-0b4d-475e-9166-38528fc62a51 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:04.479796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:04.480578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.480977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.481370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.482967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:04.485981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:04.501557 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3113/6251] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:04.503096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.504721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.538115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f26eeb-d64c-4298-b810-e93386513018 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:04.545199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f1f8a-452f-490e-ac08-e4dd6db984f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:04.545984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f1f8a-452f-490e-ac08-e4dd6db984f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.549297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f1f8a-452f-490e-ac08-e4dd6db984f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.550553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f1f8a-452f-490e-ac08-e4dd6db984f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.570074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f1f8a-452f-490e-ac08-e4dd6db984f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:04.572149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f1f8a-452f-490e-ac08-e4dd6db984f8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:04.586484 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3139/6252] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:04.588654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210483-9586-4eab-a1a7-723ae1432f8c None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.589188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210483-9586-4eab-a1a7-723ae1432f8c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.589595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd210483-9586-4eab-a1a7-723ae1432f8c None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.591315 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3140/6253] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:07:04.592136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210483-9586-4eab-a1a7-723ae1432f8c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.614951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0df63-78ee-4e7c-8e5d-ddeafa43bf23 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:04.617411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd210483-9586-4eab-a1a7-723ae1432f8c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:04.621505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:04.622572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.622832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:04.623901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.624432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.624657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.624950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.625336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.626149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:04.628325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:04.640049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:04.640955 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3141/6254] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:04.641894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 22:07:04.642154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:04.644023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.661395 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3114/6255] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:04.662192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.678046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23275c60-6893-4acc-9241-670c11797f6c service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:04.683776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108512b9-b983-4587-8971-f04953ca0c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:04.684775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108512b9-b983-4587-8971-f04953ca0c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.685093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108512b9-b983-4587-8971-f04953ca0c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.685377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108512b9-b983-4587-8971-f04953ca0c72 admin admin] PATH_INFO: `/v3/projects/4584d3cb399e419e80cdbb072ba0c5d1/users/e1e1460ae4d742e1ac943fa98e74d9ad/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.707108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108512b9-b983-4587-8971-f04953ca0c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4584d3cb399e419e80cdbb072ba0c5d1, user_id=e1e1460ae4d742e1ac943fa98e74d9ad, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:04.709896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108512b9-b983-4587-8971-f04953ca0c72 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:04.760059 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3115/6256] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:04 2022] PUT /identity/v3/projects/4584d3cb399e419e80cdbb072ba0c5d1/users/e1e1460ae4d742e1ac943fa98e74d9ad/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:04.770268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf172d1-a0a6-48a0-89ab-34b440ac672b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:04.770944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf172d1-a0a6-48a0-89ab-34b440ac672b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:04.771552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf172d1-a0a6-48a0-89ab-34b440ac672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:04.818715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:04.823969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.864733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9bf172d1-a0a6-48a0-89ab-34b440ac672b None None] MFA Rules not processed for user `e1e1460ae4d742e1ac943fa98e74d9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:04.875052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9bf172d1-a0a6-48a0-89ab-34b440ac672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:04.898662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8ac5d-f6e1-4b47-a87d-3d823693c017 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.088686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4361dab-9cd5-4eb9-a11b-595d749af7ba tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30dc046a307a4cb28d9dbffdbade05a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa44fb7b4b2a45638e1af606b5199f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.091349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361dab-9cd5-4eb9-a11b-595d749af7ba tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.092500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361dab-9cd5-4eb9-a11b-595d749af7ba tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.092929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4361dab-9cd5-4eb9-a11b-595d749af7ba tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] PATH_INFO: `/v3/projects/fa44fb7b4b2a45638e1af606b5199f69` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.098386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4361dab-9cd5-4eb9-a11b-595d749af7ba tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorizing `identity:get_project(project_id=fa44fb7b4b2a45638e1af606b5199f69)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.100574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4361dab-9cd5-4eb9-a11b-595d749af7ba tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.113998 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3116/6257] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:05.118405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf172d1-a0a6-48a0-89ab-34b440ac672b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.136998 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3142/6258] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 22:07:04 2022] GET /identity/v3/projects/fa44fb7b4b2a45638e1af606b5199f69 => generated 363 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:05.161082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd1997-2510-4093-8869-88615a310479 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.161526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd1997-2510-4093-8869-88615a310479 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.161884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd1997-2510-4093-8869-88615a310479 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.163946 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3143/6259] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:07:05.169088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd1997-2510-4093-8869-88615a310479 None None] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 22:07:05.250421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf172d1-a0a6-48a0-89ab-34b440ac672b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.258448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.259704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.260051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.260514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.261523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.265500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.313615 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3117/6260] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:05 2022] POST /identity/v3/projects => generated 407 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:05.318451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.333028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd1997-2510-4093-8869-88615a310479 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.370002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd1997-2510-4093-8869-88615a310479 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.422450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ede76e-c829-4230-b10e-3b0eab91dc3a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.429832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.431309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.431668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.432495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.433202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.438197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.483721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30dc046a307a4cb28d9dbffdbade05a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa44fb7b4b2a45638e1af606b5199f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.484731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.487339 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3118/6261] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:05 2022] POST /identity/v3/users => generated 310 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:05.488412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.488678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.489131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] PATH_INFO: `/v3/projects/fa44fb7b4b2a45638e1af606b5199f69` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.490389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorizing `identity:get_project(project_id=fa44fb7b4b2a45638e1af606b5199f69)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.493570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.497140 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3144/6262] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 22:07:05 2022] GET /identity/v3/projects/fa44fb7b4b2a45638e1af606b5199f69 => generated 363 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:07:05.501287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e67a63-bef1-4bdf-b2be-6ca70d0e7f47 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.506262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a330eee-7aaa-4e95-8df5-de16549b4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.506964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a330eee-7aaa-4e95-8df5-de16549b4b5e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.507251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a330eee-7aaa-4e95-8df5-de16549b4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.507527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a330eee-7aaa-4e95-8df5-de16549b4b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.520267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a330eee-7aaa-4e95-8df5-de16549b4b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.522518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a330eee-7aaa-4e95-8df5-de16549b4b5e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.545280 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3119/6263] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:05.546862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.570524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec110e27-598b-4710-b32d-db59af85ce16 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.572028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec110e27-598b-4710-b32d-db59af85ce16 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.573237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c9a9-223b-40a9-8017-1d762e86e824 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.573627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec110e27-598b-4710-b32d-db59af85ce16 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.583536 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3120/6264] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:07:05 2022] GET /identity => generated 270 bytes in 35 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:07:05.586935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec110e27-598b-4710-b32d-db59af85ce16 None None] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 22:07:05.596621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.600125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.601397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.603035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] PATH_INFO: `/v3/projects/279c4a5ee66248aa87e548e3d09c5c1c/users/54a2baee14b740b8b65294adc272668a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.623430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279c4a5ee66248aa87e548e3d09c5c1c, user_id=54a2baee14b740b8b65294adc272668a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.630677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.667123 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3145/6265] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:05 2022] PUT /identity/v3/projects/279c4a5ee66248aa87e548e3d09c5c1c/users/54a2baee14b740b8b65294adc272668a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:05.668605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.696622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec110e27-598b-4710-b32d-db59af85ce16 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.709281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec110e27-598b-4710-b32d-db59af85ce16 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.745728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e78b4-394f-4599-b3a7-958161167729 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.753643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.754695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.755029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.755315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.756054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.758377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.788613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3146/6266] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:05.794721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.797465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e0521-de0d-4c7c-993e-e055e36a9689 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30dc046a307a4cb28d9dbffdbade05a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa44fb7b4b2a45638e1af606b5199f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.807869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0521-de0d-4c7c-993e-e055e36a9689 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.808552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0521-de0d-4c7c-993e-e055e36a9689 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.809036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e0521-de0d-4c7c-993e-e055e36a9689 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] PATH_INFO: `/v3/projects/fa44fb7b4b2a45638e1af606b5199f69` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.815989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e314a-a269-4ffb-b6e5-a033e2d3089d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:05.822068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:05.823086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.823306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.823739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] PATH_INFO: `/v3/projects/279c4a5ee66248aa87e548e3d09c5c1c/users/54a2baee14b740b8b65294adc272668a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.825236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e0521-de0d-4c7c-993e-e055e36a9689 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorizing `identity:get_project(project_id=fa44fb7b4b2a45638e1af606b5199f69)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.827219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] RBAC: Authorizing `identity:create_grant(project_id=279c4a5ee66248aa87e548e3d09c5c1c, user_id=54a2baee14b740b8b65294adc272668a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:05.828428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e0521-de0d-4c7c-993e-e055e36a9689 tempest-QuotasTestJSON-326162887 tempest-QuotasTestJSON-326162887-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.830656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:05.832039 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3121/6267] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 22:07:05 2022] GET /identity/v3/projects/fa44fb7b4b2a45638e1af606b5199f69 => generated 363 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:07:05.852853 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3147/6268] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:05 2022] PUT /identity/v3/projects/279c4a5ee66248aa87e548e3d09c5c1c/users/54a2baee14b740b8b65294adc272668a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:05.855703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:05.856239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:05.856829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:05.877389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:05.880108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:05.920830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] MFA Rules not processed for user `54a2baee14b740b8b65294adc272668a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:05.922229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.023970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d0920-dbe9-4141-8794-9f54cb65480c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.039846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.042351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.042644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.045827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] PATH_INFO: `/v3/users/30dc046a307a4cb28d9dbffdbade05a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.048491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dc046a307a4cb28d9dbffdbade05a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:06.049623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:06.087690 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3122/6269] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:05 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:06.088954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:06.090557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.109743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b37462-d3a9-4357-a24f-69ce65418ada None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.124512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.125571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.126202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.126202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] PATH_INFO: `/v3/projects/9de3ebfb61864defbf6153b5151cff0d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.127549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de3ebfb61864defbf6153b5151cff0d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:06.134158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:06.162226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dc046a307a4cb28d9dbffdbade05a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.164220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dc046a307a4cb28d9dbffdbade05a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.180024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dc046a307a4cb28d9dbffdbade05a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.180784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dc046a307a4cb28d9dbffdbade05a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.210662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dc046a307a4cb28d9dbffdbade05a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.258957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de3ebfb61864defbf6153b5151cff0d', 'request_id': 'req-4fa1e56c-ade5-4f18-87b7-b5f410886a12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.262275 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3148/6270] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:05 2022] DELETE /identity/v3/users/30dc046a307a4cb28d9dbffdbade05a5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:06.263551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:06.268667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de3ebfb61864defbf6153b5151cff0d', 'request_id': 'req-4fa1e56c-ade5-4f18-87b7-b5f410886a12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.272368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.280092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de3ebfb61864defbf6153b5151cff0d', 'request_id': 'req-4fa1e56c-ade5-4f18-87b7-b5f410886a12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.298998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] The token cache is being invalidate because project 9de3ebfb61864defbf6153b5151cff0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:06.299728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.301555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4fa1e56c-ade5-4f18-87b7-b5f410886a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.304258 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3123/6271] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:06 2022] DELETE /identity/v3/projects/9de3ebfb61864defbf6153b5151cff0d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:06.306577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.307431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.307889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.334874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:06.337150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.369729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e78b-26d2-4f1c-bfde-e84445f142f8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.375316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.375988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.376279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.376568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.378691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.448098 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3124/6272] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:06.448098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:06.454820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.474277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd590d-7ea5-4803-a345-4a3ee6dac4bc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.480870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.481138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:06.481758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.482038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.482313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] PATH_INFO: `/v3/users/a064fb34df8a4b9abee8895c96bc19ab` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.486462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a064fb34df8a4b9abee8895c96bc19ab)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:06.486462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:06.488734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:06.501960 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3149/6273] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:06 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:06.502846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:06.504185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.519966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832db4-c5dc-48f1-8d3e-2d6cf4488027 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.525794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.526811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.527147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.527464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] PATH_INFO: `/v3/users/3df417006d2b4b739eb3aeae9d172827` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.528758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df417006d2b4b739eb3aeae9d172827)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:06.531543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:06.573009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a064fb34df8a4b9abee8895c96bc19ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.582971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a064fb34df8a4b9abee8895c96bc19ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.584812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a064fb34df8a4b9abee8895c96bc19ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.585933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a064fb34df8a4b9abee8895c96bc19ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.598508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a064fb34df8a4b9abee8895c96bc19ab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.610658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df417006d2b4b739eb3aeae9d172827'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.611371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df417006d2b4b739eb3aeae9d172827'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.619887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df417006d2b4b739eb3aeae9d172827'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.620710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df417006d2b4b739eb3aeae9d172827'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.632057 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3125/6274] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:06 2022] DELETE /identity/v3/users/a064fb34df8a4b9abee8895c96bc19ab => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:06.633008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:06.634295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee92149a-8953-4cb5-b612-a24579bd757e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df417006d2b4b739eb3aeae9d172827'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:06.636251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.656312 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3150/6275] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:06 2022] DELETE /identity/v3/users/3df417006d2b4b739eb3aeae9d172827 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:06.657933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.658225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.658504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.702765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:06.704487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.743858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fc562-fbe3-4ea4-abde-5ea817705d14 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.852545 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3151/6276] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:06.853510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:06.856369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.857153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.858222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.860094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.860851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.870107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.900290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:06.902184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:06.927865 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3126/6277] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:06.931225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:06.935239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.951997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b3bd-7780-4480-8a77-6c794c974cae None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.956902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.957436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.957964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.958312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.961199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:06.976134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810747d-58c0-43f4-a054-5e240ed6fe14 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:06.980539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ec980-1a69-4c19-b219-95a6711d06b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:06.981207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec980-1a69-4c19-b219-95a6711d06b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:06.981497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec980-1a69-4c19-b219-95a6711d06b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:06.981775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ec980-1a69-4c19-b219-95a6711d06b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:06.999854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ec980-1a69-4c19-b219-95a6711d06b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:07.001341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ec980-1a69-4c19-b219-95a6711d06b4 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:07.026022 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3127/6278] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:07.047347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:07.049759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:07.063012 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3152/6279] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:07.205617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:07.206129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:07.206598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:07.242497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] MFA Rules not processed for user `8cdc0c878f6e4e5da2a2848d63a02f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:07.243983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:07.338826 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3128/6280] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:07.528887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:07.531949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:07.587834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac6460-20f3-49dc-a804-1fae197ddd55 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:07.596712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:07.597989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:07.601626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:07.602387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] PATH_INFO: `/v3/projects/21d4192b02384e008ee2fd1306f4460b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:07.604384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d4192b02384e008ee2fd1306f4460b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:07.611318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:07.619591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:07.621953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:07.658147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ca8fa-2dde-41c9-b694-ca2b2a20a760 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:07.678019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d4192b02384e008ee2fd1306f4460b', 'request_id': 'req-81347349-b793-4265-ad74-fe003e2f66aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.703231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d4192b02384e008ee2fd1306f4460b', 'request_id': 'req-81347349-b793-4265-ad74-fe003e2f66aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.723349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d4192b02384e008ee2fd1306f4460b', 'request_id': 'req-81347349-b793-4265-ad74-fe003e2f66aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.742055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] The token cache is being invalidate because project 21d4192b02384e008ee2fd1306f4460b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:07.742885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.744270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.746705 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3153/6281] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:07 2022] DELETE /identity/v3/projects/21d4192b02384e008ee2fd1306f4460b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:07.748699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:07.753228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:07.806433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:07.807681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:07.808057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:07.809421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] PATH_INFO: `/v3/projects/fa44fb7b4b2a45638e1af606b5199f69` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:07.810590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa44fb7b4b2a45638e1af606b5199f69)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:07.813111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:07.848796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81347349-b793-4265-ad74-fe003e2f66aa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:07.854046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:07.855024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:07.855458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:07.855848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] PATH_INFO: `/v3/projects/857cebb18791481798ed1576347f4a94` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:07.857154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=857cebb18791481798ed1576347f4a94)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:07.859229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:07.875057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa44fb7b4b2a45638e1af606b5199f69', 'request_id': 'req-0f250b52-f0c9-485c-b210-089b02b31666'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.881854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa44fb7b4b2a45638e1af606b5199f69', 'request_id': 'req-0f250b52-f0c9-485c-b210-089b02b31666'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.892442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa44fb7b4b2a45638e1af606b5199f69', 'request_id': 'req-0f250b52-f0c9-485c-b210-089b02b31666'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.905011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] The token cache is being invalidate because project fa44fb7b4b2a45638e1af606b5199f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:07.905930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.906260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f250b52-f0c9-485c-b210-089b02b31666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.912649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3129/6282] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:07 2022] DELETE /identity/v3/projects/fa44fb7b4b2a45638e1af606b5199f69 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:07.912649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01480f96-b241-4623-bcab-5ac5b381e370 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:07.912649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01480f96-b241-4623-bcab-5ac5b381e370 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:07.912649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01480f96-b241-4623-bcab-5ac5b381e370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:07.922826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857cebb18791481798ed1576347f4a94', 'request_id': 'req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.929192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857cebb18791481798ed1576347f4a94', 'request_id': 'req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.936097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-01480f96-b241-4623-bcab-5ac5b381e370 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:07.937323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-01480f96-b241-4623-bcab-5ac5b381e370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:07.937999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857cebb18791481798ed1576347f4a94', 'request_id': 'req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.948866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] The token cache is being invalidate because project 857cebb18791481798ed1576347f4a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:07.950283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.950661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2920145-c4f1-4dd9-9739-8925d0d0e0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:07.953442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3154/6283] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:07 2022] DELETE /identity/v3/projects/857cebb18791481798ed1576347f4a94 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:07.955255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881c49-a29b-4007-8d06-9041653316a1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:07.955255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881c49-a29b-4007-8d06-9041653316a1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:07.955255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f881c49-a29b-4007-8d06-9041653316a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:07.976843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3f881c49-a29b-4007-8d06-9041653316a1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:07.979114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3f881c49-a29b-4007-8d06-9041653316a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:08.005172 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3130/6284] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:08.012502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0cb4f-ba2c-432b-aaf8-e09f0740691d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.012885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0cb4f-ba2c-432b-aaf8-e09f0740691d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.013243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0cb4f-ba2c-432b-aaf8-e09f0740691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.038738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-10a0cb4f-ba2c-432b-aaf8-e09f0740691d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:08.040907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-10a0cb4f-ba2c-432b-aaf8-e09f0740691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:08.047992 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3155/6285] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:08.049935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a225-728a-439d-a26d-24236d0c4d51 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.050383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a225-728a-439d-a26d-24236d0c4d51 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.050660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449a225-728a-439d-a26d-24236d0c4d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.067484 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3131/6286] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:08.075186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4124-407e-4242-95a6-c1195e5dd3e5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.075509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4124-407e-4242-95a6-c1195e5dd3e5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.075783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4124-407e-4242-95a6-c1195e5dd3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.099044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-52ab4124-407e-4242-95a6-c1195e5dd3e5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:08.100341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-52ab4124-407e-4242-95a6-c1195e5dd3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:08.106458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8449a225-728a-439d-a26d-24236d0c4d51 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:08.108486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8449a225-728a-439d-a26d-24236d0c4d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:08.113419 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3132/6287] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:08.114402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab4124-407e-4242-95a6-c1195e5dd3e5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.121241 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3156/6288] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:08.124998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449a225-728a-439d-a26d-24236d0c4d51 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.128102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab4124-407e-4242-95a6-c1195e5dd3e5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.133333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717860c3-2205-4836-8fea-fa99aea956eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.134167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717860c3-2205-4836-8fea-fa99aea956eb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.134309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717860c3-2205-4836-8fea-fa99aea956eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.134600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717860c3-2205-4836-8fea-fa99aea956eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.135332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717860c3-2205-4836-8fea-fa99aea956eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:08.135746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717860c3-2205-4836-8fea-fa99aea956eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.137258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717860c3-2205-4836-8fea-fa99aea956eb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.137579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449a225-728a-439d-a26d-24236d0c4d51 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.144117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.144936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.145057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.145321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.148618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:08.148618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.148618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.156111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3133/6289] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:08.156111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8964dd-7adb-4d79-b1ed-99abcf6ee321 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.156111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8964dd-7adb-4d79-b1ed-99abcf6ee321 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.156111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8964dd-7adb-4d79-b1ed-99abcf6ee321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.163725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3157/6290] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:08.163725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.173148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdae8f-b51b-4d76-9484-3aa1aac09d28 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.177721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bf8964dd-7adb-4d79-b1ed-99abcf6ee321 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:08.178640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.179190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bf8964dd-7adb-4d79-b1ed-99abcf6ee321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:08.179480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.179830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.180291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.181038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.183318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.191447 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3134/6291] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:08.192235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8964dd-7adb-4d79-b1ed-99abcf6ee321 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.202354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8964dd-7adb-4d79-b1ed-99abcf6ee321 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.207068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.207809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.208153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.208501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.209315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.211501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.229611 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3158/6292] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:08.229611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.239782 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3135/6293] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:08.240692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.305321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48aa6c7-e1d4-4021-9206-69df927276cb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.309911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080502e-026e-4ab4-8923-f1f075431618 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.313234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.314162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.315063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.315545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.316299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.316981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:08.317203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.317522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.317802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.318118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.318553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.320594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.321680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.334059 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3159/6294] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:08.335161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.348745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279f48-4bd0-4a5f-887b-226c91605a24 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.354923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.355128 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3136/6295] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:08.356199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.356568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.357164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.357641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.358488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.360756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.368850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955830e-49ee-4c63-b29a-305f11a0b984 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.387507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.388514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.390655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.391182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.393356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.395464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.399479 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3160/6296] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/users => generated 292 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:08.400477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.414600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3e68e-21a8-4685-88f1-6f9c5988cbf8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.421620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.422552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.423389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.423389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.424149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.425917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.444154 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3161/6297] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:08.445097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.456689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492bd2f-9431-4b61-8bb3-67e7597c9dcb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.465885 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3137/6298] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:08.467170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.557851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aed964-c261-4c82-a9b7-acb431c8701f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.565079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.566014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.566459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.566958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.567843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.569655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.578271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.580064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.581756 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3138/6299] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:08.582759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.584064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.584612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.585667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.588496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.594553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba41b8-e9f6-4d72-95ba-fc35552720bc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.599676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.601493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.601951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.602407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.603327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.608186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.609075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3162/6300] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:08.610670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.621709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef8ded-ddde-42a2-98d4-6e4598c2a81d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.629643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.630987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.631480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.631960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] PATH_INFO: `/v3/projects/c93dac5286c44f1891ba0504efa20a98/users/77910ce7577e4c068577ca92252c758a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.652943 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3139/6301] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/users => generated 287 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:08.653791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.656598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93dac5286c44f1891ba0504efa20a98, user_id=77910ce7577e4c068577ca92252c758a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.660305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.687554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9a82-cedc-4070-a391-202a0bb013af admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.689839 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3163/6302] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:08 2022] PUT /identity/v3/projects/c93dac5286c44f1891ba0504efa20a98/users/77910ce7577e4c068577ca92252c758a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:08.691099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.787753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da6eb8-d5c7-403d-a6e3-287435c1e1e0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.794062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73468b8-0f8a-42bd-9203-7f1552337db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.794953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73468b8-0f8a-42bd-9203-7f1552337db9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.797883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73468b8-0f8a-42bd-9203-7f1552337db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.799203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73468b8-0f8a-42bd-9203-7f1552337db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.801746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73468b8-0f8a-42bd-9203-7f1552337db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.808112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73468b8-0f8a-42bd-9203-7f1552337db9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.819369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.820391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.820950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.821334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.823613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.826156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.835809 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3164/6303] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:08.835809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692d65-b70b-4aad-b1ec-27e1b9136c65 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.835809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692d65-b70b-4aad-b1ec-27e1b9136c65 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.836249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b692d65-b70b-4aad-b1ec-27e1b9136c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.847722 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3140/6304] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:08.849592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.871422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7b692d65-b70b-4aad-b1ec-27e1b9136c65 None None] MFA Rules not processed for user `77910ce7577e4c068577ca92252c758a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:08.872631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b692d65-b70b-4aad-b1ec-27e1b9136c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:08.875517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8970c5e-92af-4a42-b5e2-d5f5a3a12ed3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.887626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.888321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.888614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.890234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:08.892811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:08.896046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:08.920924 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3141/6305] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:08.923175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:08.955036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551cbb-9643-42ba-81db-5de1c0a188da admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:08.968456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:08.972236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:08.972582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:08.972886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] PATH_INFO: `/v3/projects/c32daad9ae9c44b0a80edecc1bac69de/users/a8474fd54b2d4ac1bc478ac813e0b9ab/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.007746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32daad9ae9c44b0a80edecc1bac69de, user_id=a8474fd54b2d4ac1bc478ac813e0b9ab, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.011067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:09.026420 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3165/6306] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:09.026420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b692d65-b70b-4aad-b1ec-27e1b9136c65 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.072256 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3142/6307] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:08 2022] PUT /identity/v3/projects/c32daad9ae9c44b0a80edecc1bac69de/users/a8474fd54b2d4ac1bc478ac813e0b9ab/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:09.076028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.084498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:09.121517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b692d65-b70b-4aad-b1ec-27e1b9136c65 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:09.207330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cb6c4-c723-4e47-a99f-f03d7f5ac5dd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:09.213874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88e453-b3e0-4197-bdf2-300bf2b9da37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:09.214809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e453-b3e0-4197-bdf2-300bf2b9da37 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.215171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e453-b3e0-4197-bdf2-300bf2b9da37 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.215520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88e453-b3e0-4197-bdf2-300bf2b9da37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.286987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f85b9-971c-477f-a422-ca3afb8b15c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:09.291022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f85b9-971c-477f-a422-ca3afb8b15c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.291513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f85b9-971c-477f-a422-ca3afb8b15c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.291808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f85b9-971c-477f-a422-ca3afb8b15c9 admin admin] PATH_INFO: `/v3/projects/7c27245ca1bd4d64bc65b0cadd17a6d2/users/a972cb56ffab489ba2455fafd073023a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.294205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88e453-b3e0-4197-bdf2-300bf2b9da37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.296629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88e453-b3e0-4197-bdf2-300bf2b9da37 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:09.306599 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3143/6308] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:09.308302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35cd8b-8614-420d-8681-346efdc8e7a1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.308590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35cd8b-8614-420d-8681-346efdc8e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.308931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35cd8b-8614-420d-8681-346efdc8e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.321445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f85b9-971c-477f-a422-ca3afb8b15c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c27245ca1bd4d64bc65b0cadd17a6d2, user_id=a972cb56ffab489ba2455fafd073023a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.325439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f85b9-971c-477f-a422-ca3afb8b15c9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:09.352169 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3166/6309] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:09 2022] PUT /identity/v3/projects/7c27245ca1bd4d64bc65b0cadd17a6d2/users/a972cb56ffab489ba2455fafd073023a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:09.352533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4b35cd8b-8614-420d-8681-346efdc8e7a1 None None] MFA Rules not processed for user `a8474fd54b2d4ac1bc478ac813e0b9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:09.352533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4b35cd8b-8614-420d-8681-346efdc8e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:09.360162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.360376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.360717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.403196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] MFA Rules not processed for user `a972cb56ffab489ba2455fafd073023a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:09.404934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:09.442990 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3144/6310] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:09.446700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35cd8b-8614-420d-8681-346efdc8e7a1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.555988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35cd8b-8614-420d-8681-346efdc8e7a1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:09.567736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:09.572190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.572190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.574587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.575533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.579504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:09.591449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3167/6311] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:09.606347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.609767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:09.639988 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3145/6312] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:09 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:09.643099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.728806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44bb5e-0d62-4f51-8b99-94ab565e25c3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:09.735392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:09.736136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.736415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.736751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.737454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.739553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:09.768794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4e570-aae6-439a-9cd3-e1343d06e9b9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:09.774761 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3146/6313] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:09 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:09.776091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.797903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19e990-d490-44cd-9369-157ac3a3da96 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:09.803490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:09.804638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.804638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.804875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.805622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.807716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:09.825578 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3147/6314] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:09.831793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.855814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb1189-9ae2-4c49-98de-bbe1b57489bf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:09.865569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:09.871955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.872105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:09.872220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.872220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] PATH_INFO: `/v3/projects/2d16849e0a40409ca932b01bc7502552/users/291d4c3913c34257baceafe5487d706f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.872391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:09.872391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:09.872391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:09.912883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d16849e0a40409ca932b01bc7502552, user_id=291d4c3913c34257baceafe5487d706f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.916206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:09.944830 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3148/6315] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:09 2022] PUT /identity/v3/projects/2d16849e0a40409ca932b01bc7502552/users/291d4c3913c34257baceafe5487d706f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:09.946053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:09.977622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:09.981586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.009344 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3168/6316] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:10.065304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d06755-b91a-456c-830e-abca0a9461d2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:10.077829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdb5a1-f5ef-45d9-a0a2-48e0ea1c97e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:10.081986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdb5a1-f5ef-45d9-a0a2-48e0ea1c97e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.082338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdb5a1-f5ef-45d9-a0a2-48e0ea1c97e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.082631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdb5a1-f5ef-45d9-a0a2-48e0ea1c97e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.084322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdb5a1-f5ef-45d9-a0a2-48e0ea1c97e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:10.085540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdb5a1-f5ef-45d9-a0a2-48e0ea1c97e5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.112661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3149/6317] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:10.117658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:10.132910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b2aa0-0592-4272-baf9-6c9a8012c503 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:10.148388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:10.149551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.149897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.150113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] PATH_INFO: `/v3/projects/2d16849e0a40409ca932b01bc7502552/users/291d4c3913c34257baceafe5487d706f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.155901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d16849e0a40409ca932b01bc7502552, user_id=291d4c3913c34257baceafe5487d706f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:10.160304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.194872 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3169/6318] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:10 2022] PUT /identity/v3/projects/2d16849e0a40409ca932b01bc7502552/users/291d4c3913c34257baceafe5487d706f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:10.204339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06512a5d-e190-4cce-9b2b-5949ea153f5e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.204642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06512a5d-e190-4cce-9b2b-5949ea153f5e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.204926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06512a5d-e190-4cce-9b2b-5949ea153f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.240016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-06512a5d-e190-4cce-9b2b-5949ea153f5e None None] MFA Rules not processed for user `291d4c3913c34257baceafe5487d706f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:10.241333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-06512a5d-e190-4cce-9b2b-5949ea153f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:10.379604 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3150/6319] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:10.380856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:10.401405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fd0f2-2f11-4c87-aa45-362d768fe5f0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:10.414567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:10.416250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.416551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.416827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.421637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:10.423360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invalid input for field 'name': '' is too short May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'minLength' in schema['properties']['name']: May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: On instance['name']: May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'minLength' in schema['properties']['name']: May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: On instance['name']: May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: '' May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise error May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['name']: May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application '' May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:10.457243 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:07:10.460129 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['name']: May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application '' May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:10.463958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3170/6320] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:07:10 2022] POST /identity/v3/domains => generated 283 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:07:10.465185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06512a5d-e190-4cce-9b2b-5949ea153f5e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:10.477174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06512a5d-e190-4cce-9b2b-5949ea153f5e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:10.491592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:10.492233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.492493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.492778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.495749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:10.503880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: Failed validating 'maxLength' in schema['properties']['name']: May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: On instance['name']: May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: Failed validating 'maxLength' in schema['properties']['name']: May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: On instance['name']: May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise error May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.520715 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application On instance['name']: May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post May 07 22:07:10.522026 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application On instance['name']: May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 07 22:07:10.523198 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.528805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:10.539766 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3151/6321] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:07:10 2022] POST /identity/v3/domains => generated 412 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:07:10.546975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df15577-3e20-4507-b117-7a9d924dbe3f tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:10.564191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:10.564883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.565212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.565447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.566253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:10.572321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.625854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:10.641243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3171/6322] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:07:10 2022] POST /identity/v3/domains => generated 276 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:10.643914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471812d-dfce-4038-996c-d60365a7cce4 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:10.775466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:10.776356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.776644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.776926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains/13aef0a5117243d690832e17ba8c9d36` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.797745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=13aef0a5117243d690832e17ba8c9d36)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:10.804356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete May 07 22:07:10.834388 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. May 07 22:07:10.835492 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:10.836732 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3152/6323] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:07:10 2022] DELETE /identity/v3/domains/13aef0a5117243d690832e17ba8c9d36 => generated 120 bytes in 211 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:10.841062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:10.858516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b66296-3008-4834-8441-a80279310d56 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:10.867948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:10.869066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:10.869973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:10.870334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains/13aef0a5117243d690832e17ba8c9d36` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:10.874442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=13aef0a5117243d690832e17ba8c9d36)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:10.876652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:10.908259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '13aef0a5117243d690832e17ba8c9d36'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:10.909064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '13aef0a5117243d690832e17ba8c9d36'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:10.946909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '13aef0a5117243d690832e17ba8c9d36'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:10.947596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '13aef0a5117243d690832e17ba8c9d36'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:10.953587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3172/6324] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:07:10 2022] PATCH /identity/v3/domains/13aef0a5117243d690832e17ba8c9d36 => generated 277 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:10.958597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:10.960526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:10.976180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4c3f-a247-456a-b651-b427b471e249 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:11.056472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:11.057810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:11.058100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:11.058380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains/13aef0a5117243d690832e17ba8c9d36` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:11.072446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=13aef0a5117243d690832e17ba8c9d36)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:11.074622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:11.128257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '13aef0a5117243d690832e17ba8c9d36'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.132475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '13aef0a5117243d690832e17ba8c9d36'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.182888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aef0a5117243d690832e17ba8c9d36', 'request_id': 'req-1ebbcf37-0173-4793-8068-e00fda7dcd35'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.191970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aef0a5117243d690832e17ba8c9d36', 'request_id': 'req-1ebbcf37-0173-4793-8068-e00fda7dcd35'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.208613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aef0a5117243d690832e17ba8c9d36', 'request_id': 'req-1ebbcf37-0173-4793-8068-e00fda7dcd35'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.220990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] The token cache is being invalidate because project 13aef0a5117243d690832e17ba8c9d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:11.221288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.221982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.229767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '13aef0a5117243d690832e17ba8c9d36', 'request_id': 'req-1ebbcf37-0173-4793-8068-e00fda7dcd35'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.230499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '13aef0a5117243d690832e17ba8c9d36', 'request_id': 'req-1ebbcf37-0173-4793-8068-e00fda7dcd35'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.234631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '13aef0a5117243d690832e17ba8c9d36', 'request_id': 'req-1ebbcf37-0173-4793-8068-e00fda7dcd35'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.240881 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3153/6325] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:07:10 2022] DELETE /identity/v3/domains/13aef0a5117243d690832e17ba8c9d36 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:11.245742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:11.264568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae58ba3-0405-4771-ba25-9cb73f82e33a tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:11.338622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:11.339550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:11.339846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:11.340111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains/427bb3db691f4197b8ac97f36c9bc8ac` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:11.348203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Could not find domain: 427bb3db691f4197b8ac97f36c9bc8ac.: keystone.exception.DomainNotFound: Could not find domain: 427bb3db691f4197b8ac97f36c9bc8ac. May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 427bb3db691f4197b8ac97f36c9bc8ac. May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:11.360438 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:11.361562 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:07:11.363001 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 427bb3db691f4197b8ac97f36c9bc8ac. May 07 22:07:11.364717 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.369997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:11.371053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3173/6326] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:07:11 2022] DELETE /identity/v3/domains/427bb3db691f4197b8ac97f36c9bc8ac => generated 112 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:11.372626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:11.395531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbcf37-0173-4793-8068-e00fda7dcd35 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:11.401499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:11.402149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:11.402691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:11.403168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:11.404095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:11.408698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:11.447637 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3154/6327] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:07:11 2022] POST /identity/v3/domains => generated 253 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:11.453346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:11.467349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5efa7e-ccde-446b-b5ae-6ae3d5c0872c tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:11.603349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:11.604027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:11.604450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:11.604786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:11.605517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:11.607600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:11.615649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.sql.core [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1296925516' for key 'project.ixu_project_name_domain_id'") May 07 22:07:11.615649 ncdv-master-1 devstack@keystone.service[91076]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 07 22:07:11.615649 ncdv-master-1 devstack@keystone.service[91076]: [parameters: {'id': '86749a0603e74c4f90e5e5a0a82e63f1', 'name': 'tempest-domain-dup-1296925516', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 07 22:07:11.615649 ncdv-master-1 devstack@keystone.service[91076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1296925516.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1296925516. May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._query(query) May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application conn.query(q) May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 22:07:11.647737 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result.read() May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1296925516' for key 'project.ixu_project_name_domain_id'") May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 07 22:07:11.648780 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return project_ref.to_dict() May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application next(self.gen) May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application yield resource May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application next(self.gen) May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.session.rollback() May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.force_reraise() May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise self.value May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application session.commit() May 07 22:07:11.649988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._prepare_impl() May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.session.flush() May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._flush(objects) May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application compat.raise_( May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application flush_context.execute() May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 07 22:07:11.651415 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rec.execute(self) May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application _emit_insert_statements( May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application c = connection._execute_20( May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ret = self._execute_context( May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 07 22:07:11.652609 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._query(query) May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application conn.query(q) May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result.read() May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 22:07:11.653642 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1296925516' for key 'project.ixu_project_name_domain_id'") May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [parameters: {'id': '86749a0603e74c4f90e5e5a0a82e63f1', 'name': 'tempest-domain-dup-1296925516', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.655472 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1296925516. May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:11.659425 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application is_domain_project = self.create_project( May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.Conflict( May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1296925516. May 07 22:07:11.660553 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:11.661666 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3174/6328] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:07:11 2022] POST /identity/v3/domains => generated 212 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 07 22:07:11.663141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:11.675515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67b3b8-3f8d-4714-aead-be0d1bd1fb5d tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:11.683555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:11.684588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:11.684872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:11.685246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains/5ee9f157e578417e882c299e27ac74ba` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:11.698852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5ee9f157e578417e882c299e27ac74ba)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:11.700902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:11.727777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5ee9f157e578417e882c299e27ac74ba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.728791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5ee9f157e578417e882c299e27ac74ba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.762279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5ee9f157e578417e882c299e27ac74ba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.763356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5ee9f157e578417e882c299e27ac74ba'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.772828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:11.775540 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3155/6329] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:07:11 2022] PATCH /identity/v3/domains/5ee9f157e578417e882c299e27ac74ba => generated 254 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:11.782236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:11.809041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeee43b-02e8-4e4c-8cdb-0cccca915882 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:11.896798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:11.897944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:11.898435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:11.898762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains/5ee9f157e578417e882c299e27ac74ba` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:11.915220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5ee9f157e578417e882c299e27ac74ba)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:11.916539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:11.949562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5ee9f157e578417e882c299e27ac74ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:11.955578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5ee9f157e578417e882c299e27ac74ba'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.074408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee9f157e578417e882c299e27ac74ba', 'request_id': 'req-df3aa34d-b334-4cef-a406-d28659ccff47'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.084332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee9f157e578417e882c299e27ac74ba', 'request_id': 'req-df3aa34d-b334-4cef-a406-d28659ccff47'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.099863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee9f157e578417e882c299e27ac74ba', 'request_id': 'req-df3aa34d-b334-4cef-a406-d28659ccff47'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.120642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] The token cache is being invalidate because project 5ee9f157e578417e882c299e27ac74ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:12.121469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.127275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.150664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5ee9f157e578417e882c299e27ac74ba', 'request_id': 'req-df3aa34d-b334-4cef-a406-d28659ccff47'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.155580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5ee9f157e578417e882c299e27ac74ba', 'request_id': 'req-df3aa34d-b334-4cef-a406-d28659ccff47'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.156499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5ee9f157e578417e882c299e27ac74ba', 'request_id': 'req-df3aa34d-b334-4cef-a406-d28659ccff47'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.168018 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3175/6330] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:07:11 2022] DELETE /identity/v3/domains/5ee9f157e578417e882c299e27ac74ba => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:12.168977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:12.210700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bb860-c17f-4782-bbca-a5515e4a02bb tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:12.289039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77485d8d-9e1d-4fd8-9c8e-552426515e62 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291d4c3913c34257baceafe5487d706f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d16849e0a40409ca932b01bc7502552', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:12.290269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485d8d-9e1d-4fd8-9c8e-552426515e62 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:12.291003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485d8d-9e1d-4fd8-9c8e-552426515e62 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:12.291494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77485d8d-9e1d-4fd8-9c8e-552426515e62 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] PATH_INFO: `/v3/domains/13aef0a5117243d690832e17ba8c9d36` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:12.302686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77485d8d-9e1d-4fd8-9c8e-552426515e62 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-77485d8d-9e1d-4fd8-9c8e-552426515e62 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Could not find domain: 13aef0a5117243d690832e17ba8c9d36.: keystone.exception.DomainNotFound: Could not find domain: 13aef0a5117243d690832e17ba8c9d36. May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 13aef0a5117243d690832e17ba8c9d36. May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:12.318221 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:12.319423 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:07:12.320920 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 13aef0a5117243d690832e17ba8c9d36. May 07 22:07:12.322752 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:12.324644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:12.326983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:12.331816 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3156/6331] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:07:12 2022] PATCH /identity/v3/domains/13aef0a5117243d690832e17ba8c9d36 => generated 112 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:12.428329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aa34d-b334-4cef-a406-d28659ccff47 tempest-DomainsNegativeTestJSON-1037649864 tempest-DomainsNegativeTestJSON-1037649864-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:12.434477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:12.435610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:12.436003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:12.436258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] PATH_INFO: `/v3/users/a8474fd54b2d4ac1bc478ac813e0b9ab` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:12.439291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8474fd54b2d4ac1bc478ac813e0b9ab)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:12.441442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:12.506371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8474fd54b2d4ac1bc478ac813e0b9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.507704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8474fd54b2d4ac1bc478ac813e0b9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.519084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8474fd54b2d4ac1bc478ac813e0b9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.519896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8474fd54b2d4ac1bc478ac813e0b9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.530196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8474fd54b2d4ac1bc478ac813e0b9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:12.561052 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3176/6332] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:12 2022] DELETE /identity/v3/users/a8474fd54b2d4ac1bc478ac813e0b9ab => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:12.566506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:12.567000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:12.567504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:12.596678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:12.603628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:12.691639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3157/6333] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:12.717171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:12.720257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:12.796563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe276d86-564f-4ec2-8d41-e650fbbe5e3a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:12.801960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea4185-7d8a-4c74-8ad6-3d349fcc2540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:12.802658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea4185-7d8a-4c74-8ad6-3d349fcc2540 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:12.803831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea4185-7d8a-4c74-8ad6-3d349fcc2540 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:12.804167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea4185-7d8a-4c74-8ad6-3d349fcc2540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:12.823161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea4185-7d8a-4c74-8ad6-3d349fcc2540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:12.825029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea4185-7d8a-4c74-8ad6-3d349fcc2540 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:12.835867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3177/6334] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:13.142980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:13.144741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:13.165629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84aa9f-73d5-4476-929b-0c055fbc23b5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:13.179992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:13.181292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:13.181655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:13.183113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] PATH_INFO: `/v3/users/a972cb56ffab489ba2455fafd073023a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:13.184565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a972cb56ffab489ba2455fafd073023a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:13.189638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:13.306031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a972cb56ffab489ba2455fafd073023a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.316426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a972cb56ffab489ba2455fafd073023a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.317892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a972cb56ffab489ba2455fafd073023a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.318723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a972cb56ffab489ba2455fafd073023a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.331154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a972cb56ffab489ba2455fafd073023a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.356399 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3158/6335] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:13 2022] DELETE /identity/v3/users/a972cb56ffab489ba2455fafd073023a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:13.361530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:13.362029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:13.362114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:13.389426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:13.391902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:13.470706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:13.472574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:13.540156 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3178/6336] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:13.557592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:13.559063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:13.636837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a0cd1-2549-4385-8c5d-727397fc1607 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:13.648193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:13.649671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:13.650838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:13.651384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] PATH_INFO: `/v3/users/e1e1460ae4d742e1ac943fa98e74d9ad` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:13.671127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e1460ae4d742e1ac943fa98e74d9ad)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:13.673320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:13.674955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d5e1-0b97-49b2-9fc0-e8e07cdb04bd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:13.686836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad00fe5-b08a-4067-ad02-9183c11c03d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:13.687510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00fe5-b08a-4067-ad02-9183c11c03d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:13.688608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00fe5-b08a-4067-ad02-9183c11c03d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:13.688902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad00fe5-b08a-4067-ad02-9183c11c03d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:13.709398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00fe5-b08a-4067-ad02-9183c11c03d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:13.710909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad00fe5-b08a-4067-ad02-9183c11c03d7 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:13.730686 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3179/6337] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:13.753119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e1460ae4d742e1ac943fa98e74d9ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.760391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e1460ae4d742e1ac943fa98e74d9ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.761125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e1460ae4d742e1ac943fa98e74d9ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.761726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e1460ae4d742e1ac943fa98e74d9ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.773350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e1460ae4d742e1ac943fa98e74d9ad'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:13.806077 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3159/6338] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:13 2022] DELETE /identity/v3/users/e1e1460ae4d742e1ac943fa98e74d9ad => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:13.811211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:13.811683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:13.811959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:13.839304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:13.841236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:13.949067 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3180/6339] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:13.982838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:13.992516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:13.994206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:13.995004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:14.034876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cb4d6-58e2-4c2e-aeb6-42ee02b1c229 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.046369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.048417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.048778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.049069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] PATH_INFO: `/v3/projects/c32daad9ae9c44b0a80edecc1bac69de` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.053495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32daad9ae9c44b0a80edecc1bac69de)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.055483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.132203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcba39-96dc-4910-8b4c-807399ecf567 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.143542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32daad9ae9c44b0a80edecc1bac69de', 'request_id': 'req-ada54509-c7df-4965-9fd7-a48b747a6c6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.152806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32daad9ae9c44b0a80edecc1bac69de', 'request_id': 'req-ada54509-c7df-4965-9fd7-a48b747a6c6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.166274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32daad9ae9c44b0a80edecc1bac69de', 'request_id': 'req-ada54509-c7df-4965-9fd7-a48b747a6c6f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.183377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] The token cache is being invalidate because project c32daad9ae9c44b0a80edecc1bac69de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:14.183667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.184418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.187332 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3160/6340] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:13 2022] DELETE /identity/v3/projects/c32daad9ae9c44b0a80edecc1bac69de => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:14.190748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:14.192467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:14.210995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.210995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.211316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.214900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.218193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:14.293268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada54509-c7df-4965-9fd7-a48b747a6c6f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.302716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.302995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.304376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.304590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.304683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.305047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] PATH_INFO: `/v3/users/291d4c3913c34257baceafe5487d706f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.307322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=291d4c3913c34257baceafe5487d706f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.313468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.318641 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3181/6341] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:14.320501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:14.326214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:14.343698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd2753-8fb0-4c70-93bc-5d50bb16a54d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.352199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.353197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.353574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.353946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] PATH_INFO: `/v3/projects/7c27245ca1bd4d64bc65b0cadd17a6d2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.356098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c27245ca1bd4d64bc65b0cadd17a6d2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.370968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.425308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291d4c3913c34257baceafe5487d706f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.436044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291d4c3913c34257baceafe5487d706f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.436831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291d4c3913c34257baceafe5487d706f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.437397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291d4c3913c34257baceafe5487d706f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.458674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8b7f337f-f257-4702-a001-b61cd276fe35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291d4c3913c34257baceafe5487d706f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.460090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c27245ca1bd4d64bc65b0cadd17a6d2', 'request_id': 'req-75d7678a-ce75-4f3e-b433-8f1d5f02938f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.471191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c27245ca1bd4d64bc65b0cadd17a6d2', 'request_id': 'req-75d7678a-ce75-4f3e-b433-8f1d5f02938f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.486748 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3161/6342] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:14 2022] DELETE /identity/v3/users/291d4c3913c34257baceafe5487d706f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:14.491162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c27245ca1bd4d64bc65b0cadd17a6d2', 'request_id': 'req-75d7678a-ce75-4f3e-b433-8f1d5f02938f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.502686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] The token cache is being invalidate because project 7c27245ca1bd4d64bc65b0cadd17a6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:14.502901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.504885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-75d7678a-ce75-4f3e-b433-8f1d5f02938f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:14.506895 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3182/6343] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:14 2022] DELETE /identity/v3/projects/7c27245ca1bd4d64bc65b0cadd17a6d2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:14.512494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bba2c-12ba-4fe4-ba44-b392a30b2f3b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.512659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bba2c-12ba-4fe4-ba44-b392a30b2f3b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.512950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bba2c-12ba-4fe4-ba44-b392a30b2f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.533633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ae5bba2c-12ba-4fe4-ba44-b392a30b2f3b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:14.534864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ae5bba2c-12ba-4fe4-ba44-b392a30b2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:14.603513 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3162/6344] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:14.610754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7011-bd0a-482a-b602-88a0517f4125 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.611125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7011-bd0a-482a-b602-88a0517f4125 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.611407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7011-bd0a-482a-b602-88a0517f4125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.631763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-84db7011-bd0a-482a-b602-88a0517f4125 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:14.633531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-84db7011-bd0a-482a-b602-88a0517f4125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:14.650480 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3183/6345] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:14.651196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bba2c-12ba-4fe4-ba44-b392a30b2f3b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:14.665780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bba2c-12ba-4fe4-ba44-b392a30b2f3b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.674097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.674842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.675060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.675385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.676167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:14.676479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.678229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.694642 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3163/6346] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:07:14.699397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7011-bd0a-482a-b602-88a0517f4125 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:14.710195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7011-bd0a-482a-b602-88a0517f4125 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.718085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.718542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.718860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.719144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.719841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.721894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.757334 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3184/6347] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:14 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:14.758301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:14.780244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec757b-a78e-4cf1-8c74-fd6f2dfd79b1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.888159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.888929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.889417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.889577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.890320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.892633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.926528 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3164/6348] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:14 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:14.927820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:14.941139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f630c0e-e5ab-4335-8cbf-327fed106359 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.948129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.949624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.949879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.950199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.951505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:14.953548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:14.968062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3185/6349] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:14.969347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:14.981475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73b4d8-fd27-4b78-8ed9-725a4408ae5f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:14.991794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:14.996431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:14.997907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:14.998213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:14.999237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:15.001371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:15.015155 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3165/6350] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:15.019581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:15.031170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d9ce0-7c37-4f12-b744-16f74cfcd6de admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:15.038972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09d1ed-608e-46eb-861d-ffaf2d414d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:15.042400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d1ed-608e-46eb-861d-ffaf2d414d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.042400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d1ed-608e-46eb-861d-ffaf2d414d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.042400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d1ed-608e-46eb-861d-ffaf2d414d66 admin admin] PATH_INFO: `/v3/projects/e26f8701226f4b8cbedae536d77c9c61/users/9c29470ef66e4f3fb42580aadd704908/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.062119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09d1ed-608e-46eb-861d-ffaf2d414d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26f8701226f4b8cbedae536d77c9c61, user_id=9c29470ef66e4f3fb42580aadd704908, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:15.065125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09d1ed-608e-46eb-861d-ffaf2d414d66 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:15.084455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:15.087923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:15.100712 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3186/6351] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:15 2022] PUT /identity/v3/projects/e26f8701226f4b8cbedae536d77c9c61/users/9c29470ef66e4f3fb42580aadd704908/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:15.105168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.105168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.106242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.141921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740ab2b-b4c4-44c3-ac64-4ff469d46635 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:15.164027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] MFA Rules not processed for user `9c29470ef66e4f3fb42580aadd704908`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:15.165797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:15.283672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:15.284767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.285280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.285656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] PATH_INFO: `/v3/projects/2d16849e0a40409ca932b01bc7502552` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.287014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d16849e0a40409ca932b01bc7502552)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:15.289833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:15.331033 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3187/6352] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:15 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:15.332515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:15.339245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:15.370625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d16849e0a40409ca932b01bc7502552', 'request_id': 'req-5276172e-cfa3-4389-891e-aa6756a14586'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.380456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2defb-3cc0-4345-9f56-897e1332527c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:15.390854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d16849e0a40409ca932b01bc7502552', 'request_id': 'req-5276172e-cfa3-4389-891e-aa6756a14586'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.409153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d16849e0a40409ca932b01bc7502552', 'request_id': 'req-5276172e-cfa3-4389-891e-aa6756a14586'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.433219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] The token cache is being invalidate because project 2d16849e0a40409ca932b01bc7502552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:15.433523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.436020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.440645 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3166/6353] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:15 2022] DELETE /identity/v3/projects/2d16849e0a40409ca932b01bc7502552 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:15.441862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:15.466918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:15.490556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:15.496861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.497278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.497713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] PATH_INFO: `/v3/projects/4584d3cb399e419e80cdbb072ba0c5d1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.503959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4584d3cb399e419e80cdbb072ba0c5d1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:15.506010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:15.580710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276172e-cfa3-4389-891e-aa6756a14586 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:15.596576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4584d3cb399e419e80cdbb072ba0c5d1', 'request_id': 'req-12379b58-4ad4-44f8-800a-b604e010e60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.614394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4584d3cb399e419e80cdbb072ba0c5d1', 'request_id': 'req-12379b58-4ad4-44f8-800a-b604e010e60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.645604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4584d3cb399e419e80cdbb072ba0c5d1', 'request_id': 'req-12379b58-4ad4-44f8-800a-b604e010e60c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.660514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:15.661551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.662197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.662678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.665014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:15.669799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] The token cache is being invalidate because project 4584d3cb399e419e80cdbb072ba0c5d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:15.670690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.672472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12379b58-4ad4-44f8-800a-b604e010e60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:15.680858 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3188/6354] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:15 2022] DELETE /identity/v3/projects/4584d3cb399e419e80cdbb072ba0c5d1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:15.682996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab1e9-f98c-4e7e-bc77-cbf443a923fb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.683191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab1e9-f98c-4e7e-bc77-cbf443a923fb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.683436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeab1e9-f98c-4e7e-bc77-cbf443a923fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.729893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4eeab1e9-f98c-4e7e-bc77-cbf443a923fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:15.731227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4eeab1e9-f98c-4e7e-bc77-cbf443a923fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:15.740042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:15.741757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:15.755637 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3167/6355] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:15.756624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:15.758010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:15.842621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9ff63-5f2a-4b72-8088-ba655b236bc5 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:15.859143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:15.860155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.860435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.860704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] PATH_INFO: `/v3/users/54a2baee14b740b8b65294adc272668a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.862594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a2baee14b740b8b65294adc272668a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:15.869016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:15.971243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3189/6356] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:15.980808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a1041-2371-42ae-8e89-19304b93b46a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:15.981869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a1041-2371-42ae-8e89-19304b93b46a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:15.983149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a1041-2371-42ae-8e89-19304b93b46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:15.986025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a2baee14b740b8b65294adc272668a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:16.003789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a2baee14b740b8b65294adc272668a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:16.004700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a2baee14b740b8b65294adc272668a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:16.006445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a2baee14b740b8b65294adc272668a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:16.013424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9e2a1041-2371-42ae-8e89-19304b93b46a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:16.015736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9e2a1041-2371-42ae-8e89-19304b93b46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:16.023009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a2baee14b740b8b65294adc272668a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:16.053632 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3190/6357] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:16.059039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a1041-2371-42ae-8e89-19304b93b46a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:16.072709 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3168/6358] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:15 2022] DELETE /identity/v3/users/54a2baee14b740b8b65294adc272668a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:16.078022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a1041-2371-42ae-8e89-19304b93b46a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:16.153904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:16.155351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:16.155709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:16.156162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:16.156906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:16.157489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:16.160761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:16.182828 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3191/6359] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:07:16.186511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:16.210596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e26aea-e558-4185-b1d1-d50706e0878e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:16.286156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:16.287008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:16.287367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:16.292100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:16.293005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:16.296174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:16.359906 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3169/6360] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:16 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:16.361229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:16.379262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c36b4-83a5-4a69-b199-ea4ec51e07f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:16.555611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:16.558358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:16.558620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:16.561009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:16.561765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:16.563797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:16.611319 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3192/6361] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:16 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:16.615455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:16.629234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33ee83-3847-455f-809d-eb7b64a2b0cd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:16.636029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:16.636771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:16.637053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:16.637337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:16.638132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:16.640941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:16.654681 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3170/6362] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:16.658574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:16.673748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616b626-f263-40af-86ed-733406e3e484 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:16.680508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ebb12-ea97-44de-869e-069b1149548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:16.682465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ebb12-ea97-44de-869e-069b1149548c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:16.682869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ebb12-ea97-44de-869e-069b1149548c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:16.683222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ebb12-ea97-44de-869e-069b1149548c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:16.684096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ebb12-ea97-44de-869e-069b1149548c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:16.686880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ebb12-ea97-44de-869e-069b1149548c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:16.702968 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3193/6363] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:07:16.707735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:16.722653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72a881-5a40-4f7f-9a30-55fb3655c689 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:16.730598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:16.731285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:16.731579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:16.732746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] PATH_INFO: `/v3/projects/d34597bf2e7144eea68fb88f1f1290fe/users/4fe8ba0b205d46829904f8bd91e2c0ec/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:16.760773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34597bf2e7144eea68fb88f1f1290fe, user_id=4fe8ba0b205d46829904f8bd91e2c0ec, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:16.766162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:16.797790 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3171/6364] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:16 2022] PUT /identity/v3/projects/d34597bf2e7144eea68fb88f1f1290fe/users/4fe8ba0b205d46829904f8bd91e2c0ec/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:16.809399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3535a2-a627-4ca0-b6cf-6a10b5815ce6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:16.809986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3535a2-a627-4ca0-b6cf-6a10b5815ce6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:16.811071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3535a2-a627-4ca0-b6cf-6a10b5815ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:16.853514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7c3535a2-a627-4ca0-b6cf-6a10b5815ce6 None None] MFA Rules not processed for user `4fe8ba0b205d46829904f8bd91e2c0ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:16.855075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7c3535a2-a627-4ca0-b6cf-6a10b5815ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:16.975495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:16.976224 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3194/6365] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:17.070033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2f0ef-9544-47b1-a97e-a1439fc587db admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:17.079532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:17.080501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:17.080856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:17.081386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:17.082676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:17.085581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:17.133581 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3172/6366] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:16 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:17.137427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3535a2-a627-4ca0-b6cf-6a10b5815ce6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:17.158594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3535a2-a627-4ca0-b6cf-6a10b5815ce6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:17.297997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:17.298976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:17.299268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:17.299551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:17.300250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:17.302229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:17.348424 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3195/6367] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:17 2022] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:17.349679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:17.374864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd2610-e70a-428d-8573-ebfa8c2deaf0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:17.380329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:17.381021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:17.381309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:17.381584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:17.382750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:17.384580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:17.402968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3173/6368] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:17.407063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:17.420643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c530dc0-7b25-40e9-97f0-783559dec7bd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:17.426926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:17.428051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:17.431720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:17.431720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] PATH_INFO: `/v3/projects/e5823056a46c49ca98fdab191d97360a/users/5a579636a5f649038f8979e73a8b4211/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:17.481009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5823056a46c49ca98fdab191d97360a, user_id=5a579636a5f649038f8979e73a8b4211, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:17.486797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:17.505503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:17.507062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:17.534557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ad340-f2cc-43d9-8bc1-02a0b6d510b6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:17.540246 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3196/6369] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:17 2022] PUT /identity/v3/projects/e5823056a46c49ca98fdab191d97360a/users/5a579636a5f649038f8979e73a8b4211/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:17.542019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:17.676567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:17.677721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:17.678164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:17.678675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] PATH_INFO: `/v3/projects/279c4a5ee66248aa87e548e3d09c5c1c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:17.685618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] RBAC: Authorizing `identity:delete_project(project_id=279c4a5ee66248aa87e548e3d09c5c1c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:17.689792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:17.804152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685a6d0-e8bc-4fe3-afce-9fef12a70875 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:17.816889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:17.819571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:17.819867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:17.820154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:17.824280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:17.833044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:17.843372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279c4a5ee66248aa87e548e3d09c5c1c', 'request_id': 'req-c619bce1-6e95-4bff-8d74-1d190624d69b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:17.860045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279c4a5ee66248aa87e548e3d09c5c1c', 'request_id': 'req-c619bce1-6e95-4bff-8d74-1d190624d69b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:17.876433 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3197/6370] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:17.915949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:17.916248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279c4a5ee66248aa87e548e3d09c5c1c', 'request_id': 'req-c619bce1-6e95-4bff-8d74-1d190624d69b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:17.934449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67dcc1e-0271-467d-a94c-fc4a6a913bd0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:17.937585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] The token cache is being invalidate because project 279c4a5ee66248aa87e548e3d09c5c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:17.938498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:17.939144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c619bce1-6e95-4bff-8d74-1d190624d69b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:17.943125 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3174/6371] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:17 2022] DELETE /identity/v3/projects/279c4a5ee66248aa87e548e3d09c5c1c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:17.948014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacc4c4-4792-40fb-b388-56249a417538 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:17.948304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacc4c4-4792-40fb-b388-56249a417538 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:17.948637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacc4c4-4792-40fb-b388-56249a417538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:17.983060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dbacc4c4-4792-40fb-b388-56249a417538 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:17.985172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dbacc4c4-4792-40fb-b388-56249a417538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:18.109272 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3175/6372] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:18.110819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa918-0940-42af-a34f-9eced1618dba None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.111127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa918-0940-42af-a34f-9eced1618dba None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.111411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caa918-0940-42af-a34f-9eced1618dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.124792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6f937-7b3f-4d65-a5ca-29d34a7f10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:18.125920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6f937-7b3f-4d65-a5ca-29d34a7f10ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.126444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6f937-7b3f-4d65-a5ca-29d34a7f10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.127083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6f937-7b3f-4d65-a5ca-29d34a7f10ab admin admin] PATH_INFO: `/v3/projects/e5823056a46c49ca98fdab191d97360a/users/5a579636a5f649038f8979e73a8b4211/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.131030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6f937-7b3f-4d65-a5ca-29d34a7f10ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5823056a46c49ca98fdab191d97360a, user_id=5a579636a5f649038f8979e73a8b4211, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:18.134898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6f937-7b3f-4d65-a5ca-29d34a7f10ab admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:18.144377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-90caa918-0940-42af-a34f-9eced1618dba None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:18.145623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90caa918-0940-42af-a34f-9eced1618dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:18.157109 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3176/6373] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:18.162360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caa918-0940-42af-a34f-9eced1618dba None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:18.167405 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3198/6374] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:17 2022] PUT /identity/v3/projects/e5823056a46c49ca98fdab191d97360a/users/5a579636a5f649038f8979e73a8b4211/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:18.175981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90caa918-0940-42af-a34f-9eced1618dba None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:18.178954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a019-5753-413d-b517-7458f4661edf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.179505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a019-5753-413d-b517-7458f4661edf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.179979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a019-5753-413d-b517-7458f4661edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.261063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-18a7a019-5753-413d-b517-7458f4661edf None None] MFA Rules not processed for user `5a579636a5f649038f8979e73a8b4211`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:18.262667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-18a7a019-5753-413d-b517-7458f4661edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:18.331327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:18.332028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.332316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.332591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.334336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:18.337956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:18.340304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:18.389959 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3177/6375] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:18.389959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:18.422623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739dff-e58c-4682-b338-6a676361ea67 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:18.432819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:18.433510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.434411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.434751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.435493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:18.437453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:18.445773 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3199/6376] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:18.448560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a019-5753-413d-b517-7458f4661edf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:18.477747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a019-5753-413d-b517-7458f4661edf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:18.512075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3178/6377] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:18 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:18.517261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:18.522211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:18.525817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.526127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.526596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.528410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:18.532688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:18.598009 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3200/6378] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:18 2022] POST /identity/v3/projects => generated 333 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:18.599355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:18.741272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afebff-a751-4f2a-9009-46e0b4acbd17 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:18.850889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b885e0-bbda-47af-8ba7-7a3415ae285b tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:18.859656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:18.860277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.860569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.860855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.861653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:18.866317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:18.889660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:18.890453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:18.891138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:18.891490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:18.893191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:18.895420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:18.944317 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3179/6379] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:18 2022] POST /identity/v3/users => generated 293 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:18.948411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:18.952347 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3201/6380] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:07:18 2022] POST /identity/v3/projects => generated 333 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:18.953604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:19.036336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26efd68-179e-4a57-9cf7-47718bd09753 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.050459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be286c1c-488e-4c7a-9dad-a3ae806300a6 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.058531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.059445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.059866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.060568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.062498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.074864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.173548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3202/6381] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:18 2022] POST /identity/v3/projects => generated 358 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:19.179740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:19.219605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.220838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.223514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.223999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.225075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.228559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.263262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3180/6382] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:19.266653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:19.300705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12d65b-f1d3-4252-a01b-b4148339f1e7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.381412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b81ba7-5ed4-414a-8cbd-ea4b2ff79737 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.396489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.397187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.397479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.397763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.398510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.410033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.467424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.467424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.467424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.467424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.467833 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3203/6383] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 22:07:19 2022] GET /identity/v3/projects => generated 7891 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:07:19.467917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.469022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:19.472753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.490120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55332-cee0-4066-9d03-9bf61c89141c tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.501655 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3181/6384] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:19.503251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:19.506652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.525807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.526129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.526383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.527226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:19.527618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.534224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.543793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece53962-2ba7-4c77-b68b-2f5ea4da5feb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.561295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6b37b-2d18-4bf3-8bf3-74435da823b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.562202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6b37b-2d18-4bf3-8bf3-74435da823b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.562485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6b37b-2d18-4bf3-8bf3-74435da823b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.562764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6b37b-2d18-4bf3-8bf3-74435da823b9 admin admin] PATH_INFO: `/v3/projects/166cd25407574835882c9ad8e6a9005e/users/dc231b6d21d64b979b4befb3329667a9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.599595 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3204/6385] 10.222.0.32 () {58 vars in 1157 bytes} [Sat May 7 22:07:19 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:19.601742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:19.617951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6b37b-2d18-4bf3-8bf3-74435da823b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=166cd25407574835882c9ad8e6a9005e, user_id=dc231b6d21d64b979b4befb3329667a9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.622911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6b37b-2d18-4bf3-8bf3-74435da823b9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.629391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aea530-045a-4939-95c1-5bc3426b82ab tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.646495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.647214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.647503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.647792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.648568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Adding query filter params (parent_id=ac13b6cd387748d486909853841148a9) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:19.648880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.662800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.667524 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3182/6386] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:19 2022] PUT /identity/v3/projects/166cd25407574835882c9ad8e6a9005e/users/dc231b6d21d64b979b4befb3329667a9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:19.679959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b2b0-ec7e-4a8a-933f-278f06bdf657 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.680312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b2b0-ec7e-4a8a-933f-278f06bdf657 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.680531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b2b0-ec7e-4a8a-933f-278f06bdf657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.747967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3205/6387] 10.222.0.32 () {58 vars in 1215 bytes} [Sat May 7 22:07:19 2022] GET /identity/v3/projects?parent_id=ac13b6cd387748d486909853841148a9 => generated 498 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:19.749636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:19.767070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3458b2b0-ec7e-4a8a-933f-278f06bdf657 None None] MFA Rules not processed for user `dc231b6d21d64b979b4befb3329667a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:19.769768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3458b2b0-ec7e-4a8a-933f-278f06bdf657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:19.772619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf5175-8f94-4f0a-9530-22de20b9a822 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:19.944458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:19.945335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:19.945627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:19.945909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects/0131496b71f44351aee10219b3be3c5f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:19.947569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0131496b71f44351aee10219b3be3c5f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:19.954229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:19.979214 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3183/6388] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:19.980365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b2b0-ec7e-4a8a-933f-278f06bdf657 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:20.130664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0131496b71f44351aee10219b3be3c5f', 'request_id': 'req-a304213b-1411-4aa1-9878-7161dc3bf40e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.151050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0131496b71f44351aee10219b3be3c5f', 'request_id': 'req-a304213b-1411-4aa1-9878-7161dc3bf40e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.152021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b2b0-ec7e-4a8a-933f-278f06bdf657 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:20.165260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0131496b71f44351aee10219b3be3c5f', 'request_id': 'req-a304213b-1411-4aa1-9878-7161dc3bf40e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.181135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] The token cache is being invalidate because project 0131496b71f44351aee10219b3be3c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:20.181479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.183216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.192548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3206/6389] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:19 2022] DELETE /identity/v3/projects/0131496b71f44351aee10219b3be3c5f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:20.194228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:20.236569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:20.323597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:20.324448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:20.324448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:20.324766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:20.325328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:20.328381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:20.404487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304213b-1411-4aa1-9878-7161dc3bf40e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:20.409454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:20.410964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:20.411309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:20.411626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects/ac13b6cd387748d486909853841148a9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:20.412910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac13b6cd387748d486909853841148a9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:20.416211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:20.420736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3184/6390] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:19 2022] POST /identity/v3/projects => generated 385 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:20.423629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:20.443156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:20.510448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac13b6cd387748d486909853841148a9', 'request_id': 'req-866d3646-042f-4c77-b207-aed21d4a6f86'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.520235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac13b6cd387748d486909853841148a9', 'request_id': 'req-866d3646-042f-4c77-b207-aed21d4a6f86'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.546899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac13b6cd387748d486909853841148a9', 'request_id': 'req-866d3646-042f-4c77-b207-aed21d4a6f86'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.563202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] The token cache is being invalidate because project ac13b6cd387748d486909853841148a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:20.563638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.569517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.580399 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3207/6391] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:20 2022] DELETE /identity/v3/projects/ac13b6cd387748d486909853841148a9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:20.584124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:20.584303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce0ad5-7b3a-423f-a0b7-5c36e7af3a72 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:20.585554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:20.710903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d3646-042f-4c77-b207-aed21d4a6f86 tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:20.718242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:20.718978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:20.720583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:20.720893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:20.721621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:20.723662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:20.727958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a579636a5f649038f8979e73a8b4211', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5823056a46c49ca98fdab191d97360a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:20.729287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:20.729573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:20.729846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] PATH_INFO: `/v3/projects/c1b0004587e34646801312ec497aaee6` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:20.733308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1b0004587e34646801312ec497aaee6)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:20.752518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:20.776649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3185/6392] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:20 2022] POST /identity/v3/users => generated 299 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:20.781687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:20.791711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:20.830320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b0004587e34646801312ec497aaee6', 'request_id': 'req-83325930-fc96-455d-8646-1aea15e28d3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.841062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b0004587e34646801312ec497aaee6', 'request_id': 'req-83325930-fc96-455d-8646-1aea15e28d3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.852214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b0004587e34646801312ec497aaee6', 'request_id': 'req-83325930-fc96-455d-8646-1aea15e28d3e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.856518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a714d-b56f-4f24-8636-a2af8cb1de05 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:20.866216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] The token cache is being invalidate because project c1b0004587e34646801312ec497aaee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:20.866948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.867904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:20.870243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3208/6393] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:20 2022] DELETE /identity/v3/projects/c1b0004587e34646801312ec497aaee6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:20.873959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:20.876680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:21.001683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83325930-fc96-455d-8646-1aea15e28d3e tempest-ListProjectsTestJSON-1687883284 tempest-ListProjectsTestJSON-1687883284-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:21.007352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:21.008199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.008485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.008768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] PATH_INFO: `/v3/users/4fe8ba0b205d46829904f8bd91e2c0ec` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.010385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe8ba0b205d46829904f8bd91e2c0ec)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:21.012617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:21.059257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:21.062685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.063381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.063668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.065141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:21.067945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:21.105562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe8ba0b205d46829904f8bd91e2c0ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:21.106269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe8ba0b205d46829904f8bd91e2c0ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:21.108456 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3186/6394] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:21.112209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:21.115604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:21.122831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe8ba0b205d46829904f8bd91e2c0ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:21.123694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe8ba0b205d46829904f8bd91e2c0ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:21.134678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a862907d-7778-4255-a66f-2dae389c1ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe8ba0b205d46829904f8bd91e2c0ec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:21.146892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c5abd-636a-4619-934a-30b1d4141966 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:21.163778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:21.164410 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3209/6395] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:20 2022] DELETE /identity/v3/users/4fe8ba0b205d46829904f8bd91e2c0ec => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:21.165551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.165976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.166274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.166745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.167267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.167755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] PATH_INFO: `/v3/projects/f10d4bf3772b49d0b3c82e2dd703021e/users/3528c4839c5e4219a2050c70ed50b7fe/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.203178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:21.207121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:21.218265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10d4bf3772b49d0b3c82e2dd703021e, user_id=3528c4839c5e4219a2050c70ed50b7fe, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:21.218265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:21.237447 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3187/6396] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:21 2022] PUT /identity/v3/projects/f10d4bf3772b49d0b3c82e2dd703021e/users/3528c4839c5e4219a2050c70ed50b7fe/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:21.241925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:21.350185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3210/6397] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:21.388768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584be04d-8df8-4e47-83b2-293faaabc972 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:21.393985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:21.395489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:21.401201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:21.401895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.402183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.402463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.403226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:21.408102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:21.435686 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3188/6398] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:21.439679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:21.462825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63516b75-9b21-4d2d-b526-3d54caf7bb7d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:21.476206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6d578-b4c2-4b2b-953d-436b4733352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:21.477137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6d578-b4c2-4b2b-953d-436b4733352a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.477564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6d578-b4c2-4b2b-953d-436b4733352a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.477847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6d578-b4c2-4b2b-953d-436b4733352a admin admin] PATH_INFO: `/v3/projects/f10d4bf3772b49d0b3c82e2dd703021e/users/3528c4839c5e4219a2050c70ed50b7fe/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.482654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6d578-b4c2-4b2b-953d-436b4733352a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10d4bf3772b49d0b3c82e2dd703021e, user_id=3528c4839c5e4219a2050c70ed50b7fe, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:21.485379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6d578-b4c2-4b2b-953d-436b4733352a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:21.507949 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3189/6399] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:21 2022] PUT /identity/v3/projects/f10d4bf3772b49d0b3c82e2dd703021e/users/3528c4839c5e4219a2050c70ed50b7fe/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:21.519773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.520335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.520823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.522764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7af1c-8f2c-48c2-be33-e28235eae49a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:21.577594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] MFA Rules not processed for user `3528c4839c5e4219a2050c70ed50b7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:21.580967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:21.617422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:21.618598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.618931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.619549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.738134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:21.742370 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3190/6400] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:21.747366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:21.758159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:21.761633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:21.771306 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3211/6401] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:21.900185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd49b67-a962-4dc0-b196-58558f1b4dcc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:21.904101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44dc3d-53d8-4aff-9dc2-286fc95eb6b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:21.904783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dc3d-53d8-4aff-9dc2-286fc95eb6b6 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:21.905693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dc3d-53d8-4aff-9dc2-286fc95eb6b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:21.905693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44dc3d-53d8-4aff-9dc2-286fc95eb6b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:21.928930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44dc3d-53d8-4aff-9dc2-286fc95eb6b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:21.930414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44dc3d-53d8-4aff-9dc2-286fc95eb6b6 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:21.962962 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3191/6402] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:23.062231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:23.082097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4a4e1-0da0-4551-aefb-724343cd073e service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:23.093930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:23.095180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:23.095180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:23.095558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] PATH_INFO: `/v3/users/dc231b6d21d64b979b4befb3329667a9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:23.097569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc231b6d21d64b979b4befb3329667a9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:23.099944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:23.223748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc231b6d21d64b979b4befb3329667a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.224637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc231b6d21d64b979b4befb3329667a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.240200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc231b6d21d64b979b4befb3329667a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.243666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc231b6d21d64b979b4befb3329667a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.271232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc231b6d21d64b979b4befb3329667a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.339247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:23.339816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:23.340109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:23.342495 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3212/6403] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:23 2022] DELETE /identity/v3/users/dc231b6d21d64b979b4befb3329667a9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:23.389802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:23.394164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:23.400907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:23.402037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:23.578087 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3192/6404] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:23.578533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e46779-3ffd-4089-9ddf-6dbed94cf487 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:23.586550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:23.588988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:23.589564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:23.590151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] PATH_INFO: `/v3/projects/d34597bf2e7144eea68fb88f1f1290fe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:23.592444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34597bf2e7144eea68fb88f1f1290fe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:23.594991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:23.632758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:23.634896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:23.671142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34597bf2e7144eea68fb88f1f1290fe', 'request_id': 'req-4e836f05-a941-4fd6-96cc-7f00a21869fc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.682234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34597bf2e7144eea68fb88f1f1290fe', 'request_id': 'req-4e836f05-a941-4fd6-96cc-7f00a21869fc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.699672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34597bf2e7144eea68fb88f1f1290fe', 'request_id': 'req-4e836f05-a941-4fd6-96cc-7f00a21869fc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.717741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] The token cache is being invalidate because project d34597bf2e7144eea68fb88f1f1290fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:23.720015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.722383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:23.728933 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3213/6405] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:23 2022] DELETE /identity/v3/projects/d34597bf2e7144eea68fb88f1f1290fe => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:23.731794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:23.736241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:23.748372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e82ca-215d-42f0-a373-81cdd1c3e706 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:23.842442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:23.843551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:23.844198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:23.844651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:23.853657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:23.889837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e836f05-a941-4fd6-96cc-7f00a21869fc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:23.895652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:23.899810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:23.909954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:23.912313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:23.913425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:23.913890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] PATH_INFO: `/v3/users/5a579636a5f649038f8979e73a8b4211` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:23.921364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a579636a5f649038f8979e73a8b4211)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:23.924543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:23.928941 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3193/6406] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:07:24.037374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a579636a5f649038f8979e73a8b4211'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:24.038349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a579636a5f649038f8979e73a8b4211'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:24.057201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a579636a5f649038f8979e73a8b4211'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:24.057993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a579636a5f649038f8979e73a8b4211'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:24.084012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a579636a5f649038f8979e73a8b4211'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:24.129782 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3214/6407] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:23 2022] DELETE /identity/v3/users/5a579636a5f649038f8979e73a8b4211 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:24.767490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:24.784237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1e0ea-9da7-4bac-b6a1-31f82aa96d46 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:24.965456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:24.969210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:24.991851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:24.994182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:24.994480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:24.994760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] PATH_INFO: `/v3/projects/e5823056a46c49ca98fdab191d97360a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:24.999188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5823056a46c49ca98fdab191d97360a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:25.001227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:25.100269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5823056a46c49ca98fdab191d97360a', 'request_id': 'req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.114683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5823056a46c49ca98fdab191d97360a', 'request_id': 'req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.135084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404a65-5a71-456f-b511-2b4fe39728b1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:25.142429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5823056a46c49ca98fdab191d97360a', 'request_id': 'req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.179335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] The token cache is being invalidate because project e5823056a46c49ca98fdab191d97360a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:25.179636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.180328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-488ccc61-1f99-4fdc-9cf2-813f37f6a2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.185370 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3194/6408] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:24 2022] DELETE /identity/v3/projects/e5823056a46c49ca98fdab191d97360a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:25.187266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0b8a-de93-46c5-ab65-27eab8b091f7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:25.187561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0b8a-de93-46c5-ab65-27eab8b091f7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:25.187863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0b8a-de93-46c5-ab65-27eab8b091f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:25.234460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-aa4d0b8a-de93-46c5-ab65-27eab8b091f7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:25.235731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aa4d0b8a-de93-46c5-ab65-27eab8b091f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:25.313710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:25.315133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:25.315623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:25.316188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] PATH_INFO: `/v3/projects/166cd25407574835882c9ad8e6a9005e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:25.319977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] RBAC: Authorizing `identity:delete_project(project_id=166cd25407574835882c9ad8e6a9005e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:25.322512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:25.416522 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3195/6409] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:25.426915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80938-b083-4086-a868-16f96779bc7a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:25.427503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80938-b083-4086-a868-16f96779bc7a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:25.427958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda80938-b083-4086-a868-16f96779bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:25.432935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166cd25407574835882c9ad8e6a9005e', 'request_id': 'req-290e7d98-3496-4a15-bf47-aad810af467f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.443620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166cd25407574835882c9ad8e6a9005e', 'request_id': 'req-290e7d98-3496-4a15-bf47-aad810af467f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.459542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166cd25407574835882c9ad8e6a9005e', 'request_id': 'req-290e7d98-3496-4a15-bf47-aad810af467f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.460746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eda80938-b083-4086-a868-16f96779bc7a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:25.462168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eda80938-b083-4086-a868-16f96779bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:25.506611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] The token cache is being invalidate because project 166cd25407574835882c9ad8e6a9005e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:25.507010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.509316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.511706 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3215/6410] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:24 2022] DELETE /identity/v3/projects/166cd25407574835882c9ad8e6a9005e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:25.516170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:25.520240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:25.602726 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3196/6411] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:25.608609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda80938-b083-4086-a868-16f96779bc7a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:25.625494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda80938-b083-4086-a868-16f96779bc7a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:25.636541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:25.637734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:25.638028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:25.638901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:25.639658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:25.639966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:25.642580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:25.661047 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3197/6412] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:25.662826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:25.675402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90bb6-5cc5-48b2-b5f1-becb245debe1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:25.689729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:25.690423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:25.690788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:25.691153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:25.693893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:25.698009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:25.704753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e7d98-3496-4a15-bf47-aad810af467f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:25.721320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:25.722850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:25.723321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:25.724140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] PATH_INFO: `/v3/users/3528c4839c5e4219a2050c70ed50b7fe` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:25.740761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3528c4839c5e4219a2050c70ed50b7fe)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:25.743625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:25.864123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3198/6413] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:25 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:25.868063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:25.885981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3528c4839c5e4219a2050c70ed50b7fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.888251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3528c4839c5e4219a2050c70ed50b7fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.902421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3528c4839c5e4219a2050c70ed50b7fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.906444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3528c4839c5e4219a2050c70ed50b7fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.931570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3528c4839c5e4219a2050c70ed50b7fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:25.985793 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3216/6414] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:25 2022] DELETE /identity/v3/users/3528c4839c5e4219a2050c70ed50b7fe => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:26.033869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffafb9-f695-4451-9716-8b8a2d0697a5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:26.203492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:26.205905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:26.206200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:26.206526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:26.217438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:26.223934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:26.267261 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3199/6415] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:25 2022] POST /identity/v3/users => generated 282 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:26.268809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:26.271779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:26.300285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c023-dcd8-4594-806a-4ac05178ec91 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:26.309794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:26.311688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:26.312813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:26.314563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:26.315853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:26.319260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:26.355326 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3217/6416] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:26.361448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:26.382299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e811f-f571-479d-bee3-80e65ef16629 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:26.391344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d99bb-5e6a-4af5-9d85-d7defb8bd17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:26.394426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d99bb-5e6a-4af5-9d85-d7defb8bd17f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:26.394829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d99bb-5e6a-4af5-9d85-d7defb8bd17f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:26.395817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d99bb-5e6a-4af5-9d85-d7defb8bd17f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:26.397488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d99bb-5e6a-4af5-9d85-d7defb8bd17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:26.399749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d99bb-5e6a-4af5-9d85-d7defb8bd17f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:26.427148 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3200/6417] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:26.430853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:26.453842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67066140-b08d-4aec-87b6-08206e1e7506 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:26.471768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:26.473405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:26.473770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:26.474429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] PATH_INFO: `/v3/projects/459c39a796f143c5867b67501e462aec/users/5ddfbbda16c5485d957a657e9fe2dd44/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:26.534400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=459c39a796f143c5867b67501e462aec, user_id=5ddfbbda16c5485d957a657e9fe2dd44, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:26.539380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:26.577641 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3218/6418] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:26 2022] PUT /identity/v3/projects/459c39a796f143c5867b67501e462aec/users/5ddfbbda16c5485d957a657e9fe2dd44/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:26.598227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:26.598524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:26.598837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:26.644904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] MFA Rules not processed for user `5ddfbbda16c5485d957a657e9fe2dd44`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:26.646457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:26.786674 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3201/6419] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:26.791334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:26.868983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:26.875539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:26.932822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d9dd2-5915-44d1-9663-24532ea57c1a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:26.941950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:26.942676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:26.943177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:26.943688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:26.944554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:26.946712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:26.973462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a97d9a-700c-43e4-8c3c-8a2010ec6afa None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:26.987188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:26.988266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:26.988655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:26.989037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] PATH_INFO: `/v3/users/9c29470ef66e4f3fb42580aadd704908` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:26.991392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c29470ef66e4f3fb42580aadd704908)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:26.993661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.005628 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3219/6420] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:26 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:27.008749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.113409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c29470ef66e4f3fb42580aadd704908'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.132170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c29470ef66e4f3fb42580aadd704908'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.134011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c29470ef66e4f3fb42580aadd704908'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.135126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c29470ef66e4f3fb42580aadd704908'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.152601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c29470ef66e4f3fb42580aadd704908'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.162570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b197eb0-d991-4dff-ab8a-38aaed9a6273 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.172708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c705a-f91f-4221-8562-314b991ff1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.173782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c705a-f91f-4221-8562-314b991ff1ec admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.174272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c705a-f91f-4221-8562-314b991ff1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.174688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c705a-f91f-4221-8562-314b991ff1ec admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.175861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c705a-f91f-4221-8562-314b991ff1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.181224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c705a-f91f-4221-8562-314b991ff1ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.207977 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3202/6421] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:26 2022] DELETE /identity/v3/users/9c29470ef66e4f3fb42580aadd704908 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:27.209358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.215571 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3220/6422] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:27 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:27.219614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.219893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.220167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.220641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.246166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:27.248233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.364462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da994d3-5851-4e7e-9444-6fb79cb13675 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.373430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.376586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.377588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.377588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] PATH_INFO: `/v3/projects/f10d4bf3772b49d0b3c82e2dd703021e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.381865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10d4bf3772b49d0b3c82e2dd703021e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.384438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.396547 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3221/6423] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:27.397433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.402631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.446000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2e9ad-8c76-4c26-a6f0-16834294825f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.453349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.454593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.454983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.455516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.456778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.458880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.472600 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3222/6424] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:27.473730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.475950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.496610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10d4bf3772b49d0b3c82e2dd703021e', 'request_id': 'req-485b76de-a7e6-4746-8607-1644468641bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.510651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10d4bf3772b49d0b3c82e2dd703021e', 'request_id': 'req-485b76de-a7e6-4746-8607-1644468641bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.528118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10d4bf3772b49d0b3c82e2dd703021e', 'request_id': 'req-485b76de-a7e6-4746-8607-1644468641bf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.563762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] The token cache is being invalidate because project f10d4bf3772b49d0b3c82e2dd703021e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:27.564084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.568381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:27.568859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef968ac-b9b0-4df0-96ab-074cb153a1c8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.574104 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3203/6425] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:27 2022] DELETE /identity/v3/projects/f10d4bf3772b49d0b3c82e2dd703021e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:27.575078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.576657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.681226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b76de-a7e6-4746-8607-1644468641bf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.687429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ea19-2198-4ff7-a6f9-e226c3260b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.688342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ea19-2198-4ff7-a6f9-e226c3260b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.688628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ea19-2198-4ff7-a6f9-e226c3260b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.689187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ea19-2198-4ff7-a6f9-e226c3260b5f admin admin] PATH_INFO: `/v3/projects/2fbc66c4a18240229de26f61022ea49c/users/bc2b7f6f467d42c49c2f09d97dafe522/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.691237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.691903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.692191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.692469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.696346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.706998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ea19-2198-4ff7-a6f9-e226c3260b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbc66c4a18240229de26f61022ea49c, user_id=bc2b7f6f467d42c49c2f09d97dafe522, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.710040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ea19-2198-4ff7-a6f9-e226c3260b5f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.724950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.726432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.728835 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3204/6426] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:27 2022] PUT /identity/v3/projects/2fbc66c4a18240229de26f61022ea49c/users/bc2b7f6f467d42c49c2f09d97dafe522/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:27.730413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531587-3417-49a1-bd6a-305292825e16 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.730709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531587-3417-49a1-bd6a-305292825e16 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.731029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c531587-3417-49a1-bd6a-305292825e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.754726 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3223/6427] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:27.755670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0c531587-3417-49a1-bd6a-305292825e16 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:27.755796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.757185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0c531587-3417-49a1-bd6a-305292825e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.777551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489662db-edf0-49d2-9e5a-f1ae0ff5b8f3 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.844584 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3205/6428] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:27.854100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac8c4-53ae-47cb-9518-b57e8ac38659 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.855168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac8c4-53ae-47cb-9518-b57e8ac38659 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.855809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ac8c4-53ae-47cb-9518-b57e8ac38659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.889305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-892ac8c4-53ae-47cb-9518-b57e8ac38659 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:27.890793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-892ac8c4-53ae-47cb-9518-b57e8ac38659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:27.908054 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3206/6429] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:27.908821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ac8c4-53ae-47cb-9518-b57e8ac38659 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.917998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.918858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.919149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.920021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.920763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.920882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ac8c4-53ae-47cb-9518-b57e8ac38659 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.922412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.927747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.928660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.929080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.929634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.929943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:27.930298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.932424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.947133 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3224/6430] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:27.951078 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3207/6431] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:27.951838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.952191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:27.964872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dcefb-f879-4417-98cc-98b904fe34f3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.972629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.973368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.973654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.973936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:27.974957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:27.978013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:27.981844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304656c9-c7c8-4eee-a151-7a898a2a0c9d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:27.992934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e8ef-2877-4ca5-ae58-1ab53366d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:27.994146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e8ef-2877-4ca5-ae58-1ab53366d3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:27.994445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e8ef-2877-4ca5-ae58-1ab53366d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:27.994729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e8ef-2877-4ca5-ae58-1ab53366d3c4 admin admin] PATH_INFO: `/v3/projects/2fbc66c4a18240229de26f61022ea49c/users/bc2b7f6f467d42c49c2f09d97dafe522/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.000466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97e8ef-2877-4ca5-ae58-1ab53366d3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbc66c4a18240229de26f61022ea49c, user_id=bc2b7f6f467d42c49c2f09d97dafe522, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.007075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97e8ef-2877-4ca5-ae58-1ab53366d3c4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.022896 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3208/6432] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:27 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:28.025464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.035792 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3225/6433] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:27 2022] PUT /identity/v3/projects/2fbc66c4a18240229de26f61022ea49c/users/bc2b7f6f467d42c49c2f09d97dafe522/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:28.045670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0ea1-73ba-4070-8f1e-d94014007410 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.045992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0ea1-73ba-4070-8f1e-d94014007410 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.046844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb0ea1-73ba-4070-8f1e-d94014007410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.094593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9cfb0ea1-73ba-4070-8f1e-d94014007410 None None] MFA Rules not processed for user `bc2b7f6f467d42c49c2f09d97dafe522`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:28.095878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9cfb0ea1-73ba-4070-8f1e-d94014007410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:28.127843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3869f1-eb3a-4f85-a7e4-556a114fb5a7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.245622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.246325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.246624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.246920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.247763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.250359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.259050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3226/6434] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:07:28.262275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb0ea1-73ba-4070-8f1e-d94014007410 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.282156 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3209/6435] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:28.284687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb0ea1-73ba-4070-8f1e-d94014007410 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.286334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.297487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.298391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.302027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.302027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.302027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.303273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3896-b419-4506-93db-d538e2918259 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.305079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.314966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.315767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.316124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.316400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.317239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.319783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.335270 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3227/6436] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/roles => generated 234 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:28.338015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.346811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3210/6437] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:28 2022] GET /identity/v3/roles => generated 1645 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:28.350304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.354289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3613f00-1af7-41af-bf32-7980562b66e2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.360433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.361126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.361409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.361690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.362556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.364480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.374482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081528d-1e74-4a3c-b068-4991ea9404fe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.387235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.388652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.388818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.389043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.389762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.394983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.411867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3228/6438] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/roles => generated 235 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:28.416422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.425098 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3211/6439] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:28 2022] GET /identity/v3/roles => generated 1871 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:28.426227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.442838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0492a6-216a-4d77-a5a3-7105c5238c27 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.445946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc05acc-1514-4ef4-b9a4-f7516bcb609f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.459176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a736d5-1f34-401a-be21-94947f34f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.464196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a736d5-1f34-401a-be21-94947f34f659 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.464589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a736d5-1f34-401a-be21-94947f34f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.464950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a736d5-1f34-401a-be21-94947f34f659 admin admin] PATH_INFO: `/v3/projects/71bfb23676c24e00b5997394686be11b/users/957bab5b90134d2cb1c1cf7b0dce10ac/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.486981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.487394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.487697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.487964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.489810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.496286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.497194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a736d5-1f34-401a-be21-94947f34f659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bfb23676c24e00b5997394686be11b, user_id=957bab5b90134d2cb1c1cf7b0dce10ac, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.500476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a736d5-1f34-401a-be21-94947f34f659 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.531626 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3229/6440] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/roles => generated 234 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:28.536165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.538622 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3212/6441] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:28 2022] PUT /identity/v3/projects/71bfb23676c24e00b5997394686be11b/users/957bab5b90134d2cb1c1cf7b0dce10ac/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:28.548799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.551136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.551880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.557244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7f201-da95-4bcb-b2b7-8a8c482b6fe0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.591667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] MFA Rules not processed for user `957bab5b90134d2cb1c1cf7b0dce10ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:28.595752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:28.654621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.655573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.656309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.656309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.657156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.658893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.679840 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3230/6442] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/domains => generated 276 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:28.684047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.770717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc90a9-77cb-409a-b99f-42d7df991174 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.778235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.778821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.779229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.779645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.780519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:28.783254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:28.850426 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3231/6443] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:28.855253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.870511 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3213/6444] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:28.876949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:28.894493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:28.945561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2402567-cf76-4996-8512-99b88848eef2 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:28.990908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:28.991184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:28.991533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:28.994570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/groups` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:28.994570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.006682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.043998 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3232/6445] 10.222.0.32 () {60 vars in 1146 bytes} [Sat May 7 22:07:28 2022] POST /identity/v3/groups => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:29.045933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.056581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e6bf3-614a-4b00-8e17-143cba30eaed None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.161359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.163380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.163916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.164427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] PATH_INFO: `/v3/projects/e26f8701226f4b8cbedae536d77c9c61` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.167604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26f8701226f4b8cbedae536d77c9c61)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.172980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.192113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7934c-449a-4726-aaa2-7beb604c9dc8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.200184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.205598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.205598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.205598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.205598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.205598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.284775 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3233/6446] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:29.286654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.318785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26f8701226f4b8cbedae536d77c9c61', 'request_id': 'req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:29.327666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26f8701226f4b8cbedae536d77c9c61', 'request_id': 'req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:29.339177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26f8701226f4b8cbedae536d77c9c61', 'request_id': 'req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:29.354226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] The token cache is being invalidate because project e26f8701226f4b8cbedae536d77c9c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:29.354602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:29.355647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:29.358909 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3214/6447] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:28 2022] DELETE /identity/v3/projects/e26f8701226f4b8cbedae536d77c9c61 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:29.359058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.364921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:29.391989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba47a5f-8f20-4ffd-b50c-4b824a84a027 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.488564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11dcf5-88ee-49dc-a86b-dc1c014c6754 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.494615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331e941-5f2b-41f5-a884-2928f27ad802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.496106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e941-5f2b-41f5-a884-2928f27ad802 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.496560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e941-5f2b-41f5-a884-2928f27ad802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.497142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e941-5f2b-41f5-a884-2928f27ad802 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.498696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331e941-5f2b-41f5-a884-2928f27ad802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.500999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331e941-5f2b-41f5-a884-2928f27ad802 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.502496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f8a76-12a8-49e5-a764-d332170ede08 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.503204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f8a76-12a8-49e5-a764-d332170ede08 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.503512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f8a76-12a8-49e5-a764-d332170ede08 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.503772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f8a76-12a8-49e5-a764-d332170ede08 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.504519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f8a76-12a8-49e5-a764-d332170ede08 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.506126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f8a76-12a8-49e5-a764-d332170ede08 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.526855 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3234/6448] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/roles => generated 235 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:29.526855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.526855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.526855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.532961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3215/6449] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:29.534696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f02c3-2d07-4d9b-963c-eec06ce87c4a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.535099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f02c3-2d07-4d9b-963c-eec06ce87c4a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.535291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f02c3-2d07-4d9b-963c-eec06ce87c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.549671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:29.550812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:29.557910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-901f02c3-2d07-4d9b-963c-eec06ce87c4a None None] MFA Rules not processed for user `96077bbd65b9449a8b679c2ebb35bdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:29.559171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-901f02c3-2d07-4d9b-963c-eec06ce87c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:29.566091 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3235/6450] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:29.572025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.573613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:29.589535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe5ae-107e-4712-badb-0ee9d7885e90 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.596201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.597317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.597900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.598401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.599820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.603111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.635416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3236/6451] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/users => generated 442 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:29.636406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.652063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4115-d5bd-4ed7-beff-16a71d1a2169 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.657616 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3216/6452] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:29.658961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c49d5-d956-40b5-b125-9828256bc9c9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.659258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c49d5-d956-40b5-b125-9828256bc9c9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.660225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c49d5-d956-40b5-b125-9828256bc9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.663251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.663925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.664215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.664483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.665248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.666949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.682683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3237/6453] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:29 2022] GET /identity/v3/roles => generated 2322 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:29.683725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.691630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-292c49d5-d956-40b5-b125-9828256bc9c9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:29.693366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-292c49d5-d956-40b5-b125-9828256bc9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:29.698711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635536-5039-403f-8c2f-f7223229bc14 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.706274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.707007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.707298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.707579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.708322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.709337 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:29.709337 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:29.709337 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:29.711140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.713618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3217/6454] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:29.714678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c49d5-d956-40b5-b125-9828256bc9c9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.729348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c49d5-d956-40b5-b125-9828256bc9c9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.737163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.738474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.739066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.739436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] PATH_INFO: `/v3/projects/643fb689449f4071a7fcf8ad37ef9793/users/bbc6679a5ae54263acbd3ad68883dfbf/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.752731 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3238/6455] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/roles => generated 270 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:29.752731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.761927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643fb689449f4071a7fcf8ad37ef9793, user_id=bbc6679a5ae54263acbd3ad68883dfbf, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.768038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.774719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f74e3a-7515-4b08-835a-ff39fbd79c84 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.781535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.782527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.782968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.783356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.784278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:29.788471 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3218/6456] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:29 2022] PUT /identity/v3/projects/643fb689449f4071a7fcf8ad37ef9793/users/bbc6679a5ae54263acbd3ad68883dfbf/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:29.789310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.791313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.793030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.809649 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3239/6457] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:29.811122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.822602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b527e1f-56a4-40ac-91f2-1f6bc5a29d55 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.870806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689c2cb-f443-4ecd-b834-be671d8afd82 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.879112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.881182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.881847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.882750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/aaf37629fe064ee18a401040a140264b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.894091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:29.894997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:29.895286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:29.895564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:29.897306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.899398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.910702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=aaf37629fe064ee18a401040a140264b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:29.913467 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3240/6458] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:29 2022] GET /identity/v3/roles => generated 2322 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:29.915007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:29.915130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:29.930641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e6f16-f240-4bac-8cd6-dc16e7106a4e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:29.936778 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3219/6459] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:29 2022] PUT /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/aaf37629fe064ee18a401040a140264b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:29.938305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.015280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.016439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.016829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.017470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.018277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.020361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.054239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a127b-ddab-49e1-bb9e-a429027ab18f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.060841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.061718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.061929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.062205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] PATH_INFO: `/v3/projects/643fb689449f4071a7fcf8ad37ef9793/users/bbc6679a5ae54263acbd3ad68883dfbf/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.064745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643fb689449f4071a7fcf8ad37ef9793, user_id=bbc6679a5ae54263acbd3ad68883dfbf, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.065786 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3241/6460] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:29 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:30.067740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.069868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.083487 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3220/6461] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:29 2022] PUT /identity/v3/projects/643fb689449f4071a7fcf8ad37ef9793/users/bbc6679a5ae54263acbd3ad68883dfbf/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:30.084605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.156201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7c48-c5e0-475a-bfdb-dcfdecc69891 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.175921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201d491-1dfc-421b-bd37-0d428cced197 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.182714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7c93-edcd-43bb-9a83-cb87af02c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.184593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7c93-edcd-43bb-9a83-cb87af02c6ec admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.185753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7c93-edcd-43bb-9a83-cb87af02c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.186103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7c93-edcd-43bb-9a83-cb87af02c6ec admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.186905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7c93-edcd-43bb-9a83-cb87af02c6ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.188938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7c93-edcd-43bb-9a83-cb87af02c6ec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.226753 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3221/6462] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:30 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:30.226753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.226753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.226753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.237306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.238582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.239946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.240400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.243080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Adding query filter params (scope.project.id=0dde06ac62a640da84e25f0ae9080547, user.id=2baaa6df4bb047bb996c1c17311b3595) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:30.243623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.245708 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:30.245708 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:30.245708 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:30.248395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.280816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] MFA Rules not processed for user `bbc6679a5ae54263acbd3ad68883dfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:30.282861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.352205 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3242/6463] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 22:07:30 2022] GET /identity/v3/role_assignments?scope.project.id=0dde06ac62a640da84e25f0ae9080547&user.id=2baaa6df4bb047bb996c1c17311b3595&effective => generated 228 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:30.352205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.369233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb2b7-42cc-4c68-8f2e-36b8f00c7495 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.370302 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3222/6464] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:30.371664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.377327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.384364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.385053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.385342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.385613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.386381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.388070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.403650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3243/6465] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:30 2022] GET /identity/v3/roles => generated 2322 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:30.404433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.422629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447fab8-3a71-45a1-be14-e69bee1099be admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.443336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.444453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.445569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.445569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/aaf37629fe064ee18a401040a140264b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.449727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=aaf37629fe064ee18a401040a140264b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.453557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200dc12-379a-48ac-a42d-1c94bbb70c54 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.453714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.463201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role aaf37629fe064ee18a401040a140264b was removed from user 2baaa6df4bb047bb996c1c17311b3595 on project 0dde06ac62a640da84e25f0ae9080547. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:30.463714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:30.464708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:30.470482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.475985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.476286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.476566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.480664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.492824 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3244/6466] 10.222.0.32 () {58 vars in 1466 bytes} [Sat May 7 22:07:30 2022] DELETE /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/aaf37629fe064ee18a401040a140264b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:30.493230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.495055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.503834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.505860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.521443 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3223/6467] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:30.522149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.524232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.551244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee116623-952b-4510-ae8a-a1ba861dbf72 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.596085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cb557-fde0-4448-aeea-97d0c579e1d5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.602551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.603814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.604463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.605032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.608625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.618036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.619476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.619924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.620638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.621545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.623566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.636794 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3224/6468] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:30 2022] GET /identity/v3/roles => generated 2322 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:30.637890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.639897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.730289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0385-c010-42e3-adbf-48d86e3cae8a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.731497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.737982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.738971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.740153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.740661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.741023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/aaf37629fe064ee18a401040a140264b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.742846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=aaf37629fe064ee18a401040a140264b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.744066 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:30.744066 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:30.744066 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:30.745418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:30.775442 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3245/6469] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:30.777497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.801675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role aaf37629fe064ee18a401040a140264b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:30.802058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:30.803984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:30.809631 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3225/6470] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:30 2022] DELETE /identity/v3/roles/aaf37629fe064ee18a401040a140264b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:30.815633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:30.819262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:30.819600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818e57-5c8f-4399-b1e3-068ceab385b7 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.964240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58732c89-b7f9-4ee5-a73c-0c82c8d4a39b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:30.969485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfea01-ea11-4ea0-98c1-adb951305987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.970557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfea01-ea11-4ea0-98c1-adb951305987 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.971262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfea01-ea11-4ea0-98c1-adb951305987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.972092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfea01-ea11-4ea0-98c1-adb951305987 admin admin] PATH_INFO: `/v3/projects/e3330eb3ed9b4f1bae703deb89227aca/users/2dfee5f25ae1427ba3d3cfec7b1d823e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.978287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:30.979346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:30.979614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:30.979880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/5d957d3003644823838743c7d145491a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:30.988492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=5d957d3003644823838743c7d145491a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:30.991231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.002005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfea01-ea11-4ea0-98c1-adb951305987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3330eb3ed9b4f1bae703deb89227aca, user_id=2dfee5f25ae1427ba3d3cfec7b1d823e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:31.005670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfea01-ea11-4ea0-98c1-adb951305987 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.016107 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3226/6471] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:30 2022] PUT /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/5d957d3003644823838743c7d145491a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:31.017226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:31.032125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3246/6472] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:30 2022] PUT /identity/v3/projects/e3330eb3ed9b4f1bae703deb89227aca/users/2dfee5f25ae1427ba3d3cfec7b1d823e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:31.042705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:31.042938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:31.043216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:31.098305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a000e-6835-4ad9-8c08-0c4bf090f948 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:31.104966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] MFA Rules not processed for user `2dfee5f25ae1427ba3d3cfec7b1d823e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:31.108259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:31.165022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:31.166021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:31.166216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:31.166499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:31.168433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:31.169473 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:31.169473 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:31.169473 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:31.170349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.213896 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3227/6473] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:31 2022] PUT /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 520 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:31.227683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:31.253918 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3247/6474] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:31.258737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:31.260099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:31.393395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37585ae8-8f34-4d05-a024-2fedb2a4407d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:31.401843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:31.402616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:31.402964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:31.403272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:31.405068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Adding query filter params (scope.project.id=0dde06ac62a640da84e25f0ae9080547, user.id=2baaa6df4bb047bb996c1c17311b3595) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:31.405527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:31.408272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.479577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0695a7b-073e-4566-b159-a75c23f5aa19 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:31.480637 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3228/6475] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 22:07:31 2022] GET /identity/v3/role_assignments?scope.project.id=0dde06ac62a640da84e25f0ae9080547&user.id=2baaa6df4bb047bb996c1c17311b3595&effective => generated 1061 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:31.484806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:31.507189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ecb93-11ec-4c69-91b5-801240ce1224 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:31.520106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:31.524235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:31.524557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:31.524852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:31.531686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:31.534341 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:31.534341 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:31.534341 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:31.535302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.574068 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3229/6476] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:31 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:31.578393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:31.629315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:31.629939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:31.630287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:31.630412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:31.636240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:31.638271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.719572 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3248/6477] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:31 2022] POST /identity/v3/projects => generated 373 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:31.723619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:31.763628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725907e-1de6-4c62-882c-16cf9d91106a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:31.911623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409316d-61a6-4a15-8b78-58765bfb1b58 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:31.924212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:31.924912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:31.925194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:31.925472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:31.926174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:31.928176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.930816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:31.931546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:31.932047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:31.932516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:31.933510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Adding query filter params (scope.project.id=0dde06ac62a640da84e25f0ae9080547, user.id=2baaa6df4bb047bb996c1c17311b3595) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:31.934000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:31.936139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:31.975250 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3249/6478] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:31 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:31.978894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:31.995570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06393087-606d-4f63-82ce-52b4ce6ffade admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:32.006041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:32.006982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.008568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.008568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.008568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:32.010280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:32.041545 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3250/6479] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:31 2022] GET /identity/v3/roles => generated 2322 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:07:32.047218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:32.057284 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3230/6480] 10.222.0.32 () {58 vars in 1355 bytes} [Sat May 7 22:07:31 2022] GET /identity/v3/role_assignments?scope.project.id=0dde06ac62a640da84e25f0ae9080547&user.id=2baaa6df4bb047bb996c1c17311b3595&effective => generated 577 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:32.063104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:32.081397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f06c-993f-48ae-8c71-95b4504e6f47 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:32.081599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3cb01-b5c7-401b-9d82-d522cfbc86e8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:32.088724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15669c-0e46-46c7-8024-94919ae6371e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:32.089690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15669c-0e46-46c7-8024-94919ae6371e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.090051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15669c-0e46-46c7-8024-94919ae6371e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.090426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15669c-0e46-46c7-8024-94919ae6371e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.092777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15669c-0e46-46c7-8024-94919ae6371e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:32.095400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15669c-0e46-46c7-8024-94919ae6371e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:32.101696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:32.102602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.102913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.103250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] PATH_INFO: `/v3/projects/24f68c36b4f249b8a8760c0febdaf835/users/1e524969b92a4123bc2608ad2731531d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-dc15669c-0e46-46c7-8024-94919ae6371e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca.: keystone.exception.ImpliedRoleNotFound: 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca. May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = query.one() May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._iter().one() May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._only_one_row( May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:32.156397 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) May 07 22:07:32.158001 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role May 07 22:07:32.159069 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 07 22:07:32.159069 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 07 22:07:32.159069 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 07 22:07:32.159069 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca. May 07 22:07:32.159069 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:32.159667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f68c36b4f249b8a8760c0febdaf835, user_id=1e524969b92a4123bc2608ad2731531d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:32.163038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3231/6481] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:32 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 137 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:32.164681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda5b3c-98a4-431d-a025-a596d05318a6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.165143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda5b3c-98a4-431d-a025-a596d05318a6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.165602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda5b3c-98a4-431d-a025-a596d05318a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.166467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:32.202871 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3251/6482] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:32 2022] PUT /identity/v3/projects/24f68c36b4f249b8a8760c0febdaf835/users/1e524969b92a4123bc2608ad2731531d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:32.204109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:32.231324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-aeda5b3c-98a4-431d-a025-a596d05318a6 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:32.239030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aeda5b3c-98a4-431d-a025-a596d05318a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:32.337922 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3232/6483] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:07:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:32.339776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda5b3c-98a4-431d-a025-a596d05318a6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:32.557139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda5b3c-98a4-431d-a025-a596d05318a6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:32.567525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:32.569639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.570076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.573473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.574709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:32.577850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:32.592060 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3233/6484] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:32 2022] GET /identity/v3/roles => generated 2322 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:32.593320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:32.595258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:32.657326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c03585-5467-4bd6-8dc9-4284a84c2a1f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:32.663110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:32.664428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.664924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.665414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/5d957d3003644823838743c7d145491a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.668805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=5d957d3003644823838743c7d145491a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:32.671782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:32.678001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 5d957d3003644823838743c7d145491a was removed from user 2baaa6df4bb047bb996c1c17311b3595 on project 0dde06ac62a640da84e25f0ae9080547. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:32.678738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:32.679896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:32.705370 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3252/6485] 10.222.0.32 () {58 vars in 1466 bytes} [Sat May 7 22:07:32 2022] DELETE /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/5d957d3003644823838743c7d145491a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:32.706418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:32.712118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:32.761377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9b2f-8c8d-465a-8c37-05738ecbff7e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:32.817418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc93d-31c3-439b-a4f8-1e26275615d4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:32.823969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:32.825255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.826297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.827151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] PATH_INFO: `/v3/projects/24f68c36b4f249b8a8760c0febdaf835/users/1e524969b92a4123bc2608ad2731531d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.829552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f68c36b4f249b8a8760c0febdaf835, user_id=1e524969b92a4123bc2608ad2731531d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:32.832775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:32.845800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3253/6486] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:32 2022] PUT /identity/v3/projects/24f68c36b4f249b8a8760c0febdaf835/users/1e524969b92a4123bc2608ad2731531d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:32.847020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:32.849689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:32.885258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6235a-a5f0-4347-ba32-8581df2f412a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:32.886014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6235a-a5f0-4347-ba32-8581df2f412a service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:32.886318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6235a-a5f0-4347-ba32-8581df2f412a service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:32.886614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6235a-a5f0-4347-ba32-8581df2f412a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:32.895337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-36e6235a-a5f0-4347-ba32-8581df2f412a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:33.007344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6235a-a5f0-4347-ba32-8581df2f412a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:33.010316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826a97c-8bc4-4c55-b42a-29c094c4707d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:33.012867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6235a-a5f0-4347-ba32-8581df2f412a service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:33.023825 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3234/6487] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:07:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:07:33.025153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e49b24-2d94-47d8-b2dc-7a2301e77515 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.025441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e49b24-2d94-47d8-b2dc-7a2301e77515 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.025722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e49b24-2d94-47d8-b2dc-7a2301e77515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.035104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:33.037450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.037811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.038170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.040435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:33.046407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:33.059375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f7e49b24-2d94-47d8-b2dc-7a2301e77515 None None] MFA Rules not processed for user `1e524969b92a4123bc2608ad2731531d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:33.061716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f7e49b24-2d94-47d8-b2dc-7a2301e77515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:33.088798 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3254/6488] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:32 2022] POST /identity/v3/roles => generated 271 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:33.089788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:33.098804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:33.306855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84c17-004c-4965-853e-dc058fd3e838 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:33.319929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:33.320828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.321307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.321774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] PATH_INFO: `/v3/users/77910ce7577e4c068577ca92252c758a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.323159 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3235/6489] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:33.328023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77910ce7577e4c068577ca92252c758a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:33.330045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:33.331386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e49b24-2d94-47d8-b2dc-7a2301e77515 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:33.381519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e49b24-2d94-47d8-b2dc-7a2301e77515 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:33.403888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:33.404581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.404869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.411737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.412525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Adding query filter params (domain_id=002b0170538c492ead7f5488329411a5) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:33.412847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:33.417021 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:33.417021 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:33.417021 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:33.417974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:33.447272 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3236/6490] 10.222.0.32 () {58 vars in 1206 bytes} [Sat May 7 22:07:33 2022] GET /identity/v3/roles?domain_id=002b0170538c492ead7f5488329411a5 => generated 408 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:33.448351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:33.465238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68868515-7bff-4731-8fe6-c2e990c1340b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:33.469253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77910ce7577e4c068577ca92252c758a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:33.472818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77910ce7577e4c068577ca92252c758a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:33.478254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:33.479862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.480750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.480750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.481496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:33.483167 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:33.483167 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:33.483167 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:33.484100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:33.505370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77910ce7577e4c068577ca92252c758a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:33.507319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77910ce7577e4c068577ca92252c758a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:33.532225 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3237/6491] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:33 2022] POST /identity/v3/services => generated 288 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:33.533512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:33.535777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77910ce7577e4c068577ca92252c758a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:33.535950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:33.576296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ff618-9c32-4ef3-81e2-6c9fa6c18dad tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:33.586482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:33.587766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.588110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.588440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/bb77f73b124e48879ddc0833553331d6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.592503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bb77f73b124e48879ddc0833553331d6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:33.594824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:33.617254 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3255/6492] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:33 2022] DELETE /identity/v3/users/77910ce7577e4c068577ca92252c758a => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:33.617890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:33.623618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:33.676753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role bb77f73b124e48879ddc0833553331d6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:33.677031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:33.677821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dd0b911e-4d74-49d4-894d-112e7b069eb4 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:33.682005 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3238/6493] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:33 2022] DELETE /identity/v3/roles/bb77f73b124e48879ddc0833553331d6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:33.683161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.684407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.684800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.713991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:33.715368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:33.812555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a31c3d-ea02-493b-8ff3-31092cdf8f6c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:33.890862 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3239/6494] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:33.891498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:33.896740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:33.916894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:33.917646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:33.917936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:33.918218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:33.918987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:33.920606 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:33.920606 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:33.920606 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:33.925582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:33.953629 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3256/6495] 10.222.0.32 () {60 vars in 1212 bytes} [Sat May 7 22:07:33 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:33.960474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:33.982586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:34.041072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718522a7-04c8-4d0f-b589-d5ae9d11194d tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.061747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.063663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.065859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.066422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.067615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.071476 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:34.071476 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:34.071476 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:34.079116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.103393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3247b-f58d-473e-8d3c-c6515cdd45d5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.136642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3257/6496] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:33 2022] POST /identity/v3/services => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:34.138487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.145751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:34.161947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.162647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.162977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.163258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.164024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Adding query filter params (domain_id=002b0170538c492ead7f5488329411a5) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:34.164329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.165978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.183076 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3240/6497] 10.222.0.32 () {58 vars in 1206 bytes} [Sat May 7 22:07:33 2022] GET /identity/v3/roles?domain_id=002b0170538c492ead7f5488329411a5 => generated 148 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:34.183076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.204065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abce64-159a-4f7d-8eca-586766ee7151 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.215794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.215794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.215794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.216768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.216768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.216768 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:34.216768 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:34.216768 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:34.216768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.241039 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3241/6498] 10.222.0.32 () {60 vars in 1212 bytes} [Sat May 7 22:07:34 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:34.241039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.260085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fe965-011d-4b8f-97d1-5c8dad184cce tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.271534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.273777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.274176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.275076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/bb77f73b124e48879ddc0833553331d6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.301299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Could not find role: bb77f73b124e48879ddc0833553331d6.: keystone.exception.RoleNotFound: Could not find role: bb77f73b124e48879ddc0833553331d6. May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete May 07 22:07:34.313207 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:07:34.314322 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bb77f73b124e48879ddc0833553331d6. May 07 22:07:34.315513 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:34.317758 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3242/6499] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:34 2022] DELETE /identity/v3/roles/bb77f73b124e48879ddc0833553331d6 => generated 110 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:34.318887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.334036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f0cde-d720-47e9-ae72-022f1b635787 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.343578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb545-b58a-4433-a238-42cd5e878fe7 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.355102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.355102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.355102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.355571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.356076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.357430 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:34.357430 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:34.357430 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:34.357813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.358324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.358605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.358906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.359024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.370199 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3243/6500] 10.222.0.32 () {58 vars in 1190 bytes} [Sat May 7 22:07:34 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:34.371261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.391709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d21ce-4348-4cd3-8f05-ab118fd2ede6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.396302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.397795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.398834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.399230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.399661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.405665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.406970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=002b0170538c492ead7f5488329411a5, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.409815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.439464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3244/6501] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:34 2022] PUT /identity/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:34.440505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.456800 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3258/6502] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:34 2022] GET /identity/v3/auth/tokens => generated 3496 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:34.457798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.475344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4264383-a875-4408-a25d-d0f01d703239 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.629939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734b41-ef7d-4c3c-b9ba-389f5d5b7318 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.632024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.633803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.636011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.637025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.641440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=002b0170538c492ead7f5488329411a5, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.644781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.655236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.660115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.660690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.662177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.663230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=0969cae2e0ad4997b27132725695eb23)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.668087 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:34.668087 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:34.668087 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:34.672273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.693529 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3245/6503] 10.222.0.32 () {58 vars in 1289 bytes} [Sat May 7 22:07:34 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23 => generated 332 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:34.697445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.703226 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3259/6504] 10.222.0.32 () {58 vars in 1364 bytes} [Sat May 7 22:07:34 2022] GET /identity/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles => generated 410 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:34.711592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.729110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62fe1e-bd8d-4e39-b960-8e790975a18b tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.732812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f449edc-b161-476d-98a8-1ba358b766cc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.742202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.743724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.746017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.746419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.747792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.749194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=0969cae2e0ad4997b27132725695eb23)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.751076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.752283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.752816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.753604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.758978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=002b0170538c492ead7f5488329411a5, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.769081 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3246/6505] 10.222.0.32 () {58 vars in 1290 bytes} [Sat May 7 22:07:34 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) May 07 22:07:34.770150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.771291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.785125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3260/6506] 10.222.0.32 () {58 vars in 1464 bytes} [Sat May 7 22:07:34 2022] HEAD /identity/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:34.789638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce594e-3ce2-4567-b868-c987df022be6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.790908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.807108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.808418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.810322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55d7a6-8b1c-4312-871c-f2b5aae2725e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.810903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.811408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.812315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0969cae2e0ad4997b27132725695eb23)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.813559 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:34.813559 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:34.813559 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:34.818034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.826539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.827610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.828151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.830300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.833604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=002b0170538c492ead7f5488329411a5, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.837419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.846506 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3247/6507] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 22:07:34 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:34.848025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.862062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 3992c5968e0b495b9961a50e27b8894c was removed from group ef27cef2967f4dd3bb8d6b1dadad8c4f on domain 002b0170538c492ead7f5488329411a5. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:34.862357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:34.862712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9881d-f834-4890-9864-f2bc224254c6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.866136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:34.868782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:34.870070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:34.870602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:34.871142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:34.872089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:34.874715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:34.884995 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3248/6508] 10.222.0.32 () {58 vars in 1190 bytes} [Sat May 7 22:07:34 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:34.886342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.889035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:34.905122 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3261/6509] 10.222.0.32 () {58 vars in 1466 bytes} [Sat May 7 22:07:34 2022] DELETE /identity/v3/domains/002b0170538c492ead7f5488329411a5/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:34.912816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:34.916063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76f09a-366e-48d4-b5a5-9eca540e885f tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:34.917213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:35.029920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a12f7-6af8-4ba1-8efe-e4f7fce4f450 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:35.040524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:35.041911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.042210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.042590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.046755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dde06ac62a640da84e25f0ae9080547, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:35.049693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:35.051394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:35.052696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.053652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.054531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.056007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=0969cae2e0ad4997b27132725695eb23)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:35.060257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:35.092355 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3262/6510] 10.222.0.32 () {60 vars in 1485 bytes} [Sat May 7 22:07:34 2022] PUT /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:35.096683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Could not find Endpoint Group: 0969cae2e0ad4997b27132725695eb23.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 0969cae2e0ad4997b27132725695eb23. May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete May 07 22:07:35.119667 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), May 07 22:07:35.120990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group May 07 22:07:35.120990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, May 07 22:07:35.120990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group May 07 22:07:35.120990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( May 07 22:07:35.120990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 0969cae2e0ad4997b27132725695eb23. May 07 22:07:35.120990 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:07:35.124261 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3249/6511] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 22:07:34 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/0969cae2e0ad4997b27132725695eb23 => generated 120 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:35.125180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:35.144746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aef7c-0634-4763-9d60-e86ad6962801 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:35.288691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3759d-ad3d-4378-8627-b81bbb2eb103 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:35.297162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:35.301831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.302237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.302532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.307301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_grants(project_id=0dde06ac62a640da84e25f0ae9080547, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:35.308110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:35.308834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.309249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.310153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services/008650189ff249b7943461f018fe06ee` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.311603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_service(service_id=008650189ff249b7943461f018fe06ee)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:35.313460 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:35.313460 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:35.313460 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:35.314716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:35.320520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:35.351233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3263/6512] 10.222.0.32 () {58 vars in 1367 bytes} [Sat May 7 22:07:35 2022] GET /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles => generated 411 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:35.356273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:35.369269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b52ce-51db-4f39-8e5d-e862bd301d3a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:35.371090 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3250/6513] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:35 2022] DELETE /identity/v3/services/008650189ff249b7943461f018fe06ee => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:35.377420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:35.409534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:35.410349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.411154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.411154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/users/2baaa6df4bb047bb996c1c17311b3595` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.412933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, user_id=2baaa6df4bb047bb996c1c17311b3595)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:35.414916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:35.437858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504495-f486-4285-8ae1-91308a510861 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:35.457599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d67e0-874e-4a40-8d12-652d89162389 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:35.459649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d67e0-874e-4a40-8d12-652d89162389 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.460554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d67e0-874e-4a40-8d12-652d89162389 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.461049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d67e0-874e-4a40-8d12-652d89162389 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.461874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d67e0-874e-4a40-8d12-652d89162389 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:35.463953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d67e0-874e-4a40-8d12-652d89162389 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:35.470144 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3264/6514] 10.222.0.32 () {60 vars in 1359 bytes} [Sat May 7 22:07:35 2022] PUT /identity/v3/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/users/2baaa6df4bb047bb996c1c17311b3595 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:35.471784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:35.476008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:35.517925 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3251/6515] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:35 2022] POST /identity/v3/services => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:35.521471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cacabf-6455-46f0-a7d6-ac0bb81b2ad2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.526460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cacabf-6455-46f0-a7d6-ac0bb81b2ad2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.526460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cacabf-6455-46f0-a7d6-ac0bb81b2ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.667258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-98cacabf-6455-46f0-a7d6-ac0bb81b2ad2 None None] MFA Rules not processed for user `2baaa6df4bb047bb996c1c17311b3595`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:35.674421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-98cacabf-6455-46f0-a7d6-ac0bb81b2ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:35.688268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2dc30-a87d-45b4-841f-33efa906f76f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:35.711909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:35.712779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:35.713249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:35.713543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] PATH_INFO: `/v3/projects/c93dac5286c44f1891ba0504efa20a98` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:35.714789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93dac5286c44f1891ba0504efa20a98)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:35.717790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:35.826617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93dac5286c44f1891ba0504efa20a98', 'request_id': 'req-3d7a5964-bc39-4e64-9b38-a44b7159fbec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:35.842236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93dac5286c44f1891ba0504efa20a98', 'request_id': 'req-3d7a5964-bc39-4e64-9b38-a44b7159fbec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:35.863514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93dac5286c44f1891ba0504efa20a98', 'request_id': 'req-3d7a5964-bc39-4e64-9b38-a44b7159fbec'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:35.886260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] The token cache is being invalidate because project c93dac5286c44f1891ba0504efa20a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:35.888845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:35.891917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:35.893927 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3252/6516] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:35 2022] POST /identity/v3/auth/tokens => generated 3518 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:35.895085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cacabf-6455-46f0-a7d6-ac0bb81b2ad2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:35.898441 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3265/6517] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:35 2022] DELETE /identity/v3/projects/c93dac5286c44f1891ba0504efa20a98 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:35.899550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:35.904259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:35.996035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cacabf-6455-46f0-a7d6-ac0bb81b2ad2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.048775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a5964-bc39-4e64-9b38-a44b7159fbec admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.054246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ac7d4-2ed4-46c6-94ac-d524f303d853 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.055166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac7d4-2ed4-46c6-94ac-d524f303d853 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.055519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac7d4-2ed4-46c6-94ac-d524f303d853 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.055810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac7d4-2ed4-46c6-94ac-d524f303d853 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.060971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ac7d4-2ed4-46c6-94ac-d524f303d853 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0dde06ac62a640da84e25f0ae9080547, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.064145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ac7d4-2ed4-46c6-94ac-d524f303d853 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.067991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.069086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.069781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.070224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.071186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.072097 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3266/6518] 10.222.0.32 () {58 vars in 1467 bytes} [Sat May 7 22:07:35 2022] HEAD /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:36.073333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68cbd3-d860-4302-b663-347233a75279 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.073630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68cbd3-d860-4302-b663-347233a75279 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.073815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.073960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68cbd3-d860-4302-b663-347233a75279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.091663 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3253/6519] 10.222.0.32 () {60 vars in 1212 bytes} [Sat May 7 22:07:35 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:36.092830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.098108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-de68cbd3-d860-4302-b663-347233a75279 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:36.099726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de68cbd3-d860-4302-b663-347233a75279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:36.105309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d17624-bc5a-4b52-8d04-f4a3036052bd tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.110959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.112356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.112858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.113377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.116530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dde06ac62a640da84e25f0ae9080547, group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.126400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.141409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 3992c5968e0b495b9961a50e27b8894c was removed from group ef27cef2967f4dd3bb8d6b1dadad8c4f on project 0dde06ac62a640da84e25f0ae9080547. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:36.142042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:36.143217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:36.178006 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3254/6520] 10.222.0.32 () {58 vars in 1469 bytes} [Sat May 7 22:07:36 2022] DELETE /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:36.179293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.184403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:36.214009 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3267/6521] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:36 2022] POST /identity/v3/auth/tokens => generated 3492 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:36.214009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68cbd3-d860-4302-b663-347233a75279 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.214009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de68cbd3-d860-4302-b663-347233a75279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:36.250686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68cbd3-d860-4302-b663-347233a75279 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.376546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99460c-82b4-4821-9432-fbd33ef886ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.392559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f965f-58db-42e5-91ad-7c61a671441a tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.393258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f965f-58db-42e5-91ad-7c61a671441a tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.393403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.393525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f965f-58db-42e5-91ad-7c61a671441a tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.393810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f965f-58db-42e5-91ad-7c61a671441a tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.394192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.394706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f965f-58db-42e5-91ad-7c61a671441a tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.394856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.395074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/users/2baaa6df4bb047bb996c1c17311b3595` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.396402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f965f-58db-42e5-91ad-7c61a671441a tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.396956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, user_id=2baaa6df4bb047bb996c1c17311b3595)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.400279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.414023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2baaa6df4bb047bb996c1c17311b3595'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:36.417500 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3255/6522] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:36 2022] POST /identity/v3/services => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:36.418963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2d28-93eb-4baf-abb1-40a50f5e21b5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.419791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2d28-93eb-4baf-abb1-40a50f5e21b5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.420137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba2d28-93eb-4baf-abb1-40a50f5e21b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.444073 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3268/6523] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:07:36 2022] DELETE /identity/v3/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/users/2baaa6df4bb047bb996c1c17311b3595 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:36.444073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.446761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:36.450369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-97ba2d28-93eb-4baf-abb1-40a50f5e21b5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:36.451616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-97ba2d28-93eb-4baf-abb1-40a50f5e21b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:36.547340 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3256/6524] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:36 2022] POST /identity/v3/auth/tokens => generated 3626 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:36.548429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2d28-93eb-4baf-abb1-40a50f5e21b5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.598912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435ebf-e644-4464-be7e-a98e3e3a1800 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.626015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.626995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.627404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.628479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.632005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:36.665441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba2d28-93eb-4baf-abb1-40a50f5e21b5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.672403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.673675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.674129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.674579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/201f89f9b4b044e6a699df1647ebbca4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.675662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=201f89f9b4b044e6a699df1647ebbca4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.676875 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:36.676875 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:36.676875 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:36.678396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.696804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3257/6525] 10.222.0.32 () {60 vars in 1312 bytes} [Sat May 7 22:07:36 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/201f89f9b4b044e6a699df1647ebbca4 => generated 335 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:36.697955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.755241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.757741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.799277 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3269/6526] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:36 2022] GET /identity/v3/auth/tokens => generated 3714 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:36.800338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.829229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eac8c5-ead9-476d-a1a4-b0a3694e9faf service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.840239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.843175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.843543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.844324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.846351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:36.846792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.850222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.853430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67d59f-6787-418d-b155-32935d360c00 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.862952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.863846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.864135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.864476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.866340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.868134 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:36.868134 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:36.868134 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:36.869428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.881789 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3270/6527] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:36.881789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.882083 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3258/6528] 10.222.0.32 () {60 vars in 1380 bytes} [Sat May 7 22:07:36 2022] PUT /identity/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:36.885225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.904068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ac29-ee7b-430d-9912-ebe197d813bc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.906182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d9002-ab74-4adc-b61b-5e9b18f823b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:36.918716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.920222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.920697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.921040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services/c71a38cdf3a14df4bb1d6f08f9ac7283` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.921768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c71a38cdf3a14df4bb1d6f08f9ac7283)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.922902 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:36.922902 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:36.922902 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:36.923297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:36.924062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.924254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:36.924992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:36.925394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:36.930292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:36.933078 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:36.933078 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:36.933078 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:36.936567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:36.980713 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3259/6529] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:07:36 2022] GET /identity/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles => generated 376 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:36.985531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:36.990689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3271/6530] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:36 2022] DELETE /identity/v3/services/c71a38cdf3a14df4bb1d6f08f9ac7283 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:36.991820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.022789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095b9f-967a-42d6-b6cc-c45927403197 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.052028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42376d-cb71-4e3c-a663-363ad0c52ad6 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.068628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.070087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.072983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.074222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.074724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.075308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.075943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.078796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.080107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.085142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.086517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.087851 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:37.087851 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:37.087851 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:37.089140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.113723 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3272/6531] 10.222.0.32 () {58 vars in 1362 bytes} [Sat May 7 22:07:36 2022] HEAD /identity/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:37.115047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.125994 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3260/6532] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:36 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:37.127131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.160543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649184f5-b6ce-437f-a7e8-94a39625bddd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.346996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.348329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.350278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.350641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/201f89f9b4b044e6a699df1647ebbca4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.360997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=201f89f9b4b044e6a699df1647ebbca4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.360997 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:37.360997 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:37.360997 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:37.360997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.361872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6feb0-fe8d-40fa-8210-1e03b43be9b3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.369828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.370867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.371157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.371449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.376333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.377689 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:37.377689 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:37.377689 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:37.378760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.387510 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3273/6533] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 22:07:37 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/201f89f9b4b044e6a699df1647ebbca4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:37.389350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.401432 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3261/6534] 10.222.0.32 () {58 vars in 1364 bytes} [Sat May 7 22:07:37 2022] DELETE /identity/v3/system/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:37.405414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.432549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f4955-44a3-4ff9-840e-e906ee555816 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.460673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.461611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.461898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.462173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services/6413605861754c94ac3fd4d0b7860939` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.462873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6413605861754c94ac3fd4d0b7860939)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.468029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.527121 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3262/6535] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:37 2022] DELETE /identity/v3/services/6413605861754c94ac3fd4d0b7860939 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:37.528066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.599712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcbc3c-25c6-4b8b-9558-7aa0fc432307 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.604383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429c317-ea50-4623-819b-2e4b6614713e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.621433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.623243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.624839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.625138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.629802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=002b0170538c492ead7f5488329411a5, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.632872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.635440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.638664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.640414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.640764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.646374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.650506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.673398 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3263/6536] 10.222.0.32 () {60 vars in 1479 bytes} [Sat May 7 22:07:37 2022] PUT /identity/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:37.674796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.696349 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3274/6537] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:37 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:37.698221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.725675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7ceee-eee4-425a-b962-1ccd319b573f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.879389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708142b-ac7b-4701-9932-529b20ff4d82 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.885211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.886098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.886386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.887252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.891122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.892434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.892727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.893007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/32d7a001f4964e1aa1af371f5f92405d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:37.893735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=32d7a001f4964e1aa1af371f5f92405d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.895571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=002b0170538c492ead7f5488329411a5, user_id=2baaa6df4bb047bb996c1c17311b3595)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:37.900412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.903186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:37.926715 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3264/6538] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 22:07:37 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/32d7a001f4964e1aa1af371f5f92405d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:37.927784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.932550 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3275/6539] 10.222.0.32 () {58 vars in 1361 bytes} [Sat May 7 22:07:37 2022] GET /identity/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles => generated 409 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:37.933433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:37.959998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90254fa1-8f7e-4ee9-a7d9-00e6b16cc1f1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:37.992881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e524969b92a4123bc2608ad2731531d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24f68c36b4f249b8a8760c0febdaf835', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:37.993770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:37.994061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:37.994345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] PATH_INFO: `/v3/services/1a89e1b375e4447cb80c8ad1d08d8b89` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.000843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1a89e1b375e4447cb80c8ad1d08d8b89)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.005847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.057122 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3276/6540] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:37 2022] DELETE /identity/v3/services/1a89e1b375e4447cb80c8ad1d08d8b89 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:38.058905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:38.093070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971869-c349-4d97-98bf-f3c58518f09e tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.114605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.115322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.115604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.121728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.129971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.131887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.150284 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3265/6541] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:37 2022] GET /identity/v3/roles => generated 2322 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:38.151264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:38.152977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:38.157804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011b23-c6ab-4b2d-89ce-cf130707f256 tempest-EndPointGroupsTest-1314307768 tempest-EndPointGroupsTest-1314307768-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.165721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.166616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.167187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.167583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.171343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=002b0170538c492ead7f5488329411a5, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.174149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.182636 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3277/6542] 10.222.0.32 () {58 vars in 1461 bytes} [Sat May 7 22:07:38 2022] HEAD /identity/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:38.183729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:38.192303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574e90-7cb9-4cbd-ba33-235dc557e0c5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.212323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.213222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.213716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.214001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] PATH_INFO: `/v3/users/2dfee5f25ae1427ba3d3cfec7b1d823e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.215285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfee5f25ae1427ba3d3cfec7b1d823e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.217415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.230794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e64b1-064b-42ea-8f17-fc4159e1cf9b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.252896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.253586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.253876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.254158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.254928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.256569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.310148 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3278/6543] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:38 2022] GET /identity/v3/roles => generated 2322 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:38.317208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:38.373114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c59a-b58e-40e0-9921-e01e0abd1399 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.401390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.404304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.404616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.407885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.424835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=002b0170538c492ead7f5488329411a5, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.426931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfee5f25ae1427ba3d3cfec7b1d823e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:38.427610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.449548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfee5f25ae1427ba3d3cfec7b1d823e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:38.451687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfee5f25ae1427ba3d3cfec7b1d823e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:38.458897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfee5f25ae1427ba3d3cfec7b1d823e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:38.461373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 3992c5968e0b495b9961a50e27b8894c was removed from user 2baaa6df4bb047bb996c1c17311b3595 on domain 002b0170538c492ead7f5488329411a5. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:38.461678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:38.464274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f3241999-066f-4193-88ab-e1d4b9ddb0c3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:38.473692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfee5f25ae1427ba3d3cfec7b1d823e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:38.509405 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3266/6545] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:38 2022] DELETE /identity/v3/users/2dfee5f25ae1427ba3d3cfec7b1d823e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:38.510609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:38.512025 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3279/6545] 10.222.0.32 () {58 vars in 1463 bytes} [Sat May 7 22:07:38 2022] DELETE /identity/v3/domains/002b0170538c492ead7f5488329411a5/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:38.513540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:38.513682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.513837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.514120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.548305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:38.549574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:38.650216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9b092-1f73-47b4-a7db-87e120522b67 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.658443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.658443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.658443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.658443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] PATH_INFO: `/v3/projects/e73167bb9ccd40c88b2d3f1a9fdfc341/users/be2b2c49be5441eeb70a15a6d2b3aa8c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.687148 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3280/6546] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:38.688080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:38.689699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73167bb9ccd40c88b2d3f1a9fdfc341, user_id=be2b2c49be5441eeb70a15a6d2b3aa8c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.692462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.694097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:38.727144 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3267/6547] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:38 2022] PUT /identity/v3/projects/e73167bb9ccd40c88b2d3f1a9fdfc341/users/be2b2c49be5441eeb70a15a6d2b3aa8c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:38.728303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:38.730939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:38.848890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709a914-91ea-48ba-b011-8058ca44da7b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.878183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ce1dc-9923-46ce-8a94-cfe2b7ae2b08 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:38.887373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.889466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.890811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.891115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.946294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c05aad-4db9-4c5f-a392-ecb6f4b6c94b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:38.948209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05aad-4db9-4c5f-a392-ecb6f4b6c94b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:38.948870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05aad-4db9-4c5f-a392-ecb6f4b6c94b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:38.951251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c05aad-4db9-4c5f-a392-ecb6f4b6c94b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:38.954543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c05aad-4db9-4c5f-a392-ecb6f4b6c94b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.960490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c05aad-4db9-4c5f-a392-ecb6f4b6c94b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:38.991511 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3281/6548] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:38 2022] PUT /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:38.992200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:38.994803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.000652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62800-2ef9-4644-a889-641307329cac None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.013732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62800-2ef9-4644-a889-641307329cac None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.014092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62800-2ef9-4644-a889-641307329cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.025845 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3268/6549] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:39.027043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.045048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca2360-97df-4a39-89b2-a073a75fd1ed service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.104725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d6b62800-2ef9-4644-a889-641307329cac None None] MFA Rules not processed for user `be2b2c49be5441eeb70a15a6d2b3aa8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:39.106158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d6b62800-2ef9-4644-a889-641307329cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:39.130348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.131269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.131635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.132017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.134087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_grants(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.137294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.159119 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3269/6550] 10.222.0.32 () {58 vars in 1364 bytes} [Sat May 7 22:07:39 2022] GET /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles => generated 410 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:39.163504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.185492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26abe2-f620-4a95-b58f-13674c00260f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.205620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.206597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.206919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.208222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.220762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.224383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.238949 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3270/6551] 10.222.0.32 () {58 vars in 1464 bytes} [Sat May 7 22:07:39 2022] HEAD /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:39.243266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.269660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5d5a2-de26-47d0-b8d3-133141394fec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.276506 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3282/6552] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:39.280157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62800-2ef9-4644-a889-641307329cac None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.282184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d6b62800-2ef9-4644-a889-641307329cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:39.284022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.284939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.285631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.285631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.292497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dde06ac62a640da84e25f0ae9080547, user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.296353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.318814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 3992c5968e0b495b9961a50e27b8894c was removed from user 2baaa6df4bb047bb996c1c17311b3595 on project 0dde06ac62a640da84e25f0ae9080547. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:39.320051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:39.324466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:39.357992 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3271/6553] 10.222.0.32 () {58 vars in 1466 bytes} [Sat May 7 22:07:39 2022] DELETE /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:39.358597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.363673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:39.462514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62800-2ef9-4644-a889-641307329cac None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.532536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffcfcc-7a11-489b-b79b-3f78d9bbdf4b tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.543243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.544257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.544557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.545096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.549978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.551100 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:39.551100 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:39.551100 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:39.552027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.565528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.567280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.567580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.569331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.569331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.570935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.582602 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3272/6554] 10.222.0.32 () {60 vars in 1377 bytes} [Sat May 7 22:07:39 2022] PUT /identity/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:39.583658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.600410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a46c3-f9af-4b8f-b0ee-95cf5387df8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.609933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.610815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.611112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.611392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.615048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=2baaa6df4bb047bb996c1c17311b3595)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.615666 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3283/6555] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:39 2022] POST /identity/v3/projects => generated 385 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:39.619107 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:39.619107 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:39.619107 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:39.620054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.620904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.624086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:39.651412 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3273/6556] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 22:07:39 2022] GET /identity/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles => generated 375 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:39.657531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.688670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782607-53a1-4370-9445-428ce3359be3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.727894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbb32c-0b17-473c-aa5c-c7deaa28754c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.733968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.734664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.735482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.735660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.736452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.739047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.784930 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3284/6557] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:39 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:39.790113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.820181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726b3da-f15b-45ca-a60d-309d3ea6530d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.821990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.824519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.824519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.824519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.833040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.837303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.837621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.841731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.842219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.842542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.844520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.846816 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:39.846816 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:39.846816 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:39.849895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.878363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3274/6558] 10.222.0.32 () {58 vars in 1359 bytes} [Sat May 7 22:07:39 2022] HEAD /identity/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:39.882012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.891586 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3285/6559] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:39 2022] GET /identity/v3/roles => generated 2322 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:07:39.895981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.904740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e89f6-5626-4e3f-a117-de33c50a21de tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.915812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba407b-9ec3-4a9d-a66a-914d58a84524 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:39.923748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.925526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.927221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.927674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.929107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:39.930058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:39.931397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:39.932041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] PATH_INFO: `/v3/projects/d1c2d124ae814b1b906a2a6b1ca65418/users/168641baf51a4928b8e5fb15ac535a0f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:39.936276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=2baaa6df4bb047bb996c1c17311b3595, role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.940869 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:39.940869 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:39.940869 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:39.944018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:39.966559 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3275/6560] 10.222.0.32 () {58 vars in 1361 bytes} [Sat May 7 22:07:39 2022] DELETE /identity/v3/system/users/2baaa6df4bb047bb996c1c17311b3595/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:39.973213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:39.973575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c2d124ae814b1b906a2a6b1ca65418, user_id=168641baf51a4928b8e5fb15ac535a0f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:39.976671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.000822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d663-4735-4b91-8801-78c09138f6e1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.011762 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3286/6561] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:39 2022] PUT /identity/v3/projects/d1c2d124ae814b1b906a2a6b1ca65418/users/168641baf51a4928b8e5fb15ac535a0f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:40.013304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.136708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.137402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.137722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.138012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.139061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.140186 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:40.140186 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:40.140186 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:40.141101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.180526 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3276/6562] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:39 2022] POST /identity/v3/roles => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:40.182947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.188078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ad97-1399-4c12-95c9-26a1dd614885 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.240646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.243275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.243925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.245687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.247689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.252782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.253324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88028959-3482-433f-a54b-19b3e4e769bc tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.265919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.267875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.269045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.270621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.273144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.277495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.286786 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3287/6563] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:40 2022] GET /identity/v3/roles => generated 2322 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:40.290536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.319212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3277/6564] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:40 2022] POST /identity/v3/roles => generated 270 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:40.323583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.324940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c7f7b-c233-4f63-aab1-b76e4e0052d1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.344249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f734-8cad-46af-86d0-769147dbf086 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.345170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5d7e9-eeb3-4ccf-aaab-2264bd17f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.347280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5d7e9-eeb3-4ccf-aaab-2264bd17f6b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.350139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.350931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5d7e9-eeb3-4ccf-aaab-2264bd17f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.352283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.352744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.352982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5d7e9-eeb3-4ccf-aaab-2264bd17f6b8 admin admin] PATH_INFO: `/v3/projects/d1c2d124ae814b1b906a2a6b1ca65418/users/168641baf51a4928b8e5fb15ac535a0f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.353595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/15492323462e453dae96ef89a0099ee5/implies/8e852fc32b7344678108b17c8a68b91d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.355722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=15492323462e453dae96ef89a0099ee5, implied_role_id=8e852fc32b7344678108b17c8a68b91d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.358655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.367910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5d7e9-eeb3-4ccf-aaab-2264bd17f6b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c2d124ae814b1b906a2a6b1ca65418, user_id=168641baf51a4928b8e5fb15ac535a0f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.376332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5d7e9-eeb3-4ccf-aaab-2264bd17f6b8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.413151 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3278/6565] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:40 2022] PUT /identity/v3/roles/15492323462e453dae96ef89a0099ee5/implies/8e852fc32b7344678108b17c8a68b91d => generated 530 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:40.414219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.420002 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3288/6566] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:40 2022] PUT /identity/v3/projects/d1c2d124ae814b1b906a2a6b1ca65418/users/168641baf51a4928b8e5fb15ac535a0f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:40.430455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.431141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.432942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.533470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] MFA Rules not processed for user `168641baf51a4928b8e5fb15ac535a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:40.536620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:40.568118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c60bb-ff34-4c10-8421-8811e1ccd7f3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.583371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.584797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.585252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.585689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.586581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.590351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.628014 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3279/6567] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:07:40 2022] POST /identity/v3/domains => generated 275 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:40.629143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.634983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:40.686323 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3289/6568] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:40.687892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.691757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:40.760933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014abc1-9a0a-4a4c-aede-2ed9b7aaf8bd tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.770032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.771787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.773439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.774011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] PATH_INFO: `/v3/projects/e3330eb3ed9b4f1bae703deb89227aca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.777201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3330eb3ed9b4f1bae703deb89227aca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.781494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.806269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d785fb2-3a69-4149-a4db-5ac7d46f7720 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:40.811271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:40.812145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:40.812426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:40.812711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] PATH_INFO: `/v3/users/50f9e5d13f0f4fcc8dd2c0a6fdffa417` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:40.814140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f9e5d13f0f4fcc8dd2c0a6fdffa417)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:40.816088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:40.848209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3330eb3ed9b4f1bae703deb89227aca', 'request_id': 'req-c8688059-1a2d-4205-8b05-41a5197f8cbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.858198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3330eb3ed9b4f1bae703deb89227aca', 'request_id': 'req-c8688059-1a2d-4205-8b05-41a5197f8cbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.872642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3330eb3ed9b4f1bae703deb89227aca', 'request_id': 'req-c8688059-1a2d-4205-8b05-41a5197f8cbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.876842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f9e5d13f0f4fcc8dd2c0a6fdffa417'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.877507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f9e5d13f0f4fcc8dd2c0a6fdffa417'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.885317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f9e5d13f0f4fcc8dd2c0a6fdffa417'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.886385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f9e5d13f0f4fcc8dd2c0a6fdffa417'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.889268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] The token cache is being invalidate because project e3330eb3ed9b4f1bae703deb89227aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:40.890445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.892033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.895190 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3280/6569] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:40 2022] DELETE /identity/v3/projects/e3330eb3ed9b4f1bae703deb89227aca => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:40.896128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.896651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f9e5d13f0f4fcc8dd2c0a6fdffa417'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:40.900218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:40.930817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3290/6570] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:40 2022] DELETE /identity/v3/users/50f9e5d13f0f4fcc8dd2c0a6fdffa417 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:40.932150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:40.934935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:40.980867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688059-1a2d-4205-8b05-41a5197f8cbf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.026351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f94d58-18b1-4dc4-9bdb-486d9f7d70e6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.037569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b9822-5ff7-45cd-93b2-f73b120f5ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.042915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9822-5ff7-45cd-93b2-f73b120f5ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.042915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9822-5ff7-45cd-93b2-f73b120f5ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.042915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b9822-5ff7-45cd-93b2-f73b120f5ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.047997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-363b9822-5ff7-45cd-93b2-f73b120f5ff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:41.051636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.052429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.052794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.053155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.053999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.055798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.074373 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3281/6571] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:40 2022] POST /identity/v3/roles => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:41.075983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.081559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:41.136748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b9822-5ff7-45cd-93b2-f73b120f5ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.138935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b9822-5ff7-45cd-93b2-f73b120f5ff1 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.159867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3291/6572] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:41.164257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f0644-1c90-4290-9181-b3009f36fd70 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.164966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f0644-1c90-4290-9181-b3009f36fd70 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.164966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f0644-1c90-4290-9181-b3009f36fd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.182129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583061a-10d7-46c6-aef2-c4e829591b52 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.196772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.197657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.197935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.198205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] PATH_INFO: `/v3/users/1e524969b92a4123bc2608ad2731531d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.199444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e524969b92a4123bc2608ad2731531d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.202229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.207922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fe1f0644-1c90-4290-9181-b3009f36fd70 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:41.209196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fe1f0644-1c90-4290-9181-b3009f36fd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:41.221143 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3292/6573] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:41.222054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f0644-1c90-4290-9181-b3009f36fd70 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.240283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f0644-1c90-4290-9181-b3009f36fd70 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.249242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.250342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.250505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.250854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/15492323462e453dae96ef89a0099ee5/implies/18dd931056b144319a856f7bb100e929` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.255066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=15492323462e453dae96ef89a0099ee5, implied_role_id=18dd931056b144319a856f7bb100e929)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.256985 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:41.256985 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:41.256985 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:41.256985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.292573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e524969b92a4123bc2608ad2731531d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:41.301170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e524969b92a4123bc2608ad2731531d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:41.301962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e524969b92a4123bc2608ad2731531d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:41.302650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e524969b92a4123bc2608ad2731531d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:41.315497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e524969b92a4123bc2608ad2731531d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:41.319449 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3293/6574] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:41 2022] PUT /identity/v3/roles/15492323462e453dae96ef89a0099ee5/implies/18dd931056b144319a856f7bb100e929 => generated 529 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:41.321149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.323967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:41.359139 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3282/6575] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:41 2022] DELETE /identity/v3/users/1e524969b92a4123bc2608ad2731531d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:41.360114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.370541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:41.426296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5f33a-a69b-49ea-8e86-269fdc7bbc45 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.529359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.530469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.530900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.531854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.535149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:41.573892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde57fe-ddcc-4359-a2ff-681e484eaf74 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.580894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.581828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.582139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.582422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/15492323462e453dae96ef89a0099ee5/implies/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.585482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=15492323462e453dae96ef89a0099ee5, implied_role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.586913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.626562 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3283/6576] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:41 2022] PUT /identity/v3/roles/15492323462e453dae96ef89a0099ee5/implies/3992c5968e0b495b9961a50e27b8894c => generated 525 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:41.627784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.629841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:41.660208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.662596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.685873 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3294/6577] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:41.686867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.705559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad623c2b-d5c8-4337-ab7e-377695bf5ee8 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.801494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.804128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.805105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.805407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/3992c5968e0b495b9961a50e27b8894c/implies/15492323462e453dae96ef89a0099ee5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.809053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=3992c5968e0b495b9961a50e27b8894c, implied_role_id=15492323462e453dae96ef89a0099ee5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.816353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] 15492323462e453dae96ef89a0099ee5 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 15492323462e453dae96ef89a0099ee5 cannot be an implied roles. May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put May 07 22:07:41.865409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) May 07 22:07:41.867223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:41.867223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:41.867223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role May 07 22:07:41.867223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, May 07 22:07:41.867223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 15492323462e453dae96ef89a0099ee5 cannot be an implied roles. May 07 22:07:41.867223 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:41.871891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557272b5-7b80-4406-ada1-49929371fa4d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.877324 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3295/6578] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:41 2022] PUT /identity/v3/roles/3992c5968e0b495b9961a50e27b8894c/implies/15492323462e453dae96ef89a0099ee5 => generated 116 bytes in 191 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:41.878359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.893055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.898917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.898917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.898917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] PATH_INFO: `/v3/users/be2b2c49be5441eeb70a15a6d2b3aa8c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.901865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2b2c49be5441eeb70a15a6d2b3aa8c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.906243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.922271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de3ce-68b2-4839-b39a-2d122e76c908 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:41.936493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:41.937633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:41.938079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:41.938487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/15492323462e453dae96ef89a0099ee5/implies/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:41.942341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=15492323462e453dae96ef89a0099ee5, implied_role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:41.943963 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:41.943963 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:41.943963 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:41.946271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:41.968966 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3296/6579] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:41 2022] DELETE /identity/v3/roles/15492323462e453dae96ef89a0099ee5/implies/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:41.973518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:41.993265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2b2c49be5441eeb70a15a6d2b3aa8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.005243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2b2c49be5441eeb70a15a6d2b3aa8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.006643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2b2c49be5441eeb70a15a6d2b3aa8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.008256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2b2c49be5441eeb70a15a6d2b3aa8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.048130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-76151a21-c331-4353-8191-31820561b4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2b2c49be5441eeb70a15a6d2b3aa8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.086249 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3284/6580] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:41 2022] DELETE /identity/v3/users/be2b2c49be5441eeb70a15a6d2b3aa8c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:42.092515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:42.092762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:42.094105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:42.122969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e1465-7361-4f29-9411-bbf808482e7a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:42.162334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:42.165613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:42.296747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:42.297698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:42.297990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:42.301302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/15492323462e453dae96ef89a0099ee5/implies/18dd931056b144319a856f7bb100e929` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:42.305329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=15492323462e453dae96ef89a0099ee5, implied_role_id=18dd931056b144319a856f7bb100e929)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:42.307413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:42.314457 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3285/6581] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:42.315815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:42.326183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:42.337083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3297/6582] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:41 2022] DELETE /identity/v3/roles/15492323462e453dae96ef89a0099ee5/implies/18dd931056b144319a856f7bb100e929 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:42.337083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:42.340205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:42.353702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9caa7-7b41-40a4-b45b-aa6436c56ba0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:42.430345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc161cb-f473-4b3c-abb9-94eb6e4880ec tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:42.436479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:42.437350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:42.437640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:42.438287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:42.477846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:42.478931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:42.479324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:42.479705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] PATH_INFO: `/v3/projects/24f68c36b4f249b8a8760c0febdaf835` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:42.483677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f68c36b4f249b8a8760c0febdaf835)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:42.485770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:42.555815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:42.560389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:42.581362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f68c36b4f249b8a8760c0febdaf835', 'request_id': 'req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.589510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f68c36b4f249b8a8760c0febdaf835', 'request_id': 'req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.591350 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3298/6583] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:42.593238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:42.600694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:42.618982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f68c36b4f249b8a8760c0febdaf835', 'request_id': 'req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.639353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] The token cache is being invalidate because project 24f68c36b4f249b8a8760c0febdaf835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:42.639711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.642664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.648986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3286/6584] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:42 2022] DELETE /identity/v3/projects/24f68c36b4f249b8a8760c0febdaf835 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:42.648986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:42.648986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:42.737797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87631e-af14-4493-afc7-e52c450e3cb1 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:42.810550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b0d7-f258-4f1d-8870-a949c32ec2b8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:42.812768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:42.814047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:42.814264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:42.814544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/18dd931056b144319a856f7bb100e929` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:42.817684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=18dd931056b144319a856f7bb100e929)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:42.819311 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:42.819311 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:42.819311 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:42.820967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:42.825533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:42.826597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:42.826911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:42.827188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] PATH_INFO: `/v3/projects/2449f72b9a5c40b29a5d792bc609e239` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:42.832895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2449f72b9a5c40b29a5d792bc609e239)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:42.834367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:42.865558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 18dd931056b144319a856f7bb100e929 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:42.866845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.868535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-df62f373-1fcc-492b-810a-b83b562e0db1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.872605 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3299/6585] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:42 2022] DELETE /identity/v3/roles/18dd931056b144319a856f7bb100e929 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:42.876957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:42.878984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:42.879324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:42.933168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:42.935002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:42.964252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2449f72b9a5c40b29a5d792bc609e239', 'request_id': 'req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.973730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2449f72b9a5c40b29a5d792bc609e239', 'request_id': 'req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:42.986015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2449f72b9a5c40b29a5d792bc609e239', 'request_id': 'req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.006549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] The token cache is being invalidate because project 2449f72b9a5c40b29a5d792bc609e239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:43.007615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.008731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.010528 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3287/6586] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:42 2022] DELETE /identity/v3/projects/2449f72b9a5c40b29a5d792bc609e239 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:43.016430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:43.018140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:43.021279 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3300/6587] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:43.022152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:43.023625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:43.041019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae81fca-3cc5-44c3-82fa-7bd87b82ff7a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:43.054465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:43.061837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:43.061837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:43.061837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] PATH_INFO: `/v3/users/14d1860f410c46438c8807061b10f9ab` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:43.063663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d1860f410c46438c8807061b10f9ab)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:43.067816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:43.139544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ff61d-fa79-4c26-aa7c-647cdfde3666 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:43.146745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:43.147726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:43.148076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:43.148379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/74c457d86fe149028176aa3e9b7be327` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:43.173786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=74c457d86fe149028176aa3e9b7be327)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:43.178704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:43.188244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d1860f410c46438c8807061b10f9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.191408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d1860f410c46438c8807061b10f9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.217132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d1860f410c46438c8807061b10f9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.218263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d1860f410c46438c8807061b10f9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.236999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '74c457d86fe149028176aa3e9b7be327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.238566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '74c457d86fe149028176aa3e9b7be327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.254418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d1860f410c46438c8807061b10f9ab'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.294377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '74c457d86fe149028176aa3e9b7be327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.295297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-496c2b07-0f70-49c2-b3f4-1dcf21e901c9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '74c457d86fe149028176aa3e9b7be327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.300950 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3288/6588] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:07:43 2022] PATCH /identity/v3/domains/74c457d86fe149028176aa3e9b7be327 => generated 276 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:43.303200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:43.303774 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3301/6589] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:43 2022] DELETE /identity/v3/users/14d1860f410c46438c8807061b10f9ab => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:43.303922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:43.304342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:43.305237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:43.309253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:43.336519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:43.339395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:43.517337 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3289/6590] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:43.520859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:43.523367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:43.526552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88331ed9-e169-4fd4-8f07-ddfa0c259163 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:43.537375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:43.539353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:43.540995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:43.540995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/74c457d86fe149028176aa3e9b7be327` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:43.557154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e4b51-2877-4825-a452-437b1c6614dc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:43.569480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:43.570368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:43.570646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:43.570991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] PATH_INFO: `/v3/projects/e73167bb9ccd40c88b2d3f1a9fdfc341` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:43.574838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=74c457d86fe149028176aa3e9b7be327)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:43.578436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73167bb9ccd40c88b2d3f1a9fdfc341)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:43.581102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:43.582031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:43.663056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '74c457d86fe149028176aa3e9b7be327'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.669968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '74c457d86fe149028176aa3e9b7be327'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.740052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73167bb9ccd40c88b2d3f1a9fdfc341', 'request_id': 'req-4680d426-13a0-44b3-930e-0b3244578e18'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.756588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73167bb9ccd40c88b2d3f1a9fdfc341', 'request_id': 'req-4680d426-13a0-44b3-930e-0b3244578e18'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.772415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73167bb9ccd40c88b2d3f1a9fdfc341', 'request_id': 'req-4680d426-13a0-44b3-930e-0b3244578e18'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.794667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c457d86fe149028176aa3e9b7be327', 'request_id': 'req-c1328431-71c1-4044-ad97-581caa692248'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.810500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c457d86fe149028176aa3e9b7be327', 'request_id': 'req-c1328431-71c1-4044-ad97-581caa692248'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.818055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] The token cache is being invalidate because project e73167bb9ccd40c88b2d3f1a9fdfc341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:43.818477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.820674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.828378 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3290/6591] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:43 2022] DELETE /identity/v3/projects/e73167bb9ccd40c88b2d3f1a9fdfc341 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:43.828378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:43.829622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:43.833436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c457d86fe149028176aa3e9b7be327', 'request_id': 'req-c1328431-71c1-4044-ad97-581caa692248'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.852927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] The token cache is being invalidate because project 74c457d86fe149028176aa3e9b7be327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:43.853193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.857731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.878698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '74c457d86fe149028176aa3e9b7be327', 'request_id': 'req-c1328431-71c1-4044-ad97-581caa692248'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.884682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '74c457d86fe149028176aa3e9b7be327', 'request_id': 'req-c1328431-71c1-4044-ad97-581caa692248'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.886451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '74c457d86fe149028176aa3e9b7be327', 'request_id': 'req-c1328431-71c1-4044-ad97-581caa692248'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:43.904496 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3302/6592] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:07:43 2022] DELETE /identity/v3/domains/74c457d86fe149028176aa3e9b7be327 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:43.905407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:43.915437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:43.967687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680d426-13a0-44b3-930e-0b3244578e18 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:44.078862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1328431-71c1-4044-ad97-581caa692248 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:44.095007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:44.095906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.096196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.096480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] PATH_INFO: `/v3/users/957bab5b90134d2cb1c1cf7b0dce10ac` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.107350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:44.108071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.108353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.108633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.111243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:44.112015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=957bab5b90134d2cb1c1cf7b0dce10ac)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:44.112143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:44.114044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:44.123317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:44.135252 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3291/6593] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:44.135252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:44.135882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:44.176581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5b4fb-c8c9-46c0-b1e7-2127d2597456 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:44.182355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:44.183655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.183952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.184238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] PATH_INFO: `/v3/users/168641baf51a4928b8e5fb15ac535a0f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.202350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=168641baf51a4928b8e5fb15ac535a0f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:44.207147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:44.252460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957bab5b90134d2cb1c1cf7b0dce10ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.253955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957bab5b90134d2cb1c1cf7b0dce10ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.274544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957bab5b90134d2cb1c1cf7b0dce10ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.279549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957bab5b90134d2cb1c1cf7b0dce10ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.293198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957bab5b90134d2cb1c1cf7b0dce10ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.298807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168641baf51a4928b8e5fb15ac535a0f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.314475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168641baf51a4928b8e5fb15ac535a0f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.316092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168641baf51a4928b8e5fb15ac535a0f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.317087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168641baf51a4928b8e5fb15ac535a0f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.330034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168641baf51a4928b8e5fb15ac535a0f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.332316 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3303/6594] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:43 2022] DELETE /identity/v3/users/957bab5b90134d2cb1c1cf7b0dce10ac => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:44.333513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:44.335573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:44.358912 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3292/6595] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:44 2022] DELETE /identity/v3/users/168641baf51a4928b8e5fb15ac535a0f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:44.358912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:44.358912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:44.475175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb687a-247c-4cdb-8ee6-ec062bbfc08d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:44.549397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba47767-3f48-4a24-8c03-dccb850e33d0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:44.561907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:44.563047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.563666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.563849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] PATH_INFO: `/v3/projects/17cfc6fd78b745da8412e7e15d557cc0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.565239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17cfc6fd78b745da8412e7e15d557cc0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:44.567770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:44.568711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:44.570409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.570922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.571202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/15492323462e453dae96ef89a0099ee5/implies/8e852fc32b7344678108b17c8a68b91d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.573501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=15492323462e453dae96ef89a0099ee5, implied_role_id=8e852fc32b7344678108b17c8a68b91d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:44.576234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:44.597700 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3304/6596] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:44 2022] DELETE /identity/v3/roles/15492323462e453dae96ef89a0099ee5/implies/8e852fc32b7344678108b17c8a68b91d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:44.597700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:44.599815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:44.673295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17cfc6fd78b745da8412e7e15d557cc0', 'request_id': 'req-8048f82a-4272-49ae-bc22-82f0ac68bb40'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.696087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17cfc6fd78b745da8412e7e15d557cc0', 'request_id': 'req-8048f82a-4272-49ae-bc22-82f0ac68bb40'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.710998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dbb47-180c-404f-9155-82ecff8c4ddb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:44.717487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17cfc6fd78b745da8412e7e15d557cc0', 'request_id': 'req-8048f82a-4272-49ae-bc22-82f0ac68bb40'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.738652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] The token cache is being invalidate because project 17cfc6fd78b745da8412e7e15d557cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:44.739018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.753677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8048f82a-4272-49ae-bc22-82f0ac68bb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:44.755764 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3293/6597] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:44 2022] DELETE /identity/v3/projects/17cfc6fd78b745da8412e7e15d557cc0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:44.760141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.760467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.760754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.786979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108076cf-6628-4189-b0df-f197e6077637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:44.787657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108076cf-6628-4189-b0df-f197e6077637 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.787980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108076cf-6628-4189-b0df-f197e6077637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.788247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108076cf-6628-4189-b0df-f197e6077637 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.788887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108076cf-6628-4189-b0df-f197e6077637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:44.791927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108076cf-6628-4189-b0df-f197e6077637 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:44.807047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:44.810399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:44.843517 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3294/6598] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:44.844231 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3305/6599] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:44 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:44.844938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:44.845891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:44.846124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:44.846405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:44.848002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:44.878283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:44.880149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:44.936901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdb198-d607-4328-9368-3664cb0e11fb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.004409 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3306/6600] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:45.005800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.009738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.010606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.010983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.011246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/8e852fc32b7344678108b17c8a68b91d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.012573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8e852fc32b7344678108b17c8a68b91d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.014019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.014251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.032556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83905a3-c142-4e48-87e3-6fadaf3ecc06 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.037850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2433b7-ac16-4410-a560-f0c533d60bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.038529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2433b7-ac16-4410-a560-f0c533d60bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.038927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2433b7-ac16-4410-a560-f0c533d60bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.039106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2433b7-ac16-4410-a560-f0c533d60bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.039844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2433b7-ac16-4410-a560-f0c533d60bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.041781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2433b7-ac16-4410-a560-f0c533d60bc1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.056904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 8e852fc32b7344678108b17c8a68b91d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:45.057242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.058024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.063029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3295/6601] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:44 2022] DELETE /identity/v3/roles/8e852fc32b7344678108b17c8a68b91d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:45.063029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.063029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.082249 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3307/6602] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:45 2022] POST /identity/v3/users => generated 286 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:45.092056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.092056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.098906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.132913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:45.134329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.137278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef7c0a-82cf-4e3e-ace3-eb068cd6d790 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.143081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.143795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.144080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.144353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.148998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.251090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.252564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.264211 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3296/6603] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:45.265053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.266372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.288462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bdbcb-6b45-4d64-8dd6-85fd3bfd29ae service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.292511 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3308/6604] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:45.293894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.296205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.301852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.302748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.303677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.303960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] PATH_INFO: `/v3/projects/d1c2d124ae814b1b906a2a6b1ca65418` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.306624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c2d124ae814b1b906a2a6b1ca65418)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.308672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.398077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c2d124ae814b1b906a2a6b1ca65418', 'request_id': 'req-45e42f46-42a0-4016-b764-88f7c26f728d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.405921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c2d124ae814b1b906a2a6b1ca65418', 'request_id': 'req-45e42f46-42a0-4016-b764-88f7c26f728d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.416610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c2d124ae814b1b906a2a6b1ca65418', 'request_id': 'req-45e42f46-42a0-4016-b764-88f7c26f728d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.429538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] The token cache is being invalidate because project d1c2d124ae814b1b906a2a6b1ca65418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:45.429797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.430476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.432659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3297/6605] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:45 2022] DELETE /identity/v3/projects/d1c2d124ae814b1b906a2a6b1ca65418 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:45.433857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.438147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.451359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848d626-37e1-4113-99d7-35b240f8b3a6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.591829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e42f46-42a0-4016-b764-88f7c26f728d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.617652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.618466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.618876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.619260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.620091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.622334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.657076 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3298/6606] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:45 2022] GET /identity/v3/roles => generated 2322 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:45.660822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.662142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.662142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.662611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/15492323462e453dae96ef89a0099ee5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.664243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.665143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=15492323462e453dae96ef89a0099ee5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.667340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.674638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.706232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cd453-38c8-418b-90f8-9a62334e0bda admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.720249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.721216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.722215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.724039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.728341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:45.729676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.735895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.747498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 15492323462e453dae96ef89a0099ee5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:45.748088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.748908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-221702ff-0177-4a9c-8600-23b24d436f8d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:45.751616 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3309/6607] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:45 2022] DELETE /identity/v3/roles/15492323462e453dae96ef89a0099ee5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:45.753079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.753739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.754450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.778177 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3299/6608] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:45.779471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.781903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.784579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:45.786372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.803996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d52ed8-da64-4112-9118-2aab901a2f72 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.876189 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3310/6609] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:45.876189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.876189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:45.892041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209b56-a642-46ff-a9b5-361c1190dbb8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:45.905020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.906026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.906482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.906956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.908662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.910497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.923785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:45.923785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:45.923785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:45.923785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] PATH_INFO: `/v3/projects/71bfb23676c24e00b5997394686be11b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:45.928909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bfb23676c24e00b5997394686be11b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:45.932942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:45.935130 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3300/6610] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:45 2022] GET /identity/v3/roles => generated 2322 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:45.936731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:45.943062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.016491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bfb23676c24e00b5997394686be11b', 'request_id': 'req-b92b0c5f-e46a-47e3-831c-c48d18799b28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.024231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bfb23676c24e00b5997394686be11b', 'request_id': 'req-b92b0c5f-e46a-47e3-831c-c48d18799b28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.034421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bfb23676c24e00b5997394686be11b', 'request_id': 'req-b92b0c5f-e46a-47e3-831c-c48d18799b28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.061468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] The token cache is being invalidate because project 71bfb23676c24e00b5997394686be11b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:46.061801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.064727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.069639 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3311/6611] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:45 2022] DELETE /identity/v3/projects/71bfb23676c24e00b5997394686be11b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:46.070698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:46.074925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.082256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2703fc-5e85-4d17-b170-cf50221983b3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:46.204705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503d9ff-8c67-4f6f-8189-e84b75db3eb8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:46.205663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503d9ff-8c67-4f6f-8189-e84b75db3eb8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.206160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503d9ff-8c67-4f6f-8189-e84b75db3eb8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.206661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503d9ff-8c67-4f6f-8189-e84b75db3eb8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.209191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503d9ff-8c67-4f6f-8189-e84b75db3eb8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.213920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b0c5f-e46a-47e3-831c-c48d18799b28 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:46.222101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503d9ff-8c67-4f6f-8189-e84b75db3eb8 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:46.228390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:46.229235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.232995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.232995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.234181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.239933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:46.259541 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3301/6612] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:45 2022] PUT /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 520 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:46.259541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.259541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.259541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.281970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:46.284048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.304315 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3312/6613] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:46 2022] POST /identity/v3/projects => generated 389 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:46.305630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:46.310348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.410342 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3302/6614] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:46.411659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:46.413383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.442535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e7c73-5222-4a8e-b2d4-8ab8e9c0351f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:46.464785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58588917-81aa-4fa1-8885-a24b46f18ad4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:46.470999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:46.471910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.472201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.472479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] PATH_INFO: `/v3/projects/63c9ad0084d14b79976b3b9d05e0909e/users/da3025bfa7124f1c8c7030c2700c5572/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.491490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c9ad0084d14b79976b3b9d05e0909e, user_id=da3025bfa7124f1c8c7030c2700c5572, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.494669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:46.533014 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3313/6615] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:46 2022] PUT /identity/v3/projects/63c9ad0084d14b79976b3b9d05e0909e/users/da3025bfa7124f1c8c7030c2700c5572/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:46.534763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:46.539719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.544747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:46.546421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.547002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.548644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] PATH_INFO: `/v3/users/bbc6679a5ae54263acbd3ad68883dfbf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.551350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc6679a5ae54263acbd3ad68883dfbf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.554189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:46.642450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc6679a5ae54263acbd3ad68883dfbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.655312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc6679a5ae54263acbd3ad68883dfbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.656207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc6679a5ae54263acbd3ad68883dfbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.656838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc6679a5ae54263acbd3ad68883dfbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.663063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794543f8-261e-453b-976e-6bdd2a593ef0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:46.669839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:46.673122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc6679a5ae54263acbd3ad68883dfbf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:46.675746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.676424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.676879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.679595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.680825 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:46.680825 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:46.680825 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:46.682764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:46.683950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.685204 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:46.685204 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:46.685204 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:46.686628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:46.695182 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3314/6616] 10.222.0.32 () {58 vars in 1344 bytes} [Sat May 7 22:07:46 2022] HEAD /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:46.699455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:46.702760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.709229 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3303/6617] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:46 2022] DELETE /identity/v3/users/bbc6679a5ae54263acbd3ad68883dfbf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:46.709229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:46.709733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:46.870460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff6e5-5da0-4609-b163-b46997de78d1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:46.964103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:46.967804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.968224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.968673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.969483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.971587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:46.974456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a5adf-122a-4ee0-bc8d-55bfe7895f8a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:46.988546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92889a77-a71d-4802-bbc5-2f91c35f48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:46.989310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889a77-a71d-4802-bbc5-2f91c35f48e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:46.989590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889a77-a71d-4802-bbc5-2f91c35f48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:46.989865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92889a77-a71d-4802-bbc5-2f91c35f48e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:46.992432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92889a77-a71d-4802-bbc5-2f91c35f48e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:46.992432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92889a77-a71d-4802-bbc5-2f91c35f48e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:46.996563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92889a77-a71d-4802-bbc5-2f91c35f48e5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.010826 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3304/6618] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:47.015920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d666-4207-46bd-9a44-1f220bd33df0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.016276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d666-4207-46bd-9a44-1f220bd33df0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.016560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d666-4207-46bd-9a44-1f220bd33df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.036614 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3315/6619] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:46 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:47.038728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.055064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1c24d666-4207-46bd-9a44-1f220bd33df0 None None] MFA Rules not processed for user `da3025bfa7124f1c8c7030c2700c5572`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:47.055938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:47.056740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1c24d666-4207-46bd-9a44-1f220bd33df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:47.160353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421342e-919a-4974-90b6-0c955f3d4090 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.166172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.167386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.167706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.168297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.170936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.172585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.183319 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3305/6620] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:47.183547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d666-4207-46bd-9a44-1f220bd33df0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.183917 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3316/6621] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:07:47 2022] GET /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 520 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:47.185418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.216913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d666-4207-46bd-9a44-1f220bd33df0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.226278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648de0b-4c2b-45c1-bf8c-17f5fb0fd0af tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.233416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.234125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.234391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.234670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.235442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.237738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.238491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.239314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.241559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.241928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.244899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.249632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.261707 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3317/6622] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:47 2022] GET /identity/v3/roles => generated 2322 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:47.265688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.267873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:47.284207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59841494-a154-47a5-90d5-d34881be67d0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.292616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.293299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.293606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.294483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.295208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.297152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.320673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3306/6623] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:47 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:47.321617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.364739 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3318/6624] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:47 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:47.365813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.468840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625e4e3-4d53-41b6-91cc-502001c4ecc1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.479680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.481090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.481716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.483110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.485964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.488123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.492220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756c914-7954-4c84-85f7-3e515507c40b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.507425 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3319/6625] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:47 2022] GET /identity/v3/roles => generated 2322 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:47.509181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.523911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68141a7b-6f21-44f9-9dac-b3b19a5a1008 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.539869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.540710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.541097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.541490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.542943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.545056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.575730 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3320/6626] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:47 2022] POST /identity/v3/users => generated 296 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:47.576710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.578466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:47.591611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f64ae-a79d-4347-8647-baa96e8bead9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.597566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.598474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.598791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.599068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] PATH_INFO: `/v3/projects/643fb689449f4071a7fcf8ad37ef9793` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.600331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=643fb689449f4071a7fcf8ad37ef9793)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.602295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.616380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.617646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.618243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.618752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.621581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.624395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.640989 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3307/6627] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:47 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:47.642101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.673451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643fb689449f4071a7fcf8ad37ef9793', 'request_id': 'req-12112440-27de-47c0-a5e9-f694b2bfc5fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:47.681223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643fb689449f4071a7fcf8ad37ef9793', 'request_id': 'req-12112440-27de-47c0-a5e9-f694b2bfc5fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:47.692314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643fb689449f4071a7fcf8ad37ef9793', 'request_id': 'req-12112440-27de-47c0-a5e9-f694b2bfc5fe'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:47.720269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] The token cache is being invalidate because project 643fb689449f4071a7fcf8ad37ef9793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:47.720649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:47.721456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:47.723482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3321/6628] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:47 2022] DELETE /identity/v3/projects/643fb689449f4071a7fcf8ad37ef9793 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:47.724421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.727860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:47.755058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d324e-6789-488c-8383-286a50d30dc1 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.814957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12112440-27de-47c0-a5e9-f694b2bfc5fe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.827022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.828246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.828854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.829316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] PATH_INFO: `/v3/projects/33e09f0bdaee4a37929b1bc77db7c09e/users/a9eebb6dbb6b42bbb327bdcbab689bd7/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.840988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.841822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.842218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.842637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.843436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.845959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.866613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e09f0bdaee4a37929b1bc77db7c09e, user_id=a9eebb6dbb6b42bbb327bdcbab689bd7, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.870141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:47.874531 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3308/6629] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:47 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:47.876309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.880164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:47.895890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6a9e4-243b-47b5-aa8b-333cc9c2037e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:47.921558 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3322/6630] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:47 2022] PUT /identity/v3/projects/33e09f0bdaee4a37929b1bc77db7c09e/users/a9eebb6dbb6b42bbb327bdcbab689bd7/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:47.924362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:47.933224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:47.988810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc440d6-1026-447f-a6b2-ed2af091aa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:47.989801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc440d6-1026-447f-a6b2-ed2af091aa7b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:47.990098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc440d6-1026-447f-a6b2-ed2af091aa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:47.990369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc440d6-1026-447f-a6b2-ed2af091aa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:47.991141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc440d6-1026-447f-a6b2-ed2af091aa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:47.992749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc440d6-1026-447f-a6b2-ed2af091aa7b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.008945 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3309/6631] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:47 2022] GET /identity/v3/roles => generated 2322 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:48.010210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.010499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.010860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.034522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:48.036468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:48.061408 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3310/6632] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:48.062549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.068528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:48.086808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a01ed-d3de-4c44-a8fb-d949a8ed1e95 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.090973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541199b-7fe5-4c7e-b3f3-eb873ec1c29f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.092575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac502ed4-c3ea-449a-960f-55e6eafe4c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.093392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502ed4-c3ea-449a-960f-55e6eafe4c07 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.093848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502ed4-c3ea-449a-960f-55e6eafe4c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.094168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502ed4-c3ea-449a-960f-55e6eafe4c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.095367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac502ed4-c3ea-449a-960f-55e6eafe4c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.095924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.096841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.097129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.097367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac502ed4-c3ea-449a-960f-55e6eafe4c07 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.097490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.099305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.101223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.111290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3311/6633] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:48 2022] GET /identity/v3/roles => generated 2322 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:48.112923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38aad7-c109-4d19-b069-1fe8578d6bfe None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.113319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38aad7-c109-4d19-b069-1fe8578d6bfe None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.113770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38aad7-c109-4d19-b069-1fe8578d6bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca.: keystone.exception.ImpliedRoleNotFound: 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca. May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = query.one() May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._iter().one() May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._only_one_row( May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:48.122557 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 07 22:07:48.123936 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 07 22:07:48.125119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 07 22:07:48.125119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca. May 07 22:07:48.125119 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:48.127380 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3323/6634] 10.222.0.32 () {58 vars in 1343 bytes} [Sat May 7 22:07:47 2022] GET /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 137 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:48.128255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.149254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c4c52-e9db-46c7-a2ad-4ed8170ada24 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.150215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6f38aad7-c109-4d19-b069-1fe8578d6bfe None None] MFA Rules not processed for user `a9eebb6dbb6b42bbb327bdcbab689bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:48.151620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6f38aad7-c109-4d19-b069-1fe8578d6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:48.154852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0363-f79c-4297-8578-a5acf3661f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.160179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0363-f79c-4297-8578-a5acf3661f38 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.160659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0363-f79c-4297-8578-a5acf3661f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.161138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0363-f79c-4297-8578-a5acf3661f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.161950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0363-f79c-4297-8578-a5acf3661f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.163789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0363-f79c-4297-8578-a5acf3661f38 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.189737 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3324/6635] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:48 2022] GET /identity/v3/roles => generated 2322 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:48.191455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c909ea-18ec-4ef9-95e0-9e93250f3437 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.191903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c909ea-18ec-4ef9-95e0-9e93250f3437 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.192244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c909ea-18ec-4ef9-95e0-9e93250f3437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.220811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-53c909ea-18ec-4ef9-95e0-9e93250f3437 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:48.222385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53c909ea-18ec-4ef9-95e0-9e93250f3437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:48.243284 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3312/6636] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:48.244750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38aad7-c109-4d19-b069-1fe8578d6bfe None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.250394 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3325/6637] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:48.251517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c909ea-18ec-4ef9-95e0-9e93250f3437 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.266518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c909ea-18ec-4ef9-95e0-9e93250f3437 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.272144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.273193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.273480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.273755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.278170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.279485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.282474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38aad7-c109-4d19-b069-1fe8578d6bfe None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.295781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.296683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.296963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.297243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] PATH_INFO: `/v3/projects/39796839a27841638728e87c7ee65c26/users/724254e8d5e4464fa1676f2d40e3ecff/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca.: keystone.exception.ImpliedRoleNotFound: 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca. May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = query.one() May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._iter().one() May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._only_one_row( May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:48.297784 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) May 07 22:07:48.298861 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role May 07 22:07:48.299849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, May 07 22:07:48.299849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role May 07 22:07:48.299849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( May 07 22:07:48.299849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 5d957d3003644823838743c7d145491a does not imply e782775841f847dba246f668b6bbf4ca. May 07 22:07:48.299849 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:48.307892 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3326/6638] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:48 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 137 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:48.309088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.326054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39796839a27841638728e87c7ee65c26, user_id=724254e8d5e4464fa1676f2d40e3ecff, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.328911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.352975 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3313/6639] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:48 2022] PUT /identity/v3/projects/39796839a27841638728e87c7ee65c26/users/724254e8d5e4464fa1676f2d40e3ecff/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:48.352975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.357549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b79741-4a59-4354-bbc8-2ccd303eba50 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.465361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb499cf2-25b2-4bf7-afb8-631e214f4b76 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.485052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.486077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.486523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.486991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.488028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:48.488516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.494083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.502370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.503304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.503585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.507135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] PATH_INFO: `/v3/projects/3391a37a10c644b093470d0b903ff818/users/98884898865847848cbd7c9601a4488a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.510923 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3314/6640] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:48.511922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.514185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:48.540402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3391a37a10c644b093470d0b903ff818, user_id=98884898865847848cbd7c9601a4488a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.546830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.576229 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3327/6641] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:48 2022] PUT /identity/v3/projects/3391a37a10c644b093470d0b903ff818/users/98884898865847848cbd7c9601a4488a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:48.577229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.658703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ebfcb-8ae4-4cea-8331-99e7f5b219ec admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.659086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102580d-d72a-4b96-8047-b936a66575ed admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.664662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.665592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.665884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.666166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.668476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.670670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.737215 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3328/6642] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:48 2022] PUT /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 520 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:48.739528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.782157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf08335-8861-401e-b663-3aed167543a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.784278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08335-8861-401e-b663-3aed167543a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.784573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08335-8861-401e-b663-3aed167543a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.786805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08335-8861-401e-b663-3aed167543a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.890210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5b814-5e62-4c71-b1df-658d50cda94e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.896680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.897368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.897656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.897934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.898663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.900344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.902354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf08335-8861-401e-b663-3aed167543a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.904813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf08335-8861-401e-b663-3aed167543a1 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.916656 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3329/6643] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:48 2022] GET /identity/v3/roles => generated 2322 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:48.916656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:48.920039 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3315/6644] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:48.921814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a5b0c-e5ef-4443-a2bb-87698088f4d3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.922246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a5b0c-e5ef-4443-a2bb-87698088f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.922536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a5b0c-e5ef-4443-a2bb-87698088f4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.942360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bbd07-829d-4e13-a948-9a9aa33a27f0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:48.948580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:48.949651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:48.950636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:48.951320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:48.952203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:48.954590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:48.966208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5e2a5b0c-e5ef-4443-a2bb-87698088f4d3 None None] MFA Rules not processed for user `98884898865847848cbd7c9601a4488a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:48.967600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5e2a5b0c-e5ef-4443-a2bb-87698088f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:49.001286 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3330/6645] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:48 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:49.002348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.084759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3316/6646] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:49.086036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a5b0c-e5ef-4443-a2bb-87698088f4d3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.100822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a5b0c-e5ef-4443-a2bb-87698088f4d3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.124293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdedb6-85a4-4854-8500-cf6733ca577e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.129504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.131028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.131415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.131805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.133727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=30f043a896b74cc3b6996c2bfe52ac68)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.135513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.171200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.173157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.173633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.174619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] PATH_INFO: `/v3/projects/39796839a27841638728e87c7ee65c26/users/724254e8d5e4464fa1676f2d40e3ecff/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.177901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39796839a27841638728e87c7ee65c26, user_id=724254e8d5e4464fa1676f2d40e3ecff, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.181050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.181817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3331/6647] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:49 2022] PUT /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68 => generated 519 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:49.182987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.194449 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3317/6648] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:49 2022] PUT /identity/v3/projects/39796839a27841638728e87c7ee65c26/users/724254e8d5e4464fa1676f2d40e3ecff/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:49.195545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.262011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03404abb-9469-4553-bb1c-5502e5fff494 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.288143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462afb9-ba30-4bd1-b651-ab6a1468e9e9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.297246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.298845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.299143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.299432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.300133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.302101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.333193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3318/6649] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:49 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:49.334033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.349106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5fe7-762b-447d-b3ad-adc66f8b60d6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.356317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.357005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.357294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.357839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.358547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.359360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.360529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.360761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.361054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.361338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] PATH_INFO: `/v3/users/a9eebb6dbb6b42bbb327bdcbab689bd7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.363174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9eebb6dbb6b42bbb327bdcbab689bd7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.365816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.398111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3319/6650] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:49 2022] POST /identity/v3/projects => generated 393 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:49.399361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.464243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9eebb6dbb6b42bbb327bdcbab689bd7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:49.465382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9eebb6dbb6b42bbb327bdcbab689bd7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:49.474881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9eebb6dbb6b42bbb327bdcbab689bd7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:49.476013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9eebb6dbb6b42bbb327bdcbab689bd7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:49.488957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d41c351a-2032-4837-9fca-ab8820177283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9eebb6dbb6b42bbb327bdcbab689bd7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:49.500192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33b91-3600-4038-9927-b70dd1ded0ff admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.511969 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3332/6651] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:49 2022] DELETE /identity/v3/users/a9eebb6dbb6b42bbb327bdcbab689bd7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:49.514608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.514608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.514608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.536224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.540809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.541112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.541401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.549069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=30f043a896b74cc3b6996c2bfe52ac68, implied_role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.550746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.550907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] MFA Rules not processed for user `724254e8d5e4464fa1676f2d40e3ecff`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:49.552449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:49.626386 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3320/6652] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:49 2022] PUT /identity/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c => generated 520 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:49.626386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.633201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:49.652314 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3333/6653] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:49.652314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.654070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:49.767951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c861a-71cf-4fa3-98a8-d216da13703f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.813660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa47cd0-776e-4743-8619-6ad16901e132 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.835019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd2349-27c6-43dd-b827-57562a940d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.836023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd2349-27c6-43dd-b827-57562a940d58 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.838324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd2349-27c6-43dd-b827-57562a940d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.840342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd2349-27c6-43dd-b827-57562a940d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.843822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd2349-27c6-43dd-b827-57562a940d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.848326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd2349-27c6-43dd-b827-57562a940d58 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.854173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.855033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.855486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.856751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.857357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:49.860093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:49.885132 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3321/6654] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:49 2022] GET /identity/v3/roles => generated 2322 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:49.888817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcdfc-8af3-4aca-acd6-3ba16e3366cd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.889189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcdfc-8af3-4aca-acd6-3ba16e3366cd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.889482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebcdfc-8af3-4aca-acd6-3ba16e3366cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.890824 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3334/6655] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:49 2022] POST /identity/v3/users => generated 303 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:49.892086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.895135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:49.936168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-73ebcdfc-8af3-4aca-acd6-3ba16e3366cd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:49.937411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-73ebcdfc-8af3-4aca-acd6-3ba16e3366cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:49.956342 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3322/6656] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:49.957194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcdfc-8af3-4aca-acd6-3ba16e3366cd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:49.990055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea01fd-4691-4193-8a11-b24e6d406d06 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:49.996423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:49.997945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:49.998668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:49.999164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:49.999947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.001310 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:50.001310 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:50.001310 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:50.002988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.026007 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3335/6657] 10.222.0.32 () {58 vars in 1151 bytes} [Sat May 7 22:07:49 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:50.026811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.042936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c1f9-bb4a-446c-bf51-a0dc446bc11a tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.048891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.049885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.050281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.050985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.051827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.064785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.077959 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3336/6658] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:50 2022] GET /identity/v3/roles => generated 2322 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:50.078751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.099941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7836f-0658-4556-bda4-410a1a81c9eb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.114426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.115237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.115594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.115944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.116769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.118454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.136429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebcdfc-8af3-4aca-acd6-3ba16e3366cd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.142436 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3337/6659] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:50 2022] GET /identity/v3/roles => generated 2322 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:50.144117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.146637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:50.148917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.149929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.156167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.156458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.157239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.159159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.185320 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3323/6660] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:49 2022] POST /identity/v3/services => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:50.186546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.244667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd75093-fe9f-4d7e-bf07-43f14eef15ba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.257877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.258981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.260777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.260777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.263434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=30f043a896b74cc3b6996c2bfe52ac68, implied_role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.267128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.284542 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3324/6661] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:50 2022] DELETE /identity/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:50.285485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.295755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22946136-9a04-4ca3-8918-607fe1bd4481 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.413915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298167c-0a1d-4cbf-b636-16076b2454b9 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.427622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.428536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.428822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.429112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] PATH_INFO: `/v3/projects/57a0ca9121124ab694106520a0e9e439/users/371ab34d1e4a4cb299a2479b648b1f21/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.439662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.440345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.441046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.441335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.463077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.465251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a0ca9121124ab694106520a0e9e439, user_id=371ab34d1e4a4cb299a2479b648b1f21, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.468595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.472039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.493715 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3338/6662] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:50.494447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.503785 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3325/6663] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:50 2022] PUT /identity/v3/projects/57a0ca9121124ab694106520a0e9e439/users/371ab34d1e4a4cb299a2479b648b1f21/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:50.504688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.520049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa712-4e12-46c5-8b7e-4ce9e245ffdf service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.593212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.594546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.595097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.595537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] PATH_INFO: `/v3/projects/e256be8c99ba46109347c2cc41b13c37/users/cc0d16cdd5c6400ea050868c6fea0754/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.615199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e256be8c99ba46109347c2cc41b13c37, user_id=cc0d16cdd5c6400ea050868c6fea0754, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.619262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.651649 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3339/6664] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:50 2022] PUT /identity/v3/projects/e256be8c99ba46109347c2cc41b13c37/users/cc0d16cdd5c6400ea050868c6fea0754/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:50.652422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.679472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d9e7d-8b66-483c-999f-3844ee6425f1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.797962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5abfac3-9497-4162-8de8-0beab05aaf8d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:50.816797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a60fd-be94-4359-81d9-c61ff5118ccf tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.818400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a60fd-be94-4359-81d9-c61ff5118ccf tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.819557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a60fd-be94-4359-81d9-c61ff5118ccf tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.819852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a60fd-be94-4359-81d9-c61ff5118ccf tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.823063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a60fd-be94-4359-81d9-c61ff5118ccf tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=30f043a896b74cc3b6996c2bfe52ac68)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.829138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a60fd-be94-4359-81d9-c61ff5118ccf tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.848786 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3340/6665] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:50 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:50.849769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:50.850341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571a4b-ffc2-4a2d-a788-d6007e456657 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.850620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:50.850745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571a4b-ffc2-4a2d-a788-d6007e456657 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.851166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:50.852151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.852296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d571a4b-ffc2-4a2d-a788-d6007e456657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:50.852640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:50.853938 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:50.853938 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:50.853938 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:50.855116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:50.886204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0d571a4b-ffc2-4a2d-a788-d6007e456657 None None] MFA Rules not processed for user `371ab34d1e4a4cb299a2479b648b1f21`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:50.888168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0d571a4b-ffc2-4a2d-a788-d6007e456657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:50.895238 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2119305822. To ensure interoperability, identifiers should be a valid uuid. May 07 22:07:50.895238 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 22:07:50.895238 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:50.969768 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3341/6666] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:50 2022] POST /identity/v3/auth/tokens => generated 3568 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:50.970931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d571a4b-ffc2-4a2d-a788-d6007e456657 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:50.971951 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3326/6667] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:07:50 2022] POST /identity/v3/endpoints => generated 361 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:50.972903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.003378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623342f-2505-45b3-ab77-080893ccf642 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.171754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.172722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.173010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.183028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.191639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.193306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.204713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d571a4b-ffc2-4a2d-a788-d6007e456657 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.219920 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3327/6668] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:50 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:51.221243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.262423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.263148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.263430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.263713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.264442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.266082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.318055 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3342/6669] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:50 2022] GET /identity/v3/roles => generated 2322 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:51.321340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.394837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987a9c0-5ce3-435d-ab49-d965b4110f12 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.400179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.400854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.401147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.401425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.402124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.426810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.466991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e456e8-d28d-4da2-88ab-ac23c852fdc3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.474324 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3328/6670] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:51 2022] POST /identity/v3/projects => generated 383 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:51.475519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.538242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.539272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.539569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.539848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-2119305822` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.540505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2119305822)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.541585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.547141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3343/6671] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 22:07:51 2022] GET /identity/v3/regions/tempest-region-2119305822 => generated 180 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:51.547141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.559953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341eed9-26c3-46ef-9282-4581312b131d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.564375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6cee0-50b5-4b70-bba6-da94e6b0ddb1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.569849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.570354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.570642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.570952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.572014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.573472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.585886 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3329/6672] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:51 2022] GET /identity/v3/roles => generated 2322 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:51.586842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.592773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:51.648317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.649408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.649698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.649983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] PATH_INFO: `/v3/projects/e256be8c99ba46109347c2cc41b13c37/users/cc0d16cdd5c6400ea050868c6fea0754/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.659670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e256be8c99ba46109347c2cc41b13c37, user_id=cc0d16cdd5c6400ea050868c6fea0754, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.662349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.668176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e634593-027a-4e5e-85f6-bc5d046c78c5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.683867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3344/6673] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:51 2022] PUT /identity/v3/projects/e256be8c99ba46109347c2cc41b13c37/users/cc0d16cdd5c6400ea050868c6fea0754/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:51.685592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.754330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.754578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c0f9c-aa75-4dbe-a993-e99f9c2ec3ed admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.755784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.756237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.756754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] PATH_INFO: `/v3/projects/33e09f0bdaee4a37929b1bc77db7c09e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.757995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e09f0bdaee4a37929b1bc77db7c09e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.759523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.762169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.762349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.762349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.762349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.762349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.763692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.804165 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3345/6674] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:51 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:51.804427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.821529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e09f0bdaee4a37929b1bc77db7c09e', 'request_id': 'req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:51.827865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e09f0bdaee4a37929b1bc77db7c09e', 'request_id': 'req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:51.845888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e09f0bdaee4a37929b1bc77db7c09e', 'request_id': 'req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:51.855434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] The token cache is being invalidate because project 33e09f0bdaee4a37929b1bc77db7c09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:51.855741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:51.856939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:51.863411 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3330/6675] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:51 2022] DELETE /identity/v3/projects/33e09f0bdaee4a37929b1bc77db7c09e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:51.864768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:51.866700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:51.915614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323eafa3-db98-4391-92bc-fbd21658616f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.967303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46897d5-90b8-47c8-ad6d-2579d6bd9ffa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:51.973224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0de05-59d9-486b-b44f-3aed83c4f1a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.973911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0de05-59d9-486b-b44f-3aed83c4f1a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.974197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0de05-59d9-486b-b44f-3aed83c4f1a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.974482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0de05-59d9-486b-b44f-3aed83c4f1a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.975420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0de05-59d9-486b-b44f-3aed83c4f1a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.977339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0de05-59d9-486b-b44f-3aed83c4f1a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.991700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:51.992674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:51.993166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:51.993554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:51.994418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:51.996389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:51.998752 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3331/6676] 10.222.0.32 () {60 vars in 1142 bytes} [Sat May 7 22:07:51 2022] POST /identity/v3/roles => generated 235 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:52.004395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547e18-1751-4da0-9949-5720ba927625 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.004625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547e18-1751-4da0-9949-5720ba927625 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.004875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547e18-1751-4da0-9949-5720ba927625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.016666 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3346/6677] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:51 2022] POST /identity/v3/services => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:52.018022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.020264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.039834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fd547e18-1751-4da0-9949-5720ba927625 None None] MFA Rules not processed for user `cc0d16cdd5c6400ea050868c6fea0754`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:52.041719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd547e18-1751-4da0-9949-5720ba927625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.131451 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3332/6678] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:52 2022] POST /identity/v3/auth/tokens => generated 3775 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:52.131451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9b06d-42b3-4c70-9e32-42b6c1a6a73a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.131451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9b06d-42b3-4c70-9e32-42b6c1a6a73a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.131451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9b06d-42b3-4c70-9e32-42b6c1a6a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.145895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63aef4d-cb16-487d-8bea-dac0def6aa75 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.151154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.151966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.152339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.152729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.152885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0fd9b06d-42b3-4c70-9e32-42b6c1a6a73a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:52.153688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.154160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0fd9b06d-42b3-4c70-9e32-42b6c1a6a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.155711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.173466 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3333/6679] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:52 2022] POST /identity/v3/auth/tokens => generated 3677 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:52.174440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9b06d-42b3-4c70-9e32-42b6c1a6a73a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.178595 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3347/6680] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/roles => generated 2548 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:52.179988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.182132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.209511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15823f4-f42c-4dcc-bce5-b58b8499fd78 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.215098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.215823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.216113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.216394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.217382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.218467 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:52.218467 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:52.218467 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:52.219589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.223837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9b06d-42b3-4c70-9e32-42b6c1a6a73a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.229734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.230813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.231891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.232507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/77dbb8f6614b482e99f77f2f11b39a0a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.234596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:update_role(role_id=77dbb8f6614b482e99f77f2f11b39a0a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.236308 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:52.236308 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:52.236308 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:52.238204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.245633 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-92eb35bd-a702-4089-bb6d-98f72e1cc479 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-511372614. To ensure interoperability, identifiers should be a valid uuid. May 07 22:07:52.245633 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 22:07:52.245633 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:52.278953 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3334/6681] 10.222.0.32 () {60 vars in 1242 bytes} [Sat May 7 22:07:52 2022] PATCH /identity/v3/roles/77dbb8f6614b482e99f77f2f11b39a0a => generated 238 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:52.280109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.284962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.289892 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3348/6682] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:07:52 2022] POST /identity/v3/endpoints => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:52.291398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f376bc-4835-4f2e-ae07-6598f71f91bc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.291687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f376bc-4835-4f2e-ae07-6598f71f91bc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.291984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f376bc-4835-4f2e-ae07-6598f71f91bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.312524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-82f376bc-4835-4f2e-ae07-6598f71f91bc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:52.313749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-82f376bc-4835-4f2e-ae07-6598f71f91bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.343192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3349/6683] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:52 2022] POST /identity/v3/auth/tokens => generated 3860 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:52.344511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f376bc-4835-4f2e-ae07-6598f71f91bc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.355438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f376bc-4835-4f2e-ae07-6598f71f91bc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.361295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.361985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.362268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.362543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.363300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.364954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.376539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17682d0f-0ff3-45f1-943a-025d7ebc13d7 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.381547 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3350/6684] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/roles => generated 2551 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:52.381547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.403189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06a4ca-8238-415a-b822-7e59b343157b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.403781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.404513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.404746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.405031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.409138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.409983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.410275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.410551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/77dbb8f6614b482e99f77f2f11b39a0a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.415401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.416841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.421153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:get_role(role_id=77dbb8f6614b482e99f77f2f11b39a0a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.422887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.424455 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3351/6685] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/roles/77dbb8f6614b482e99f77f2f11b39a0a => generated 238 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:52.427951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.448839 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3335/6686] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/auth/tokens => generated 3958 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:52.450502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.464496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd0bb3-fa31-45f3-8e3c-9ba5befcadd7 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.471139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.472350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.472646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.473024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.474275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:52.474738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.476387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.492904 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3336/6687] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:52.495557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.508659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536491a-c190-4508-8501-fbcab3f268a2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.515595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.516786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.517775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.518607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] PATH_INFO: `/v3/projects/0d4d7bfcbafc4b53b0ec59e03b73d227/users/201cc02ed186467b96e0ab11e71be9d2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.523706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada2dc0-d2f8-4e06-b12e-2cb5206899b5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.536544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.537405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.537936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.538452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-511372614` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.539618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-511372614)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.540302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.541812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4d7bfcbafc4b53b0ec59e03b73d227, user_id=201cc02ed186467b96e0ab11e71be9d2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.548436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.555395 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3352/6688] 10.222.0.32 () {58 vars in 1202 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/regions/tempest-region-511372614 => generated 178 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:52.556791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.569062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5396-fdd3-4291-b493-584eec7207cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.570244 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3337/6689] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:52 2022] PUT /identity/v3/projects/0d4d7bfcbafc4b53b0ec59e03b73d227/users/201cc02ed186467b96e0ab11e71be9d2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:52.571241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.642190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.642786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.643082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.643371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.644080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.645775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.655819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db4ced-140c-4a71-956a-bd0889c7ef77 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.661114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.664149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.664149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.664149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.664149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.665717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.671072 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3353/6690] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/roles => generated 2551 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:52.671920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.701526 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3338/6691] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:52 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:52.702965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.706108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.745295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121b600-be1b-473f-8c3c-1fc1bc403560 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.780565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebabc7-3371-4060-9985-b039975be98b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:52.784850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.785075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.785368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.785611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.788329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.810891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e02dd-d7f7-4651-9598-bd48128367b2 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:52.811975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e02dd-d7f7-4651-9598-bd48128367b2 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.812476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e02dd-d7f7-4651-9598-bd48128367b2 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.812966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e02dd-d7f7-4651-9598-bd48128367b2 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.813944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e02dd-d7f7-4651-9598-bd48128367b2 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.815787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e02dd-d7f7-4651-9598-bd48128367b2 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.836350 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-e92e02dd-d7f7-4651-9598-bd48128367b2 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1438470215. To ensure interoperability, identifiers should be a valid uuid. May 07 22:07:52.836350 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 22:07:52.836350 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:52.865334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:52.867168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:52.867297 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3354/6692] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:07:52 2022] POST /identity/v3/endpoints => generated 360 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:52.869312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1896c1-8726-4b8b-a3f3-21449013853e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:52.869900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1896c1-8726-4b8b-a3f3-21449013853e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:52.870576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1896c1-8726-4b8b-a3f3-21449013853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:52.895132 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3339/6693] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:52 2022] GET /identity/v3/auth/tokens => generated 4073 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:52.905555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:52.908726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8c1896c1-8726-4b8b-a3f3-21449013853e None None] MFA Rules not processed for user `201cc02ed186467b96e0ab11e71be9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:52.910259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8c1896c1-8726-4b8b-a3f3-21449013853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:52.989018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8731b-3a90-4aef-8785-5f5da2fda5dd service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.007398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.008463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.008758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.009037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/77dbb8f6614b482e99f77f2f11b39a0a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.011716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_role(role_id=77dbb8f6614b482e99f77f2f11b39a0a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.013717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.034170 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3355/6694] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:52 2022] POST /identity/v3/auth/tokens => generated 4065 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:53.035491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1896c1-8726-4b8b-a3f3-21449013853e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.066884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 77dbb8f6614b482e99f77f2f11b39a0a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:53.067391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:53.068226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:53.070445 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3340/6695] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:52 2022] DELETE /identity/v3/roles/77dbb8f6614b482e99f77f2f11b39a0a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:53.074818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.076152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:53.171068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1896c1-8726-4b8b-a3f3-21449013853e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.180643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fa384-9571-4caa-b53a-d9b68d188249 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.188362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.189333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.189748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.190120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-1438470215` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.191401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1438470215)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.192651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.198422 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3341/6696] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 22:07:53 2022] GET /identity/v3/regions/tempest-region-1438470215 => generated 180 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:53.199586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.201724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:53.262858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.263699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.264228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.264492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.266324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.267578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.305313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641c276-2906-41b7-91db-471e328d2515 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.318600 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3356/6697] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:53 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:53.319841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.322309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.323276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.323632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.323944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:53.324088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.324655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.326661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.365149 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3342/6698] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:53 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:53.365149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.406380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52b251-f6d8-4d53-8a22-4d60711e7e61 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.428573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51568f5a-ffa5-4dcd-98f6-0d15b29942b5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.434218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.435128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.435492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.435859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.436686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.437808 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:53.437808 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:53.437808 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:53.438914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.447694 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3343/6699] 10.222.0.32 () {58 vars in 1133 bytes} [Sat May 7 22:07:53 2022] GET /identity/v3/endpoints => generated 4386 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:53.448500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.453312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:53.464142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.465078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.465434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.466240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.468607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.470267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.499968 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3357/6700] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:53 2022] PUT /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 520 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:53.499968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.527858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c860f-824d-40dc-b512-a885498bddba tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.574372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9929e-84de-4691-867e-a50406cc709d tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.579454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.580249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.580953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.580953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.581766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.583866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.608625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3358/6701] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:07:53 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:53.608831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.609277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.609379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.609379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.609379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.609379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.610353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.621420 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3344/6702] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:53 2022] GET /identity/v3/roles => generated 2322 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:53.622759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.678445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed2821-ff83-4691-9300-855f43f6bd29 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.682010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a1e4d-ecd2-4ad4-8bd8-c2eb8a8b59ca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.685019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.685948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.686310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.686654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints/b2657c681bb4405194c918e6eaf2d797` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.688200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.689115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.689398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.689676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.693779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=30f043a896b74cc3b6996c2bfe52ac68)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.695444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.696612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=b2657c681bb4405194c918e6eaf2d797)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.697816 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:53.697816 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:53.697816 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:53.699179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.703751 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3359/6703] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:53 2022] GET /identity/v3/endpoints/b2657c681bb4405194c918e6eaf2d797 => generated 360 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:53.703751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.714372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4270fd7-d271-4576-a517-f9c9051fc4ed tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.719537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.720572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.720900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.721429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.722825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.725003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.733633 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3345/6704] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:53 2022] PUT /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68 => generated 519 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:53.734915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.741639 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3360/6705] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:53 2022] GET /identity/v3/roles => generated 2322 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:53.743196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.757862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048a99c-919c-465e-9f96-5abdbf0b8bfe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.800485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71225-5bad-4724-a4de-b7a6d2093295 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.805985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.807169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.807643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.808081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.808961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.810797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.820391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.821471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.821942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.822258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints/b2657c681bb4405194c918e6eaf2d797` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.823762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b2657c681bb4405194c918e6eaf2d797)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.824591 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3346/6706] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:53 2022] GET /identity/v3/roles => generated 2322 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:53.824864 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:53.824864 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:07:53.824864 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:07:53.826149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.828528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.835919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b2657c681bb4405194c918e6eaf2d797', 'request_id': 'req-7ba0bb69-118d-460c-86f9-afcd791bb99f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:53.851228 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3361/6707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:53 2022] DELETE /identity/v3/endpoints/b2657c681bb4405194c918e6eaf2d797 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:53.852143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.875920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0bb69-118d-460c-86f9-afcd791bb99f tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.885529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.887468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.888035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.888356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] PATH_INFO: `/v3/projects/6d911cfddbe341409acd6c662de3978e/users/b407240a2a064ebc9712506f9057925c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.913051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6ed0a-e3f2-4ed4-83c3-2f7ef1999373 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:53.914717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d911cfddbe341409acd6c662de3978e, user_id=b407240a2a064ebc9712506f9057925c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.920720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.938750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:53.940343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:53.940802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:53.941311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:53.946625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3362/6708] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:53 2022] PUT /identity/v3/projects/6d911cfddbe341409acd6c662de3978e/users/b407240a2a064ebc9712506f9057925c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:53.947673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=30f043a896b74cc3b6996c2bfe52ac68, implied_role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:53.947923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:53.949619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:53.975669 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3347/6709] 10.222.0.32 () {60 vars in 1362 bytes} [Sat May 7 22:07:53 2022] PUT /identity/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c => generated 520 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:53.976586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.025723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335ddda-9f43-48bb-ab9d-d1218d05bba1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.061064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c289f2-dd20-41e2-9c4b-a9a1aa6098e6 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.065915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.066589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.066913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.067196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.068151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.069521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.081876 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3348/6710] 10.222.0.32 () {58 vars in 1133 bytes} [Sat May 7 22:07:53 2022] GET /identity/v3/endpoints => generated 4039 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:54.082411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.082740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.083355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.083646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.083926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] PATH_INFO: `/v3/projects/a45ecca62a364aaabca1717c79558f6f/users/463a78a91e954c95b13a993b176b5526/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.094261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a884d1-4cac-4435-881a-6b5a92ee7805 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.099920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.100584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.100868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.101063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45ecca62a364aaabca1717c79558f6f, user_id=463a78a91e954c95b13a993b176b5526, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.101174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.101845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.103473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.103857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.116086 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3349/6711] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:07:54 2022] GET /identity/v3/roles => generated 2322 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:54.117141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.122185 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3363/6712] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:53 2022] PUT /identity/v3/projects/a45ecca62a364aaabca1717c79558f6f/users/463a78a91e954c95b13a993b176b5526/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:54.131028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.187750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e37f6-60d3-4884-bb1f-7a7d0ab822f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.187912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f058-a7c5-4b63-9d7e-0b370cce3c21 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.192743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.193659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.194495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.194872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints/b2657c681bb4405194c918e6eaf2d797` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.200240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Could not find endpoint: b2657c681bb4405194c918e6eaf2d797.: keystone.exception.EndpointNotFound: Could not find endpoint: b2657c681bb4405194c918e6eaf2d797. May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._iter().one() May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._only_one_row( May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exc.NoResultFound( May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:54.217815 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: b2657c681bb4405194c918e6eaf2d797. May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:54.219196 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:07:54.220529 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: b2657c681bb4405194c918e6eaf2d797. May 07 22:07:54.221736 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:54.225064 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3364/6713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:54 2022] DELETE /identity/v3/endpoints/b2657c681bb4405194c918e6eaf2d797 => generated 114 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:54.226522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.254406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da821f-a636-47f3-8baf-48d7c8ee6edb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.255328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da821f-a636-47f3-8baf-48d7c8ee6edb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.256044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da821f-a636-47f3-8baf-48d7c8ee6edb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.256336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da821f-a636-47f3-8baf-48d7c8ee6edb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.257575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da821f-a636-47f3-8baf-48d7c8ee6edb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=30f043a896b74cc3b6996c2bfe52ac68)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.259385 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-18da821f-a636-47f3-8baf-48d7c8ee6edb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:54.259385 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:54.259385 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:54.260322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da821f-a636-47f3-8baf-48d7c8ee6edb tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.268179 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3350/6714] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:54 2022] GET /identity/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies => generated 489 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:54.269552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdf2d-0bf1-4ff0-b0a2-40bb67aef9b0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.269850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdf2d-0bf1-4ff0-b0a2-40bb67aef9b0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.270133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fdf2d-0bf1-4ff0-b0a2-40bb67aef9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.299233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cf4fdf2d-0bf1-4ff0-b0a2-40bb67aef9b0 None None] MFA Rules not processed for user `463a78a91e954c95b13a993b176b5526`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:54.300489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cf4fdf2d-0bf1-4ff0-b0a2-40bb67aef9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:54.309811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cde0a4-9971-460f-9f2c-371ca7ce97e9 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.321857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.323429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.323719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.324002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] PATH_INFO: `/v3/projects/6d911cfddbe341409acd6c662de3978e/users/b407240a2a064ebc9712506f9057925c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.328243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d911cfddbe341409acd6c662de3978e, user_id=b407240a2a064ebc9712506f9057925c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.333352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.357327 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3365/6715] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:07:54 2022] PUT /identity/v3/projects/6d911cfddbe341409acd6c662de3978e/users/b407240a2a064ebc9712506f9057925c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:54.358535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.378959 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3351/6716] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:54 2022] POST /identity/v3/auth/tokens => generated 3869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:54.379606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdf2d-0bf1-4ff0-b0a2-40bb67aef9b0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.393832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fdf2d-0bf1-4ff0-b0a2-40bb67aef9b0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.451166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5eb43-58c2-4390-bdd2-fcb2d502711b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.459076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.460176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.460581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.460914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-1438470215` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.461835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1438470215)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.463816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.467708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48add7f-bb6d-4019-b046-161aec6d30e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.468587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48add7f-bb6d-4019-b046-161aec6d30e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.468873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48add7f-bb6d-4019-b046-161aec6d30e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.469280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48add7f-bb6d-4019-b046-161aec6d30e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.470511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48add7f-bb6d-4019-b046-161aec6d30e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=5d957d3003644823838743c7d145491a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.472183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48add7f-bb6d-4019-b046-161aec6d30e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.479473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3352/6717] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:07:54 2022] GET /identity/v3/roles/5d957d3003644823838743c7d145491a/implies => generated 659 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:54.480439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099a171-cea7-48bd-a939-75a692acecb7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.480728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099a171-cea7-48bd-a939-75a692acecb7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.481042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099a171-cea7-48bd-a939-75a692acecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.488941 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3366/6718] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 22:07:54 2022] DELETE /identity/v3/regions/tempest-region-1438470215 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:54.490096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.491641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:54.514466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e099a171-cea7-48bd-a939-75a692acecb7 None None] MFA Rules not processed for user `b407240a2a064ebc9712506f9057925c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:54.515511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e099a171-cea7-48bd-a939-75a692acecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:54.565016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0053e-db1c-4e7b-953c-e9ef872d2a18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.568843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.569499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.569785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.570065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.594916 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3353/6719] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:54 2022] POST /identity/v3/auth/tokens => generated 3948 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:54.595970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099a171-cea7-48bd-a939-75a692acecb7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.624830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e099a171-cea7-48bd-a939-75a692acecb7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.626567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.628144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.629913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.630873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.631166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.631445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.633371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=30f043a896b74cc3b6996c2bfe52ac68, implied_role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.635021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.644463 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3354/6720] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:54 2022] DELETE /identity/v3/roles/30f043a896b74cc3b6996c2bfe52ac68/implies/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:54.645219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.647936 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3367/6721] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:54 2022] GET /identity/v3/auth/tokens => generated 3869 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:54.648871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.650465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:54.739809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79643f-72aa-4362-8422-55601bd1a439 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.740435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1363b-dc54-4321-a51a-544f9c939f11 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.748300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.752694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.753064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.753490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.754225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.756441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.770862 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3355/6722] 10.222.0.32 () {58 vars in 1133 bytes} [Sat May 7 22:07:54 2022] GET /identity/v3/endpoints => generated 4039 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:54.772049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.804625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.805468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.806099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.806710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.810537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:54.859628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5910be-c852-4c80-ae28-536b18e357b6 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:54.867828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:54.868931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:54.869292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:54.869779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:54.872278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=30f043a896b74cc3b6996c2bfe52ac68)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.874374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.891638 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3356/6723] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:54 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/30f043a896b74cc3b6996c2bfe52ac68 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:54.893940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.904370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:54.905839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:54.926590 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3368/6724] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:54 2022] GET /identity/v3/auth/tokens => generated 3883 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:54.927482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:54.939617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b423fc-410f-4428-97f7-abfe098b5ffd service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.024882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32060-c3d1-45e2-b5ef-ffd0ecae1e15 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.039144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.039980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.040261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.040535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.044277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=5d957d3003644823838743c7d145491a, implied_role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.044947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.045909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.048078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.048751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.049345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.052774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Adding query filter params (service_id=2b96ad0a0e1b44d9be5abcddf9644ce7) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:55.054150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.057759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.067927 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3369/6725] 10.222.0.32 () {58 vars in 1346 bytes} [Sat May 7 22:07:54 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a/implies/e782775841f847dba246f668b6bbf4ca => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:55.069116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.087517 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3357/6726] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:07:54 2022] GET /identity/v3/endpoints?service_id=2b96ad0a0e1b44d9be5abcddf9644ce7 => generated 503 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:55.091023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.126504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441709c-aa97-4bfa-ab5c-3bf66bd425b4 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.180635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fa476-8883-403a-8d8a-b58339b00c02 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.206871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.207821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.208111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.208388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/74c457d86fe149028176aa3e9b7be327` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.235823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Could not find domain: 74c457d86fe149028176aa3e9b7be327.: keystone.exception.DomainNotFound: Could not find domain: 74c457d86fe149028176aa3e9b7be327. May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 74c457d86fe149028176aa3e9b7be327. May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:07:55.303242 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:07:55.304692 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 74c457d86fe149028176aa3e9b7be327. May 07 22:07:55.305880 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:07:55.308857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.309664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.309958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.310235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.312153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Adding query filter params (service_id=a9f5699493294f81a3687acc071ba2cc) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:55.312474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.314128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.320640 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3370/6727] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:07:55 2022] PATCH /identity/v3/domains/74c457d86fe149028176aa3e9b7be327 => generated 112 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:07:55.322170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.344738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff8c08-3a98-4802-b18d-e04a40ce040c tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.346309 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3358/6728] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:07:55 2022] GET /identity/v3/endpoints?service_id=a9f5699493294f81a3687acc071ba2cc => generated 503 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:55.347060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.367941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.369032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.369321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.369498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/users/2baaa6df4bb047bb996c1c17311b3595` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.371830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2baaa6df4bb047bb996c1c17311b3595)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.374356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.393175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739affd7-8a5b-4f8a-9a6b-633ec44d261d tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.394498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.403944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.403944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.404154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.404927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:55.405240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.410187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.437593 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3359/6729] 10.222.0.32 () {58 vars in 1166 bytes} [Sat May 7 22:07:55 2022] GET /identity/v3/endpoints?interface=public => generated 3396 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:07:55.439722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.473309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2baaa6df4bb047bb996c1c17311b3595'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:55.474197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2baaa6df4bb047bb996c1c17311b3595'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:55.479208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9e99c-2223-45f6-b030-2a9435548d9a tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.490673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.491273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2baaa6df4bb047bb996c1c17311b3595'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:55.492234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.492529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.492817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.493574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:07:55.493699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2baaa6df4bb047bb996c1c17311b3595'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:55.494026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.499921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.512091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2baaa6df4bb047bb996c1c17311b3595'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:55.517231 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3360/6730] 10.222.0.32 () {58 vars in 1170 bytes} [Sat May 7 22:07:55 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:55.519904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.535356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:55.553646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39959fa5-c5c5-49ac-9193-015f34057959 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.554761 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3371/6731] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:55 2022] DELETE /identity/v3/users/2baaa6df4bb047bb996c1c17311b3595 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:55.560598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.562211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:55.653343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.654698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.655339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.655814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.657075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.659809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.676082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5160801-3ff5-41c8-95f8-3dbcfcafa9e5 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.679206 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3361/6732] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:07:55 2022] POST /identity/v3/services => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:07:55.684939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.694369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.695520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.695818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.696155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/3992c5968e0b495b9961a50e27b8894c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.698534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3992c5968e0b495b9961a50e27b8894c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.700221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.712323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dcd36-3f02-452b-893b-65c31e5fff50 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.717989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.718802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.719206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.719584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.720449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.722342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.741116 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-606820544. To ensure interoperability, identifiers should be a valid uuid. May 07 22:07:55.741116 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 22:07:55.741116 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:55.745976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 3992c5968e0b495b9961a50e27b8894c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:55.746388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:55.747774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:55.749993 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3372/6733] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:55 2022] DELETE /identity/v3/roles/3992c5968e0b495b9961a50e27b8894c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:07:55.753907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.755636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:55.777448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3362/6734] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:07:55 2022] POST /identity/v3/endpoints => generated 359 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:07:55.781497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.786509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:55.824355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9444c39-8339-4b52-80e5-e7ac8db8e6cf tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.876319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68396b-714a-423e-a5ed-3821336885f0 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.920122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.920122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.920122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.920693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.920693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ef27cef2967f4dd3bb8d6b1dadad8c4f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.923843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.956015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.956897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.957187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.957478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-606820544` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.959432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-606820544)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:55.960652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:55.968746 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3363/6735] 10.222.0.32 () {58 vars in 1202 bytes} [Sat May 7 22:07:55 2022] GET /identity/v3/regions/tempest-region-606820544 => generated 178 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:07:55.969629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:55.980401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2783a-5dad-447f-a762-c54301502819 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:55.988596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:55.989495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:55.989798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:55.990086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints/5598c6826671469b8f833ef4943200ec` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:55.995662 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3373/6736] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:07:55 2022] DELETE /identity/v3/groups/ef27cef2967f4dd3bb8d6b1dadad8c4f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:56.000984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:56.002486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=5598c6826671469b8f833ef4943200ec)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.003583 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:56.003583 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:56.003583 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:56.005414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:56.030449 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-990913943. To ensure interoperability, identifiers should be a valid uuid. May 07 22:07:56.030449 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 22:07:56.030449 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:56.105831 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3364/6737] 10.222.0.32 () {60 vars in 1255 bytes} [Sat May 7 22:07:55 2022] PATCH /identity/v3/endpoints/5598c6826671469b8f833ef4943200ec => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:56.111498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:56.142516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5902a-22bf-4c56-b4b3-06f5cca65f33 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:56.150963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9fcbb-1603-4814-8052-c4190c2b96ad tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:56.168730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:56.170016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:56.170396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:56.170977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/projects/0dde06ac62a640da84e25f0ae9080547` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:56.173902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0dde06ac62a640da84e25f0ae9080547)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.178585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:56.237878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:56.239339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:56.240113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:56.240113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-990913943` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:56.242896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-990913943)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.250515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:56.253759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3365/6738] 10.222.0.32 () {58 vars in 1202 bytes} [Sat May 7 22:07:56 2022] GET /identity/v3/regions/tempest-region-990913943 => generated 178 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:07:56.257930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:56.280401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cae93a-d544-4d8d-b82f-2e16de336554 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:56.295339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dde06ac62a640da84e25f0ae9080547', 'request_id': 'req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.304583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dde06ac62a640da84e25f0ae9080547', 'request_id': 'req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.317670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dde06ac62a640da84e25f0ae9080547', 'request_id': 'req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.337788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] The token cache is being invalidate because project 0dde06ac62a640da84e25f0ae9080547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:56.338536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.340179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.344364 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3374/6739] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:55 2022] DELETE /identity/v3/projects/0dde06ac62a640da84e25f0ae9080547 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:56.352539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:56.354604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:56.455349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1cfe4-4a18-49e7-8d03-3b606bd06a9e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:56.460320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:56.461271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:56.461638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:56.462087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints/5598c6826671469b8f833ef4943200ec` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:56.463485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:56.466262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:56.466764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:56.467389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:56.469810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=002b0170538c492ead7f5488329411a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.474093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:56.501694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '002b0170538c492ead7f5488329411a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.502368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '002b0170538c492ead7f5488329411a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.503630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5598c6826671469b8f833ef4943200ec)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.505016 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:07:56.505016 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:07:56.505016 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:07:56.506565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:56.534819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5598c6826671469b8f833ef4943200ec', 'request_id': 'req-cef38360-9b1a-46f9-bac4-8f0b2bb53415'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.562042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3366/6740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:56 2022] DELETE /identity/v3/endpoints/5598c6826671469b8f833ef4943200ec => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:56.563665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:56.566034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '002b0170538c492ead7f5488329411a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.568489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '002b0170538c492ead7f5488329411a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.582055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:56.588067 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3375/6741] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:07:56 2022] PATCH /identity/v3/domains/002b0170538c492ead7f5488329411a5 => generated 277 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:07:56.592624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:56.595756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:56.638367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef38360-9b1a-46f9-bac4-8f0b2bb53415 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:56.783494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719909b7-1109-4e7d-85b5-8115d1364a7e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:56.826291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:56.827022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:56.827302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:56.827641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-990913943` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:56.828624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-990913943)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.830072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:56.838863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:56.840053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:56.840673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:56.841008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/domains/002b0170538c492ead7f5488329411a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:56.876083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=002b0170538c492ead7f5488329411a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.879048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:56.879640 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3367/6742] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 22:07:56 2022] DELETE /identity/v3/regions/tempest-region-990913943 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:56.883827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:56.887084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:56.935445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910edb4-7999-4d99-bd0d-ae19b620de18 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:56.936653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '002b0170538c492ead7f5488329411a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.943947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '002b0170538c492ead7f5488329411a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:56.951293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:56.952652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:56.952949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:56.961001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-606820544` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:56.961564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-606820544)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:56.963633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:57.027299 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3368/6743] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 22:07:56 2022] DELETE /identity/v3/regions/tempest-region-606820544 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:57.029192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:57.032246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:57.108922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002b0170538c492ead7f5488329411a5', 'request_id': 'req-de877dc7-2df8-4bca-9a9d-d035a540e6a3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.117498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002b0170538c492ead7f5488329411a5', 'request_id': 'req-de877dc7-2df8-4bca-9a9d-d035a540e6a3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.128547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8153-257d-4f48-9945-f935c09fdbb5 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:57.129461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002b0170538c492ead7f5488329411a5', 'request_id': 'req-de877dc7-2df8-4bca-9a9d-d035a540e6a3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.148275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] The token cache is being invalidate because project 002b0170538c492ead7f5488329411a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:57.148574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.150161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.161210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '002b0170538c492ead7f5488329411a5', 'request_id': 'req-de877dc7-2df8-4bca-9a9d-d035a540e6a3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.165211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '002b0170538c492ead7f5488329411a5', 'request_id': 'req-de877dc7-2df8-4bca-9a9d-d035a540e6a3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.166689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '002b0170538c492ead7f5488329411a5', 'request_id': 'req-de877dc7-2df8-4bca-9a9d-d035a540e6a3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.177383 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3376/6744] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:07:56 2022] DELETE /identity/v3/domains/002b0170538c492ead7f5488329411a5 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:57.178491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:57.180117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:57.185235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:57.186009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:57.186411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:57.186967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:57.190094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:57.342133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:57.343696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:57.377377 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3369/6745] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:57 2022] GET /identity/v3/auth/tokens => generated 4014 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:57.378494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:57.401826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:57.409045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de877dc7-2df8-4bca-9a9d-d035a540e6a3 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:57.438738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:57.439900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:57.440352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:57.440792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] PATH_INFO: `/v3/users/98884898865847848cbd7c9601a4488a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:57.442263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98884898865847848cbd7c9601a4488a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:57.446276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:57.515653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98884898865847848cbd7c9601a4488a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.516690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a20579-b94a-4eef-899a-8a3164b59312 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:57.517273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98884898865847848cbd7c9601a4488a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.533343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:57.534994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:57.535286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:57.535572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/services/a53f71b6b49e4992a50b31d444ba41a1` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:57.536236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a53f71b6b49e4992a50b31d444ba41a1)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:57.537902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:57.541951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98884898865847848cbd7c9601a4488a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.543462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98884898865847848cbd7c9601a4488a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.560742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98884898865847848cbd7c9601a4488a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.593990 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3370/6746] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:57 2022] DELETE /identity/v3/services/a53f71b6b49e4992a50b31d444ba41a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:57.595561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:57.596748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3377/6747] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:57 2022] DELETE /identity/v3/users/98884898865847848cbd7c9601a4488a => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:57.601265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:57.606828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:57.616455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:57.731823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b93d2d-030e-4dbe-a513-69440706b5b5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:57.760346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:57.762072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:57.762369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:57.762690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints/c8c63592c80b4d26adb427f71b2b8e49` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:57.773103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c8c63592c80b4d26adb427f71b2b8e49)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:57.775993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:57.777184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af07d83-99df-4fc4-940d-37cd3e8b3725 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:57.787663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c8c63592c80b4d26adb427f71b2b8e49', 'request_id': 'req-c0e27c2c-c4e0-4495-bbdb-3c4e74eac8eb'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:57.802342 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3378/6748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:57 2022] DELETE /identity/v3/endpoints/c8c63592c80b4d26adb427f71b2b8e49 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:57.806029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77591-137c-4d70-889f-e6bdbdc95443 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:57.806029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77591-137c-4d70-889f-e6bdbdc95443 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:57.807948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77591-137c-4d70-889f-e6bdbdc95443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:57.846006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-73a77591-137c-4d70-889f-e6bdbdc95443 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:57.847653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73a77591-137c-4d70-889f-e6bdbdc95443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:57.922596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:57.923744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:57.924338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:57.924720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/30f043a896b74cc3b6996c2bfe52ac68` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:57.927168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_role(role_id=30f043a896b74cc3b6996c2bfe52ac68)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:57.929566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.000865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 30f043a896b74cc3b6996c2bfe52ac68 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:58.001279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:58.008015 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3379/6749] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:57 2022] POST /identity/v3/auth/tokens => generated 3677 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:58.008286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:58.008801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a77591-137c-4d70-889f-e6bdbdc95443 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.016761 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3371/6750] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:57 2022] DELETE /identity/v3/roles/30f043a896b74cc3b6996c2bfe52ac68 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:58.018239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.020635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.061594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a77591-137c-4d70-889f-e6bdbdc95443 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:58.142711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304dab9-a016-4345-b5cf-5231fb53fc1f tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:58.175655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:58.177313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:58.177610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:58.177991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/e782775841f847dba246f668b6bbf4ca` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:58.185625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e782775841f847dba246f668b6bbf4ca)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:58.192663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.211537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:58.219349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:58.220339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:58.220693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-511372614` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:58.221462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-511372614)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:58.223222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.255757 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3380/6751] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 22:07:58 2022] DELETE /identity/v3/regions/tempest-region-511372614 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:58.257375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.259363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.290380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role e782775841f847dba246f668b6bbf4ca has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:58.290678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:58.291490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:58.298822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3372/6752] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:58 2022] DELETE /identity/v3/roles/e782775841f847dba246f668b6bbf4ca => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:58.298822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.303459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.401191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e531a-a945-4a65-87ee-1639317d751b tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:58.408889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bed03-3af4-4400-a297-c90347b2fb0e tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:58.429612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:58.430875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:58.431536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:58.431881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/services/a9f5699493294f81a3687acc071ba2cc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:58.432611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a9f5699493294f81a3687acc071ba2cc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:58.435371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.470338 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3373/6753] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:58 2022] DELETE /identity/v3/services/a9f5699493294f81a3687acc071ba2cc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:58.471366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.475120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.521060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:58.521740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:58.522036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:58.522337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:58.525102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.566021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4c1da-0ce0-459e-9587-b730188c1d74 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:58.572608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc2b7f6f467d42c49c2f09d97dafe522', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fbc66c4a18240229de26f61022ea49c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:58.573689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:58.574087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:58.574461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] PATH_INFO: `/v3/roles/5d957d3003644823838743c7d145491a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:58.577138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5d957d3003644823838743c7d145491a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:58.579461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.607079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:58.608637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.633826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invalidating the token cache because role 5d957d3003644823838743c7d145491a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:58.635688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:58.636705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:58.640165 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3374/6754] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:58 2022] DELETE /identity/v3/roles/5d957d3003644823838743c7d145491a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:58.641775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.644102 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3381/6755] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:58 2022] GET /identity/v3/auth/tokens => generated 3545 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:58.645212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.646298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.695567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a742b45-81c5-4b5b-8609-f0f781efb6a9 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:58.751805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e4af-6b03-4654-9ff3-120ab741ba22 tempest-RolesV3TestJSON-747560246 tempest-RolesV3TestJSON-747560246-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:58.760546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:58.761231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:58.761636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:58.765173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:58.781885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.884614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:58.885755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:58.886054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:58.886334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/endpoints/fe4953c0175e461cb2b5648f7f871602` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:58.898543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=fe4953c0175e461cb2b5648f7f871602)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:58.901075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.915179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'fe4953c0175e461cb2b5648f7f871602', 'request_id': 'req-8a24e2ea-8b21-4fee-9e21-0c6028113a56'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:58.935665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:58.938242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3382/6756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:07:58 2022] DELETE /identity/v3/endpoints/fe4953c0175e461cb2b5648f7f871602 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:58.939237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.943921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:58.947212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:58.977308 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3375/6757] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:58 2022] GET /identity/v3/auth/tokens => generated 3450 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:58.979168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:58.980709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:59.033320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df55f2-f1f1-4aee-9777-95b91017c08f service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.081552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.082831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.084088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.084088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/regions/tempest-region-2119305822` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.084088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2119305822)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:59.086211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:59.124486 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3376/6758] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 22:07:58 2022] DELETE /identity/v3/regions/tempest-region-2119305822 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:59.128789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:59.171737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24e2ea-8b21-4fee-9e21-0c6028113a56 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.188011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179491ec-9f73-4993-9ef9-235e0b4b1029 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.202838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.203733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.204021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.204298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] PATH_INFO: `/v3/users/5ddfbbda16c5485d957a657e9fe2dd44` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.205552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddfbbda16c5485d957a657e9fe2dd44)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:59.208449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:59.225603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '724254e8d5e4464fa1676f2d40e3ecff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39796839a27841638728e87c7ee65c26', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.227654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.228211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.229247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] PATH_INFO: `/v3/services/2b96ad0a0e1b44d9be5abcddf9644ce7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.230054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2b96ad0a0e1b44d9be5abcddf9644ce7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:59.234155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:59.285102 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3377/6759] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:59 2022] DELETE /identity/v3/services/2b96ad0a0e1b44d9be5abcddf9644ce7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:59.289437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:59.291832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:59.308572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddfbbda16c5485d957a657e9fe2dd44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.309897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddfbbda16c5485d957a657e9fe2dd44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.320576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddfbbda16c5485d957a657e9fe2dd44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.320576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddfbbda16c5485d957a657e9fe2dd44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.343432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddfbbda16c5485d957a657e9fe2dd44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.346994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecab57f-396e-49dc-824f-c7b0962e7e66 tempest-EndPointsTestJSON-1008257480 tempest-EndPointsTestJSON-1008257480-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.355428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.356557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.358102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.358505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] PATH_INFO: `/v3/users/da3025bfa7124f1c8c7030c2700c5572` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.360931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3025bfa7124f1c8c7030c2700c5572)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:59.364738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:59.381438 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3383/6760] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:58 2022] DELETE /identity/v3/users/5ddfbbda16c5485d957a657e9fe2dd44 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:59.382403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:59.384963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:59.452520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3025bfa7124f1c8c7030c2700c5572'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.464059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3025bfa7124f1c8c7030c2700c5572'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.465011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3025bfa7124f1c8c7030c2700c5572'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.468467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3025bfa7124f1c8c7030c2700c5572'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.480291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676f893-985f-4fbf-b1ab-24ca9600b1c6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.488217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.489519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.489519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.490020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] PATH_INFO: `/v3/projects/3391a37a10c644b093470d0b903ff818` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.490169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6cd86538-c1fb-4e95-8d1d-e4c18f3eac0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3025bfa7124f1c8c7030c2700c5572'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.493814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3391a37a10c644b093470d0b903ff818)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:59.496021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:59.545164 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3378/6761] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:59 2022] DELETE /identity/v3/users/da3025bfa7124f1c8c7030c2700c5572 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:59.550548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.552023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.553382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.611281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3391a37a10c644b093470d0b903ff818', 'request_id': 'req-6782673a-f0e7-4c3f-94bc-c59083f8cba3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.627564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:59.640067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:59.642230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3391a37a10c644b093470d0b903ff818', 'request_id': 'req-6782673a-f0e7-4c3f-94bc-c59083f8cba3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.656996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3391a37a10c644b093470d0b903ff818', 'request_id': 'req-6782673a-f0e7-4c3f-94bc-c59083f8cba3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.683204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] The token cache is being invalidate because project 3391a37a10c644b093470d0b903ff818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:07:59.683542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.684858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6782673a-f0e7-4c3f-94bc-c59083f8cba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.690405 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3384/6762] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:07:59 2022] DELETE /identity/v3/projects/3391a37a10c644b093470d0b903ff818 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:59.692247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.692689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.692978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.714280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:07:59.715714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:59.790192 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3379/6763] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:59.792893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:59.797001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:59.799892 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3385/6764] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:07:59.811738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:59.817051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:07:59.831393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3cee7-e9af-4cc9-8041-f3da1e5589ba None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.848978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.850316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.850749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.851166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] PATH_INFO: `/v3/users/cc0d16cdd5c6400ea050868c6fea0754` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.852609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0d16cdd5c6400ea050868c6fea0754)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:59.854878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:59.922963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f508e-a80f-45e6-ab1f-8ec4bc5a7fab None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.927621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.928554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.928855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.929619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.931672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0d16cdd5c6400ea050868c6fea0754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.939539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:07:59.941080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:07:59.943194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0d16cdd5c6400ea050868c6fea0754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.944111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0d16cdd5c6400ea050868c6fea0754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.944877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0d16cdd5c6400ea050868c6fea0754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.955253 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3386/6765] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:07:59.956310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:07:59.963033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0d16cdd5c6400ea050868c6fea0754'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:07:59.978896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc20d-3ad7-46a5-adc9-0b324d207375 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:07:59.992254 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3380/6766] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:07:59 2022] DELETE /identity/v3/users/cc0d16cdd5c6400ea050868c6fea0754 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:07:59.993140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:07:59.994547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:07:59.994547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:07:59.994547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:07:59.999592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:00.019865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:00.021607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:00.033929 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3387/6767] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:00.552963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:00.554802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:00.659268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:00.660921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:00.680161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d13b67-0e79-4548-bf3b-53489948e712 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:00.775109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec005e8b-edb8-440e-85af-04d765916a19 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:00.784668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:00.785864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:00.786232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:00.786566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] PATH_INFO: `/v3/projects/63c9ad0084d14b79976b3b9d05e0909e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:00.799042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c9ad0084d14b79976b3b9d05e0909e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:00.807169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:00.816571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:00.817578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:00.817868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:00.818146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] PATH_INFO: `/v3/projects/459c39a796f143c5867b67501e462aec` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:00.823659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459c39a796f143c5867b67501e462aec)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:00.826431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:00.894372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c9ad0084d14b79976b3b9d05e0909e', 'request_id': 'req-92927074-5e61-492b-b306-83435d2d06e3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:00.908334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c9ad0084d14b79976b3b9d05e0909e', 'request_id': 'req-92927074-5e61-492b-b306-83435d2d06e3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:00.924904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c9ad0084d14b79976b3b9d05e0909e', 'request_id': 'req-92927074-5e61-492b-b306-83435d2d06e3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:00.960712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459c39a796f143c5867b67501e462aec', 'request_id': 'req-9ba33197-b702-4c7c-8982-c4c87b19cb90'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:00.964330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] The token cache is being invalidate because project 63c9ad0084d14b79976b3b9d05e0909e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:00.971139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:00.972811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:00.975596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3381/6768] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:00 2022] DELETE /identity/v3/projects/63c9ad0084d14b79976b3b9d05e0909e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:00.976307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:00.976454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459c39a796f143c5867b67501e462aec', 'request_id': 'req-9ba33197-b702-4c7c-8982-c4c87b19cb90'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:00.977912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:00.999343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459c39a796f143c5867b67501e462aec', 'request_id': 'req-9ba33197-b702-4c7c-8982-c4c87b19cb90'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.013139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] The token cache is being invalidate because project 459c39a796f143c5867b67501e462aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:01.013438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.017375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.023344 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3388/6769] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:00 2022] DELETE /identity/v3/projects/459c39a796f143c5867b67501e462aec => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:01.031102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:01.034453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:01.089846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92927074-5e61-492b-b306-83435d2d06e3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:01.158091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba33197-b702-4c7c-8982-c4c87b19cb90 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:01.174380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:01.175850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:01.178968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:01.179972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:01.180330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:01.180682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] PATH_INFO: `/v3/projects/e256be8c99ba46109347c2cc41b13c37` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:01.182324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e256be8c99ba46109347c2cc41b13c37)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:01.184670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:01.187513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:01.187980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] PATH_INFO: `/v3/users/724254e8d5e4464fa1676f2d40e3ecff` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:01.189945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=724254e8d5e4464fa1676f2d40e3ecff)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:01.199099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:01.279082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e256be8c99ba46109347c2cc41b13c37', 'request_id': 'req-93cb4c49-ce5f-48ba-8333-bd7217393ae8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.291674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e256be8c99ba46109347c2cc41b13c37', 'request_id': 'req-93cb4c49-ce5f-48ba-8333-bd7217393ae8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.296011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724254e8d5e4464fa1676f2d40e3ecff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.297087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724254e8d5e4464fa1676f2d40e3ecff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.308268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724254e8d5e4464fa1676f2d40e3ecff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.310226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724254e8d5e4464fa1676f2d40e3ecff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.310358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e256be8c99ba46109347c2cc41b13c37', 'request_id': 'req-93cb4c49-ce5f-48ba-8333-bd7217393ae8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.326508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6e5442aa-eea4-4189-a072-7f19b2ec5061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724254e8d5e4464fa1676f2d40e3ecff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.336079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] The token cache is being invalidate because project e256be8c99ba46109347c2cc41b13c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:01.336404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.337143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.345425 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3382/6770] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:00 2022] DELETE /identity/v3/projects/e256be8c99ba46109347c2cc41b13c37 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:01.346504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:01.348016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:01.360680 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3389/6771] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:01 2022] DELETE /identity/v3/users/724254e8d5e4464fa1676f2d40e3ecff => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:01.360680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb855b9-39b9-4a8d-94ab-85f1aed28a34 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:01.360680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb855b9-39b9-4a8d-94ab-85f1aed28a34 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:01.360680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb855b9-39b9-4a8d-94ab-85f1aed28a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:01.383645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bdb855b9-39b9-4a8d-94ab-85f1aed28a34 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:01.384889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bdb855b9-39b9-4a8d-94ab-85f1aed28a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:01.446936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb4c49-ce5f-48ba-8333-bd7217393ae8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:01.515290 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3390/6772] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:01.518130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd960-559a-452a-b646-23e534724287 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:01.518130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd960-559a-452a-b646-23e534724287 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:01.518352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd960-559a-452a-b646-23e534724287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:01.553623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:01.555024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:01.557269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:01.557665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] PATH_INFO: `/v3/users/bc2b7f6f467d42c49c2f09d97dafe522` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:01.560004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2b7f6f467d42c49c2f09d97dafe522)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:01.563915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:01.596871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d15fd960-559a-452a-b646-23e534724287 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:01.612855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d15fd960-559a-452a-b646-23e534724287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:01.630914 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3391/6773] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:01.635673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd960-559a-452a-b646-23e534724287 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:01.658738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd960-559a-452a-b646-23e534724287 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:01.677966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:01.678247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2b7f6f467d42c49c2f09d97dafe522'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.679128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:01.679584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:01.680072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:01.680983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:01.681744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:01.683645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:01.689014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2b7f6f467d42c49c2f09d97dafe522'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.689841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2b7f6f467d42c49c2f09d97dafe522'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.691937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2b7f6f467d42c49c2f09d97dafe522'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.699721 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3392/6774] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:01.703920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:01.707200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:01.708510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2b7f6f467d42c49c2f09d97dafe522'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:01.724563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aee176-13e6-4316-99c2-8b0a433358e6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:01.733189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:01.734135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:01.734585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:01.735079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:01.736221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:01.738345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:01.755987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3383/6775] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:01 2022] DELETE /identity/v3/users/bc2b7f6f467d42c49c2f09d97dafe522 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:01.776907 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3393/6776] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:01 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:08:01.780576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:01.842295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:01.844572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:01.942566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440a498-834d-43c4-85e7-288f4f05ed18 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.023164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b41089-501d-4a63-a5ac-c6e4cf2649d4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.029041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.030060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.030576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.030830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] PATH_INFO: `/v3/projects/39796839a27841638728e87c7ee65c26` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.032429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=39796839a27841638728e87c7ee65c26)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.035646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.066918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.068228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.068755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.069040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.069752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.072365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.116227 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3384/6777] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:01 2022] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:02.120270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.135882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb858f-659f-43cc-b6b5-6fb916f92958 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.138230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39796839a27841638728e87c7ee65c26', 'request_id': 'req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.156103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39796839a27841638728e87c7ee65c26', 'request_id': 'req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.168112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39796839a27841638728e87c7ee65c26', 'request_id': 'req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.191863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] The token cache is being invalidate because project 39796839a27841638728e87c7ee65c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:02.192162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.200869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0de2956d-5293-41a5-ba2f-e1d12a2cbafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.200869 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3394/6778] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:01 2022] DELETE /identity/v3/projects/39796839a27841638728e87c7ee65c26 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:02.202380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714556f-83ac-434d-9c05-85f0bea0037d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.203805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714556f-83ac-434d-9c05-85f0bea0037d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.204091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714556f-83ac-434d-9c05-85f0bea0037d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.207202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.207986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.208497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.208885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.210928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.212241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.227233 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3385/6779] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:02.228224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.231532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.246916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1714556f-83ac-434d-9c05-85f0bea0037d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:02.246916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1714556f-83ac-434d-9c05-85f0bea0037d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.247250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51aa5-6b21-4cb1-9ec3-9dc3c90c167b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.253736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.254688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.260195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.261837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.265813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.265813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.280508 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3386/6780] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:02.281603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.283980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.287987 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3395/6781] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:02.289033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714556f-83ac-434d-9c05-85f0bea0037d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.330608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f1e2d-aacc-47a9-a6ef-02788d0e43c8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.335697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714556f-83ac-434d-9c05-85f0bea0037d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.346026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d9db7-c8bd-4613-b529-fae97f390cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.347563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9db7-c8bd-4613-b529-fae97f390cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.347947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9db7-c8bd-4613-b529-fae97f390cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.348596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d9db7-c8bd-4613-b529-fae97f390cd6 admin admin] PATH_INFO: `/v3/projects/ada272cf0693430583f1dc2c0e59c479/users/97be6b6eca8f4da6bbae59449ff0ed2f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.363613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.364669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.367154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.367671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] PATH_INFO: `/v3/projects/2fbc66c4a18240229de26f61022ea49c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.370098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbc66c4a18240229de26f61022ea49c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.372358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.385976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d9db7-c8bd-4613-b529-fae97f390cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada272cf0693430583f1dc2c0e59c479, user_id=97be6b6eca8f4da6bbae59449ff0ed2f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.392298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d9db7-c8bd-4613-b529-fae97f390cd6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.417783 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3396/6782] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:02 2022] PUT /identity/v3/projects/ada272cf0693430583f1dc2c0e59c479/users/97be6b6eca8f4da6bbae59449ff0ed2f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:02.423227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb674b-e1cc-43eb-a8ad-4d20a071cd57 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.423516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb674b-e1cc-43eb-a8ad-4d20a071cd57 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.426365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb674b-e1cc-43eb-a8ad-4d20a071cd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.458048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbc66c4a18240229de26f61022ea49c', 'request_id': 'req-d2af353d-274b-4688-b56e-14f485b68425'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.464160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1efb674b-e1cc-43eb-a8ad-4d20a071cd57 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:02.466435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbc66c4a18240229de26f61022ea49c', 'request_id': 'req-d2af353d-274b-4688-b56e-14f485b68425'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.473244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1efb674b-e1cc-43eb-a8ad-4d20a071cd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.487099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbc66c4a18240229de26f61022ea49c', 'request_id': 'req-d2af353d-274b-4688-b56e-14f485b68425'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.512665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] The token cache is being invalidate because project 2fbc66c4a18240229de26f61022ea49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:02.513039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.513849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2af353d-274b-4688-b56e-14f485b68425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:02.515908 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3387/6783] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:02 2022] DELETE /identity/v3/projects/2fbc66c4a18240229de26f61022ea49c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:02.517641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e48e5-86ae-4467-9849-39192b4ac250 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.518033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e48e5-86ae-4467-9849-39192b4ac250 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.518402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e48e5-86ae-4467-9849-39192b4ac250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.581967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4f8e48e5-86ae-4467-9849-39192b4ac250 None None] MFA Rules not processed for user `97be6b6eca8f4da6bbae59449ff0ed2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:02.583260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4f8e48e5-86ae-4467-9849-39192b4ac250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.627775 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3397/6784] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:02.629400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c04a6-6837-4d04-8428-db3bcccd8672 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.630160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c04a6-6837-4d04-8428-db3bcccd8672 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.630829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c04a6-6837-4d04-8428-db3bcccd8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.656799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-916c04a6-6837-4d04-8428-db3bcccd8672 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:02.658733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-916c04a6-6837-4d04-8428-db3bcccd8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.675148 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3398/6785] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:02.675148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c04a6-6837-4d04-8428-db3bcccd8672 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.686551 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3388/6786] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:02.687793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ca820-38a8-4adc-81ce-a4f1766d7e07 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.688087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ca820-38a8-4adc-81ce-a4f1766d7e07 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.688397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ca820-38a8-4adc-81ce-a4f1766d7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.691381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c04a6-6837-4d04-8428-db3bcccd8672 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.696378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.697644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.697788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.698161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.698947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:02.699251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.701647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.711948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1b0ca820-38a8-4adc-81ce-a4f1766d7e07 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:02.713453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b0ca820-38a8-4adc-81ce-a4f1766d7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.714520 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3399/6787] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:02.719921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.723965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:02.728255 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3389/6788] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:02.729183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ca820-38a8-4adc-81ce-a4f1766d7e07 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.741123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ca820-38a8-4adc-81ce-a4f1766d7e07 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.741925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ca29a-e634-4db8-a6b8-d5751375ba17 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.747626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.748146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.748437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.748717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.748870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.749526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.749691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.749955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.750240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.750993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.752083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.753895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.796889 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3400/6789] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:02.797648 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3390/6790] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:02.797807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.799341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.889464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88d967-fb4a-4983-a593-ce665b3e4a65 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.942102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb83180-1298-41a7-b8c5-ddd7b5ad6e51 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:02.948992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:02.951266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:02.951649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:02.952026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:02.953970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:02.954396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:02.958023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:02.981663 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3401/6791] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:02.982525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:02.997304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b4769-cdf6-487b-b056-97695f0aa6b5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.005282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.006029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.007042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.007341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.008103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.010208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.011802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.013673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.013673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.013673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.016797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.023563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.041192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3402/6792] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/users => generated 306 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:03.044001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.057418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee8e7d-2c3c-44d6-b3f3-d292ca5452ad admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.062045 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3391/6793] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:02 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:03.063350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.065532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.066656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.067219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.068226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.069173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.072208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.075685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f17cea-1a08-43f8-afc7-1c03fc22d4ad admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.083065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.083895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.084184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.084512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.085307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.087422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.115711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3392/6794] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:03.118597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.128423 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3403/6795] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:03 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:03.128423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.151890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298f060-b0f5-40ee-ae88-b063f973472d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.268250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.269001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.269289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.269569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.270302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.272450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.272625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df694211-22f3-46a7-9806-7cba0a91598e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.278874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.280974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.281296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.281590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] PATH_INFO: `/v3/projects/5fab2e2282ac4883bd4ec4001e3c33ee/users/7d9dacd7a5d94286b6337a4dabde4057/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.292255 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3393/6796] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:03.292255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.304536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b436a-5876-4c33-a73d-4168a3a1758f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.306490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fab2e2282ac4883bd4ec4001e3c33ee, user_id=7d9dacd7a5d94286b6337a4dabde4057, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.310892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.311246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.311581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.311869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.312149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.313056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.315399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.328394 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3404/6797] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:03 2022] PUT /identity/v3/projects/5fab2e2282ac4883bd4ec4001e3c33ee/users/7d9dacd7a5d94286b6337a4dabde4057/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:03.329710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.356887 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3394/6798] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:03 2022] POST /identity/v3/users => generated 285 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:03.356887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.377505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816d161-1b00-4542-a4f0-938f9578e873 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.432936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325176b0-fd29-44cc-ae2e-5f5df1859c19 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.440969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.442165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.442510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.443030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.444020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.462729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.470864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.471767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.472147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.472588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.473758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.476162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.485976 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3405/6799] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:03.487499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.490784 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3395/6800] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:03.492653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.495428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:03.500703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f15c6-4258-40a0-aab7-f499511f1639 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.508307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.509511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.510396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.511885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a083ae0-288e-4470-b9d7-84752413aae2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.512381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.513733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.515754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.518922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.519985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.520364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.520734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] PATH_INFO: `/v3/users/371ab34d1e4a4cb299a2479b648b1f21` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.523413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371ab34d1e4a4cb299a2479b648b1f21)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.525464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.535152 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3406/6801] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:03.536300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.554108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c06cb5-3106-4aec-b606-0ac524bf4ea7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.565042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.567226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.567705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.568297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] PATH_INFO: `/v3/projects/9dc61bcebaca411f8e8109f31dcf2460/users/8b3e45af51a2460886a8784e5ec0a823/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.594340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc61bcebaca411f8e8109f31dcf2460, user_id=8b3e45af51a2460886a8784e5ec0a823, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.595007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371ab34d1e4a4cb299a2479b648b1f21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:03.601299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.603995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371ab34d1e4a4cb299a2479b648b1f21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:03.604826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371ab34d1e4a4cb299a2479b648b1f21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:03.605540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371ab34d1e4a4cb299a2479b648b1f21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:03.633708 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3407/6802] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:03 2022] PUT /identity/v3/projects/9dc61bcebaca411f8e8109f31dcf2460/users/8b3e45af51a2460886a8784e5ec0a823/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:03.636192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.640602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371ab34d1e4a4cb299a2479b648b1f21'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:03.641669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:03.674131 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3396/6803] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:03 2022] DELETE /identity/v3/users/371ab34d1e4a4cb299a2479b648b1f21 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:03.675191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.677236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:03.787080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870b99-3bc6-4b58-8e80-384c28d13560 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.792708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39894f-5afa-4315-8c10-72cd5cfce531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.793967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39894f-5afa-4315-8c10-72cd5cfce531 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.794252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39894f-5afa-4315-8c10-72cd5cfce531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.794531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39894f-5afa-4315-8c10-72cd5cfce531 admin admin] PATH_INFO: `/v3/projects/5fab2e2282ac4883bd4ec4001e3c33ee/users/7d9dacd7a5d94286b6337a4dabde4057/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.796641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39894f-5afa-4315-8c10-72cd5cfce531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fab2e2282ac4883bd4ec4001e3c33ee, user_id=7d9dacd7a5d94286b6337a4dabde4057, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.799517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39894f-5afa-4315-8c10-72cd5cfce531 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.807400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df860e4-d2ea-465d-b158-ffe55e573688 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:03.823873 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3408/6804] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:03 2022] PUT /identity/v3/projects/5fab2e2282ac4883bd4ec4001e3c33ee/users/7d9dacd7a5d94286b6337a4dabde4057/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:03.823873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0393-f77d-411d-a49a-0a957ec18a8d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.823873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0393-f77d-411d-a49a-0a957ec18a8d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.823873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0393-f77d-411d-a49a-0a957ec18a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.878732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-90fa0393-f77d-411d-a49a-0a957ec18a8d None None] MFA Rules not processed for user `8b3e45af51a2460886a8784e5ec0a823`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:03.880294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-90fa0393-f77d-411d-a49a-0a957ec18a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:03.914134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e65d7-31b2-4aee-8504-16f71f07ae2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:03.915135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e65d7-31b2-4aee-8504-16f71f07ae2d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.915900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e65d7-31b2-4aee-8504-16f71f07ae2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.916262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e65d7-31b2-4aee-8504-16f71f07ae2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.917217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e65d7-31b2-4aee-8504-16f71f07ae2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:03.920698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e65d7-31b2-4aee-8504-16f71f07ae2d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:03.938256 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3397/6805] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:03.941034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5c9b1-ebfa-47fe-ac6e-a269c66505b4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.942142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5c9b1-ebfa-47fe-ac6e-a269c66505b4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.942536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5c9b1-ebfa-47fe-ac6e-a269c66505b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.963538 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3409/6806] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:03.964994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ccf5c9b1-ebfa-47fe-ac6e-a269c66505b4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:03.966714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:03.967118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ccf5c9b1-ebfa-47fe-ac6e-a269c66505b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:03.967505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:03.967991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:03.977973 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3398/6807] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:03.982396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5c9b1-ebfa-47fe-ac6e-a269c66505b4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:03.994986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5c9b1-ebfa-47fe-ac6e-a269c66505b4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.006126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.007808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.008698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.009089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] PATH_INFO: `/v3/projects/5107020e7b9d4876bba13abc8b3348d9/users/9c38d1af3db74471a0de37a563d1398a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.011553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] MFA Rules not processed for user `7d9dacd7a5d94286b6337a4dabde4057`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:04.013334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:04.037894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5107020e7b9d4876bba13abc8b3348d9, user_id=9c38d1af3db74471a0de37a563d1398a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.042509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.072114 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3399/6808] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:03 2022] PUT /identity/v3/projects/5107020e7b9d4876bba13abc8b3348d9/users/9c38d1af3db74471a0de37a563d1398a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:04.072114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.074753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:04.145851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3410/6809] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:04.145851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.147785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:04.162133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c5214-1457-48c7-8e63-22e9b492f415 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.168777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c9168-ea63-47b1-bdbe-0ae47d70970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.169448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9168-ea63-47b1-bdbe-0ae47d70970c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.169734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9168-ea63-47b1-bdbe-0ae47d70970c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.170009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9168-ea63-47b1-bdbe-0ae47d70970c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.170700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c9168-ea63-47b1-bdbe-0ae47d70970c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.173616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c9168-ea63-47b1-bdbe-0ae47d70970c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.217080 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3400/6810] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:04 2022] POST /identity/v3/projects => generated 395 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:04.220406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.220406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.220406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.228260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc644-59e2-45be-b4d3-689a144271b1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.251008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] MFA Rules not processed for user `9c38d1af3db74471a0de37a563d1398a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:04.252579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:04.300514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.302319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.302679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.303491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.329968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3401/6811] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:04.331799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.334152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:04.411050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.412900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.425443 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3411/6812] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:04.426384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.441205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cafee1-c94a-4978-ad92-1350a9869fa4 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.451911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.452776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.453114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.453390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.454157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.456302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.472076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7875-caa6-4a08-b1df-415b67804dfd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.478976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.479706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.480001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.480278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.486422 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3412/6813] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:04 2022] POST /identity/v3/users => generated 304 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:04.486422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.499796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1fe06-5df0-42d8-b4ef-91a0d599d319 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.505342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.505983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.506212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.506497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.507267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.510142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.563713 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3413/6814] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:04 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:04.563713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.593910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.596219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.629577 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3402/6815] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:04 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:04.630483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.653497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979be15-126a-46f4-b112-f441cf86f79f service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.685597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845e6b-9fc1-4fd8-b90a-f87583a98cf0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.691535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.693117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.693620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.694108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.695095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.698036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.712997 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3414/6816] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:04.718801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.740974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb6d6-9e98-413d-aec6-5c453c512300 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.767304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.770135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.770604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.772341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] PATH_INFO: `/v3/projects/0652ce3844234e669a65b104c4f34529/users/ee1a40d1130140adb04f862b02696fe4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.803790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.804711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.805036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0652ce3844234e669a65b104c4f34529, user_id=ee1a40d1130140adb04f862b02696fe4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.807965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.808456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.808816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.811336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:04.816518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:04.835320 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3415/6817] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:04 2022] PUT /identity/v3/projects/0652ce3844234e669a65b104c4f34529/users/ee1a40d1130140adb04f862b02696fe4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:04.836156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.865251 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3403/6818] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:04 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:04.865989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:04.904103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5b026-55a3-483f-8b8d-d98082c08b65 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.942692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c44d99-8b9a-425a-80d3-48f9bd3bf671 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:04.955778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:04.956458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:04.956798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:04.957086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:04.964601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:05.066190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.070207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.070733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.071204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.072269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.074290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.086936 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3404/6819] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:05.087807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.093808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.095707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.098317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def01cc-91b7-4d04-aeb3-5de019920155 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.104855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.105580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.105876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.106156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.107115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.108751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.112891 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3416/6820] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:05.122392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.127525 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3405/6821] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:05.128229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:05.128414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.141522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c580d-5b81-4422-93a5-49130d57ced7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.157423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.158562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.158730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228937-5be6-4c09-a9cf-486099b0081c service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.159588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.160073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] PATH_INFO: `/v3/projects/0652ce3844234e669a65b104c4f34529/users/ee1a40d1130140adb04f862b02696fe4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.163324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0652ce3844234e669a65b104c4f34529, user_id=ee1a40d1130140adb04f862b02696fe4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.170068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.171352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.173095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.177560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.178130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] PATH_INFO: `/v3/projects/57a0ca9121124ab694106520a0e9e439` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.181691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a0ca9121124ab694106520a0e9e439)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.184410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.207459 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3406/6822] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:05 2022] PUT /identity/v3/projects/0652ce3844234e669a65b104c4f34529/users/ee1a40d1130140adb04f862b02696fe4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:05.207459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.331048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a0ca9121124ab694106520a0e9e439', 'request_id': 'req-0371eb8e-54ac-42d3-91c3-c38ae0baf851'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.340124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a0ca9121124ab694106520a0e9e439', 'request_id': 'req-0371eb8e-54ac-42d3-91c3-c38ae0baf851'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.352601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a0ca9121124ab694106520a0e9e439', 'request_id': 'req-0371eb8e-54ac-42d3-91c3-c38ae0baf851'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.353616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9200-5f59-444f-8e48-87f2d27d94e6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.380290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] The token cache is being invalidate because project 57a0ca9121124ab694106520a0e9e439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:05.380620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.381895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0371eb8e-54ac-42d3-91c3-c38ae0baf851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.385686 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3417/6823] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:05 2022] DELETE /identity/v3/projects/57a0ca9121124ab694106520a0e9e439 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:05.388232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.388232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.388232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.440122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] MFA Rules not processed for user `ee1a40d1130140adb04f862b02696fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:05.441528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:05.464200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.468615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.469107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.469372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] PATH_INFO: `/v3/projects/f97a7403fdce4830bc242236241054a3/users/caf3233d015546359bc5fec82969ee1c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.490008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97a7403fdce4830bc242236241054a3, user_id=caf3233d015546359bc5fec82969ee1c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.493284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.524325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3407/6824] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:05 2022] PUT /identity/v3/projects/f97a7403fdce4830bc242236241054a3/users/caf3233d015546359bc5fec82969ee1c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:05.525346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.530334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:05.570669 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3418/6825] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:05.571605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.573194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:05.611260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e94efe-37a3-4089-8bc3-3faece4ac2e2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.632234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42744f-2ae4-4aa3-a9c9-851342a672f2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.638590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.640202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.640563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.640919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] PATH_INFO: `/v3/users/201cc02ed186467b96e0ab11e71be9d2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.642405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=201cc02ed186467b96e0ab11e71be9d2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.645271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.695412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.696427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.696812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.697315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.698267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.700095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.714244 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3419/6826] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:05.715362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.717400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:05.718080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201cc02ed186467b96e0ab11e71be9d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.728864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201cc02ed186467b96e0ab11e71be9d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.729691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201cc02ed186467b96e0ab11e71be9d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.730381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201cc02ed186467b96e0ab11e71be9d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.742723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201cc02ed186467b96e0ab11e71be9d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:05.766537 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3408/6827] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:05 2022] DELETE /identity/v3/users/201cc02ed186467b96e0ab11e71be9d2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:05.767765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.769268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:05.831163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fa1d8-47b7-47b2-99c8-f5ef5c1aa47b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.904019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe565b-f775-4c15-8dd5-bab618d1fd6d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:05.910104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058ed03-5f21-4fd6-b1c7-93cb36631814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.911268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058ed03-5f21-4fd6-b1c7-93cb36631814 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.912261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058ed03-5f21-4fd6-b1c7-93cb36631814 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.912261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058ed03-5f21-4fd6-b1c7-93cb36631814 admin admin] PATH_INFO: `/v3/projects/f97a7403fdce4830bc242236241054a3/users/caf3233d015546359bc5fec82969ee1c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.914547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058ed03-5f21-4fd6-b1c7-93cb36631814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97a7403fdce4830bc242236241054a3, user_id=caf3233d015546359bc5fec82969ee1c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.917683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058ed03-5f21-4fd6-b1c7-93cb36631814 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:05.926230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b3e45af51a2460886a8784e5ec0a823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dc61bcebaca411f8e8109f31dcf2460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:05.928668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.929074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.929450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.931750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:05.951034 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3409/6828] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:05 2022] PUT /identity/v3/projects/f97a7403fdce4830bc242236241054a3/users/caf3233d015546359bc5fec82969ee1c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:05.953001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7230c-9d8c-4d3f-b3e7-0deaad8fd982 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:05.957481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7230c-9d8c-4d3f-b3e7-0deaad8fd982 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:05.961202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7230c-9d8c-4d3f-b3e7-0deaad8fd982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post May 07 22:08:05.961570 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. May 07 22:08:05.962598 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:05.973939 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3420/6829] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:08:05 2022] POST /identity/v3/projects => generated 136 bytes in 259 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 07 22:08:05.974923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:05.982328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:06.033717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-07d7230c-9d8c-4d3f-b3e7-0deaad8fd982 None None] MFA Rules not processed for user `caf3233d015546359bc5fec82969ee1c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:06.035456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-07d7230c-9d8c-4d3f-b3e7-0deaad8fd982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:06.121571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff060b45-38d4-474b-b2c7-eca853fbf5db tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.150590 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3410/6830] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:06.156835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7230c-9d8c-4d3f-b3e7-0deaad8fd982 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.169126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7230c-9d8c-4d3f-b3e7-0deaad8fd982 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.174302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf3233d015546359bc5fec82969ee1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97a7403fdce4830bc242236241054a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.175137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.176332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.176332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.177193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.179959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.202278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1a40d1130140adb04f862b02696fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0652ce3844234e669a65b104c4f34529', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.202989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.203287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.203576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.204264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.206193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Invalid input for field 'name': '' is too short May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'minLength' in schema['properties']['name']: May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: On instance['name']: May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'minLength' in schema['properties']['name']: May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: On instance['name']: May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: '' May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise error May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['name']: May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application '' May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.213039 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:08:06.214757 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['name']: May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application '' May 07 22:08:06.216900 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.221106 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3421/6831] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:08:05 2022] POST /identity/v3/projects => generated 283 bytes in 246 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:08:06.222016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.237836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4e407-181d-473d-b2dc-985cd91b1ed7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.243639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1a40d1130140adb04f862b02696fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0652ce3844234e669a65b104c4f34529', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.244325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.244621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.244909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.245608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.247616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'maxLength' in schema['properties']['name']: May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: On instance['name']: May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'maxLength' in schema['properties']['name']: May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: On instance['name']: May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise error May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 07 22:08:06.254901 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['name']: May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:06.256206 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['name']: May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 07 22:08:06.257287 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.263650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3422/6832] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:08:06 2022] POST /identity/v3/projects => generated 412 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:08:06.264952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.269692 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3411/6833] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:06 2022] POST /identity/v3/projects => generated 360 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:06.271261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.280219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078ab99-61d7-49f4-a560-3be2f241cddf tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.399011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1a40d1130140adb04f862b02696fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0652ce3844234e669a65b104c4f34529', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.399990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.400290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.400580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] PATH_INFO: `/v3/projects/33d45595ebcb455c9dceeda2e724ae59` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.403326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c00e72-11d0-4054-9880-62f5367a01e7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.410654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorizing `identity:delete_project(project_id=33d45595ebcb455c9dceeda2e724ae59)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.413089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.416752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf3233d015546359bc5fec82969ee1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97a7403fdce4830bc242236241054a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.417566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.419710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.420110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.420970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.426375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Could not find project: 33d45595ebcb455c9dceeda2e724ae59.: keystone.exception.ProjectNotFound: Could not find project: 33d45595ebcb455c9dceeda2e724ae59. May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 07 22:08:06.440743 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 33d45595ebcb455c9dceeda2e724ae59. May 07 22:08:06.442002 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:06.444264 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3423/6834] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:06 2022] DELETE /identity/v3/projects/33d45595ebcb455c9dceeda2e724ae59 => generated 113 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:08:06.445113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.447260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:06.482820 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3412/6835] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:06 2022] POST /identity/v3/users => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:06.483958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.487411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:06.555708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df1e4f-e39b-4123-b9a5-9c06071eef20 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.565951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.566860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.567149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.567732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] PATH_INFO: `/v3/projects/0d4d7bfcbafc4b53b0ec59e03b73d227` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.569234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4d7bfcbafc4b53b0ec59e03b73d227)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.572366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.634262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acd6d1-14c0-45ce-807c-1ce33964f1d7 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.642301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b3e45af51a2460886a8784e5ec0a823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dc61bcebaca411f8e8109f31dcf2460', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.643261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.644023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.644023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.645362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get May 07 22:08:06.656537 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._list_projects() May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. May 07 22:08:06.657585 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:08:06.664558 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3413/6836] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 22:08:06 2022] GET /identity/v3/projects => generated 135 bytes in 181 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) May 07 22:08:06.665922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.677923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4d7bfcbafc4b53b0ec59e03b73d227', 'request_id': 'req-57eaa527-e07a-4c13-adde-0143445650e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:06.685252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25b8f1-33df-4bea-8f09-8605fad3940b tempest-ProjectsNegativeStaticTestJSON-1296216292 tempest-ProjectsNegativeStaticTestJSON-1296216292-project] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.692729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4d7bfcbafc4b53b0ec59e03b73d227', 'request_id': 'req-57eaa527-e07a-4c13-adde-0143445650e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:06.726510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4d7bfcbafc4b53b0ec59e03b73d227', 'request_id': 'req-57eaa527-e07a-4c13-adde-0143445650e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:06.751431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] The token cache is being invalidate because project 0d4d7bfcbafc4b53b0ec59e03b73d227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:06.751742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:06.752674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:06.755218 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3424/6837] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:06 2022] DELETE /identity/v3/projects/0d4d7bfcbafc4b53b0ec59e03b73d227 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:06.756276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.764205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:06.788122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf3233d015546359bc5fec82969ee1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97a7403fdce4830bc242236241054a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.803377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.803952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.805147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.808487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:06.809518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.815891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.851117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eaa527-e07a-4c13-adde-0143445650e3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:06.857989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1a40d1130140adb04f862b02696fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0652ce3844234e669a65b104c4f34529', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:06.858967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:06.859340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:06.859800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:06.860945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:06.863485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:06.865022 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3414/6838] 10.222.0.32 () {58 vars in 1156 bytes} [Sat May 7 22:08:06 2022] GET /identity/v3/users?domain_id=default => generated 8899 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:06.866495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.868405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:06.924619 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3425/6839] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:06 2022] POST /identity/v3/projects => generated 356 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:06.924619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:06.924619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:06.984038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483cea-697f-4bf8-b8aa-57356b4efcf6 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:07.026054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cf7fe-db91-4e71-a20d-3cb5fbebc7c7 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:07.034663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf3233d015546359bc5fec82969ee1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97a7403fdce4830bc242236241054a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:07.036733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.037033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.037315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] PATH_INFO: `/v3/users/5b17d33033a846e093305da210cdf13c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.065166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorizing `identity:update_user(user_id=5b17d33033a846e093305da210cdf13c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:07.068113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:07.100713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:07.102828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.103114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.103387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] PATH_INFO: `/v3/users/b407240a2a064ebc9712506f9057925c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.105348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b407240a2a064ebc9712506f9057925c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:07.107371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:07.124419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5b17d33033a846e093305da210cdf13c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.143804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invalidating the token cache because user 5b17d33033a846e093305da210cdf13c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:07.144362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.149093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.154420 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3426/6840] 10.222.0.32 () {60 vars in 1243 bytes} [Sat May 7 22:08:06 2022] PATCH /identity/v3/users/5b17d33033a846e093305da210cdf13c => generated 488 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:07.158266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:07.163134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:07.234953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b407240a2a064ebc9712506f9057925c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.246328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b407240a2a064ebc9712506f9057925c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.246981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b407240a2a064ebc9712506f9057925c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.247835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b407240a2a064ebc9712506f9057925c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.270852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93be8151-7d9f-49a1-b4f7-3fdf45d5a5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b407240a2a064ebc9712506f9057925c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.286541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af50e33-63bc-4b37-9dde-b6ebcbf58b74 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:07.292323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1a40d1130140adb04f862b02696fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0652ce3844234e669a65b104c4f34529', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:07.293177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.293534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.293897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.297018 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3415/6841] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:06 2022] DELETE /identity/v3/users/b407240a2a064ebc9712506f9057925c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:07.297168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:07.297365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.297365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.297365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.297655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:07.313589 ncdv-master-1 devstack@keystone.service[91075]: WARNING keystone.auth.plugins.core [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] User is disabled: 5b17d33033a846e093305da210cdf13c: AssertionError: User is disabled: 5b17d33033a846e093305da210cdf13c May 07 22:08:07.325156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.sql.core [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-76057017' for key 'project.ixu_project_name_domain_id'") May 07 22:08:07.325156 ncdv-master-1 devstack@keystone.service[91076]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 07 22:08:07.325156 ncdv-master-1 devstack@keystone.service[91076]: [parameters: {'id': 'd337ec83e1bb46e78c6acc05b7ba9556', 'name': 'tempest-project-dup-76057017', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 07 22:08:07.325156 ncdv-master-1 devstack@keystone.service[91076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 07 22:08:07.327448 ncdv-master-1 devstack@keystone.service[91075]: WARNING keystone.server.flask.application [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. May 07 22:08:07.332265 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3416/6842] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:07 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 34 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 07 22:08:07.334529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:07.336891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-76057017, project id d337ec83e1bb46e78c6acc05b7ba9556.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-76057017, project id d337ec83e1bb46e78c6acc05b7ba9556. May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._query(query) May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application conn.query(q) May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 22:08:07.340251 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result.read() May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-76057017' for key 'project.ixu_project_name_domain_id'") May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 07 22:08:07.341125 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return project_ref.to_dict() May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application next(self.gen) May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application yield resource May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application next(self.gen) May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.session.rollback() May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.force_reraise() May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise self.value May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 07 22:08:07.342170 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application session.commit() May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._prepare_impl() May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.session.flush() May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._flush(objects) May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application compat.raise_( May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application flush_context.execute() May 07 22:08:07.343386 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rec.execute(self) May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application _emit_insert_statements( May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application c = connection._execute_20( May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ret = self._execute_context( May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 07 22:08:07.344401 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.dialect.do_execute( May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._query(query) May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application conn.query(q) May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result.read() May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 07 22:08:07.345411 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application packet.raise_for_error() May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-76057017' for key 'project.ixu_project_name_domain_id'") May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [parameters: {'id': 'd337ec83e1bb46e78c6acc05b7ba9556', 'name': 'tempest-project-dup-76057017', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:07.346409 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-76057017 at domain ID default. May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:07.353633 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.Conflict( May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-76057017, project id d337ec83e1bb46e78c6acc05b7ba9556. May 07 22:08:07.355211 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:07.358829 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3427/6843] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:08:07 2022] POST /identity/v3/projects => generated 283 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 07 22:08:07.360158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:07.368375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:07.387838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b666b5-2a1d-4962-b6df-f0499a815d14 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:07.438082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3180b77-25ca-4571-a11c-011a636e35dc None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:07.443665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf3233d015546359bc5fec82969ee1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97a7403fdce4830bc242236241054a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:07.447794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.448575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.448884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] PATH_INFO: `/v3/users/5b17d33033a846e093305da210cdf13c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.473948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5b17d33033a846e093305da210cdf13c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:07.477569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:07.527628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1a40d1130140adb04f862b02696fe4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0652ce3844234e669a65b104c4f34529', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:07.528604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.528895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.529178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] PATH_INFO: `/v3/projects/19ff76083d384ae092dee1bceb67e62e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.530523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19ff76083d384ae092dee1bceb67e62e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:07.532978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:07.564373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b17d33033a846e093305da210cdf13c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.583505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b17d33033a846e093305da210cdf13c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.584281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b17d33033a846e093305da210cdf13c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.584922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b17d33033a846e093305da210cdf13c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.601112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ff76083d384ae092dee1bceb67e62e', 'request_id': 'req-3fba69a9-7b39-45fa-86d2-d92f99682be1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.603671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b17d33033a846e093305da210cdf13c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.630003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ff76083d384ae092dee1bceb67e62e', 'request_id': 'req-3fba69a9-7b39-45fa-86d2-d92f99682be1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.652898 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3417/6844] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:07 2022] DELETE /identity/v3/users/5b17d33033a846e093305da210cdf13c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:07.654908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ff76083d384ae092dee1bceb67e62e', 'request_id': 'req-3fba69a9-7b39-45fa-86d2-d92f99682be1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.655708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:07.659425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:07.681252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] The token cache is being invalidate because project 19ff76083d384ae092dee1bceb67e62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:07.682609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.684396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.686530 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3428/6845] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:07 2022] DELETE /identity/v3/projects/19ff76083d384ae092dee1bceb67e62e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:07.691221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:07.692621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:07.768784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd55be-ded8-411b-a5a6-f4695bc60017 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:07.776057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf3233d015546359bc5fec82969ee1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97a7403fdce4830bc242236241054a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:07.777516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.778045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.778424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] PATH_INFO: `/v3/projects/c1aff6cb6f614777bad55a595ab4c5f8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.779839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c1aff6cb6f614777bad55a595ab4c5f8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:07.782285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:07.790305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba69a9-7b39-45fa-86d2-d92f99682be1 tempest-ProjectsNegativeStaticTestJSON-848340087 tempest-ProjectsNegativeStaticTestJSON-848340087-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:07.857319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1aff6cb6f614777bad55a595ab4c5f8', 'request_id': 'req-a114eac6-d498-43f5-81b6-29f128b37211'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.881128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1aff6cb6f614777bad55a595ab4c5f8', 'request_id': 'req-a114eac6-d498-43f5-81b6-29f128b37211'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.902400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1aff6cb6f614777bad55a595ab4c5f8', 'request_id': 'req-a114eac6-d498-43f5-81b6-29f128b37211'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.915687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:07.916562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:07.916949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:07.917273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] PATH_INFO: `/v3/users/8b3e45af51a2460886a8784e5ec0a823` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:07.919589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3e45af51a2460886a8784e5ec0a823)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:07.921495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] The token cache is being invalidate because project c1aff6cb6f614777bad55a595ab4c5f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:07.921891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.922409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:07.923041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:07.925599 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3418/6846] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:07 2022] DELETE /identity/v3/projects/c1aff6cb6f614777bad55a595ab4c5f8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:07.930485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:07.932447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.024328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3e45af51a2460886a8784e5ec0a823'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.025350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3e45af51a2460886a8784e5ec0a823'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.032045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114eac6-d498-43f5-81b6-29f128b37211 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:08.036785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3e45af51a2460886a8784e5ec0a823'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.037757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3e45af51a2460886a8784e5ec0a823'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.040197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf3233d015546359bc5fec82969ee1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f97a7403fdce4830bc242236241054a3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:08.041181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.041516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.041972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.042867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:08.045729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:08.048933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-96e169ed-be3b-4f5a-86b4-cfb637ff4b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3e45af51a2460886a8784e5ec0a823'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Could not find domain: 200c8d87669544c8b60e8daf32d4f8e8.: keystone.exception.DomainNotFound: Could not find domain: 200c8d87669544c8b60e8daf32d4f8e8. May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 200c8d87669544c8b60e8daf32d4f8e8. May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:08.074966 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user May 07 22:08:08.076038 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 22:08:08.077103 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:08:08.078152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:08:08.078152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 200c8d87669544c8b60e8daf32d4f8e8. May 07 22:08:08.078152 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:08:08.078152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3419/6847] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:07 2022] POST /identity/v3/users => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) May 07 22:08:08.079041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:08.080373 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3429/6848] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:07 2022] DELETE /identity/v3/users/8b3e45af51a2460886a8784e5ec0a823 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:08.084850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.085137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.085417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.087785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.106402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:08.108002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.216438 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3430/6849] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:08.227846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0fc5-7153-42df-8a76-d7978f876ce0 tempest-UsersNegativeTest-933640826 tempest-UsersNegativeTest-933640826-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:08.234208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:08.235132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.235727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.235727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] PATH_INFO: `/v3/users/9c38d1af3db74471a0de37a563d1398a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.240431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c38d1af3db74471a0de37a563d1398a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:08.242381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:08.254044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:08.256015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.319257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c38d1af3db74471a0de37a563d1398a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.336040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c38d1af3db74471a0de37a563d1398a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.337681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c38d1af3db74471a0de37a563d1398a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.338797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c38d1af3db74471a0de37a563d1398a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.350858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-af4b3df1-cb17-4dc4-a72c-95f45e45a0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c38d1af3db74471a0de37a563d1398a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.380154 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3420/6850] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:08 2022] DELETE /identity/v3/users/9c38d1af3db74471a0de37a563d1398a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:08.384525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.385034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.385738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.408694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97046db-c814-4e51-b6bb-861965cc601d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:08.411885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:08.413878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.507652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:08.510705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.514228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.514836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.530660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.537674 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3421/6851] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:08.550024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:08.551820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.570095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:08.572535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:08.572782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12832bd-36b2-4a33-9daa-bc918b83fdea None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:08.581204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f22af-5811-4fc3-ae84-edd91cd152f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:08.595361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f22af-5811-4fc3-ae84-edd91cd152f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.596336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f22af-5811-4fc3-ae84-edd91cd152f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.597703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f22af-5811-4fc3-ae84-edd91cd152f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.599846 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3431/6852] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:08:08.601271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:08.603781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.614373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f22af-5811-4fc3-ae84-edd91cd152f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:08.616682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f22af-5811-4fc3-ae84-edd91cd152f5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:08.625744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9c835-7268-4ffe-a8da-3aa9ac8b3883 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:08.645645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:08.646542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.646852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.647136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] PATH_INFO: `/v3/projects/6d911cfddbe341409acd6c662de3978e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.648713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d911cfddbe341409acd6c662de3978e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:08.650863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:08.666871 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3422/6853] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:08.737433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d911cfddbe341409acd6c662de3978e', 'request_id': 'req-88fcce94-063e-4a2a-92f8-cc1446a05875'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.744554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d911cfddbe341409acd6c662de3978e', 'request_id': 'req-88fcce94-063e-4a2a-92f8-cc1446a05875'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.757082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d911cfddbe341409acd6c662de3978e', 'request_id': 'req-88fcce94-063e-4a2a-92f8-cc1446a05875'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.773179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] The token cache is being invalidate because project 6d911cfddbe341409acd6c662de3978e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:08.773617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.774982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-88fcce94-063e-4a2a-92f8-cc1446a05875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:08.778983 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3432/6854] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:08 2022] DELETE /identity/v3/projects/6d911cfddbe341409acd6c662de3978e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:08.783996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a7c75-0364-497c-84a4-288f9122c1ed None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.784930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a7c75-0364-497c-84a4-288f9122c1ed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.785296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a7c75-0364-497c-84a4-288f9122c1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.812115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6f9a7c75-0364-497c-84a4-288f9122c1ed None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:08.813873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6f9a7c75-0364-497c-84a4-288f9122c1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.915021 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3423/6855] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:08.917059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5afc3f-f224-4047-b917-f0dd1a696f39 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.917455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5afc3f-f224-4047-b917-f0dd1a696f39 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.917835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5afc3f-f224-4047-b917-f0dd1a696f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.944528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0c5afc3f-f224-4047-b917-f0dd1a696f39 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:08.946659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0c5afc3f-f224-4047-b917-f0dd1a696f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:08.970592 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3433/6856] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:08.972273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a7c75-0364-497c-84a4-288f9122c1ed None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:08.986415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a7c75-0364-497c-84a4-288f9122c1ed None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:08.996579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:08.997692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:08.998073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:08.998627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:08.999848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:08.999848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.002134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.029663 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3424/6857] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:09.033650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5afc3f-f224-4047-b917-f0dd1a696f39 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.045746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5afc3f-f224-4047-b917-f0dd1a696f39 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.068663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.069438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.069820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.070347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.071168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.077020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.128089 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3434/6858] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:09 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:09.129393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.156702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa808a-f670-4d86-8a69-8e50101de9bf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.249105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.250665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.251366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.251818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.260249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.262325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.273522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.276949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:09.299907 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3425/6859] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:09 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:09.300897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.315586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf837-e4d5-45a1-8206-88bf57a5d5f0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.321802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.322489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.322799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.324315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.325024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.327514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.329339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f8f4e-9d3a-4aed-b38c-f89b2743c396 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.347498 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3426/6860] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:09.348825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.350615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:09.352987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.356345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.358742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.359191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] PATH_INFO: `/v3/projects/5107020e7b9d4876bba13abc8b3348d9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.361198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5107020e7b9d4876bba13abc8b3348d9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.366634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c42261-ca92-4504-a938-32159594c284 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.368981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.373340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.383619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.383985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.384269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] PATH_INFO: `/v3/projects/9dc61bcebaca411f8e8109f31dcf2460` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.385684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc61bcebaca411f8e8109f31dcf2460)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.387734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.450547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc61bcebaca411f8e8109f31dcf2460', 'request_id': 'req-eb1bc465-b13f-48d3-b05b-1c463ecf512b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.459035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc61bcebaca411f8e8109f31dcf2460', 'request_id': 'req-eb1bc465-b13f-48d3-b05b-1c463ecf512b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.469108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc61bcebaca411f8e8109f31dcf2460', 'request_id': 'req-eb1bc465-b13f-48d3-b05b-1c463ecf512b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.489471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] The token cache is being invalidate because project 9dc61bcebaca411f8e8109f31dcf2460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:09.489911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.491622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.492622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5107020e7b9d4876bba13abc8b3348d9', 'request_id': 'req-7439d7d8-d116-42fa-8a3d-60d4a6afe989'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.495204 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3427/6861] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:09 2022] DELETE /identity/v3/projects/9dc61bcebaca411f8e8109f31dcf2460 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:09.497427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.499079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:09.507477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5107020e7b9d4876bba13abc8b3348d9', 'request_id': 'req-7439d7d8-d116-42fa-8a3d-60d4a6afe989'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.530073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5107020e7b9d4876bba13abc8b3348d9', 'request_id': 'req-7439d7d8-d116-42fa-8a3d-60d4a6afe989'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.549768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] The token cache is being invalidate because project 5107020e7b9d4876bba13abc8b3348d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:09.550121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.559431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.565196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3435/6862] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:09 2022] DELETE /identity/v3/projects/5107020e7b9d4876bba13abc8b3348d9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:09.567157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.570502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:09.694039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bc465-b13f-48d3-b05b-1c463ecf512b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.711246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439d7d8-d116-42fa-8a3d-60d4a6afe989 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.728300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.735667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.736058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.736451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] PATH_INFO: `/v3/users/ee1a40d1130140adb04f862b02696fe4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.738746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1a40d1130140adb04f862b02696fe4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.740888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.827689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1a40d1130140adb04f862b02696fe4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.828427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1a40d1130140adb04f862b02696fe4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.837012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.837851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.838110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.838393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.839251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.841485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.843070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1a40d1130140adb04f862b02696fe4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.843951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1a40d1130140adb04f862b02696fe4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.858194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1a40d1130140adb04f862b02696fe4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.865154 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3428/6863] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:09.865154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.867459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:09.883998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b5a05-a76b-4def-86ec-6c174c6ab957 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:09.893873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:09.895165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:09.895569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:09.895869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] PATH_INFO: `/v3/users/caf3233d015546359bc5fec82969ee1c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:09.897249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf3233d015546359bc5fec82969ee1c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:09.899548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:09.919136 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3436/6864] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:09 2022] DELETE /identity/v3/users/ee1a40d1130140adb04f862b02696fe4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:09.920221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:09.921610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:09.974953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf3233d015546359bc5fec82969ee1c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.986180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf3233d015546359bc5fec82969ee1c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.987141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf3233d015546359bc5fec82969ee1c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.987840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf3233d015546359bc5fec82969ee1c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:09.999944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf3233d015546359bc5fec82969ee1c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:10.038816 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3429/6865] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:09 2022] DELETE /identity/v3/users/caf3233d015546359bc5fec82969ee1c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:10.039852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:10.042869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:10.054101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7e315-1fe6-4a67-8730-f41b404a5ff3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:10.118558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a909-5d43-4e7c-9ccb-eb22b8526f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:10.119463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a909-5d43-4e7c-9ccb-eb22b8526f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:10.119752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a909-5d43-4e7c-9ccb-eb22b8526f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:10.120032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a909-5d43-4e7c-9ccb-eb22b8526f20 admin admin] PATH_INFO: `/v3/projects/72be56c2d4a54014a8f741c451fe014e/users/97ef9a3039534d90ba9d268970cbe9d4/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:10.147380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a909-5d43-4e7c-9ccb-eb22b8526f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72be56c2d4a54014a8f741c451fe014e, user_id=97ef9a3039534d90ba9d268970cbe9d4, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:10.150904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a909-5d43-4e7c-9ccb-eb22b8526f20 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:10.177951 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3437/6866] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:09 2022] PUT /identity/v3/projects/72be56c2d4a54014a8f741c451fe014e/users/97ef9a3039534d90ba9d268970cbe9d4/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:10.179626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:10.179929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:10.180215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:10.204608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:10.205850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:10.247766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177e82-c9b7-441e-8d00-17aa68874d0e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:10.303216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3438/6867] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:10.317460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:10.321355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:10.405908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:10.407568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:10.408852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:10.409991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] PATH_INFO: `/v3/users/97be6b6eca8f4da6bbae59449ff0ed2f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:10.415427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=97be6b6eca8f4da6bbae59449ff0ed2f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:10.425492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:10.497665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c91fdd-8d04-4685-92f3-b013f9d7d0b6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:10.507689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e9a0d-7455-4ee2-806c-ea2d2890e6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:10.509136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9a0d-7455-4ee2-806c-ea2d2890e6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:10.515286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9a0d-7455-4ee2-806c-ea2d2890e6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:10.515286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9a0d-7455-4ee2-806c-ea2d2890e6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:10.534756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e9a0d-7455-4ee2-806c-ea2d2890e6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:10.536312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e9a0d-7455-4ee2-806c-ea2d2890e6c1 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:10.562821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3439/6868] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:10.569992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97be6b6eca8f4da6bbae59449ff0ed2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:10.596091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97be6b6eca8f4da6bbae59449ff0ed2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:10.596898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97be6b6eca8f4da6bbae59449ff0ed2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:10.597594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97be6b6eca8f4da6bbae59449ff0ed2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:10.610964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97be6b6eca8f4da6bbae59449ff0ed2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:10.644574 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3430/6869] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:10 2022] DELETE /identity/v3/users/97be6b6eca8f4da6bbae59449ff0ed2f => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:10.648958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:10.650868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:10.650868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:10.686871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:10.688108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:10.835453 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3440/6870] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:10.862701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:10.865099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:10.989855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a50b75-eb26-404e-8a98-b96d971846ef admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:11.016266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d566-c4a9-4829-8233-6cab8c4811aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:11.017913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d566-c4a9-4829-8233-6cab8c4811aa service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:11.018392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d566-c4a9-4829-8233-6cab8c4811aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:11.018876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d566-c4a9-4829-8233-6cab8c4811aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:11.035347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3d566-c4a9-4829-8233-6cab8c4811aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:11.036217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3d566-c4a9-4829-8233-6cab8c4811aa service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:11.056639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3431/6871] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:11.271719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:11.276617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:11.291652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ea3d8-b3ae-4c1b-81e8-287b0d7530b6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:11.298439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:11.299646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:11.300032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:11.300326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] PATH_INFO: `/v3/projects/f97a7403fdce4830bc242236241054a3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:11.301990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97a7403fdce4830bc242236241054a3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:11.304084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:11.382243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97a7403fdce4830bc242236241054a3', 'request_id': 'req-6a7530ed-7917-4ae1-bb22-177d8845d8f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.396238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97a7403fdce4830bc242236241054a3', 'request_id': 'req-6a7530ed-7917-4ae1-bb22-177d8845d8f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.409922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97a7403fdce4830bc242236241054a3', 'request_id': 'req-6a7530ed-7917-4ae1-bb22-177d8845d8f4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.427121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] The token cache is being invalidate because project f97a7403fdce4830bc242236241054a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:11.427783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.428668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6a7530ed-7917-4ae1-bb22-177d8845d8f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.434880 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3441/6872] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:11 2022] DELETE /identity/v3/projects/f97a7403fdce4830bc242236241054a3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:11.437557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:11.438011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:11.438122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:11.462756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:11.464060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:11.563414 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3432/6873] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:11.569720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:11.570225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:11.570467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:11.591380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:11.605886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:11.627935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:11.630402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:11.635441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91818e50-4bf9-4899-aced-3cec769aeda4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:11.651358 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3442/6874] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:11.652270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:11.653678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:11.654035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:11.654365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] PATH_INFO: `/v3/projects/0652ce3844234e669a65b104c4f34529` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:11.654561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:11.655715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0652ce3844234e669a65b104c4f34529)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:11.657297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:11.657832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:11.713876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db4da6-7284-4f48-ae2d-9d87e253d7fa None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:11.737383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:11.738472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:11.739023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:11.739278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] PATH_INFO: `/v3/projects/ada272cf0693430583f1dc2c0e59c479` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:11.741121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada272cf0693430583f1dc2c0e59c479)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:11.743639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:11.782262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0652ce3844234e669a65b104c4f34529', 'request_id': 'req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.789862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0652ce3844234e669a65b104c4f34529', 'request_id': 'req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.802962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0652ce3844234e669a65b104c4f34529', 'request_id': 'req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.820205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] The token cache is being invalidate because project 0652ce3844234e669a65b104c4f34529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:11.820690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.822918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.826362 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3433/6875] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:11 2022] DELETE /identity/v3/projects/0652ce3844234e669a65b104c4f34529 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:11.827692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:11.830901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:11.862295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada272cf0693430583f1dc2c0e59c479', 'request_id': 'req-3005c616-d954-49b1-8c47-679e3d9e1828'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.872617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada272cf0693430583f1dc2c0e59c479', 'request_id': 'req-3005c616-d954-49b1-8c47-679e3d9e1828'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.889583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada272cf0693430583f1dc2c0e59c479', 'request_id': 'req-3005c616-d954-49b1-8c47-679e3d9e1828'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.909347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] The token cache is being invalidate because project ada272cf0693430583f1dc2c0e59c479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:11.909661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.911018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3005c616-d954-49b1-8c47-679e3d9e1828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:11.921634 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3443/6876] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:11 2022] DELETE /identity/v3/projects/ada272cf0693430583f1dc2c0e59c479 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:11.923165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33154149-6529-4007-9617-278fb4062a10 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:11.923622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33154149-6529-4007-9617-278fb4062a10 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:11.924064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33154149-6529-4007-9617-278fb4062a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:11.942550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd570efa-42a3-4d41-baa9-0627cdcf8c3b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:11.969301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-33154149-6529-4007-9617-278fb4062a10 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:11.970699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33154149-6529-4007-9617-278fb4062a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.085341 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3444/6877] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:12.086276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33154149-6529-4007-9617-278fb4062a10 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.087260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939f87-6d18-4bde-b947-a7b9b49b0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.088450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939f87-6d18-4bde-b947-a7b9b49b0144 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.088735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939f87-6d18-4bde-b947-a7b9b49b0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.089010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939f87-6d18-4bde-b947-a7b9b49b0144 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.090514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33154149-6529-4007-9617-278fb4062a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.091982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939f87-6d18-4bde-b947-a7b9b49b0144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:12.092300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939f87-6d18-4bde-b947-a7b9b49b0144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.093960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939f87-6d18-4bde-b947-a7b9b49b0144 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.110626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33154149-6529-4007-9617-278fb4062a10 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:12.112455 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3434/6878] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:12.114792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.115425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.117968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.118297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.119546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.120035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.120513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] PATH_INFO: `/v3/users/7d9dacd7a5d94286b6337a4dabde4057` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.123403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9dacd7a5d94286b6337a4dabde4057)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.126599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.162191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:12.163788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.174367 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3435/6879] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:12.175537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.179810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.220441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1c840-84d5-4460-aba4-6eef980ee8f0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:12.234420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.237400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9dacd7a5d94286b6337a4dabde4057'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:12.238241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.238241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.238241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.238478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9dacd7a5d94286b6337a4dabde4057'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:12.238561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.239128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.249957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9dacd7a5d94286b6337a4dabde4057'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:12.256560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9dacd7a5d94286b6337a4dabde4057'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:12.276466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9dacd7a5d94286b6337a4dabde4057'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:12.292310 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3436/6880] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:12 2022] POST /identity/v3/projects => generated 395 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:12.295046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.297617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.326237 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3445/6881] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:12 2022] DELETE /identity/v3/users/7d9dacd7a5d94286b6337a4dabde4057 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:12.327323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.329206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.441232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ce7ba-3675-497f-9891-deaa85c3ef0b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:12.448014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b30a6f-7d21-431c-9956-33c07e084d74 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:12.453885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.455156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.455672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.456177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.456902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2700a1d-3d60-4ff9-b170-a9ec729778c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.457595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700a1d-3d60-4ff9-b170-a9ec729778c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.457871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.458805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700a1d-3d60-4ff9-b170-a9ec729778c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.458805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2700a1d-3d60-4ff9-b170-a9ec729778c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.459183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2700a1d-3d60-4ff9-b170-a9ec729778c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:12.459494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2700a1d-3d60-4ff9-b170-a9ec729778c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.461834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.467571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2700a1d-3d60-4ff9-b170-a9ec729778c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.498086 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3437/6882] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:12.498086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b3de-5f38-4358-a47c-8c1e847de0fb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.498086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b3de-5f38-4358-a47c-8c1e847de0fb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.498086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b3de-5f38-4358-a47c-8c1e847de0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.505006 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3446/6883] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:12 2022] POST /identity/v3/users => generated 304 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:12.505959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.533135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0654f-3114-4a9d-81be-9c96a0ddfa24 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:12.549660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.550453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.550825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.551175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.552201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.555586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f853b3de-5f38-4358-a47c-8c1e847de0fb None None] MFA Rules not processed for user `97ef9a3039534d90ba9d268970cbe9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:12.556582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.557090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f853b3de-5f38-4358-a47c-8c1e847de0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.634848 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3447/6884] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:12 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:12.634848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.707027 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3438/6885] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:12.707361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b3de-5f38-4358-a47c-8c1e847de0fb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.736036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b3de-5f38-4358-a47c-8c1e847de0fb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:12.797795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bfd0b-659e-436d-a3d1-e5ea6cfb5c14 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:12.823087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.823784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.824107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.824390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.825132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.826792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.859830 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3448/6886] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:12.871883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:12.882802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:12.922965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:12.923749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:12.925723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:12.926153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:12.926971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:12.934577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:12.984225 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3439/6887] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:12 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:12.985120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.005220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b50533-44ec-46c6-a3df-b2a686286684 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.019039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32af0e-c3c2-4f11-bbaa-671f0c9d1216 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.034905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.036003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.036323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.037107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] PATH_INFO: `/v3/projects/14651fa4936f4f44865e7101c6bfec60/users/37b2e68587054d7883b4cd609e1fd867/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.047081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.048912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.049428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.052045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.076452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14651fa4936f4f44865e7101c6bfec60, user_id=37b2e68587054d7883b4cd609e1fd867, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.081874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.111073 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3440/6888] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:12 2022] PUT /identity/v3/projects/14651fa4936f4f44865e7101c6bfec60/users/37b2e68587054d7883b4cd609e1fd867/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:13.112263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.200878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.203630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.230959 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3449/6889] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:13.233570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.269013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dec78-ae18-41fd-b533-648046e38d5d service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.276055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.277085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.278087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.278589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.280217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.284857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.289817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cb072-c64c-4d2a-a523-a97a67273a4a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.304567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.305513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.306222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.306656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.307851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.312597 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3450/6890] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:13.313469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.313627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.319250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:13.332465 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3441/6891] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:13.333620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.352078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535edd-3100-4f29-ab5d-ecc0177f8de2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.358592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87963c01-6519-4259-8450-871ba215cabe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.375009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.376323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.376781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.377226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] PATH_INFO: `/v3/projects/5fab2e2282ac4883bd4ec4001e3c33ee` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.378031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.379019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fab2e2282ac4883bd4ec4001e3c33ee)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.381419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.385535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.385740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.386021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] PATH_INFO: `/v3/projects/14651fa4936f4f44865e7101c6bfec60/users/37b2e68587054d7883b4cd609e1fd867/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.392332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14651fa4936f4f44865e7101c6bfec60, user_id=37b2e68587054d7883b4cd609e1fd867, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.397790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.437419 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3442/6892] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:13 2022] PUT /identity/v3/projects/14651fa4936f4f44865e7101c6bfec60/users/37b2e68587054d7883b4cd609e1fd867/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:13.438862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.477942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fab2e2282ac4883bd4ec4001e3c33ee', 'request_id': 'req-e9801582-887a-4742-b7e1-e289335a4870'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:13.498684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fab2e2282ac4883bd4ec4001e3c33ee', 'request_id': 'req-e9801582-887a-4742-b7e1-e289335a4870'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:13.513795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fab2e2282ac4883bd4ec4001e3c33ee', 'request_id': 'req-e9801582-887a-4742-b7e1-e289335a4870'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:13.531733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] The token cache is being invalidate because project 5fab2e2282ac4883bd4ec4001e3c33ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:13.532030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:13.532864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e9801582-887a-4742-b7e1-e289335a4870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:13.538367 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3451/6893] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:13 2022] DELETE /identity/v3/projects/5fab2e2282ac4883bd4ec4001e3c33ee => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:13.539954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b14daf-70ca-49c6-8f09-33cf678902e7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.540921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b14daf-70ca-49c6-8f09-33cf678902e7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.542111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b14daf-70ca-49c6-8f09-33cf678902e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.589395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-70b14daf-70ca-49c6-8f09-33cf678902e7 None None] MFA Rules not processed for user `37b2e68587054d7883b4cd609e1fd867`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:13.591454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-70b14daf-70ca-49c6-8f09-33cf678902e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:13.595388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917ab20-05ea-4b1e-8222-4583c3bd8dc9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.707136 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3452/6894] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:13.708539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.708889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.709224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.712937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.713917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.714415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.714977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.716361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.722314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.728213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:13.729485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:13.738230 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3443/6895] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:13.739535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.742030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:13.743955 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3453/6896] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:13.744810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.747236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:13.762072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679280a9-a8e1-41bc-b46b-00b4aa7530ed None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.762446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1abe56-deb6-41b0-b7c9-c6bd3d480202 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.769824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.770096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d581d-2eab-47c3-8adc-bae5f5975044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.770667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d581d-2eab-47c3-8adc-bae5f5975044 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.770804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.770994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d581d-2eab-47c3-8adc-bae5f5975044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.771101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.771272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d581d-2eab-47c3-8adc-bae5f5975044 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.771373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] PATH_INFO: `/v3/projects/b2b3afaea2284b94823d2ab0e30ab571/users/1a669d965e8a4308b369d1f3c4995855/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.772613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d581d-2eab-47c3-8adc-bae5f5975044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.775196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d581d-2eab-47c3-8adc-bae5f5975044 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.813946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b3afaea2284b94823d2ab0e30ab571, user_id=1a669d965e8a4308b369d1f3c4995855, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.816841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.818639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3444/6897] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:13 2022] POST /identity/v3/projects => generated 395 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:13.820748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e276-2893-4b41-b40a-ad52b202391e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.822038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e276-2893-4b41-b40a-ad52b202391e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.822470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e276-2893-4b41-b40a-ad52b202391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.842858 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3454/6898] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:13 2022] PUT /identity/v3/projects/b2b3afaea2284b94823d2ab0e30ab571/users/1a669d965e8a4308b369d1f3c4995855/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:13.843807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:13.848956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-38a8e276-2893-4b41-b40a-ad52b202391e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:13.853840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38a8e276-2893-4b41-b40a-ad52b202391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:13.935929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca175c7-c334-4aa1-84e6-c3399de7d88f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:13.941098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:13.941783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.942072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.942348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.943387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:13.945398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:13.965070 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3445/6899] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:13.967015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b428cf-2f42-4e04-ac92-e4f2726ad631 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:13.967755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b428cf-2f42-4e04-ac92-e4f2726ad631 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:13.968231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b428cf-2f42-4e04-ac92-e4f2726ad631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:13.994210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3455/6900] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:13 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:13.995033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.004213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a3b428cf-2f42-4e04-ac92-e4f2726ad631 None None] MFA Rules not processed for user `1a669d965e8a4308b369d1f3c4995855`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:14.005801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a3b428cf-2f42-4e04-ac92-e4f2726ad631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:14.010190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b274c2d-b5ba-476f-ab58-3ee468b90894 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.016767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.018965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.020025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.020471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.021647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:14.022153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.024516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.043456 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3456/6901] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:14.044733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.056540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba3d36-95ac-47a3-bbba-d22f12d38d47 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.061956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.062639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.063172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.063459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.064748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.066575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.082879 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3457/6902] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:14.083746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.096418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22ee5d-74e6-4f77-9e2d-fb20a606e466 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.101909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.102594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.103436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.103655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.104518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.107406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.142464 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3458/6903] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:14 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:14.143328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.151287 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3446/6904] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:14.152839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b428cf-2f42-4e04-ac92-e4f2726ad631 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.166183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b428cf-2f42-4e04-ac92-e4f2726ad631 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.264366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be0f22-2fe9-44ed-a213-d7547b17e690 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.270817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.272250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.272545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.272833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.273570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.279181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.282838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.283717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.284263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.284653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.286080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.290722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.303293 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3459/6905] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:14.304215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.319353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c071e-66f9-4b11-add1-e089718d1c9b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.330060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.331452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.331736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.332368 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3447/6906] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:14 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:14.333252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.335927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.337285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.340941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.375060 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3460/6907] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:14 2022] POST /identity/v3/users => generated 281 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:14.375060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.383209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c498176-07c7-417b-98a2-2a59684a0609 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.439518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ed240-9f68-4b24-9b7b-998ba9260085 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.445483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.446453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.446932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.447216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] PATH_INFO: `/v3/projects/d0ad23ab4605411b89d2db9c47202dbc/users/6250d80801d240fc9312683e7e0410b4/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.471857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ad23ab4605411b89d2db9c47202dbc, user_id=6250d80801d240fc9312683e7e0410b4, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.473169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.474735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.475172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.475566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.475772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.476563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.479270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.492409 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3448/6908] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:14 2022] PUT /identity/v3/projects/d0ad23ab4605411b89d2db9c47202dbc/users/6250d80801d240fc9312683e7e0410b4/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:14.493278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.520269 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3461/6909] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:14 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:14.521489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.535845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c14bd-d338-4a50-aef0-a09404cf757d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.645622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700b8d6-6fc4-45c9-86c7-c7281ba4ce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.646641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b8d6-6fc4-45c9-86c7-c7281ba4ce0c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.647845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b8d6-6fc4-45c9-86c7-c7281ba4ce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.647845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700b8d6-6fc4-45c9-86c7-c7281ba4ce0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.648622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700b8d6-6fc4-45c9-86c7-c7281ba4ce0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.651808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e700b8d6-6fc4-45c9-86c7-c7281ba4ce0c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.672054 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3462/6910] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:14.672267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4bd4c-5ed8-4212-a69a-4f314752347c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.672545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4bd4c-5ed8-4212-a69a-4f314752347c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.672830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4bd4c-5ed8-4212-a69a-4f314752347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.677019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525c17b-95fd-4cfb-89c3-b24e5a63dfb2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.682338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.683090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.683414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.683702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.684439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.686071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.697792 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3449/6911] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:14.699546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.715654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffe54e-4867-4f7e-b302-9467801bf831 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.718346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fae4bd4c-5ed8-4212-a69a-4f314752347c None None] MFA Rules not processed for user `6250d80801d240fc9312683e7e0410b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:14.719790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fae4bd4c-5ed8-4212-a69a-4f314752347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:14.724267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.725112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.725403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.725684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] PATH_INFO: `/v3/projects/b211c8a5cc6a4c90918cded898e4a7db/users/9c6ec022033148aea769b796f09cd3f5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.764907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b211c8a5cc6a4c90918cded898e4a7db, user_id=9c6ec022033148aea769b796f09cd3f5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.769079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.795281 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3450/6912] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:14 2022] PUT /identity/v3/projects/b211c8a5cc6a4c90918cded898e4a7db/users/9c6ec022033148aea769b796f09cd3f5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:14.796525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.832332 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3463/6913] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:14.833299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4bd4c-5ed8-4212-a69a-4f314752347c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.853906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4bd4c-5ed8-4212-a69a-4f314752347c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.897894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b34ee4-9e2e-428c-8182-aa9abcfb500e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:14.904921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:14.905646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:14.907117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:14.907716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:14.909570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:14.913289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:14.942609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3451/6914] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:14.942609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:14.944992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:15.024984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.025976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.026337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.027023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.028518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.043017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.077017 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3464/6915] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:15.077980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.102471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a15c22-0328-4113-b428-fdda976584d1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.115652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.117713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.119230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.119542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] PATH_INFO: `/v3/projects/51018c16b81247ff8a3cfe8ba2f8fd13/users/93dc261b78a349bcb8fce05d488ed8a3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.129414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac2e9a-2bae-45e3-b391-698b92328a87 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.142456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1d0ae-43ae-4c06-bb1d-b7212bc41767 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.144653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d0ae-43ae-4c06-bb1d-b7212bc41767 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.144653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d0ae-43ae-4c06-bb1d-b7212bc41767 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.146886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1d0ae-43ae-4c06-bb1d-b7212bc41767 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.149649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51018c16b81247ff8a3cfe8ba2f8fd13, user_id=93dc261b78a349bcb8fce05d488ed8a3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.153497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.189590 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3465/6916] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:15 2022] PUT /identity/v3/projects/51018c16b81247ff8a3cfe8ba2f8fd13/users/93dc261b78a349bcb8fce05d488ed8a3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:15.191437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.305580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1d0ae-43ae-4c06-bb1d-b7212bc41767 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.307564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1d0ae-43ae-4c06-bb1d-b7212bc41767 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.325696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116290c-cee3-416d-9ce9-6cd343aeab9b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.328702 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3452/6917] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:15.330462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d797b3e-18a6-40f0-aca9-a13a71ccb88d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.330829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d797b3e-18a6-40f0-aca9-a13a71ccb88d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.331253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d797b3e-18a6-40f0-aca9-a13a71ccb88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.336859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7e93e-2e97-47fb-9ffa-d45d6ef62f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.338097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7e93e-2e97-47fb-9ffa-d45d6ef62f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.338649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7e93e-2e97-47fb-9ffa-d45d6ef62f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.339046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7e93e-2e97-47fb-9ffa-d45d6ef62f93 admin admin] PATH_INFO: `/v3/projects/b211c8a5cc6a4c90918cded898e4a7db/users/9c6ec022033148aea769b796f09cd3f5/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.341472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7e93e-2e97-47fb-9ffa-d45d6ef62f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b211c8a5cc6a4c90918cded898e4a7db, user_id=9c6ec022033148aea769b796f09cd3f5, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.344325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7e93e-2e97-47fb-9ffa-d45d6ef62f93 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.364797 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3466/6918] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:15 2022] PUT /identity/v3/projects/b211c8a5cc6a4c90918cded898e4a7db/users/9c6ec022033148aea769b796f09cd3f5/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:15.376142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209db2-fc40-40bf-9de2-bc9fdd706857 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.376445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209db2-fc40-40bf-9de2-bc9fdd706857 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.376869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209db2-fc40-40bf-9de2-bc9fdd706857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.378274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0d797b3e-18a6-40f0-aca9-a13a71ccb88d None None] MFA Rules not processed for user `93dc261b78a349bcb8fce05d488ed8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:15.380339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0d797b3e-18a6-40f0-aca9-a13a71ccb88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:15.474091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f6209db2-fc40-40bf-9de2-bc9fdd706857 None None] MFA Rules not processed for user `9c6ec022033148aea769b796f09cd3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:15.475726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f6209db2-fc40-40bf-9de2-bc9fdd706857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:15.533730 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3453/6919] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:15.534975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d797b3e-18a6-40f0-aca9-a13a71ccb88d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.616459 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3467/6920] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:15.629611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d797b3e-18a6-40f0-aca9-a13a71ccb88d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.632616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209db2-fc40-40bf-9de2-bc9fdd706857 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.634987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.635853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.636203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.636673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.637443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.639655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.668820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209db2-fc40-40bf-9de2-bc9fdd706857 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.676708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6ec022033148aea769b796f09cd3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b211c8a5cc6a4c90918cded898e4a7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.677878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.678245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.678606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.679585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.682493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.684955 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3454/6921] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:15 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:15.688889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.742611 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3468/6922] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:15 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:15.744094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.820505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84862f64-9913-4302-8e55-8e9681650ca1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.822165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f7c5a-73b2-41ed-be9b-fd6211e1e8e0 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.831213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a669d965e8a4308b369d1f3c4995855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b2b3afaea2284b94823d2ab0e30ab571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.832088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.832378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.832660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] PATH_INFO: `/v3/projects/c083c494e5a74955aa4e2aee5d376ecc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.834083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] RBAC: Authorizing `identity:delete_project(project_id=c083c494e5a74955aa4e2aee5d376ecc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete May 07 22:08:15.847914 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call( May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application enforcer_obj._enforce( May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application result = self._enforcer.enforce( May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. May 07 22:08:15.849333 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:15.852495 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3469/6923] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:15 2022] DELETE /identity/v3/projects/c083c494e5a74955aa4e2aee5d376ecc => generated 136 bytes in 109 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) May 07 22:08:15.853545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.914730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.915599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.915985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.916392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.917195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.919921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.940125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cf55a-96a0-4a69-8ceb-ef0d57029744 tempest-ProjectsNegativeTestJSON-922588495 tempest-ProjectsNegativeTestJSON-922588495-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.942381 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3455/6924] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:15 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:15.943275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:15.945283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c6ec022033148aea769b796f09cd3f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b211c8a5cc6a4c90918cded898e4a7db', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.946147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.946431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.946703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] PATH_INFO: `/v3/projects/c083c494e5a74955aa4e2aee5d376ecc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.948164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c083c494e5a74955aa4e2aee5d376ecc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.951090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:15.955868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432627f1-28b4-44ab-84eb-23003084a334 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:15.961367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:15.963592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:15.964006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:15.964385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] PATH_INFO: `/v3/users/37b2e68587054d7883b4cd609e1fd867` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:15.966281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b2e68587054d7883b4cd609e1fd867)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:15.968353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.009009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c083c494e5a74955aa4e2aee5d376ecc', 'request_id': 'req-9e62bb29-c465-4db3-bdbd-64e1b1a19901'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.017668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c083c494e5a74955aa4e2aee5d376ecc', 'request_id': 'req-9e62bb29-c465-4db3-bdbd-64e1b1a19901'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.021885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b2e68587054d7883b4cd609e1fd867'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.027864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c083c494e5a74955aa4e2aee5d376ecc', 'request_id': 'req-9e62bb29-c465-4db3-bdbd-64e1b1a19901'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.035261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b2e68587054d7883b4cd609e1fd867'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.036925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b2e68587054d7883b4cd609e1fd867'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.037726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b2e68587054d7883b4cd609e1fd867'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.040100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] The token cache is being invalidate because project c083c494e5a74955aa4e2aee5d376ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:16.040394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.041461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.044179 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3470/6925] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:15 2022] DELETE /identity/v3/projects/c083c494e5a74955aa4e2aee5d376ecc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:16.044659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.047348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.051573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b2e68587054d7883b4cd609e1fd867'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.090993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3456/6926] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:15 2022] DELETE /identity/v3/users/37b2e68587054d7883b4cd609e1fd867 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:16.091964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.094120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.150585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62bb29-c465-4db3-bdbd-64e1b1a19901 tempest-ProjectsNegativeTestJSON-1960542950 tempest-ProjectsNegativeTestJSON-1960542950-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:16.198953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b341c-9d72-4433-84c5-1e6f7bd40717 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:16.206180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:16.206820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.207167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.209060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] PATH_INFO: `/v3/users/1a669d965e8a4308b369d1f3c4995855` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.209060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a669d965e8a4308b369d1f3c4995855)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:16.211310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.231566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5abd11-cec6-4ee9-b3bb-f1f68662dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:16.232250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abd11-cec6-4ee9-b3bb-f1f68662dcfd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.232592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abd11-cec6-4ee9-b3bb-f1f68662dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.232873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5abd11-cec6-4ee9-b3bb-f1f68662dcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.233673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abd11-cec6-4ee9-b3bb-f1f68662dcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:16.235356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5abd11-cec6-4ee9-b3bb-f1f68662dcfd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.249267 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3471/6927] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:16.250692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa31fe-28ed-41a6-bed7-6669e53bec67 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.251012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa31fe-28ed-41a6-bed7-6669e53bec67 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.252408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa31fe-28ed-41a6-bed7-6669e53bec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.281680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bbaa31fe-28ed-41a6-bed7-6669e53bec67 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:16.289825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bbaa31fe-28ed-41a6-bed7-6669e53bec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.297515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a669d965e8a4308b369d1f3c4995855'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.307905 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3472/6928] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:16.310282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa31fe-28ed-41a6-bed7-6669e53bec67 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.319513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a669d965e8a4308b369d1f3c4995855'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.322586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a669d965e8a4308b369d1f3c4995855'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.324919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a669d965e8a4308b369d1f3c4995855'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.335007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa31fe-28ed-41a6-bed7-6669e53bec67 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:16.340871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a669d965e8a4308b369d1f3c4995855'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:16.343473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25d58-a43b-47fa-93b3-1dcab30c81c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:16.344384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25d58-a43b-47fa-93b3-1dcab30c81c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.344747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25d58-a43b-47fa-93b3-1dcab30c81c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.345025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25d58-a43b-47fa-93b3-1dcab30c81c0 admin admin] PATH_INFO: `/v3/projects/f6360875ae174a0caaa2bbb02459244d/users/046e97b7cdc5403e9bbcb90699a60160/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.378971 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3457/6929] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:16 2022] DELETE /identity/v3/users/1a669d965e8a4308b369d1f3c4995855 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:16.380300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e25d58-a43b-47fa-93b3-1dcab30c81c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6360875ae174a0caaa2bbb02459244d, user_id=046e97b7cdc5403e9bbcb90699a60160, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:16.381388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.385114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.391544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e25d58-a43b-47fa-93b3-1dcab30c81c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.424262 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3473/6930] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:16 2022] PUT /identity/v3/projects/f6360875ae174a0caaa2bbb02459244d/users/046e97b7cdc5403e9bbcb90699a60160/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:16.424790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.424790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.424983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.455215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:16.457622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.499144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b2fc2-0dbd-4c1a-a19b-c7ed02bcdd31 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:16.556748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3474/6931] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:16.558187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.560309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.575234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:16.575903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.576245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.576517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.578279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fde514-3a2e-4ec1-9876-bd889c4676d1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:16.588455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.591928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:16.592769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.593037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.593322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.594245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:16.595901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.611422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:16.613268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.618915 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3475/6932] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:16.619849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.633271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8407df-48ad-4f87-87ea-607c92b316e7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:16.638642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d4ea5-b5cf-465b-ade0-a85d32f24c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:16.639339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ea5-b5cf-465b-ade0-a85d32f24c2d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.639627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ea5-b5cf-465b-ade0-a85d32f24c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.639802 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3458/6933] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:16.639922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d4ea5-b5cf-465b-ade0-a85d32f24c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.643215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.651084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d4ea5-b5cf-465b-ade0-a85d32f24c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:16.653646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d4ea5-b5cf-465b-ade0-a85d32f24c2d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.668851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3476/6934] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:16.671728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a546dc4-794e-45de-ae86-92b273047534 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:16.682021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:16.682962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.683948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.684228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] PATH_INFO: `/v3/projects/f6360875ae174a0caaa2bbb02459244d/users/046e97b7cdc5403e9bbcb90699a60160/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.686411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6360875ae174a0caaa2bbb02459244d, user_id=046e97b7cdc5403e9bbcb90699a60160, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:16.690693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:16.705053 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3459/6935] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:16 2022] PUT /identity/v3/projects/f6360875ae174a0caaa2bbb02459244d/users/046e97b7cdc5403e9bbcb90699a60160/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:16.717086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18af38-e5a6-4e98-9743-28f1f0678357 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:16.717374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18af38-e5a6-4e98-9743-28f1f0678357 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:16.717711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18af38-e5a6-4e98-9743-28f1f0678357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:16.762987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5a18af38-e5a6-4e98-9743-28f1f0678357 None None] MFA Rules not processed for user `046e97b7cdc5403e9bbcb90699a60160`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:16.764347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5a18af38-e5a6-4e98-9743-28f1f0678357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:16.899170 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3477/6936] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:16.916788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:16.919157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:17.014184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e064e-3b00-4aba-a42c-1ebd74a91910 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:17.019003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:17.020053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:17.020491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:17.020916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:17.032355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:17.033821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:17.046947 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3460/6937] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:17.234657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18af38-e5a6-4e98-9743-28f1f0678357 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:17.253806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18af38-e5a6-4e98-9743-28f1f0678357 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:17.265605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:17.266437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:17.266882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:17.267253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:17.271555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:17.372527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:17.375336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:17.406038 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3478/6938] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:17.652074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:17.653678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:17.664898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:17.665547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:17.848096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c0f86-7325-45f7-92af-49f0f0d72dc4 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:17.861878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:17.864042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:17.864042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:17.864042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] PATH_INFO: `/v3/projects/14651fa4936f4f44865e7101c6bfec60` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:17.865118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14651fa4936f4f44865e7101c6bfec60)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:17.868072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:17.875979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f135f3-6aa4-4ef5-b38d-511fdf4a6767 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:17.889439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:17.890511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:17.891838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:17.892528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] PATH_INFO: `/v3/projects/b2b3afaea2284b94823d2ab0e30ab571` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:17.896118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b3afaea2284b94823d2ab0e30ab571)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:17.903198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:17.979698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14651fa4936f4f44865e7101c6bfec60', 'request_id': 'req-a0b72566-1bda-4e60-837a-62823e40b5d7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:17.999487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14651fa4936f4f44865e7101c6bfec60', 'request_id': 'req-a0b72566-1bda-4e60-837a-62823e40b5d7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.022049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14651fa4936f4f44865e7101c6bfec60', 'request_id': 'req-a0b72566-1bda-4e60-837a-62823e40b5d7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.029782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b3afaea2284b94823d2ab0e30ab571', 'request_id': 'req-192a785a-ff8e-4984-b212-f3d04551ea44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.037589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b3afaea2284b94823d2ab0e30ab571', 'request_id': 'req-192a785a-ff8e-4984-b212-f3d04551ea44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.046565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] The token cache is being invalidate because project 14651fa4936f4f44865e7101c6bfec60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:18.047002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.047321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b3afaea2284b94823d2ab0e30ab571', 'request_id': 'req-192a785a-ff8e-4984-b212-f3d04551ea44'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.047863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.050403 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3461/6939] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:17 2022] DELETE /identity/v3/projects/14651fa4936f4f44865e7101c6bfec60 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:18.054607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:18.056642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:18.073331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] The token cache is being invalidate because project b2b3afaea2284b94823d2ab0e30ab571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:18.074867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.075786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.077867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3479/6940] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:17 2022] DELETE /identity/v3/projects/b2b3afaea2284b94823d2ab0e30ab571 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:18.082017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:18.085906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:18.185189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a785a-ff8e-4984-b212-f3d04551ea44 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:18.191415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:18.192436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:18.192784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:18.193159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] PATH_INFO: `/v3/users/9c6ec022033148aea769b796f09cd3f5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:18.194484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c6ec022033148aea769b796f09cd3f5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:18.198208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:18.224309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b72566-1bda-4e60-837a-62823e40b5d7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:18.239866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:18.242026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:18.242386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:18.242715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] PATH_INFO: `/v3/users/6250d80801d240fc9312683e7e0410b4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:18.247602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6250d80801d240fc9312683e7e0410b4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:18.253238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:18.278683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c6ec022033148aea769b796f09cd3f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.280238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c6ec022033148aea769b796f09cd3f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.290976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c6ec022033148aea769b796f09cd3f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.292050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c6ec022033148aea769b796f09cd3f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.303002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c6ec022033148aea769b796f09cd3f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.338673 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3480/6941] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:18 2022] DELETE /identity/v3/users/9c6ec022033148aea769b796f09cd3f5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:18.350849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6250d80801d240fc9312683e7e0410b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.359987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6250d80801d240fc9312683e7e0410b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.361375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6250d80801d240fc9312683e7e0410b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.362337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6250d80801d240fc9312683e7e0410b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.380078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6250d80801d240fc9312683e7e0410b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:18.411195 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3462/6942] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:18 2022] DELETE /identity/v3/users/6250d80801d240fc9312683e7e0410b4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:19.145264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:19.147408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:19.283553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a2ee5-3428-4112-90f2-f69f940a3bbf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:19.448495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:19.449739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.450421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.451266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] PATH_INFO: `/v3/projects/b211c8a5cc6a4c90918cded898e4a7db` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.453351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b211c8a5cc6a4c90918cded898e4a7db)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:19.455996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:19.461119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:19.463264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:19.491707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0b7df-b051-4c38-912a-855d3b86096a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:19.496717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:19.497599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.497878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.498153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] PATH_INFO: `/v3/projects/d0ad23ab4605411b89d2db9c47202dbc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.501381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ad23ab4605411b89d2db9c47202dbc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:19.503569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:19.556352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b211c8a5cc6a4c90918cded898e4a7db', 'request_id': 'req-421a40f1-f535-4c79-8094-dfe7296e2866'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.565588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b211c8a5cc6a4c90918cded898e4a7db', 'request_id': 'req-421a40f1-f535-4c79-8094-dfe7296e2866'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.581504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b211c8a5cc6a4c90918cded898e4a7db', 'request_id': 'req-421a40f1-f535-4c79-8094-dfe7296e2866'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.601406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] The token cache is being invalidate because project b211c8a5cc6a4c90918cded898e4a7db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:19.602045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.603379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-421a40f1-f535-4c79-8094-dfe7296e2866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.607415 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3481/6943] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:19 2022] DELETE /identity/v3/projects/b211c8a5cc6a4c90918cded898e4a7db => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:19.614438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf88e-967e-4413-93c3-67f81f494306 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.615271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf88e-967e-4413-93c3-67f81f494306 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.616316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baf88e-967e-4413-93c3-67f81f494306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.638283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ad23ab4605411b89d2db9c47202dbc', 'request_id': 'req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.647962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ad23ab4605411b89d2db9c47202dbc', 'request_id': 'req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.659474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-54baf88e-967e-4413-93c3-67f81f494306 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:19.662509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54baf88e-967e-4413-93c3-67f81f494306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:19.669770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ad23ab4605411b89d2db9c47202dbc', 'request_id': 'req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.689096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] The token cache is being invalidate because project d0ad23ab4605411b89d2db9c47202dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:19.692053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.694135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-77c4bb99-f0a1-48a6-87b3-b081e2e7cd8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:19.697883 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3463/6944] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:19 2022] DELETE /identity/v3/projects/d0ad23ab4605411b89d2db9c47202dbc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:19.711215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dd411-682d-4158-b256-c76ac00a2dd8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.711544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dd411-682d-4158-b256-c76ac00a2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.711832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827dd411-682d-4158-b256-c76ac00a2dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.768893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-827dd411-682d-4158-b256-c76ac00a2dd8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:19.771667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-827dd411-682d-4158-b256-c76ac00a2dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:19.849156 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3482/6945] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:19.850667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a54ef-299f-43f3-ade9-4feb4fbcd327 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.850987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a54ef-299f-43f3-ade9-4feb4fbcd327 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.851279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a54ef-299f-43f3-ade9-4feb4fbcd327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.856036 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3464/6946] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:19.863542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b1776-a621-480d-8858-19801c3185e1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.864321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b1776-a621-480d-8858-19801c3185e1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.864926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b1776-a621-480d-8858-19801c3185e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.886129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9e7b1776-a621-480d-8858-19801c3185e1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:19.888335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e7b1776-a621-480d-8858-19801c3185e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:19.897999 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3465/6947] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:19.899303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-881a54ef-299f-43f3-ade9-4feb4fbcd327 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:19.900554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-881a54ef-299f-43f3-ade9-4feb4fbcd327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:19.901984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b1776-a621-480d-8858-19801c3185e1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:19.922985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b1776-a621-480d-8858-19801c3185e1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:19.927478 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3483/6948] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:19.932569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a54ef-299f-43f3-ade9-4feb4fbcd327 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:19.933450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:19.935792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.936260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.936723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.939335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:19.940243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:19.947992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:19.956272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a54ef-299f-43f3-ade9-4feb4fbcd327 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:19.962907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:19.963589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.964015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.964298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:19.965613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:19.966023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:19.966228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3466/6949] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:08:19.969332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:19.970712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:19.984465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e69f79-f002-4f2a-a1ff-b0c05be0cafe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:19.994807 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3484/6950] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:19.996068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:19.997499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:19.998542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:19.998888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:19.999171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.000549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.005738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.006447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843b833-4eab-44bb-9633-b8c2cbffd4c2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.012535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.013402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.013821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.014245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.015421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.018174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.054666 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3485/6951] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:19 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:20.062286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.076008 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3467/6952] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:19 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:08:20.080931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.182160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5b739-2145-456c-b086-c4f13d3fca1f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.254621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c96ca3-151d-4394-8ade-f8edafa2d7fb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.264591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.265575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.266059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.266530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.267912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.271440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.287150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.288352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.289254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.290061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.291714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.298158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.320393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3468/6953] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:20 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:20.322189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.347460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70194bdc-7639-4be4-a286-f037ef852e6f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.362758 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3486/6954] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:20 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:20.364137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.365077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.365710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.366158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.367551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.368289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.369836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.399091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3469/6955] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:20.403711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.407092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cedaba-b5e2-4d15-af9c-8761e64997b0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.416486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.418407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.420666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.421116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.422051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.426156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.437412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c15052-87d5-4ca5-a720-8578c176f0d2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.444419 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3487/6956] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:20.454140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.456849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.457625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.457918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.458194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.459123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.460810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.478141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b75441-b859-4e88-a004-e818b8352915 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.492462 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3470/6957] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:20.493740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.495569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.496687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.496969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.497338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.498210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.500944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.516581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f3fc1-d360-4c0d-a33d-57ef04dc6513 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.529658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9dcbc-bedc-47f7-849a-139c30e247c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.531643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dcbc-bedc-47f7-849a-139c30e247c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.532958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dcbc-bedc-47f7-849a-139c30e247c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.533730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dcbc-bedc-47f7-849a-139c30e247c2 admin admin] PATH_INFO: `/v3/projects/2fdedd0c64d2432887488390439c39ad/users/0b8847964e304a6b9cb10897e338ce07/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.550643 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3488/6958] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:08:20.553340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:20.570245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9dcbc-bedc-47f7-849a-139c30e247c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fdedd0c64d2432887488390439c39ad, user_id=0b8847964e304a6b9cb10897e338ce07, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.571368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c1a9e-0f8b-4fe8-81f1-3be346e0c643 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:20.573486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9dcbc-bedc-47f7-849a-139c30e247c2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.581864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ffbeb-c97a-430e-874d-e4127f961b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:20.581864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ffbeb-c97a-430e-874d-e4127f961b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.588797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ffbeb-c97a-430e-874d-e4127f961b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.589565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ffbeb-c97a-430e-874d-e4127f961b56 admin admin] PATH_INFO: `/v3/projects/88dc6e94066e42c084774d57a8faf609/users/5ba647cc3a734dcbbf61bcfa66d6511f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.618858 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3471/6959] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:20 2022] PUT /identity/v3/projects/2fdedd0c64d2432887488390439c39ad/users/0b8847964e304a6b9cb10897e338ce07/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:20.631394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ffbeb-c97a-430e-874d-e4127f961b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88dc6e94066e42c084774d57a8faf609, user_id=5ba647cc3a734dcbbf61bcfa66d6511f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:20.632422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.635691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ffbeb-c97a-430e-874d-e4127f961b56 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:20.635957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.637132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.666635 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3489/6960] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:20 2022] PUT /identity/v3/projects/88dc6e94066e42c084774d57a8faf609/users/5ba647cc3a734dcbbf61bcfa66d6511f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:20.679863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48d121-5f36-4d4d-8bcf-81446d8a7940 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:20.680200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48d121-5f36-4d4d-8bcf-81446d8a7940 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:20.680483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48d121-5f36-4d4d-8bcf-81446d8a7940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:20.703943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] MFA Rules not processed for user `0b8847964e304a6b9cb10897e338ce07`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:20.706247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:20.736291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-db48d121-5f36-4d4d-8bcf-81446d8a7940 None None] MFA Rules not processed for user `5ba647cc3a734dcbbf61bcfa66d6511f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:20.737546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-db48d121-5f36-4d4d-8bcf-81446d8a7940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:20.939462 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3490/6961] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:20.954473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48d121-5f36-4d4d-8bcf-81446d8a7940 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:21.025846 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3472/6962] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:21.043427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:21.045296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:21.174803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a47f-dd73-429e-bb8f-3db243c575f6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:21.186593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f348d4-c229-4b31-8a95-b673c4341cb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:21.187305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f348d4-c229-4b31-8a95-b673c4341cb5 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:21.187590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f348d4-c229-4b31-8a95-b673c4341cb5 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:21.187919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f348d4-c229-4b31-8a95-b673c4341cb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:21.190254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48d121-5f36-4d4d-8bcf-81446d8a7940 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:21.197155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:21.197716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:21.198592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:21.199597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:21.201461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:21.204278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:21.205459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f348d4-c229-4b31-8a95-b673c4341cb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:21.208690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f348d4-c229-4b31-8a95-b673c4341cb5 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:21.238842 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3473/6963] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:21.258021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362276c-126c-4b2a-939a-1d098acb2496 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:21.258314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362276c-126c-4b2a-939a-1d098acb2496 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:21.258603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362276c-126c-4b2a-939a-1d098acb2496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:21.275088 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3491/6964] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:20 2022] POST /identity/v3/projects => generated 381 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:21.279825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:21.475616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6362276c-126c-4b2a-939a-1d098acb2496 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:21.476907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6362276c-126c-4b2a-939a-1d098acb2496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:21.540861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacdb73-fadb-4b64-a5ba-fc9c1a7d3fd6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:21.560992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef3867-2b07-4ef8-b6db-d3980d9e5396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:21.561602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef3867-2b07-4ef8-b6db-d3980d9e5396 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:21.561872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef3867-2b07-4ef8-b6db-d3980d9e5396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:21.562140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef3867-2b07-4ef8-b6db-d3980d9e5396 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:21.575698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef3867-2b07-4ef8-b6db-d3980d9e5396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:21.578193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef3867-2b07-4ef8-b6db-d3980d9e5396 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:21.633386 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3492/6965] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:21 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:21.639038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:21.639363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:21.642154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:21.667052 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3474/6966] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:08:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:21.668682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362276c-126c-4b2a-939a-1d098acb2496 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:21.682364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:21.684965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:21.698005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362276c-126c-4b2a-939a-1d098acb2496 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:21.710826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:21.712840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:21.713133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:21.713413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:21.713892 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3493/6967] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:08:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:21.716892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:21.717278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:21.719787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:21.721479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:21.752810 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3475/6968] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:21.753880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:21.755949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:21.992382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcf052-1a22-453c-8a2a-5179990cf22f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:21.993471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4846fa5-f232-43fb-8cc3-97e5766ad210 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:22.003781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:22.004515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:22.004816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:22.007300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:22.007524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:22.007524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:22.007780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:22.007947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:22.025713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:22.029296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:22.031708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:22.033324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:22.049918 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3494/6969] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:22.052710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:22.052961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3476/6970] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:22.065985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5cb1f-0c61-4a32-a893-6ffbc50a4c8b service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:22.071572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ec525-dbe0-401d-ab9c-5d079e150228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:22.072537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec525-dbe0-401d-ab9c-5d079e150228 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:22.072770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec525-dbe0-401d-ab9c-5d079e150228 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:22.073058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ec525-dbe0-401d-ab9c-5d079e150228 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:22.074382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ec525-dbe0-401d-ab9c-5d079e150228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:22.076137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ec525-dbe0-401d-ab9c-5d079e150228 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:22.106831 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3495/6971] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:22.109466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:22.137639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdaa6b0-f2d8-4c89-ab7e-668e3bd75557 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:22.149903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:22.150876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:22.151168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:22.151449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] PATH_INFO: `/v3/projects/9ec9ff453be64806a3592200d6c0ca1c/users/3ee314553fcc4a41a5477bc146bcea00/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:22.193003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec9ff453be64806a3592200d6c0ca1c, user_id=3ee314553fcc4a41a5477bc146bcea00, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:22.196547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:22.254011 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3477/6972] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:22 2022] PUT /identity/v3/projects/9ec9ff453be64806a3592200d6c0ca1c/users/3ee314553fcc4a41a5477bc146bcea00/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:22.266973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d7b37-08bb-4d66-8029-9cd99afc8ab4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:22.267633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d7b37-08bb-4d66-8029-9cd99afc8ab4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:22.267633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d7b37-08bb-4d66-8029-9cd99afc8ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:22.362417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d82d7b37-08bb-4d66-8029-9cd99afc8ab4 None None] MFA Rules not processed for user `3ee314553fcc4a41a5477bc146bcea00`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:22.365677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d82d7b37-08bb-4d66-8029-9cd99afc8ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:22.504165 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3496/6973] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:22.505509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:22.733287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f64ca-b62d-4c89-89f3-a257f61e7992 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:22.739733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091620e-12a5-4b23-a021-94cca3691538 tempest-IdentityV3ProjectsTest-335104100 tempest-IdentityV3ProjectsTest-335104100-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ba647cc3a734dcbbf61bcfa66d6511f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88dc6e94066e42c084774d57a8faf609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:22.741058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091620e-12a5-4b23-a021-94cca3691538 tempest-IdentityV3ProjectsTest-335104100 tempest-IdentityV3ProjectsTest-335104100-project] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:22.742035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091620e-12a5-4b23-a021-94cca3691538 tempest-IdentityV3ProjectsTest-335104100 tempest-IdentityV3ProjectsTest-335104100-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:22.742497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091620e-12a5-4b23-a021-94cca3691538 tempest-IdentityV3ProjectsTest-335104100 tempest-IdentityV3ProjectsTest-335104100-project] PATH_INFO: `/v3/users/5ba647cc3a734dcbbf61bcfa66d6511f/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:22.744322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091620e-12a5-4b23-a021-94cca3691538 tempest-IdentityV3ProjectsTest-335104100 tempest-IdentityV3ProjectsTest-335104100-project] RBAC: Authorizing `identity:list_user_projects(user_id=5ba647cc3a734dcbbf61bcfa66d6511f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:22.747663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091620e-12a5-4b23-a021-94cca3691538 tempest-IdentityV3ProjectsTest-335104100 tempest-IdentityV3ProjectsTest-335104100-project] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:22.957248 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3478/6974] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:08:22 2022] GET /identity/v3/users/5ba647cc3a734dcbbf61bcfa66d6511f/projects => generated 515 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:22.963768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63405e1d-84ea-47b5-a314-9f1876c666d8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:22.964451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63405e1d-84ea-47b5-a314-9f1876c666d8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:22.965140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63405e1d-84ea-47b5-a314-9f1876c666d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:23.042197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783e43-ed12-494d-a59e-4bd11591112c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:23.042533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783e43-ed12-494d-a59e-4bd11591112c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:23.043580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba783e43-ed12-494d-a59e-4bd11591112c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:23.107831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-63405e1d-84ea-47b5-a314-9f1876c666d8 None None] MFA Rules not processed for user `5ba647cc3a734dcbbf61bcfa66d6511f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:23.113099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ba783e43-ed12-494d-a59e-4bd11591112c None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:23.116029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ba783e43-ed12-494d-a59e-4bd11591112c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:23.122764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-63405e1d-84ea-47b5-a314-9f1876c666d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:23.138463 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3497/6975] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:23.147769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:23.149207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:23.149921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:23.181109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] MFA Rules not processed for user `5ba647cc3a734dcbbf61bcfa66d6511f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:23.184253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:23.364001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.models.token_model [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] User 5ba647cc3a734dcbbf61bcfa66d6511f has no access to project 9ec9ff453be64806a3592200d6c0ca1c {{(pid=91076) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} May 07 22:08:23.367121 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3479/6976] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:23.382332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba783e43-ed12-494d-a59e-4bd11591112c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:23.390708 ncdv-master-1 devstack@keystone.service[91076]: WARNING keystone.server.flask.application [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. May 07 22:08:23.399832 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3498/6977] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:23 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 254 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 07 22:08:23.403601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:23.585834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba783e43-ed12-494d-a59e-4bd11591112c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:23.597995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9ae3b-7150-4f7c-8f69-7766e8aa8ad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:23.599563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ae3b-7150-4f7c-8f69-7766e8aa8ad6 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:23.600017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ae3b-7150-4f7c-8f69-7766e8aa8ad6 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:23.600532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9ae3b-7150-4f7c-8f69-7766e8aa8ad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:23.626911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5004f-68f4-4c12-8472-ec55b55b9ac7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:23.637066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9ae3b-7150-4f7c-8f69-7766e8aa8ad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:23.638944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9ae3b-7150-4f7c-8f69-7766e8aa8ad6 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:23.642111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:23.643089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:23.643374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:23.644225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] PATH_INFO: `/v3/users/5ba647cc3a734dcbbf61bcfa66d6511f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:23.648985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba647cc3a734dcbbf61bcfa66d6511f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:23.651417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:23.666661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3480/6978] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 22:08:23.772707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba647cc3a734dcbbf61bcfa66d6511f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:23.774443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba647cc3a734dcbbf61bcfa66d6511f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:23.830137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba647cc3a734dcbbf61bcfa66d6511f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:23.834956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba647cc3a734dcbbf61bcfa66d6511f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:23.856917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fe93d736-4d9e-4f4f-a2f0-0d0fb67580c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba647cc3a734dcbbf61bcfa66d6511f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:23.914406 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3499/6979] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:23 2022] DELETE /identity/v3/users/5ba647cc3a734dcbbf61bcfa66d6511f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:23.919498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:23.920027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:23.920117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:24.018185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:24.022543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:24.260559 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3481/6980] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:24.270435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:24.270786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:24.271516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:24.286464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:24.287936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:24.323027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:24.326004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:24.336445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bae11-2423-4848-80a1-d78a63c51f4b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:24.371463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:24.372556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:24.373324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:24.373767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] PATH_INFO: `/v3/users/93dc261b78a349bcb8fce05d488ed8a3` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:24.375561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dc261b78a349bcb8fce05d488ed8a3)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:24.383244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:24.521465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dc261b78a349bcb8fce05d488ed8a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:24.524854 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3500/6981] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:24.525892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:24.533582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:24.547821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dc261b78a349bcb8fce05d488ed8a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:24.548545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dc261b78a349bcb8fce05d488ed8a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:24.550521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dc261b78a349bcb8fce05d488ed8a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:24.581083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dc261b78a349bcb8fce05d488ed8a3'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:24.628635 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3482/6982] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:24 2022] DELETE /identity/v3/users/93dc261b78a349bcb8fce05d488ed8a3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:24.637954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:24.642416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:24.778717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e100706-9b43-4083-9df4-ec1cf1402009 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:24.912128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2f514-ee09-4d76-ac65-97bf8928c3eb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:24.942017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379c624-6399-4a73-891b-e28743dd23ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:24.943554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c624-6399-4a73-891b-e28743dd23ef service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:24.945010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c624-6399-4a73-891b-e28743dd23ef service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:24.945618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379c624-6399-4a73-891b-e28743dd23ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:24.948456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9379c624-6399-4a73-891b-e28743dd23ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:24.952331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:24.952999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:24.953310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:24.953556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:24.960889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:25.083942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c624-6399-4a73-891b-e28743dd23ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:25.087886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379c624-6399-4a73-891b-e28743dd23ef service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:25.128616 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3483/6983] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:25.132844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:25.133342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:25.134023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:25.135011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:25.141418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:25.181218 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3501/6984] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:25.182192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:25.184016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:25.187005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:25.188629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:25.211102 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3484/6985] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:25.224754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:25.228954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:25.261296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900b07-5d7e-4ecf-8258-537e147f4a5f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:25.266676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b073465-8813-4a33-8028-d96a5679cbe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:25.267676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b073465-8813-4a33-8028-d96a5679cbe7 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:25.268157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b073465-8813-4a33-8028-d96a5679cbe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:25.268635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b073465-8813-4a33-8028-d96a5679cbe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:25.291478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b073465-8813-4a33-8028-d96a5679cbe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:25.294262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b073465-8813-4a33-8028-d96a5679cbe7 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:25.310188 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3485/6986] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:25.390039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77824e1c-0f07-43c3-a7ea-cbb5405febf6 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:25.411704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:25.412648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:25.413097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:25.413617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:25.418098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:25.460151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:25.465499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:25.512510 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3502/6987] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:25.715349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:25.715721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:25.715899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:25.772711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:25.774727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:25.796238 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3486/6988] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:08:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:25.822323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:25.850546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af1809-4e79-4187-bf80-36e39d17ab15 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:25.864241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259e7d4-ebf3-4440-8f9e-b951e9fcf9c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:25.864911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e7d4-ebf3-4440-8f9e-b951e9fcf9c4 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:25.865235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e7d4-ebf3-4440-8f9e-b951e9fcf9c4 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:25.865512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e7d4-ebf3-4440-8f9e-b951e9fcf9c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:25.892470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259e7d4-ebf3-4440-8f9e-b951e9fcf9c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:25.894475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259e7d4-ebf3-4440-8f9e-b951e9fcf9c4 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:25.925115 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3503/6989] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:26.304516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:26.306267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:26.347800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf796-ad60-4dbf-bc88-67c614f120cc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:26.349223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf796-ad60-4dbf-bc88-67c614f120cc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:26.349763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf796-ad60-4dbf-bc88-67c614f120cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:26.358686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec1946-b910-4ddd-856d-3baa5b86ff3d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:26.386346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-236cf796-ad60-4dbf-bc88-67c614f120cc None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:26.389120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:26.390234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:26.390665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:26.391139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-236cf796-ad60-4dbf-bc88-67c614f120cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:26.391315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] PATH_INFO: `/v3/projects/51018c16b81247ff8a3cfe8ba2f8fd13` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:26.392786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51018c16b81247ff8a3cfe8ba2f8fd13)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:26.396356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:26.421570 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3504/6990] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:08:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:26.433035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cf796-ad60-4dbf-bc88-67c614f120cc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:26.462559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cf796-ad60-4dbf-bc88-67c614f120cc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:26.477969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:26.479613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:26.480752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:26.481430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:26.507971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:26.510165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:26.542103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51018c16b81247ff8a3cfe8ba2f8fd13', 'request_id': 'req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:26.542263 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3505/6991] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:26.562048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51018c16b81247ff8a3cfe8ba2f8fd13', 'request_id': 'req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:26.583540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51018c16b81247ff8a3cfe8ba2f8fd13', 'request_id': 'req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:26.621309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] The token cache is being invalidate because project 51018c16b81247ff8a3cfe8ba2f8fd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:26.621991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:26.623328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fd5328d8-c2bc-4b9c-951d-d32e37bb4b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:26.625176 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3487/6992] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:26 2022] DELETE /identity/v3/projects/51018c16b81247ff8a3cfe8ba2f8fd13 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:26.629626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:26.676201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c7d4-261c-4812-8900-5957755e8f04 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:26.843038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:26.844011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:26.844329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:26.844463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] PATH_INFO: `/v3/users/046e97b7cdc5403e9bbcb90699a60160` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:26.845796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046e97b7cdc5403e9bbcb90699a60160)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:26.850846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:27.025116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046e97b7cdc5403e9bbcb90699a60160'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.027042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046e97b7cdc5403e9bbcb90699a60160'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.069974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:27.069974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:27.070205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:27.095594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046e97b7cdc5403e9bbcb90699a60160'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.104501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046e97b7cdc5403e9bbcb90699a60160'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.119664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:27.121585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:27.124536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046e97b7cdc5403e9bbcb90699a60160'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.161003 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3506/6993] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:26 2022] DELETE /identity/v3/users/046e97b7cdc5403e9bbcb90699a60160 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:27.161003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:27.161392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:27.358104 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3488/6994] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:08:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:27.375354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:27.377145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:27.407379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef020a7-bf81-422c-92fe-d6d0aae855f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:27.415642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:27.416882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:27.418158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:27.418648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] PATH_INFO: `/v3/projects/88dc6e94066e42c084774d57a8faf609` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:27.420370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88dc6e94066e42c084774d57a8faf609)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:27.422851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:27.526612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88dc6e94066e42c084774d57a8faf609', 'request_id': 'req-b9fcff24-2115-4b2f-9213-636ecdd6e79c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.547189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88dc6e94066e42c084774d57a8faf609', 'request_id': 'req-b9fcff24-2115-4b2f-9213-636ecdd6e79c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.565307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88dc6e94066e42c084774d57a8faf609', 'request_id': 'req-b9fcff24-2115-4b2f-9213-636ecdd6e79c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.588174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] The token cache is being invalidate because project 88dc6e94066e42c084774d57a8faf609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:27.588816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.591495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.600179 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3507/6995] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:27 2022] DELETE /identity/v3/projects/88dc6e94066e42c084774d57a8faf609 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:27.601304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:27.607242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:27.631889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf5559-0aaa-4562-8878-7083a36d4bca None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:27.789974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcff24-2115-4b2f-9213-636ecdd6e79c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:27.820756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:27.823368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:27.825440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db0075-fad2-4ac6-b19b-4f91c12a7059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:27.826075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:27.826191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0075-fad2-4ac6-b19b-4f91c12a7059 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:27.826397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0075-fad2-4ac6-b19b-4f91c12a7059 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:27.826675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db0075-fad2-4ac6-b19b-4f91c12a7059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:27.827533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] PATH_INFO: `/v3/users/3ee314553fcc4a41a5477bc146bcea00` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:27.833466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee314553fcc4a41a5477bc146bcea00)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:27.837727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:27.838597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1db0075-fad2-4ac6-b19b-4f91c12a7059 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:27.932410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee314553fcc4a41a5477bc146bcea00'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.933917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee314553fcc4a41a5477bc146bcea00'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.944854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee314553fcc4a41a5477bc146bcea00'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.951680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee314553fcc4a41a5477bc146bcea00'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.967259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee314553fcc4a41a5477bc146bcea00'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:27.986046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0075-fad2-4ac6-b19b-4f91c12a7059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:27.989235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db0075-fad2-4ac6-b19b-4f91c12a7059 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:28.001144 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3508/6996] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:27 2022] DELETE /identity/v3/users/3ee314553fcc4a41a5477bc146bcea00 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:28.013635 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3489/6997] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 22:08:28.213038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:28.217077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:28.433933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3b496-7441-4f7a-a22b-d7320bf3620b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:28.449816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:28.451259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:28.451712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:28.452178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] PATH_INFO: `/v3/projects/f6360875ae174a0caaa2bbb02459244d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:28.457857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6360875ae174a0caaa2bbb02459244d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:28.460181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:28.672027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6360875ae174a0caaa2bbb02459244d', 'request_id': 'req-56f3fd9b-8ea7-467c-a680-685070f700e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:28.690498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6360875ae174a0caaa2bbb02459244d', 'request_id': 'req-56f3fd9b-8ea7-467c-a680-685070f700e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:28.713605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6360875ae174a0caaa2bbb02459244d', 'request_id': 'req-56f3fd9b-8ea7-467c-a680-685070f700e3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:28.739725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] The token cache is being invalidate because project f6360875ae174a0caaa2bbb02459244d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:28.740082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:28.747171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-56f3fd9b-8ea7-467c-a680-685070f700e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:28.755110 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3509/6998] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:28 2022] DELETE /identity/v3/projects/f6360875ae174a0caaa2bbb02459244d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:28.771367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906023ee-2190-4508-a891-768456851b01 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:28.771921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906023ee-2190-4508-a891-768456851b01 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:28.771921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906023ee-2190-4508-a891-768456851b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:28.848477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-906023ee-2190-4508-a891-768456851b01 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:28.850276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-906023ee-2190-4508-a891-768456851b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:29.093994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878bc18-3c88-4214-8f7f-2ae63677099f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.098050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878bc18-3c88-4214-8f7f-2ae63677099f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.099397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878bc18-3c88-4214-8f7f-2ae63677099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.111787 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3490/6999] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:29.154234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906023ee-2190-4508-a891-768456851b01 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.157385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-906023ee-2190-4508-a891-768456851b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:29.217933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b878bc18-3c88-4214-8f7f-2ae63677099f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:29.222651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b878bc18-3c88-4214-8f7f-2ae63677099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:29.239423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906023ee-2190-4508-a891-768456851b01 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.264551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3510/7000] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:29.269633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878bc18-3c88-4214-8f7f-2ae63677099f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.271537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.272709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.272992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.273264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] PATH_INFO: `/v3/projects/9ec9ff453be64806a3592200d6c0ca1c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.282292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec9ff453be64806a3592200d6c0ca1c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:29.283789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:29.289275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878bc18-3c88-4214-8f7f-2ae63677099f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.298425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.300437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.300437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.300437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.301469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:29.301853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:29.303951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:29.353061 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3511/7001] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:29.354746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.373513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d184cf-2a2d-4682-9a5b-f42ae3894c3f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.398640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.400162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.401118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.402169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.403226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:29.413441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:29.469229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec9ff453be64806a3592200d6c0ca1c', 'request_id': 'req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:29.481905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec9ff453be64806a3592200d6c0ca1c', 'request_id': 'req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:29.500513 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3512/7002] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:29 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:08:29.502706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.509398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec9ff453be64806a3592200d6c0ca1c', 'request_id': 'req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:29.534077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] The token cache is being invalidate because project 9ec9ff453be64806a3592200d6c0ca1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:29.536009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:29.537003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4fa7b66-4524-4bf1-96a9-b35fadb4b18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:29.552033 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3491/7003] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:29 2022] DELETE /identity/v3/projects/9ec9ff453be64806a3592200d6c0ca1c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:29.553783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae527-08e6-48aa-a773-7505beb921e0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.554077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae527-08e6-48aa-a773-7505beb921e0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.554354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae527-08e6-48aa-a773-7505beb921e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.618153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-349ae527-08e6-48aa-a773-7505beb921e0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:29.619471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-349ae527-08e6-48aa-a773-7505beb921e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:29.651049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008251f0-336f-44aa-8e22-3220fa219b72 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.657385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.658461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.658991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.659481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.660405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:29.662701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:29.729719 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3513/7004] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:29 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:29.734238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.738033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:29.767634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5af9e-c3a1-406b-bd84-fde1bc8ab0b2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.779938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.780631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.780918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.781199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.781932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:29.786763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:29.807137 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3514/7005] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:29.809449 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3492/7006] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:29.811554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.818878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18e5d-c666-4401-b409-e10f04d3c5a4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.819310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18e5d-c666-4401-b409-e10f04d3c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.819694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18e5d-c666-4401-b409-e10f04d3c5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.852456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7267660-90a1-4b42-a1d1-5faedbe4d19d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.863491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.864284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.864676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.865075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.866396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:29.866876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-21a18e5d-c666-4401-b409-e10f04d3c5a4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:29.868631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:29.870049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-21a18e5d-c666-4401-b409-e10f04d3c5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:29.896664 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3493/7007] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:29.899437 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3515/7008] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:29.900816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18e5d-c666-4401-b409-e10f04d3c5a4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.906644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:29.918457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18e5d-c666-4401-b409-e10f04d3c5a4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.937087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae154e6-a066-47c2-a0c7-4c016c2c03fb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:29.939614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.940981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.942183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.943062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.944390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:29.945708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:29.948048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4aa95-b5a9-49d3-8fc0-b9ead0390d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:29.950884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4aa95-b5a9-49d3-8fc0-b9ead0390d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:29.951241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4aa95-b5a9-49d3-8fc0-b9ead0390d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:29.951589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4aa95-b5a9-49d3-8fc0-b9ead0390d64 admin admin] PATH_INFO: `/v3/projects/5ffa9fa2c541495f8ee64d894922f943/users/0a477dc6fc084a2a8a733136ec9e4350/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:29.951706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:29.997124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3494/7009] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:30.000410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:30.013393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4aa95-b5a9-49d3-8fc0-b9ead0390d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffa9fa2c541495f8ee64d894922f943, user_id=0a477dc6fc084a2a8a733136ec9e4350, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:30.019322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4aa95-b5a9-49d3-8fc0-b9ead0390d64 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:30.029180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc084-cf9c-4813-9f40-37017611c15d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:30.069301 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3516/7010] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:29 2022] PUT /identity/v3/projects/5ffa9fa2c541495f8ee64d894922f943/users/0a477dc6fc084a2a8a733136ec9e4350/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:30.096086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c42d3-5559-47a4-a15e-b789931725fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:30.097410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c42d3-5559-47a4-a15e-b789931725fa admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.097854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c42d3-5559-47a4-a15e-b789931725fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.098265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c42d3-5559-47a4-a15e-b789931725fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.099137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c42d3-5559-47a4-a15e-b789931725fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:30.101569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c42d3-5559-47a4-a15e-b789931725fa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:30.114680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e765c-9474-4acf-bd2c-8565a7cd12e1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.115211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e765c-9474-4acf-bd2c-8565a7cd12e1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.122018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e765c-9474-4acf-bd2c-8565a7cd12e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.187587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2b7e765c-9474-4acf-bd2c-8565a7cd12e1 None None] MFA Rules not processed for user `0a477dc6fc084a2a8a733136ec9e4350`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:30.197623 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3495/7011] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:29 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:30.199320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.200690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b7e765c-9474-4acf-bd2c-8565a7cd12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:30.201050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.204677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.263423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:30.266397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:30.448365 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3517/7012] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:30.449994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e765c-9474-4acf-bd2c-8565a7cd12e1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:30.468212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3496/7013] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:08:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:30.476244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:30.478040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:30.586909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e765c-9474-4acf-bd2c-8565a7cd12e1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:30.602827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:30.603845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.605653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.606173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.606997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:30.609264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:30.638365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195cdbe-df18-4a4e-b8da-4440ae46127a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:30.654720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:30.655866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.656145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.656412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.686158 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3518/7014] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:30 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:30.687329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:30.689547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:30.701139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:30.704626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:30.720754 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3497/7015] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:30.722043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:30.763404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c83cf6-522f-4252-86fa-da44cc0eb81d service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:30.769058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:30.770028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.770320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.770650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.771444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:30.773237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:30.793479 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3498/7016] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:30.819910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:30.861576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26092c-2104-49fd-b1d1-103fbfa8d970 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:30.897255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:30.909105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.909280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.909579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] PATH_INFO: `/v3/users/0a477dc6fc084a2a8a733136ec9e4350` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.914292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a477dc6fc084a2a8a733136ec9e4350)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:30.921854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:30.942960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c39ff-c765-49c4-ad63-f63a3ee0bc64 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:30.968411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:30.969444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:30.969947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:30.970466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:30.991441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:31.013130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:31.039050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3519/7017] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:31.043387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:31.065088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac831-e3be-499a-94a9-7fcefaabc1ee service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:31.068952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a477dc6fc084a2a8a733136ec9e4350'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:31.075007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:31.077777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.078279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.078467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.079452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:31.081437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:31.085158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a477dc6fc084a2a8a733136ec9e4350'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:31.086631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a477dc6fc084a2a8a733136ec9e4350'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:31.099367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a477dc6fc084a2a8a733136ec9e4350'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:31.103092 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3520/7018] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:31.105596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:31.109436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:31.130142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3f8eb-0f21-4c4d-9a34-e10bfb17f224 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:31.132257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8305a83b-e844-4eed-b193-e8013a8994cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a477dc6fc084a2a8a733136ec9e4350'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:31.136708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b0168-de85-4268-8272-6529468abeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:31.137827 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b0168-de85-4268-8272-6529468abeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.138009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b0168-de85-4268-8272-6529468abeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.138711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b0168-de85-4268-8272-6529468abeeb admin admin] PATH_INFO: `/v3/projects/897a1c519ef5418587c1629e414dde55/users/7aa19d8ed0f142e08d2b863a100501d8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.165149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b0168-de85-4268-8272-6529468abeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=897a1c519ef5418587c1629e414dde55, user_id=7aa19d8ed0f142e08d2b863a100501d8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:31.168752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b0168-de85-4268-8272-6529468abeeb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:31.189756 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3499/7019] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:30 2022] DELETE /identity/v3/users/0a477dc6fc084a2a8a733136ec9e4350 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:31.212045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.212365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.212636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.213626 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3521/7020] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:31 2022] PUT /identity/v3/projects/897a1c519ef5418587c1629e414dde55/users/7aa19d8ed0f142e08d2b863a100501d8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:31.215770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43770f-03b7-4e98-b65c-007b297b208e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.216060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43770f-03b7-4e98-b65c-007b297b208e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.216334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43770f-03b7-4e98-b65c-007b297b208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.254213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:31.256404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:31.267077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fe43770f-03b7-4e98-b65c-007b297b208e None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:31.268312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fe43770f-03b7-4e98-b65c-007b297b208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:31.360028 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3500/7021] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:31.372012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:31.374901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:31.378877 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3522/7022] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:31.380034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43770f-03b7-4e98-b65c-007b297b208e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:31.397494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43770f-03b7-4e98-b65c-007b297b208e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:31.404084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49cbc9-5cdc-44d1-a6aa-a8713602fb31 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:31.405488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49cbc9-5cdc-44d1-a6aa-a8713602fb31 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.405931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49cbc9-5cdc-44d1-a6aa-a8713602fb31 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.406436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49cbc9-5cdc-44d1-a6aa-a8713602fb31 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.469207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1c49cbc9-5cdc-44d1-a6aa-a8713602fb31 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:31.487088 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3523/7023] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:31 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:31.490713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a957-3b29-41e8-98f1-84c63ec798a6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.492533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a957-3b29-41e8-98f1-84c63ec798a6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.493125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a957-3b29-41e8-98f1-84c63ec798a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.539757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fc86a957-3b29-41e8-98f1-84c63ec798a6 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:31.541242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fc86a957-3b29-41e8-98f1-84c63ec798a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:31.567967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23b597-86a8-44f3-b078-77a257aff29e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:31.572937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:31.573761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.574112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.574462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.586564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:31.588516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:31.603432 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3501/7024] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:31.660357 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3524/7025] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:08:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:31.674032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:31.675722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:31.773522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cb2d1-d36f-4fdc-b63a-e7395a3f93ae service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:31.784884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823d1c-5619-4972-866c-816375836fab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:31.785717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823d1c-5619-4972-866c-816375836fab service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:31.786006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823d1c-5619-4972-866c-816375836fab service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:31.786299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06823d1c-5619-4972-866c-816375836fab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:31.800441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823d1c-5619-4972-866c-816375836fab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:31.802125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06823d1c-5619-4972-866c-816375836fab service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:31.814610 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3502/7026] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:32.077757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:32.077757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:32.078333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:32.115436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:32.118448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:32.140032 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3525/7027] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:32.177072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823d1c-5619-4972-866c-816375836fab service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:32.207332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06823d1c-5619-4972-866c-816375836fab service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:32.221290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb68fac-e930-462e-b917-f817721820aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:32.222762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb68fac-e930-462e-b917-f817721820aa service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:32.223076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb68fac-e930-462e-b917-f817721820aa service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:32.225056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb68fac-e930-462e-b917-f817721820aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:32.255767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb68fac-e930-462e-b917-f817721820aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:32.259809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb68fac-e930-462e-b917-f817721820aa service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:32.292955 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3503/7028] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:32.436654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:32.439179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:32.496295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8328-81cc-4f0c-8943-63fc66437cfa None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:32.496891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8328-81cc-4f0c-8943-63fc66437cfa None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:32.497226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea8328-81cc-4f0c-8943-63fc66437cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:32.533433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd6b7d-c22e-46ff-b450-68e5491be983 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:32.556329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d9ea8328-81cc-4f0c-8943-63fc66437cfa None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:32.558637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d9ea8328-81cc-4f0c-8943-63fc66437cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:32.563968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:32.564197 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3504/7029] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:32 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 22:08:32.569328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d6eb-1fdb-4595-97eb-8c278683cb1a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:32.569770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d6eb-1fdb-4595-97eb-8c278683cb1a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:32.570144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d6eb-1fdb-4595-97eb-8c278683cb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:32.579998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:32.580686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:32.582150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] PATH_INFO: `/v3/projects/5ffa9fa2c541495f8ee64d894922f943` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:32.583704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffa9fa2c541495f8ee64d894922f943)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:32.588911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:32.608327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-72f1d6eb-1fdb-4595-97eb-8c278683cb1a None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:32.618827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-72f1d6eb-1fdb-4595-97eb-8c278683cb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:32.638844 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3505/7030] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:32.639995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e32c-5d4e-4a50-bdfc-d475d65488d4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:32.640449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e32c-5d4e-4a50-bdfc-d475d65488d4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:32.640960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e32c-5d4e-4a50-bdfc-d475d65488d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:32.688942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-67e6e32c-5d4e-4a50-bdfc-d475d65488d4 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:32.702331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffa9fa2c541495f8ee64d894922f943', 'request_id': 'req-42f02073-72f0-444f-be57-9ed73f6f4ecd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:32.705550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-67e6e32c-5d4e-4a50-bdfc-d475d65488d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:32.737540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffa9fa2c541495f8ee64d894922f943', 'request_id': 'req-42f02073-72f0-444f-be57-9ed73f6f4ecd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:32.751461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffa9fa2c541495f8ee64d894922f943', 'request_id': 'req-42f02073-72f0-444f-be57-9ed73f6f4ecd'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:32.769382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] The token cache is being invalidate because project 5ffa9fa2c541495f8ee64d894922f943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:32.769768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:32.770541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:32.789192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3526/7031] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:32 2022] DELETE /identity/v3/projects/5ffa9fa2c541495f8ee64d894922f943 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:32.789192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:32.796243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:32.825641 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3506/7032] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:32.827087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:32.827380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:32.827656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:32.872505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:32.874979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:33.000184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f02073-72f0-444f-be57-9ed73f6f4ecd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.021407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab77a38-9433-41d7-9d2f-888461c94123 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.027525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77a38-9433-41d7-9d2f-888461c94123 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.027922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77a38-9433-41d7-9d2f-888461c94123 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.028175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77a38-9433-41d7-9d2f-888461c94123 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.081820 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3507/7033] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:33.083165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.091386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-8ab77a38-9433-41d7-9d2f-888461c94123 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:33.207475 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 07 22:08:33.209010 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:33.210282 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3527/7034] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:32 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 188 bytes in 423 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:08:33.210990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30437-42bd-476b-962d-54ef3e08f9ca None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.213260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30437-42bd-476b-962d-54ef3e08f9ca None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.213632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30437-42bd-476b-962d-54ef3e08f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.269381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977ac8e-b494-40cf-9793-062157b9c8dd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.271860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-33b30437-42bd-476b-962d-54ef3e08f9ca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:33.273407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33b30437-42bd-476b-962d-54ef3e08f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:33.304280 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3528/7035] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:33.304280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30437-42bd-476b-962d-54ef3e08f9ca None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.305260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.306498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.310103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.310794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.326362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:33.328168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:33.338842 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3508/7036] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:33.344495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30437-42bd-476b-962d-54ef3e08f9ca None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.363596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.370012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bbfb8-c640-4172-a3be-1e12c0ddad43 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.371295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bbfb8-c640-4172-a3be-1e12c0ddad43 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.371590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bbfb8-c640-4172-a3be-1e12c0ddad43 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.371879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bbfb8-c640-4172-a3be-1e12c0ddad43 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.411834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4b9a-ed9a-4deb-a00d-0c38f610ff6b service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.419456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.423636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.424860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.425388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.444614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:33.446475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:33.450625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f26bbfb8-c640-4172-a3be-1e12c0ddad43 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:33.489074 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. May 07 22:08:33.490227 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:08:33.497862 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3509/7037] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:33.503773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.510551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3529/7038] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:33 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 188 bytes in 209 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:08:33.525496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bbfb8-c640-4172-a3be-1e12c0ddad43 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.545320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7708c95-1647-43be-9705-af3b8578f3d8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.563530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bbfb8-c640-4172-a3be-1e12c0ddad43 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.567929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.569488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.570651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.571229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.572368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:33.577219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:33.577508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7e684-301b-4c8e-8e86-71984e63f36a tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.578513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e684-301b-4c8e-8e86-71984e63f36a tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.578956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e684-301b-4c8e-8e86-71984e63f36a tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.579347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7e684-301b-4c8e-8e86-71984e63f36a tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.636971 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3510/7039] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:33 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:08:33.642732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.648002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-71f7e684-301b-4c8e-8e86-71984e63f36a tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:33.677579 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3530/7040] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:33 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:33.706730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ad7f8-d8e5-41df-914b-658516e337cc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.707054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ad7f8-d8e5-41df-914b-658516e337cc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.707338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ad7f8-d8e5-41df-914b-658516e337cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.732768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dc4ad7f8-d8e5-41df-914b-658516e337cc None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:33.734566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc4ad7f8-d8e5-41df-914b-658516e337cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:33.785552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a16d8-0cc6-442a-81f9-1a68ff64a55f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.811230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.812285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.812578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.812852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.813759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:33.815556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:33.843415 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3531/7041] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:33.851874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ad7f8-d8e5-41df-914b-658516e337cc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.868540 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3511/7042] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:33 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:33.869745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.889590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4a5ee-e958-4a42-91e5-8df7098fb6f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.908809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.909507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.911051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.911051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.911872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:33.913457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:33.950833 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3512/7043] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:33.955208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:33.957666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ad7f8-d8e5-41df-914b-658516e337cc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:33.963630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:33.965786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:33.966366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:33.966852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:33.976914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:33.979596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:33.990177 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3532/7044] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:33.992944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1cea2-c074-44d0-9f21-de0cc13c739f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:34.015096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c435a-f828-4498-a0c6-10fabe251f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:34.015706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c435a-f828-4498-a0c6-10fabe251f6c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.015897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c435a-f828-4498-a0c6-10fabe251f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.016371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c435a-f828-4498-a0c6-10fabe251f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.017563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c435a-f828-4498-a0c6-10fabe251f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:34.024182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c435a-f828-4498-a0c6-10fabe251f6c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:34.053580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:34.084493 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3513/7045] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:34.092330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd639064-dccb-4b4e-8581-b3284cb1e7ac service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:34.122573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc213033-e9d0-4cd6-aca4-20e6c737d2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:34.129711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213033-e9d0-4cd6-aca4-20e6c737d2ac admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.129711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213033-e9d0-4cd6-aca4-20e6c737d2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.133236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213033-e9d0-4cd6-aca4-20e6c737d2ac admin admin] PATH_INFO: `/v3/projects/e2bec96bf83d4fb296cbb8aeb28d576e/users/38e6d754538146aea01b0f51c8e2cc2f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.192390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213033-e9d0-4cd6-aca4-20e6c737d2ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2bec96bf83d4fb296cbb8aeb28d576e, user_id=38e6d754538146aea01b0f51c8e2cc2f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:34.196755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213033-e9d0-4cd6-aca4-20e6c737d2ac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:34.245991 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3533/7046] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:34 2022] PUT /identity/v3/projects/e2bec96bf83d4fb296cbb8aeb28d576e/users/38e6d754538146aea01b0f51c8e2cc2f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:34.256949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499182-e881-4737-bb8e-9cfa168f609d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.257242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499182-e881-4737-bb8e-9cfa168f609d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.257626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.257934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.258216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499182-e881-4737-bb8e-9cfa168f609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.258385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.281016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3e499182-e881-4737-bb8e-9cfa168f609d None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:34.283132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3e499182-e881-4737-bb8e-9cfa168f609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:34.330429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] MFA Rules not processed for user `38e6d754538146aea01b0f51c8e2cc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:34.332381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:34.421435 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3514/7047] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:08:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:34.438897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499182-e881-4737-bb8e-9cfa168f609d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:34.606623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3534/7048] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:34.608069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:34.611466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:34.673152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499182-e881-4737-bb8e-9cfa168f609d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:34.698714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e8dc-9439-4225-8996-8c396eba03c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:34.699493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e8dc-9439-4225-8996-8c396eba03c4 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.699894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e8dc-9439-4225-8996-8c396eba03c4 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.700829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e8dc-9439-4225-8996-8c396eba03c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.721334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e8dc-9439-4225-8996-8c396eba03c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:34.723364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e8dc-9439-4225-8996-8c396eba03c4 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:34.766330 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3515/7049] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:08:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:08:34.768249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.770077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.771219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.783777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5adac7-62eb-4b59-b877-4cdb02ed20da None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:34.788783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158d87c-cf5b-4742-a5f0-5f3f7a94e07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:34.789656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d87c-cf5b-4742-a5f0-5f3f7a94e07c service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.790122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d87c-cf5b-4742-a5f0-5f3f7a94e07c service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.790331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d87c-cf5b-4742-a5f0-5f3f7a94e07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.804533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d87c-cf5b-4742-a5f0-5f3f7a94e07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:34.806688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d87c-cf5b-4742-a5f0-5f3f7a94e07c service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:34.820243 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3535/7050] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:34.836242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:34.837853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:34.870277 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3516/7051] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:34 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:34.876299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccb476-ef27-436d-ab02-031ad252953c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:34.877123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccb476-ef27-436d-ab02-031ad252953c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:34.877123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccb476-ef27-436d-ab02-031ad252953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:34.956919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e7ccb476-ef27-436d-ab02-031ad252953c None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:34.969852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e7ccb476-ef27-436d-ab02-031ad252953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:34.996512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:34.998104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:35.238691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68adec-f9df-4e02-be6f-6e2205633a8d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:35.248378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:35.250441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:35.251010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:35.251493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] PATH_INFO: `/v3/users/0b8847964e304a6b9cb10897e338ce07` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:35.255072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8847964e304a6b9cb10897e338ce07)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:35.260302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:35.278427 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3536/7052] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:35.285738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccb476-ef27-436d-ab02-031ad252953c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:35.315172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccb476-ef27-436d-ab02-031ad252953c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:35.341690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667310ee-29fa-43cf-aa72-f5ffe1e10bb9 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:35.347838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667310ee-29fa-43cf-aa72-f5ffe1e10bb9 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:35.348132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667310ee-29fa-43cf-aa72-f5ffe1e10bb9 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:35.348411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667310ee-29fa-43cf-aa72-f5ffe1e10bb9 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:35.457201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8847964e304a6b9cb10897e338ce07'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:35.488305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8847964e304a6b9cb10897e338ce07'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:35.492321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8847964e304a6b9cb10897e338ce07'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:35.494815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8847964e304a6b9cb10897e338ce07'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:35.504218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-667310ee-29fa-43cf-aa72-f5ffe1e10bb9 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:35.524380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8847964e304a6b9cb10897e338ce07'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:35.537310 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3537/7053] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:35 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:35.597634 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3517/7054] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:34 2022] DELETE /identity/v3/users/0b8847964e304a6b9cb10897e338ce07 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:35.602469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2812f-d552-4bb5-bf14-2edceb51a16d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:35.602783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2812f-d552-4bb5-bf14-2edceb51a16d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:35.603108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2812f-d552-4bb5-bf14-2edceb51a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:35.638722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c3f2812f-d552-4bb5-bf14-2edceb51a16d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:35.638722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c3f2812f-d552-4bb5-bf14-2edceb51a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:35.764911 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3538/7055] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:35.780456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:35.782057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:35.992516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271d5a-5167-4291-8833-76353c3deaa5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:36.004236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4b25c-323b-4e6d-8586-d774b78b8af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:36.005841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b25c-323b-4e6d-8586-d774b78b8af2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:36.006343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b25c-323b-4e6d-8586-d774b78b8af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:36.006870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4b25c-323b-4e6d-8586-d774b78b8af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:36.022996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4b25c-323b-4e6d-8586-d774b78b8af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:36.029997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4b25c-323b-4e6d-8586-d774b78b8af2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:36.048248 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3518/7056] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:36.543988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac8ba-ad37-4de7-90ca-54463337ef7f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:36.544721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac8ba-ad37-4de7-90ca-54463337ef7f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:36.544721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfac8ba-ad37-4de7-90ca-54463337ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:36.587012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ebfac8ba-ad37-4de7-90ca-54463337ef7f None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:36.588358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ebfac8ba-ad37-4de7-90ca-54463337ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:36.606446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803ea9-6847-4d73-aebd-104efb41cd64 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:36.607063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803ea9-6847-4d73-aebd-104efb41cd64 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:36.607063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b803ea9-6847-4d73-aebd-104efb41cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:36.608414 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3539/7057] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:36 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:36.648265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9b803ea9-6847-4d73-aebd-104efb41cd64 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:36.649573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b803ea9-6847-4d73-aebd-104efb41cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:36.768328 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3519/7058] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:36.772973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfac8ba-ad37-4de7-90ca-54463337ef7f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:36.809161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfac8ba-ad37-4de7-90ca-54463337ef7f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:36.816476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:36.817887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:36.818550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:36.819254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:36.821937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348239fb-ac87-475f-8dde-46d0b83adbc3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:36.822231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348239fb-ac87-475f-8dde-46d0b83adbc3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:36.822516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348239fb-ac87-475f-8dde-46d0b83adbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:36.863304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-348239fb-ac87-475f-8dde-46d0b83adbc3 None None] MFA Rules not processed for user `38e6d754538146aea01b0f51c8e2cc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:36.887894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-348239fb-ac87-475f-8dde-46d0b83adbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:36.947010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:36.965554 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3540/7059] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:36 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:36.991947 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3520/7060] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:37.354383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:37.356364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:37.389889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5985f2-fb92-4541-962e-aa82da000133 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:37.409206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:37.410098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:37.410379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:37.410665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] PATH_INFO: `/v3/projects/2fdedd0c64d2432887488390439c39ad` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:37.417624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fdedd0c64d2432887488390439c39ad)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:37.420180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:37.578459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fdedd0c64d2432887488390439c39ad', 'request_id': 'req-74838a73-9a91-4064-9e72-3f5cb10524f8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:37.588699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fdedd0c64d2432887488390439c39ad', 'request_id': 'req-74838a73-9a91-4064-9e72-3f5cb10524f8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:37.619337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fdedd0c64d2432887488390439c39ad', 'request_id': 'req-74838a73-9a91-4064-9e72-3f5cb10524f8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:37.646701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] The token cache is being invalidate because project 2fdedd0c64d2432887488390439c39ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:37.647421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:37.648199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-74838a73-9a91-4064-9e72-3f5cb10524f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:37.655893 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3541/7061] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:37 2022] DELETE /identity/v3/projects/2fdedd0c64d2432887488390439c39ad => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:37.660951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c884b-4bf3-41d9-953b-5290018ab5d0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:37.661508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c884b-4bf3-41d9-953b-5290018ab5d0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:37.661845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c884b-4bf3-41d9-953b-5290018ab5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:37.697350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8a7c884b-4bf3-41d9-953b-5290018ab5d0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:37.698846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8a7c884b-4bf3-41d9-953b-5290018ab5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:37.823156 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3521/7062] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:37.833136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2eaef-72c5-476c-a4f6-79a21b9a01ea None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:37.833550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2eaef-72c5-476c-a4f6-79a21b9a01ea None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:37.833788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2eaef-72c5-476c-a4f6-79a21b9a01ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:37.885498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-29b2eaef-72c5-476c-a4f6-79a21b9a01ea None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:37.888282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-29b2eaef-72c5-476c-a4f6-79a21b9a01ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:37.909443 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3542/7063] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:37.913933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c884b-4bf3-41d9-953b-5290018ab5d0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:37.927380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c884b-4bf3-41d9-953b-5290018ab5d0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:37.952059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:37.952671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:37.954927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:37.955270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:37.956035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:37.956346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:37.957981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:37.972817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dc8f-1cf9-4340-9c9b-1b30c8492d05 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:37.976495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dc8f-1cf9-4340-9c9b-1b30c8492d05 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:37.976772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dc8f-1cf9-4340-9c9b-1b30c8492d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:37.991203 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3522/7064] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:08:37.998391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:38.020218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986eb91-9f26-4ba5-8cfa-a59cd56982bd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:38.023302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bae3dc8f-1cf9-4340-9c9b-1b30c8492d05 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:38.024550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bae3dc8f-1cf9-4340-9c9b-1b30c8492d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:38.038153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:38.039123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.039793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.040300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.041148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:38.045631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:38.046918 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3543/7065] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:37 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:38.051612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ce70-056e-4c48-8bda-c431c498d281 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.051906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ce70-056e-4c48-8bda-c431c498d281 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.052185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ce70-056e-4c48-8bda-c431c498d281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.087940 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3523/7066] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:37 2022] POST /identity/v3/projects => generated 409 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:38.091726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:38.098120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8597ce70-056e-4c48-8bda-c431c498d281 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:38.099380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8597ce70-056e-4c48-8bda-c431c498d281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:38.229563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21bbbf-ff78-478d-822b-02b543dfcd37 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:38.240159 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3544/7067] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:38.244674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ce70-056e-4c48-8bda-c431c498d281 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:38.246080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:38.246913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.247418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.248633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.249774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:38.254274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:38.258680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ce70-056e-4c48-8bda-c431c498d281 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:38.267806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aae0fc-c500-4895-9038-85ab612df43b tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:38.268714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae0fc-c500-4895-9038-85ab612df43b tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.269115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae0fc-c500-4895-9038-85ab612df43b tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.269625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae0fc-c500-4895-9038-85ab612df43b tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.284388 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3524/7068] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:38 2022] POST /identity/v3/users => generated 305 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:38.295110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:38.317053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc654a62-1382-4131-9644-00452571c16c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:38.346366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e6aae0fc-c500-4895-9038-85ab612df43b tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:38.348255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:38.352892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.359086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.359799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.361236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:38.364335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:38.368759 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3545/7069] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:38 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:38.401118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3525/7070] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:38.402896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aae0fc-c500-4895-9038-85ab612df43b tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:38.430152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aae0fc-c500-4895-9038-85ab612df43b tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:38.440653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a045f-3bce-47a8-b57f-4b526d8e5b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:38.440653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a045f-3bce-47a8-b57f-4b526d8e5b7c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.440653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a045f-3bce-47a8-b57f-4b526d8e5b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.440653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a045f-3bce-47a8-b57f-4b526d8e5b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.441598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a045f-3bce-47a8-b57f-4b526d8e5b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:38.444690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a045f-3bce-47a8-b57f-4b526d8e5b7c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:38.457434 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3546/7071] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:38.462085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:38.477273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe38ee-efc3-4107-8696-25ce4f2e0ec3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:38.488820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:38.490046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.490495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.490971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] PATH_INFO: `/v3/projects/3d280519f2a242bf8e30ac547d10046e/users/4049e0ae555b45ff96e9942d9e8cf12d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.530716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d280519f2a242bf8e30ac547d10046e, user_id=4049e0ae555b45ff96e9942d9e8cf12d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:38.534594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:38.577711 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3526/7072] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:38 2022] PUT /identity/v3/projects/3d280519f2a242bf8e30ac547d10046e/users/4049e0ae555b45ff96e9942d9e8cf12d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:38.590799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724511-7113-4cdd-9af4-73d67f5bd60a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.591836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724511-7113-4cdd-9af4-73d67f5bd60a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.592629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724511-7113-4cdd-9af4-73d67f5bd60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.684448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-21724511-7113-4cdd-9af4-73d67f5bd60a None None] MFA Rules not processed for user `4049e0ae555b45ff96e9942d9e8cf12d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:38.685701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21724511-7113-4cdd-9af4-73d67f5bd60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:38.813005 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3547/7073] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:38.814213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:38.963323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57929891-c2f5-4c18-aadb-0e1206c3376b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:38.988892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de928f3c-7e2b-4b82-9c77-dd5018a4ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:38.990442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de928f3c-7e2b-4b82-9c77-dd5018a4ff3f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:38.991131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de928f3c-7e2b-4b82-9c77-dd5018a4ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:38.991574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de928f3c-7e2b-4b82-9c77-dd5018a4ff3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:38.992450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de928f3c-7e2b-4b82-9c77-dd5018a4ff3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:39.003842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de928f3c-7e2b-4b82-9c77-dd5018a4ff3f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:39.126428 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3527/7074] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:38 2022] POST /identity/v3/projects => generated 411 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:39.134689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724511-7113-4cdd-9af4-73d67f5bd60a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.179710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724511-7113-4cdd-9af4-73d67f5bd60a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:39.374170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.374465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.374749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.418118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:39.419287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.419805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.420451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.421497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:39.427107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:39.440846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:39.445877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:39.460351 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3528/7075] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:39 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 22:08:39.463095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.468707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:39.501858 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3548/7076] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:39 2022] POST /identity/v3/users => generated 312 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:39.505487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.521352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0689cdd-9d1d-4713-bcf0-c190135ec52b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:39.529071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafebe-83cf-471c-85e3-ac3a2471e810 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:39.534540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:39.535997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.539228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.540584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] PATH_INFO: `/v3/users/96077bbd65b9449a8b679c2ebb35bdd6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.544667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96077bbd65b9449a8b679c2ebb35bdd6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:39.547139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:39.550881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:39.554340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.555183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.557187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.562508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:39.572970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:39.593591 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3549/7077] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:39.599885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.617360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86b12-14bb-46da-9501-57fc99ac3e46 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:39.627908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:39.629288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.630022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.630730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] PATH_INFO: `/v3/projects/e4a5b6bd9e37462f8560313b5caa550f/users/280a3c8253ce4ac898b6c815f4c202a0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.667058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96077bbd65b9449a8b679c2ebb35bdd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:39.676477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a5b6bd9e37462f8560313b5caa550f, user_id=280a3c8253ce4ac898b6c815f4c202a0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:39.676687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96077bbd65b9449a8b679c2ebb35bdd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:39.678427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96077bbd65b9449a8b679c2ebb35bdd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:39.679178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96077bbd65b9449a8b679c2ebb35bdd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:39.684308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:39.695782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96077bbd65b9449a8b679c2ebb35bdd6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:39.714972 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3550/7078] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:39 2022] PUT /identity/v3/projects/e4a5b6bd9e37462f8560313b5caa550f/users/280a3c8253ce4ac898b6c815f4c202a0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:39.719501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.732152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:39.741359 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3529/7079] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:39 2022] DELETE /identity/v3/users/96077bbd65b9449a8b679c2ebb35bdd6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:39.742333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.747758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:39.850450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76d972-cf4e-4b22-bf9e-019162e47cc7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:39.858538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c5ff1-128a-4441-8a13-ea5bdd13dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:39.859455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c5ff1-128a-4441-8a13-ea5bdd13dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.859792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c5ff1-128a-4441-8a13-ea5bdd13dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.860143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c5ff1-128a-4441-8a13-ea5bdd13dd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.861492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c5ff1-128a-4441-8a13-ea5bdd13dd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:39.863184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c5ff1-128a-4441-8a13-ea5bdd13dd28 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:39.880201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ea5a-519a-4a27-92e4-63da2b8b1411 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:39.880684 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3530/7080] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:39.882267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c560ef-cc24-4136-b889-7a79749181ed None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.882658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c560ef-cc24-4136-b889-7a79749181ed None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.883066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c560ef-cc24-4136-b889-7a79749181ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.904622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-89c560ef-cc24-4136-b889-7a79749181ed None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:39.906079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89c560ef-cc24-4136-b889-7a79749181ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:39.916092 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3531/7081] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:39.917978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c560ef-cc24-4136-b889-7a79749181ed None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.939780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c560ef-cc24-4136-b889-7a79749181ed None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:39.946430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:39.947514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:39.947970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:39.948412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] PATH_INFO: `/v3/projects/e4a5b6bd9e37462f8560313b5caa550f/users/280a3c8253ce4ac898b6c815f4c202a0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:39.951101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a5b6bd9e37462f8560313b5caa550f, user_id=280a3c8253ce4ac898b6c815f4c202a0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:39.955620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:39.974702 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3532/7082] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:39 2022] PUT /identity/v3/projects/e4a5b6bd9e37462f8560313b5caa550f/users/280a3c8253ce4ac898b6c815f4c202a0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:39.975726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:39.977643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:40.038470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75158aca-7832-4396-8660-af6f11ca047f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:40.039299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75158aca-7832-4396-8660-af6f11ca047f service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.039499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75158aca-7832-4396-8660-af6f11ca047f service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.039849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75158aca-7832-4396-8660-af6f11ca047f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.042932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-75158aca-7832-4396-8660-af6f11ca047f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:40.066678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75158aca-7832-4396-8660-af6f11ca047f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:40.068339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75158aca-7832-4396-8660-af6f11ca047f service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:40.090977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257667-9876-4c4c-b48f-84a16288d2e8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:40.092658 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3551/7083] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:40.094067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f1480-4916-4b44-9f85-ff2d22253a1f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.095103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f1480-4916-4b44-9f85-ff2d22253a1f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.095982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f1480-4916-4b44-9f85-ff2d22253a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.099974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:40.100937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.101459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.102201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.146845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1f7f1480-4916-4b44-9f85-ff2d22253a1f None None] MFA Rules not processed for user `280a3c8253ce4ac898b6c815f4c202a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:40.148251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1f7f1480-4916-4b44-9f85-ff2d22253a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:40.185768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:40.187526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:40.209542 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3533/7084] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:40.272985 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3552/7085] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:40 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:40.303181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:40.319133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b875349-d59d-4d1b-87f2-26fd47ccbccd service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:40.331239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738c653-09ac-4319-9a11-8e485a6e84b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:40.331938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738c653-09ac-4319-9a11-8e485a6e84b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.332223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738c653-09ac-4319-9a11-8e485a6e84b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.332499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738c653-09ac-4319-9a11-8e485a6e84b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.362508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738c653-09ac-4319-9a11-8e485a6e84b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:40.365203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a738c653-09ac-4319-9a11-8e485a6e84b8 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:40.398672 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3534/7086] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:40 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:40.465634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79448-da27-493d-bd16-ea759a685d88 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.466218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79448-da27-493d-bd16-ea759a685d88 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.466645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79448-da27-493d-bd16-ea759a685d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.549088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2ff79448-da27-493d-bd16-ea759a685d88 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:40.554283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2ff79448-da27-493d-bd16-ea759a685d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:40.744829 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3553/7087] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:40.746095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0729fe-f8eb-467c-a888-cd994e791e98 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.746394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0729fe-f8eb-467c-a888-cd994e791e98 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.746674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0729fe-f8eb-467c-a888-cd994e791e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.767977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cb0729fe-f8eb-467c-a888-cd994e791e98 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:40.769202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cb0729fe-f8eb-467c-a888-cd994e791e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:40.780657 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3535/7088] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:40 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 07 22:08:40.782825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f985d7-0ca1-4952-9772-d2861b2a4e73 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.783680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f985d7-0ca1-4952-9772-d2861b2a4e73 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.784213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f985d7-0ca1-4952-9772-d2861b2a4e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.852548 ncdv-master-1 devstack@keystone.service[91076]: WARNING keystone.server.flask.application [None req-08f985d7-0ca1-4952-9772-d2861b2a4e73 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. May 07 22:08:40.859886 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3554/7089] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:40 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 78 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 07 22:08:40.861508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87c46-5cae-43e5-8131-8a23c95163a7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.862248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87c46-5cae-43e5-8131-8a23c95163a7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.862703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87c46-5cae-43e5-8131-8a23c95163a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.913340 ncdv-master-1 devstack@keystone.service[91075]: WARNING keystone.server.flask.application [None req-e2b87c46-5cae-43e5-8131-8a23c95163a7 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. May 07 22:08:40.915254 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3536/7090] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:40 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 55 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) May 07 22:08:40.921037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93205e2-57ec-410e-934e-56eaa0cc18ac None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:40.921610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93205e2-57ec-410e-934e-56eaa0cc18ac None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:40.922066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93205e2-57ec-410e-934e-56eaa0cc18ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:40.956139 ncdv-master-1 devstack@keystone.service[91076]: WARNING keystone.server.flask.application [None req-c93205e2-57ec-410e-934e-56eaa0cc18ac None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. May 07 22:08:40.960636 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3555/7091] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:40 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 41 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 07 22:08:40.996438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87c46-5cae-43e5-8131-8a23c95163a7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:40.999757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e2b87c46-5cae-43e5-8131-8a23c95163a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:41.032349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87c46-5cae-43e5-8131-8a23c95163a7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:41.037489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:41.038852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:41.039824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:41.040327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] PATH_INFO: `/v3/projects/0c313e966d334c26afa43b480ab20fb0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:41.041980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c313e966d334c26afa43b480ab20fb0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:41.044440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:41.136092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c313e966d334c26afa43b480ab20fb0', 'request_id': 'req-5aa139d8-73ce-4941-bd0c-688e872b27ec'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.148771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c313e966d334c26afa43b480ab20fb0', 'request_id': 'req-5aa139d8-73ce-4941-bd0c-688e872b27ec'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.160522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c313e966d334c26afa43b480ab20fb0', 'request_id': 'req-5aa139d8-73ce-4941-bd0c-688e872b27ec'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.178836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] The token cache is being invalidate because project 0c313e966d334c26afa43b480ab20fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:41.179940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.180982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5aa139d8-73ce-4941-bd0c-688e872b27ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.186173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3537/7092] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:40 2022] DELETE /identity/v3/projects/0c313e966d334c26afa43b480ab20fb0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:41.187633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93205e2-57ec-410e-934e-56eaa0cc18ac None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:41.189552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c93205e2-57ec-410e-934e-56eaa0cc18ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:41.362992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93205e2-57ec-410e-934e-56eaa0cc18ac None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:41.380613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:41.381550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:41.381841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:41.382126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] PATH_INFO: `/v3/users/2af2d3cdc86e4f39bf7867d3c41c806b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:41.385754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af2d3cdc86e4f39bf7867d3c41c806b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:41.391118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:41.433729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:41.434313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:41.434973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:41.467898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] MFA Rules not processed for user `97ef9a3039534d90ba9d268970cbe9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:41.469860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:41.503886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af2d3cdc86e4f39bf7867d3c41c806b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.507065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af2d3cdc86e4f39bf7867d3c41c806b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.521753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af2d3cdc86e4f39bf7867d3c41c806b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.523231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af2d3cdc86e4f39bf7867d3c41c806b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.538352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af2d3cdc86e4f39bf7867d3c41c806b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:41.576760 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3556/7093] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:41 2022] DELETE /identity/v3/users/2af2d3cdc86e4f39bf7867d3c41c806b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:41.588013 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3538/7094] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:41.981708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:41.983380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:42.119721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7704e4-bfb6-4b4e-8444-bba994cf3049 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:42.132051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb12e4-13aa-4e7b-a900-e4db496111c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:42.132989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb12e4-13aa-4e7b-a900-e4db496111c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:42.133618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb12e4-13aa-4e7b-a900-e4db496111c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:42.134152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb12e4-13aa-4e7b-a900-e4db496111c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:42.140766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fabb12e4-13aa-4e7b-a900-e4db496111c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:42.161114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb12e4-13aa-4e7b-a900-e4db496111c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:42.164363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb12e4-13aa-4e7b-a900-e4db496111c4 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:42.191515 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3557/7095] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:42.757193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:42.759339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:42.778414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70f9a4-4eb3-495d-b846-3ab7f1d94688 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:42.880891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:42.882065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:42.882580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:42.883080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] PATH_INFO: `/v3/projects/23a13a3b2129408f8c3dd879e607478d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:42.885077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a13a3b2129408f8c3dd879e607478d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:42.893089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:42.966852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a13a3b2129408f8c3dd879e607478d', 'request_id': 'req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:42.974645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a13a3b2129408f8c3dd879e607478d', 'request_id': 'req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:42.984011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a13a3b2129408f8c3dd879e607478d', 'request_id': 'req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:42.996402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] The token cache is being invalidate because project 23a13a3b2129408f8c3dd879e607478d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:42.996951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:42.997831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7f1c6be5-254d-440b-aa8e-38d9a159b6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:42.999979 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3539/7096] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:42 2022] DELETE /identity/v3/projects/23a13a3b2129408f8c3dd879e607478d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:43.005064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa137b-437c-4930-b7f0-79827208457d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.005910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa137b-437c-4930-b7f0-79827208457d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.006450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa137b-437c-4930-b7f0-79827208457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.031894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6afa137b-437c-4930-b7f0-79827208457d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:43.033408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6afa137b-437c-4930-b7f0-79827208457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:43.136790 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3558/7097] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:43.144275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2b54a-2bc1-4faf-8fd6-ccfad3b76042 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.144569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2b54a-2bc1-4faf-8fd6-ccfad3b76042 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.144854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2b54a-2bc1-4faf-8fd6-ccfad3b76042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.168204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a3f2b54a-2bc1-4faf-8fd6-ccfad3b76042 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:43.170531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a3f2b54a-2bc1-4faf-8fd6-ccfad3b76042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:43.189357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa137b-437c-4930-b7f0-79827208457d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:43.189485 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3540/7098] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:43.206364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa137b-437c-4930-b7f0-79827208457d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:43.223113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:43.223723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.224016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.224295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.225049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:43.225353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:43.227059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:43.255682 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3559/7099] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:08:43.264116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2b54a-2bc1-4faf-8fd6-ccfad3b76042 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:43.281132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2b54a-2bc1-4faf-8fd6-ccfad3b76042 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:43.292520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:43.293468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.293944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.303386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.303386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:43.303386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:43.335599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:43.336485 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3541/7100] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:43 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:43.348809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1e428-c14f-44ee-a9cf-a77da4b5f21f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:43.411656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:43.412590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.413087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.413407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.414098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:43.416161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:43.441802 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3560/7101] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:43 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:08:43.443188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:43.460909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1c2c5-9030-4deb-a8f3-8093117a42d0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:43.474040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:43.474969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.475480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.476192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.477108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:43.489192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:43.504397 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3542/7102] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:43.508278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:43.521346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a41466-b38f-4fa5-a400-c1f182a673d2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:43.527649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9536ac1-1639-48cb-a432-95bd345b7b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:43.528618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9536ac1-1639-48cb-a432-95bd345b7b55 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.529236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9536ac1-1639-48cb-a432-95bd345b7b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.529723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9536ac1-1639-48cb-a432-95bd345b7b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.531653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9536ac1-1639-48cb-a432-95bd345b7b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:43.533582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9536ac1-1639-48cb-a432-95bd345b7b55 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:43.555031 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3561/7103] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:43.560240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:43.572155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709c922-383b-4b1d-bd2d-7d713435740f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:43.578160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:43.579383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.579846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.580376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] PATH_INFO: `/v3/projects/79ad2ea0f3a34003bb7a3f8ff81c58e4/users/d090d094c44c44519dcd3e98de4fc2ff/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.597367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ad2ea0f3a34003bb7a3f8ff81c58e4, user_id=d090d094c44c44519dcd3e98de4fc2ff, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:43.605579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:43.619539 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3543/7104] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:43 2022] PUT /identity/v3/projects/79ad2ea0f3a34003bb7a3f8ff81c58e4/users/d090d094c44c44519dcd3e98de4fc2ff/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:43.632913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aacf15-cf18-46f4-96c1-bcf3cb4ec22a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:43.634030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aacf15-cf18-46f4-96c1-bcf3cb4ec22a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:43.634753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aacf15-cf18-46f4-96c1-bcf3cb4ec22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:43.678282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f7aacf15-cf18-46f4-96c1-bcf3cb4ec22a None None] MFA Rules not processed for user `d090d094c44c44519dcd3e98de4fc2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:43.679786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f7aacf15-cf18-46f4-96c1-bcf3cb4ec22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:43.823587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3562/7105] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:43.828675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:43.980277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17f3a8-530b-4493-b154-3fc9736bc1f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:43.989093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:43.990254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:44.002041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:44.002330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:44.006172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:44.008213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:44.104986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3544/7106] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:43 2022] POST /identity/v3/projects => generated 387 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:44.108823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aacf15-cf18-46f4-96c1-bcf3cb4ec22a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:44.139067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aacf15-cf18-46f4-96c1-bcf3cb4ec22a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:44.287329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:44.288176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:44.288538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:44.288891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:44.292844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:44.296091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:44.356344 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3563/7107] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:44 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:44.360367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:44.406538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f83bae-6a9a-47c1-afa2-8d858a33ea7c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:44.421381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:44.422089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:44.422376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:44.422657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:44.430914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:44.433619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:44.505574 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3545/7108] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:44.506972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:44.539426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a680bd5-ea83-4c13-b2fa-4f915b5316b2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:44.543440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ac22c-93f0-4fcf-a8ed-62d27a2858f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:44.544079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ac22c-93f0-4fcf-a8ed-62d27a2858f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:44.544555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ac22c-93f0-4fcf-a8ed-62d27a2858f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:44.545228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ac22c-93f0-4fcf-a8ed-62d27a2858f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:44.546555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ac22c-93f0-4fcf-a8ed-62d27a2858f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:44.563566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ac22c-93f0-4fcf-a8ed-62d27a2858f1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:44.598977 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3564/7109] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:44.600701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:44.620338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0369-c083-4d7a-a800-2f8a838b4314 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:44.651351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:44.658922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:44.659555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:44.661020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] PATH_INFO: `/v3/projects/807e75468778486fb455f697709a140d/users/a4ef40bb07e64742aac0f8ac6853cfae/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:44.697860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807e75468778486fb455f697709a140d, user_id=a4ef40bb07e64742aac0f8ac6853cfae, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:44.701649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:44.735526 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3546/7110] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:44 2022] PUT /identity/v3/projects/807e75468778486fb455f697709a140d/users/a4ef40bb07e64742aac0f8ac6853cfae/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:44.735867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871a76f-73d0-4164-918a-795a4be9b777 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:44.736136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871a76f-73d0-4164-918a-795a4be9b777 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:44.736484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871a76f-73d0-4164-918a-795a4be9b777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:44.786607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b871a76f-73d0-4164-918a-795a4be9b777 None None] MFA Rules not processed for user `a4ef40bb07e64742aac0f8ac6853cfae`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:44.787904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b871a76f-73d0-4164-918a-795a4be9b777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:44.882193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3565/7111] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:44.892571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:44.988861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e18d4-c47f-4a9b-aeaa-07b3173d0804 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:44.994038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:44.995481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:44.995931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:44.996401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:44.997269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:44.999584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:45.047872 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3547/7112] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:44 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:45.051912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871a76f-73d0-4164-918a-795a4be9b777 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:45.070523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871a76f-73d0-4164-918a-795a4be9b777 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:45.225431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:45.227457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:45.228080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:45.230466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:45.231561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:45.234429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:45.265257 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3566/7113] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:45 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:08:45.269164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:45.281879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecd14f-9a9e-4e5d-bbfc-18ea0c8c219d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:45.294043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:45.297280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:45.297577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:45.297864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:45.299125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:45.305705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:45.338097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:45.347138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3548/7114] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:45.353451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e8d4e-4579-45ee-92eb-e925bfcd837a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:45.359495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:45.361747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:45.362413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:45.362844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] PATH_INFO: `/v3/projects/f31461527eb340c5b647c2d415581b6c/users/feeae322890a4d239a4c6203e8619291/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:45.395780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31461527eb340c5b647c2d415581b6c, user_id=feeae322890a4d239a4c6203e8619291, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:45.403844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:45.463557 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3567/7115] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:45 2022] PUT /identity/v3/projects/f31461527eb340c5b647c2d415581b6c/users/feeae322890a4d239a4c6203e8619291/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:45.469872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:45.482732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5ef5b-5a76-4b47-8bf5-82cfd6e6290b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:45.570137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52aace-6123-4ad0-b16a-cdc251e839e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:45.571332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52aace-6123-4ad0-b16a-cdc251e839e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:45.572051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52aace-6123-4ad0-b16a-cdc251e839e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:45.572516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52aace-6123-4ad0-b16a-cdc251e839e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:45.574119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52aace-6123-4ad0-b16a-cdc251e839e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:45.575986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52aace-6123-4ad0-b16a-cdc251e839e6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:45.592780 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3549/7116] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:45.593220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:45.608356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326707ba-1654-4d6a-9460-2ad29c831128 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:45.622168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:45.623120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:45.623403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:45.623676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] PATH_INFO: `/v3/projects/f31461527eb340c5b647c2d415581b6c/users/feeae322890a4d239a4c6203e8619291/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:45.625906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31461527eb340c5b647c2d415581b6c, user_id=feeae322890a4d239a4c6203e8619291, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:45.628728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:45.643181 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3568/7117] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:45 2022] PUT /identity/v3/projects/f31461527eb340c5b647c2d415581b6c/users/feeae322890a4d239a4c6203e8619291/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:45.652403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:45.653159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:45.653694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:45.688014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] MFA Rules not processed for user `feeae322890a4d239a4c6203e8619291`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:45.689311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:45.772333 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3550/7118] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:45.790743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:45.794124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:45.972947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e32b14-15de-40d1-865a-5fad22dd6e6b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:45.980378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28163a0a-d9b9-499c-a82a-6f3795e1271b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:45.981056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28163a0a-d9b9-499c-a82a-6f3795e1271b service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:45.981823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28163a0a-d9b9-499c-a82a-6f3795e1271b service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:45.982253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28163a0a-d9b9-499c-a82a-6f3795e1271b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:46.073165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28163a0a-d9b9-499c-a82a-6f3795e1271b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:46.074814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28163a0a-d9b9-499c-a82a-6f3795e1271b service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:46.084864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3569/7119] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:46.644717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:46.646464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:46.746829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4e72-87a9-433d-bd53-cb09bc664b59 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:46.756323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:46.758211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:46.759484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:46.760006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] PATH_INFO: `/v3/users/4049e0ae555b45ff96e9942d9e8cf12d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:46.787033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4049e0ae555b45ff96e9942d9e8cf12d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:46.797032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:46.889557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4049e0ae555b45ff96e9942d9e8cf12d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:46.903018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4049e0ae555b45ff96e9942d9e8cf12d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:46.903793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4049e0ae555b45ff96e9942d9e8cf12d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:46.904418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4049e0ae555b45ff96e9942d9e8cf12d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:46.914526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4049e0ae555b45ff96e9942d9e8cf12d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:46.941015 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3551/7120] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:46 2022] DELETE /identity/v3/users/4049e0ae555b45ff96e9942d9e8cf12d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:46.946099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:46.946702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:46.947093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:46.977075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:46.978685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:47.041618 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3570/7121] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:47.072740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:47.075428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:47.148315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3413-e338-466e-b7e7-62ed4d587331 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:47.154469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:47.155437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:47.155828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:47.156227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:47.167644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:47.169420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:47.182007 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3552/7122] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:48.715994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:48.718191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:48.738915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032be47-24fb-4344-9d98-ae1c77c1ba6c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:48.749502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:48.750659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:48.751804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:48.752442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] PATH_INFO: `/v3/projects/3d280519f2a242bf8e30ac547d10046e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:48.754085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d280519f2a242bf8e30ac547d10046e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:48.756842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:48.844306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d280519f2a242bf8e30ac547d10046e', 'request_id': 'req-743aec38-f330-4c68-a121-723f501b699d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:48.852231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d280519f2a242bf8e30ac547d10046e', 'request_id': 'req-743aec38-f330-4c68-a121-723f501b699d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:48.871445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d280519f2a242bf8e30ac547d10046e', 'request_id': 'req-743aec38-f330-4c68-a121-723f501b699d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:48.899101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] The token cache is being invalidate because project 3d280519f2a242bf8e30ac547d10046e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:48.899615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:48.904830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:48.906921 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3571/7123] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:48 2022] DELETE /identity/v3/projects/3d280519f2a242bf8e30ac547d10046e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:48.912860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:48.928487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed279d-c742-4374-84a9-335e60969e9d service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:49.020010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:49.020903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:49.021183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:49.021644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] PATH_INFO: `/v3/users/280a3c8253ce4ac898b6c815f4c202a0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:49.022940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280a3c8253ce4ac898b6c815f4c202a0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:49.024913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:49.121872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280a3c8253ce4ac898b6c815f4c202a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:49.134267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280a3c8253ce4ac898b6c815f4c202a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:49.135906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280a3c8253ce4ac898b6c815f4c202a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:49.136793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280a3c8253ce4ac898b6c815f4c202a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:49.148926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4c6b81c3-8d1f-42b3-85f3-577c3aa751b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280a3c8253ce4ac898b6c815f4c202a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:49.223267 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3553/7124] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:48 2022] DELETE /identity/v3/users/280a3c8253ce4ac898b6c815f4c202a0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:49.939020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:49.940510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:49.956133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aec38-f330-4c68-a121-723f501b699d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:50.032809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:50.033846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.034241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.034622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] PATH_INFO: `/v3/projects/e4a5b6bd9e37462f8560313b5caa550f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.036627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a5b6bd9e37462f8560313b5caa550f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:50.038420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:50.141336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a5b6bd9e37462f8560313b5caa550f', 'request_id': 'req-5bd7328e-5607-49b5-bb75-d4cc2b901371'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:50.153486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a5b6bd9e37462f8560313b5caa550f', 'request_id': 'req-5bd7328e-5607-49b5-bb75-d4cc2b901371'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:50.169964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a5b6bd9e37462f8560313b5caa550f', 'request_id': 'req-5bd7328e-5607-49b5-bb75-d4cc2b901371'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:50.189016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] The token cache is being invalidate because project e4a5b6bd9e37462f8560313b5caa550f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:08:50.189703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:50.191671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bd7328e-5607-49b5-bb75-d4cc2b901371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:50.195198 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3572/7125] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:08:49 2022] DELETE /identity/v3/projects/e4a5b6bd9e37462f8560313b5caa550f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:50.199952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255693d-a964-4370-ba2c-f554cc5e3c69 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.200481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255693d-a964-4370-ba2c-f554cc5e3c69 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.200481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255693d-a964-4370-ba2c-f554cc5e3c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.232600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3255693d-a964-4370-ba2c-f554cc5e3c69 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:50.233827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3255693d-a964-4370-ba2c-f554cc5e3c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:50.340426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3554/7126] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:50.348595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af1a8-5d4b-41db-896e-ff4468452014 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.349076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af1a8-5d4b-41db-896e-ff4468452014 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.349618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0af1a8-5d4b-41db-896e-ff4468452014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.373557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0f0af1a8-5d4b-41db-896e-ff4468452014 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:50.374681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0f0af1a8-5d4b-41db-896e-ff4468452014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:50.386408 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3573/7127] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:50.388297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255693d-a964-4370-ba2c-f554cc5e3c69 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:50.401794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255693d-a964-4370-ba2c-f554cc5e3c69 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:50.419855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:50.421329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.422546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.422998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.424645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:08:50.424965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:50.428681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:50.460858 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3555/7128] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:08:50.462472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af1a8-5d4b-41db-896e-ff4468452014 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:50.478489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0af1a8-5d4b-41db-896e-ff4468452014 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:50.496576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:50.497583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.497995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.498373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.499361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:50.502050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:50.551003 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3574/7129] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:08:50 2022] POST /identity/v3/projects => generated 397 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:50.557972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:50.575025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f7bc8-1d82-43ab-9e77-8483d7d9a5c3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:50.692658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:50.693612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.693901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.694175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.695060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:50.697188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:50.724289 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3556/7130] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:08:50 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:08:50.728022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:50.739335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb896c-4e45-458c-bf67-872e3d1d92db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:50.744801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:50.745478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.745757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.746028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.746750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:50.748567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:50.765632 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3575/7131] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:08:50.766619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:50.778521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933abbd-8a77-4f8c-8e51-d8ed94d2102f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:50.783776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c692c1-b83e-4bf1-9a01-c4201f066fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:50.784712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c692c1-b83e-4bf1-9a01-c4201f066fbe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.785091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c692c1-b83e-4bf1-9a01-c4201f066fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.785528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c692c1-b83e-4bf1-9a01-c4201f066fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.786533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c692c1-b83e-4bf1-9a01-c4201f066fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:50.788721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c692c1-b83e-4bf1-9a01-c4201f066fbe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:50.808899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:50.809989 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3557/7132] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:08:50.821910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642a98b-0bb8-40ac-a885-f355a79ebe30 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:50.827991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:50.829561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.830071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.830524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] PATH_INFO: `/v3/projects/6d3ba93d3f2b424cbe1cd3e4f8623ad5/users/a1b011eda2034fe88aec4bed8912abde/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.848508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3ba93d3f2b424cbe1cd3e4f8623ad5, user_id=a1b011eda2034fe88aec4bed8912abde, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:50.852204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:50.873438 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3576/7133] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:08:50 2022] PUT /identity/v3/projects/6d3ba93d3f2b424cbe1cd3e4f8623ad5/users/a1b011eda2034fe88aec4bed8912abde/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:50.888801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681cb6-008d-4562-9de9-3ecf17da498a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:50.889355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681cb6-008d-4562-9de9-3ecf17da498a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:50.889837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3681cb6-008d-4562-9de9-3ecf17da498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:50.941643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e3681cb6-008d-4562-9de9-3ecf17da498a None None] MFA Rules not processed for user `a1b011eda2034fe88aec4bed8912abde`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:50.943975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e3681cb6-008d-4562-9de9-3ecf17da498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:51.040150 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3558/7134] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:51.053162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:51.056882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:51.137501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01425813-ab27-4703-9c8c-7d079281ef7c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:51.142524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:51.143660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:51.144189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:51.144482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:51.158039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:51.159707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:51.170808 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3577/7135] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:51.973736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:51.975065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:51.975065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:51.986504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:52.001248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c0a5c-50d9-4634-bd45-3fa09c0a9466 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:52.012629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc8746-14b2-48f1-91fa-6fd7d904be1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:52.013306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc8746-14b2-48f1-91fa-6fd7d904be1c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:52.014451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc8746-14b2-48f1-91fa-6fd7d904be1c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:52.014451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc8746-14b2-48f1-91fa-6fd7d904be1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:52.023423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1dbc8746-14b2-48f1-91fa-6fd7d904be1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:52.078851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:52.081666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:52.098860 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3559/7136] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:51 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:52.099813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:52.102317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:52.184954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bae46-7628-44b0-8d3b-553bfff2f58d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:52.189630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c98b7e-7957-4aab-b45d-2a5f48448630 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:52.190668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c98b7e-7957-4aab-b45d-2a5f48448630 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:52.190997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c98b7e-7957-4aab-b45d-2a5f48448630 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:52.191279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c98b7e-7957-4aab-b45d-2a5f48448630 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:52.209954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc8746-14b2-48f1-91fa-6fd7d904be1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:52.212270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc8746-14b2-48f1-91fa-6fd7d904be1c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:52.236093 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3578/7137] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:52.252933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-74c98b7e-7957-4aab-b45d-2a5f48448630 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:52.265728 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3560/7138] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:52 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:53.269929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75983758-66f9-489e-a6a1-47cc60a95792 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:53.270516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75983758-66f9-489e-a6a1-47cc60a95792 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:53.270516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75983758-66f9-489e-a6a1-47cc60a95792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:53.316135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-75983758-66f9-489e-a6a1-47cc60a95792 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:53.317561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-75983758-66f9-489e-a6a1-47cc60a95792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:53.332811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3579/7139] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:53.338053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2de08-5211-4ea9-b8ca-9c194282e5ae None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:53.339811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2de08-5211-4ea9-b8ca-9c194282e5ae None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:53.340246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2de08-5211-4ea9-b8ca-9c194282e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-9ba2de08-5211-4ea9-b8ca-9c194282e5ae None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return f(*args, **kwargs) May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post May 07 22:08:53.418572 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.check_revocation(token) May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:53.419941 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token May 07 22:08:53.421165 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:08:53.423524 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3561/7140] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:53 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 22:08:53.427937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fce33-6132-4610-9fea-23573bf5d0d0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:53.428226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fce33-6132-4610-9fea-23573bf5d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:53.428998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fce33-6132-4610-9fea-23573bf5d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:53.501441 ncdv-master-1 devstack@keystone.service[91076]: WARNING keystone.server.flask.application [None req-250fce33-6132-4610-9fea-23573bf5d0d0 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.32: keystone.exception.Unauthorized: The request you have made requires authentication. May 07 22:08:53.503233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3580/7141] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:53 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 76 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) May 07 22:08:53.507939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:53.508421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:53.508875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:53.591662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:53.593180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:53.623997 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3562/7142] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:08:53.629188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fce33-6132-4610-9fea-23573bf5d0d0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:53.667392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fce33-6132-4610-9fea-23573bf5d0d0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:53.677142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bb3e2-a19e-4cce-8cdc-b5e6c762fda3 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:53.678228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bb3e2-a19e-4cce-8cdc-b5e6c762fda3 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:53.678522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bb3e2-a19e-4cce-8cdc-b5e6c762fda3 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:53.678820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bb3e2-a19e-4cce-8cdc-b5e6c762fda3 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:53.749908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:53.751544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:53.775034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-056bb3e2-a19e-4cce-8cdc-b5e6c762fda3 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:53.779314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57632bc5-8e86-4e3c-b057-85a059f3cf50 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:53.786587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7e101-50b3-4097-8fa7-7d699a62f4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:53.787839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e101-50b3-4097-8fa7-7d699a62f4eb service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:53.788418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e101-50b3-4097-8fa7-7d699a62f4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:53.788912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7e101-50b3-4097-8fa7-7d699a62f4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:53.791419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8d7e101-50b3-4097-8fa7-7d699a62f4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:53.795543 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3581/7143] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:53 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:53.925389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e101-50b3-4097-8fa7-7d699a62f4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:53.927363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7e101-50b3-4097-8fa7-7d699a62f4eb service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:53.942837 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3563/7144] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:08:54.800833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4e8f-f001-4f92-ba08-f7ea820edb57 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:54.801697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4e8f-f001-4f92-ba08-f7ea820edb57 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:54.802143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb4e8f-f001-4f92-ba08-f7ea820edb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:54.869639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-20eb4e8f-f001-4f92-ba08-f7ea820edb57 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:54.871398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-20eb4e8f-f001-4f92-ba08-f7ea820edb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:54.888205 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3582/7145] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:54 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:54.892994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1294d5e-2ef5-470e-a6c6-f1806e74d116 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:54.893487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1294d5e-2ef5-470e-a6c6-f1806e74d116 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:54.893573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1294d5e-2ef5-470e-a6c6-f1806e74d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:54.935911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a1294d5e-2ef5-470e-a6c6-f1806e74d116 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:54.937102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a1294d5e-2ef5-470e-a6c6-f1806e74d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:54.972636 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3564/7146] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:54.977174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4e8f-f001-4f92-ba08-f7ea820edb57 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:54.994055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eb4e8f-f001-4f92-ba08-f7ea820edb57 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:55.006365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3324ed-d2ab-453d-848a-ca9f2018d08e tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:55.008409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3324ed-d2ab-453d-848a-ca9f2018d08e tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:55.009004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3324ed-d2ab-453d-848a-ca9f2018d08e tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:55.009495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3324ed-d2ab-453d-848a-ca9f2018d08e tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:55.071130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ca3324ed-d2ab-453d-848a-ca9f2018d08e tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:55.115159 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3583/7147] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:54 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:08:56.121373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1c9a-37ac-4659-8b77-582e84aae992 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:56.122637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1c9a-37ac-4659-8b77-582e84aae992 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:56.123098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a1c9a-37ac-4659-8b77-582e84aae992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:56.155953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e37a1c9a-37ac-4659-8b77-582e84aae992 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:56.157513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e37a1c9a-37ac-4659-8b77-582e84aae992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:56.162604 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3565/7148] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:56.167419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1efcc-e4ec-4361-b1b6-9f430a7fac40 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:56.167896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1efcc-e4ec-4361-b1b6-9f430a7fac40 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:56.168028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1efcc-e4ec-4361-b1b6-9f430a7fac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:56.209716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-73f1efcc-e4ec-4361-b1b6-9f430a7fac40 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:56.211086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73f1efcc-e4ec-4361-b1b6-9f430a7fac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:56.233720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3584/7149] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:56.238220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1c9a-37ac-4659-8b77-582e84aae992 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:56.260863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a1c9a-37ac-4659-8b77-582e84aae992 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:56.274603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622615-5b85-4ea0-b8ff-88d4e437f870 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7aa19d8ed0f142e08d2b863a100501d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '897a1c519ef5418587c1629e414dde55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:56.279820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622615-5b85-4ea0-b8ff-88d4e437f870 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:56.282340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622615-5b85-4ea0-b8ff-88d4e437f870 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:56.283150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622615-5b85-4ea0-b8ff-88d4e437f870 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:56.381654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-30622615-5b85-4ea0-b8ff-88d4e437f870 tempest-IdentityV3UsersTest-722328152 tempest-IdentityV3UsersTest-722328152-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:56.400421 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3566/7150] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:08:56 2022] POST /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8/password => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:57.405793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:57.406759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:57.407233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:57.444264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:57.446734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:57.462004 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3585/7151] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:57 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 07 22:08:58.466225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb308-8392-4b4d-bdd5-ae9b8f639c26 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:58.466711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb308-8392-4b4d-bdd5-ae9b8f639c26 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:58.466923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdb308-8392-4b4d-bdd5-ae9b8f639c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:58.519635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f8fdb308-8392-4b4d-bdd5-ae9b8f639c26 None None] MFA Rules not processed for user `7aa19d8ed0f142e08d2b863a100501d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:58.520863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f8fdb308-8392-4b4d-bdd5-ae9b8f639c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:58.536617 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3567/7152] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:58.542164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:58.543688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:58.581024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c1a2e-e66c-4a6a-acb9-2c91ad874ec7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:58.607516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:58.608672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:58.615422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:58.615928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] PATH_INFO: `/v3/users/7aa19d8ed0f142e08d2b863a100501d8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:58.617786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa19d8ed0f142e08d2b863a100501d8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:58.620188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:58.747838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:58.749335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:58.783788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:58.784665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:58.800402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa19d8ed0f142e08d2b863a100501d8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:08:58.837607 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3586/7153] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:08:58 2022] DELETE /identity/v3/users/7aa19d8ed0f142e08d2b863a100501d8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:08:58.842329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:58.842675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:58.842951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:58.877920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:08:58.879200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:58.994577 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3568/7154] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:08:59.019883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:59.022088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:59.167117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4040fa7-13e7-4109-9a92-9635e4441bde admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:59.173265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:59.184141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:59.184799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:59.185274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:59.202954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:59.206129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:59.231097 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3587/7155] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:08:59.346760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:08:59.349747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:59.574519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26e9de-c8cd-4651-9235-5f3a14be6c20 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:08:59.586135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949845-4daa-468d-9c92-dc94085f27b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:08:59.587063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949845-4daa-468d-9c92-dc94085f27b4 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:08:59.587621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949845-4daa-468d-9c92-dc94085f27b4 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:08:59.588117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949845-4daa-468d-9c92-dc94085f27b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:08:59.591169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8c949845-4daa-468d-9c92-dc94085f27b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:08:59.697608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c949845-4daa-468d-9c92-dc94085f27b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:08:59.700609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c949845-4daa-468d-9c92-dc94085f27b4 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:08:59.733447 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3569/7156] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:08:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:00.606577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:00.613144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:00.669866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662dc30c-92fb-4ae3-ba2d-e384d6d2619c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:00.683644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:00.684762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:00.685476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:00.685925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] PATH_INFO: `/v3/projects/897a1c519ef5418587c1629e414dde55` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:00.687509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897a1c519ef5418587c1629e414dde55)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:00.689930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:00.884704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897a1c519ef5418587c1629e414dde55', 'request_id': 'req-a1709a77-b430-43e2-9865-b33da8b1a2d9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:00.907832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897a1c519ef5418587c1629e414dde55', 'request_id': 'req-a1709a77-b430-43e2-9865-b33da8b1a2d9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:00.929577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897a1c519ef5418587c1629e414dde55', 'request_id': 'req-a1709a77-b430-43e2-9865-b33da8b1a2d9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:00.950124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] The token cache is being invalidate because project 897a1c519ef5418587c1629e414dde55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:00.950432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:00.952149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a1709a77-b430-43e2-9865-b33da8b1a2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:00.965454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65633956-8f05-4e47-9638-6466b5f1fa3a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:00.965958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65633956-8f05-4e47-9638-6466b5f1fa3a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:00.966105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65633956-8f05-4e47-9638-6466b5f1fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:00.968129 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3588/7157] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:00 2022] DELETE /identity/v3/projects/897a1c519ef5418587c1629e414dde55 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:01.042230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-65633956-8f05-4e47-9638-6466b5f1fa3a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:01.057023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65633956-8f05-4e47-9638-6466b5f1fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:01.296288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3570/7158] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:01.305449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812775b-d1ab-47dd-a770-689012ae8e18 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:01.305746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812775b-d1ab-47dd-a770-689012ae8e18 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:01.306033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812775b-d1ab-47dd-a770-689012ae8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:01.360820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2812775b-d1ab-47dd-a770-689012ae8e18 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:01.363081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2812775b-d1ab-47dd-a770-689012ae8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:01.398419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65633956-8f05-4e47-9638-6466b5f1fa3a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:01.406268 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3589/7159] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:01.419214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65633956-8f05-4e47-9638-6466b5f1fa3a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:01.454108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:01.455786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:01.458548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:01.459355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:01.460387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:01.461631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:01.466951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:01.506466 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3571/7160] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:09:01.512209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812775b-d1ab-47dd-a770-689012ae8e18 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:01.529998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812775b-d1ab-47dd-a770-689012ae8e18 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:01.542492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:01.543274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:01.543494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:01.543774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:01.546840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:01.551599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:01.618315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:01.632690 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3590/7161] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:01 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:01.637629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f532d62-92cf-4255-868d-df9c801628ed admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:01.753532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:01.755823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:01.756192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:01.756550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:01.757354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:01.801263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:01.870036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:01.883947 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3572/7162] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:01 2022] POST /identity/v3/users => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:09:01.892496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b249-5e1f-4329-8e8e-ade5058abbbc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:01.900602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:01.901820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:01.902515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:01.903419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:01.904755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:01.906935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:01.944753 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3591/7163] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:01.945982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:01.962670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5643-880c-4269-a317-cfbb92463b09 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:01.992549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:01.993351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:01.993641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:01.993921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] PATH_INFO: `/v3/projects/c0cfbd4c2898474996a0cb0a43fa5f41/users/fadeb937e8954f3d8999dae59c60ea4b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:02.060294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cfbd4c2898474996a0cb0a43fa5f41, user_id=fadeb937e8954f3d8999dae59c60ea4b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:02.063097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:02.099556 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3573/7164] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:01 2022] PUT /identity/v3/projects/c0cfbd4c2898474996a0cb0a43fa5f41/users/fadeb937e8954f3d8999dae59c60ea4b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:02.103458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:02.116719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e1c13-03e2-44d4-b676-210325ba7568 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:02.413543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8259223-ff46-43c9-aad5-a1a3fe4a0303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:02.428788 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259223-ff46-43c9-aad5-a1a3fe4a0303 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:02.432968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259223-ff46-43c9-aad5-a1a3fe4a0303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:02.433436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8259223-ff46-43c9-aad5-a1a3fe4a0303 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:02.439799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8259223-ff46-43c9-aad5-a1a3fe4a0303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:02.442289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8259223-ff46-43c9-aad5-a1a3fe4a0303 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:02.502339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:02.504747 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3592/7165] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:02.537620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcb8c3-7b66-426d-aebd-106f84c261de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:02.563665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:02.564614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:02.564904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:02.565196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] PATH_INFO: `/v3/projects/c0cfbd4c2898474996a0cb0a43fa5f41/users/fadeb937e8954f3d8999dae59c60ea4b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:02.568575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cfbd4c2898474996a0cb0a43fa5f41, user_id=fadeb937e8954f3d8999dae59c60ea4b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:02.574850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:02.629041 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3574/7166] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:02 2022] PUT /identity/v3/projects/c0cfbd4c2898474996a0cb0a43fa5f41/users/fadeb937e8954f3d8999dae59c60ea4b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:09:02.641418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0e1e3-9d74-470a-8c48-f57324fcec28 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:02.642383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0e1e3-9d74-470a-8c48-f57324fcec28 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:02.642689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0e1e3-9d74-470a-8c48-f57324fcec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:02.726729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d9d0e1e3-9d74-470a-8c48-f57324fcec28 None None] MFA Rules not processed for user `fadeb937e8954f3d8999dae59c60ea4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:02.728193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d9d0e1e3-9d74-470a-8c48-f57324fcec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:02.920906 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3593/7167] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:02.925132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:03.163259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6569b-4e39-4e65-9e7d-868e895b6e78 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:03.170493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:03.172093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:03.185472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:03.185851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:03.186619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:03.188992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:03.260445 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3575/7168] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:02 2022] POST /identity/v3/projects => generated 393 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:03.264589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0e1e3-9d74-470a-8c48-f57324fcec28 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:03.292802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0e1e3-9d74-470a-8c48-f57324fcec28 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:03.461860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:03.463893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:03.464447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:03.464967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:03.465917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:03.475774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:03.514181 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3594/7169] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:03 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:03.519283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:03.537532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194a0d5-a25e-4474-bbda-e6a52b182dae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:03.551912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:03.552682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:03.554465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:03.554762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:03.557552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:03.560365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:03.593524 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3576/7170] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:03.597770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:03.615137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a7fc8-3acd-4209-82e8-7ea7d9974ae7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:03.655339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c2c41-b7c4-44f9-b932-0e18616d01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:03.655339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c2c41-b7c4-44f9-b932-0e18616d01ac admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:03.655339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c2c41-b7c4-44f9-b932-0e18616d01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:03.655339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c2c41-b7c4-44f9-b932-0e18616d01ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:03.656169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c2c41-b7c4-44f9-b932-0e18616d01ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:03.658855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c2c41-b7c4-44f9-b932-0e18616d01ac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:03.690808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:03.708176 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3595/7171] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:03.708662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca601f4e-a5cc-4290-ba11-7c3c39329bf7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:03.720680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:03.722609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:03.722750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:03.723058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] PATH_INFO: `/v3/projects/66229100c0ed4be5b5165acd9ca855f4/users/3830aa489db54b86a8d3ac407a53cadb/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:03.761643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66229100c0ed4be5b5165acd9ca855f4, user_id=3830aa489db54b86a8d3ac407a53cadb, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:03.766079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:03.803986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3577/7172] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:03 2022] PUT /identity/v3/projects/66229100c0ed4be5b5165acd9ca855f4/users/3830aa489db54b86a8d3ac407a53cadb/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:03.816815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097eaf-d577-4c72-afc9-86a1e201543b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:03.817303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097eaf-d577-4c72-afc9-86a1e201543b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:03.817748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097eaf-d577-4c72-afc9-86a1e201543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:03.874418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a2097eaf-d577-4c72-afc9-86a1e201543b None None] MFA Rules not processed for user `3830aa489db54b86a8d3ac407a53cadb`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:03.878237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2097eaf-d577-4c72-afc9-86a1e201543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:04.027217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3596/7173] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:04.034026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:04.035892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:04.196107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7743c0-c027-47ea-8e71-f1ceaa4c719a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:04.212485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:04.215742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:04.219046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:04.221862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:04.388253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:04.390482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:04.403829 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3578/7174] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:05.189554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72070c-1692-4567-ac0e-6df6880a04f7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:05.190107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72070c-1692-4567-ac0e-6df6880a04f7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:05.190107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72070c-1692-4567-ac0e-6df6880a04f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:05.240883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3c72070c-1692-4567-ac0e-6df6880a04f7 None None] MFA Rules not processed for user `d090d094c44c44519dcd3e98de4fc2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:05.245737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3c72070c-1692-4567-ac0e-6df6880a04f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:05.454896 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3597/7175] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:05.648770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:05.847069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e4521-6f73-4507-84b2-a31ef941db1a service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:05.857781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:05.859375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:05.859924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:05.860531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] PATH_INFO: `/v3/users/fadeb937e8954f3d8999dae59c60ea4b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:05.862356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadeb937e8954f3d8999dae59c60ea4b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:05.865402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:05.955549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadeb937e8954f3d8999dae59c60ea4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:05.994519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadeb937e8954f3d8999dae59c60ea4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.000734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadeb937e8954f3d8999dae59c60ea4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.004402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadeb937e8954f3d8999dae59c60ea4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.023813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadeb937e8954f3d8999dae59c60ea4b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.069269 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3579/7176] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:05 2022] DELETE /identity/v3/users/fadeb937e8954f3d8999dae59c60ea4b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:06.073968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:06.074261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:06.074549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:06.096558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:06.098163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:06.187468 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3598/7177] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:06.247353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:06.249134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:06.351399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed635696-a500-4993-be7d-acfa7301a740 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:06.357722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:06.358684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:06.359083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:06.359424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:06.376718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:06.378212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:06.391676 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3580/7178] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:06.585543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:06.588716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:06.615798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e6da5-49cc-4fbc-9c22-2631ec9587cc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:06.642492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:06.643739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:06.644260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:06.644804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] PATH_INFO: `/v3/users/8cdc0c878f6e4e5da2a2848d63a02f0d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:06.646608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdc0c878f6e4e5da2a2848d63a02f0d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:06.649036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:06.731537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdc0c878f6e4e5da2a2848d63a02f0d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.732723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdc0c878f6e4e5da2a2848d63a02f0d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.741875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdc0c878f6e4e5da2a2848d63a02f0d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.743085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdc0c878f6e4e5da2a2848d63a02f0d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.757015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdc0c878f6e4e5da2a2848d63a02f0d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:06.830711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3599/7179] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:06 2022] DELETE /identity/v3/users/8cdc0c878f6e4e5da2a2848d63a02f0d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:07.555540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:07.558554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:07.590548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10a308-b476-4282-b117-d8c640a0f72d service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:07.790222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:07.792404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:07.804483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:07.809004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:07.810580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:07.813380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] PATH_INFO: `/v3/projects/c0cfbd4c2898474996a0cb0a43fa5f41` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:07.818682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cfbd4c2898474996a0cb0a43fa5f41)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:07.825662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:07.942185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cfbd4c2898474996a0cb0a43fa5f41', 'request_id': 'req-0f9accff-296e-4932-b5fb-0ec0ad790e0d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:07.949740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cfbd4c2898474996a0cb0a43fa5f41', 'request_id': 'req-0f9accff-296e-4932-b5fb-0ec0ad790e0d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:07.960832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cfbd4c2898474996a0cb0a43fa5f41', 'request_id': 'req-0f9accff-296e-4932-b5fb-0ec0ad790e0d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:07.974594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] The token cache is being invalidate because project c0cfbd4c2898474996a0cb0a43fa5f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:07.975264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:07.976279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:07.978380 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3581/7180] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:07 2022] DELETE /identity/v3/projects/c0cfbd4c2898474996a0cb0a43fa5f41 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:07.982599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:07.983202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011f8c9-1490-4a0a-a51e-ecc39abbfe03 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:07.984620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:08.079149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9accff-296e-4932-b5fb-0ec0ad790e0d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:08.086489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:08.087429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:08.087713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:08.088835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] PATH_INFO: `/v3/users/3830aa489db54b86a8d3ac407a53cadb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:08.090225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3830aa489db54b86a8d3ac407a53cadb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:08.092318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:08.179814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dbb21-d851-49fb-b385-c5be07277e84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:08.186002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbb21-d851-49fb-b385-c5be07277e84 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:08.186585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbb21-d851-49fb-b385-c5be07277e84 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:08.187062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dbb21-d851-49fb-b385-c5be07277e84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:08.192541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b9dbb21-d851-49fb-b385-c5be07277e84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:08.199794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3830aa489db54b86a8d3ac407a53cadb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:08.207787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3830aa489db54b86a8d3ac407a53cadb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:08.208700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3830aa489db54b86a8d3ac407a53cadb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:08.209479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3830aa489db54b86a8d3ac407a53cadb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:08.220198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3830aa489db54b86a8d3ac407a53cadb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:08.236407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dbb21-d851-49fb-b385-c5be07277e84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:08.241329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9dbb21-d851-49fb-b385-c5be07277e84 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:08.246163 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3582/7181] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:07 2022] DELETE /identity/v3/users/3830aa489db54b86a8d3ac407a53cadb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:09:08.284238 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3600/7182] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:09:08.592600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:08.594074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:08.715172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e49bbc-27fe-4329-a03e-af4459c6b01e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:08.727879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:08.730150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:08.730438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:08.730720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] PATH_INFO: `/v3/projects/759c66c34f414c19b2109393738ef639` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:08.736193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=759c66c34f414c19b2109393738ef639)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:08.741299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:08.984014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759c66c34f414c19b2109393738ef639', 'request_id': 'req-0116a8f3-dca7-49d7-b3df-11891614d0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.001390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759c66c34f414c19b2109393738ef639', 'request_id': 'req-0116a8f3-dca7-49d7-b3df-11891614d0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.028790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759c66c34f414c19b2109393738ef639', 'request_id': 'req-0116a8f3-dca7-49d7-b3df-11891614d0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.066964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] The token cache is being invalidate because project 759c66c34f414c19b2109393738ef639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:09.074272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.075674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0116a8f3-dca7-49d7-b3df-11891614d0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.088045 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3583/7183] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:08 2022] DELETE /identity/v3/projects/759c66c34f414c19b2109393738ef639 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:09.091573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89694338-1c78-45a7-ae0c-f7a73aaa7fb2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:09.092503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89694338-1c78-45a7-ae0c-f7a73aaa7fb2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:09.093024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89694338-1c78-45a7-ae0c-f7a73aaa7fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:09.121329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-89694338-1c78-45a7-ae0c-f7a73aaa7fb2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:09.122976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89694338-1c78-45a7-ae0c-f7a73aaa7fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:09.211420 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3601/7184] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:09.219584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f225c-c628-4af6-af30-c1eaef4670e7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:09.220019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f225c-c628-4af6-af30-c1eaef4670e7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:09.220138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f225c-c628-4af6-af30-c1eaef4670e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:09.283237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5e2f225c-c628-4af6-af30-c1eaef4670e7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:09.284497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5e2f225c-c628-4af6-af30-c1eaef4670e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:09.322046 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3584/7185] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:09.331014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89694338-1c78-45a7-ae0c-f7a73aaa7fb2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:09.346542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89694338-1c78-45a7-ae0c-f7a73aaa7fb2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:09.361191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:09.362392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:09.365287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:09.365901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:09.367754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:09.371734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:09.378267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:09.418024 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3602/7186] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:09:09.423012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f225c-c628-4af6-af30-c1eaef4670e7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:09.447430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f225c-c628-4af6-af30-c1eaef4670e7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:09.484789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:09.497656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:09.498288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:09.500450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:09.503094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:09.507870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:09.520503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:09.525069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:09.571295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8320f07-d1cd-494d-83de-f4d515b19358 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:09.605522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:09.609066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:09.609394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:09.609684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] PATH_INFO: `/v3/projects/66229100c0ed4be5b5165acd9ca855f4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:09.618023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66229100c0ed4be5b5165acd9ca855f4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:09.627270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:09.649608 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3585/7187] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:09 2022] POST /identity/v3/projects => generated 381 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:09.659555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:09.789558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567e27a-0bbf-4824-9106-4e8a44332460 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:09.830899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66229100c0ed4be5b5165acd9ca855f4', 'request_id': 'req-a5c5c109-9dd4-40d3-85df-88f33fd56529'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.851575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66229100c0ed4be5b5165acd9ca855f4', 'request_id': 'req-a5c5c109-9dd4-40d3-85df-88f33fd56529'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.871364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66229100c0ed4be5b5165acd9ca855f4', 'request_id': 'req-a5c5c109-9dd4-40d3-85df-88f33fd56529'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.920810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] The token cache is being invalidate because project 66229100c0ed4be5b5165acd9ca855f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:09.921624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.923558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a5c5c109-9dd4-40d3-85df-88f33fd56529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:09.930706 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3603/7188] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:09 2022] DELETE /identity/v3/projects/66229100c0ed4be5b5165acd9ca855f4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:09.937244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a2c4-8c01-41b4-871c-12ef1509f930 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:09.937542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a2c4-8c01-41b4-871c-12ef1509f930 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:09.937868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a2c4-8c01-41b4-871c-12ef1509f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:09.980098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:09.981034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:09.981480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:09.981910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:09.982764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:09.984898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:09.991496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-66f8a2c4-8c01-41b4-871c-12ef1509f930 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:09.996179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-66f8a2c4-8c01-41b4-871c-12ef1509f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:10.019157 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3604/7189] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:10.027161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469622f9-0e41-45c5-b1ca-39673d190a0f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.027819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469622f9-0e41-45c5-b1ca-39673d190a0f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.028299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469622f9-0e41-45c5-b1ca-39673d190a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.043398 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3586/7190] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:09 2022] POST /identity/v3/users => generated 291 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:10.047539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.052142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:10.073186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-469622f9-0e41-45c5-b1ca-39673d190a0f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:10.076161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-469622f9-0e41-45c5-b1ca-39673d190a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:10.081126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea87c5-5bd9-446f-9ef3-e809ef919c66 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.090934 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3605/7191] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:10.094643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469622f9-0e41-45c5-b1ca-39673d190a0f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.097249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.098221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.098947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.099408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.100395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.103745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.115510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469622f9-0e41-45c5-b1ca-39673d190a0f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.124609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3587/7192] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:09:10.127610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.132664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.133613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.134088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.134551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.136057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:10.137184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.139116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.158666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369d29a-c9e8-41e5-af97-9b3726db50d8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.162947 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3606/7193] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:09:10.167452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.169534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.171359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.171740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.172642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.173659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.175453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.198369 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3588/7194] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:10.198369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.209391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03dec0-20ea-4091-b0ed-8851ef46d6e0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.209613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b60fbc-96af-49d2-adde-e1280017c788 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.224947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47715-daad-4bdf-9ea2-d9747304c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.226304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47715-daad-4bdf-9ea2-d9747304c7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.226702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47715-daad-4bdf-9ea2-d9747304c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.227130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47715-daad-4bdf-9ea2-d9747304c7d3 admin admin] PATH_INFO: `/v3/projects/03ab9fa8c41f4e18b0d6c1fb4e8af126/users/c0d2b3c89b6f42f789022f3b43353029/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.230477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.231593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.234867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.237689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.239024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.241291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.250097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47715-daad-4bdf-9ea2-d9747304c7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ab9fa8c41f4e18b0d6c1fb4e8af126, user_id=c0d2b3c89b6f42f789022f3b43353029, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.253487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47715-daad-4bdf-9ea2-d9747304c7d3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.283349 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3589/7195] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:10 2022] PUT /identity/v3/projects/03ab9fa8c41f4e18b0d6c1fb4e8af126/users/c0d2b3c89b6f42f789022f3b43353029/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:10.287164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645383b-6bca-47e7-bc5a-777508d3d4fe None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.287471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645383b-6bca-47e7-bc5a-777508d3d4fe None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.287757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645383b-6bca-47e7-bc5a-777508d3d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.316420 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3607/7196] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:10 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:10.317677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.337347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7645383b-6bca-47e7-bc5a-777508d3d4fe None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:10.342135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7645383b-6bca-47e7-bc5a-777508d3d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:10.463887 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3590/7197] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:10.474434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5710683-ec98-4ad9-bb19-92c33e1c14ae admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.487896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.489006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.489506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.489993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.490942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.493280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.534098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3608/7198] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:10 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:10.536604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645383b-6bca-47e7-bc5a-777508d3d4fe None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.559822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.562506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:10.562651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645383b-6bca-47e7-bc5a-777508d3d4fe None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.581312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.583074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.584704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.585373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.586370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.605092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.649375 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3591/7199] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:10.650658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.679497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efa794-9f61-40ac-9ad8-8c9528a6a776 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.696371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.697376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.699835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.701902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] PATH_INFO: `/v3/projects/3b0cf02596134042a99791171f7bbd51/users/d8536f04f2b140bc8a25c934fccad1a0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.712202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac2e3a-4917-42c8-bfa3-39055c1b027e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.720250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.722419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.723243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.724389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.731593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0cf02596134042a99791171f7bbd51, user_id=d8536f04f2b140bc8a25c934fccad1a0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.739525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.760957 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3592/7200] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:10 2022] PUT /identity/v3/projects/3b0cf02596134042a99791171f7bbd51/users/d8536f04f2b140bc8a25c934fccad1a0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:10.765339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.767528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.769601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.794190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3609/7201] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:10.846112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3576ef-e50f-474f-a820-5dbdf448b6d7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.852360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfbc56-9b5d-4ed7-b7c2-6ea5e2f78d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.853262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfbc56-9b5d-4ed7-b7c2-6ea5e2f78d78 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.854010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfbc56-9b5d-4ed7-b7c2-6ea5e2f78d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.854234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfbc56-9b5d-4ed7-b7c2-6ea5e2f78d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.855414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfbc56-9b5d-4ed7-b7c2-6ea5e2f78d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.857719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfbc56-9b5d-4ed7-b7c2-6ea5e2f78d78 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.871271 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3593/7202] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:10.875312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:10.887425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e850a-457f-4e8c-abb6-962ae080dd0e service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:10.899117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:10.900907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.901493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.901975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] PATH_INFO: `/v3/projects/3b0cf02596134042a99791171f7bbd51/users/d8536f04f2b140bc8a25c934fccad1a0/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:10.904593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0cf02596134042a99791171f7bbd51, user_id=d8536f04f2b140bc8a25c934fccad1a0, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:10.908053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:10.922306 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3610/7203] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:10 2022] PUT /identity/v3/projects/3b0cf02596134042a99791171f7bbd51/users/d8536f04f2b140bc8a25c934fccad1a0/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:10.936580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9368a-ad1b-4798-9a29-d8a4780b602a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:10.937002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9368a-ad1b-4798-9a29-d8a4780b602a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:10.937392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9368a-ad1b-4798-9a29-d8a4780b602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:11.003173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ead9368a-ad1b-4798-9a29-d8a4780b602a None None] MFA Rules not processed for user `d8536f04f2b140bc8a25c934fccad1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:11.005990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ead9368a-ad1b-4798-9a29-d8a4780b602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:11.184639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3594/7204] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:11.188901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:11.383112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d1db0-5a7e-4cf8-834c-cd652dbe5b8a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:11.395762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:11.396933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:11.397462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:11.397990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:11.399620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:11.422897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:11.475659 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3611/7205] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:11 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:09:11.480544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9368a-ad1b-4798-9a29-d8a4780b602a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:11.495040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9368a-ad1b-4798-9a29-d8a4780b602a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:11.726565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:11.728913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:11.794135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:11.797450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:11.802055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:11.802803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:11.804234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:11.812963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:11.863294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3595/7206] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:11 2022] POST /identity/v3/users => generated 293 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:09:11.864847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:11.895192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f138976-79ef-406d-be73-085da41e35a9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:11.897275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a596bb-d830-4701-b5be-a4ed25587a10 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:11.902181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:11.902646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:11.903366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:11.903647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:11.903914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:11.904938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:11.905187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:11.905419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:11.905797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:11.907509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:11.907928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:11.927312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:11.929479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:11.938346 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3596/7207] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:11.940412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:11.950342 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3612/7208] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:11.956998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935eb1a-a622-467c-8591-ec76c518f78f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:11.962380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f64c1-b5a8-4a6b-b359-0cbbd3bc828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:11.963621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f64c1-b5a8-4a6b-b359-0cbbd3bc828d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:11.964201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f64c1-b5a8-4a6b-b359-0cbbd3bc828d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:11.964698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f64c1-b5a8-4a6b-b359-0cbbd3bc828d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:11.966871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f64c1-b5a8-4a6b-b359-0cbbd3bc828d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:11.968765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f64c1-b5a8-4a6b-b359-0cbbd3bc828d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:11.987541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:11.994797 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3597/7209] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:11.999873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905c659-599d-483a-a873-a7a3b89f0694 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:12.005471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:12.006837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:12.007463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:12.008011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] PATH_INFO: `/v3/projects/96c2fc5f042540529fd56e1d50236be7/users/6816c91e08904a7a9a81adcf6b4beb3c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:12.036869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c2fc5f042540529fd56e1d50236be7, user_id=6816c91e08904a7a9a81adcf6b4beb3c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:12.041950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:12.075182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271625-0403-495e-ae40-157345f3f7d1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:12.075706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271625-0403-495e-ae40-157345f3f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:12.076159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271625-0403-495e-ae40-157345f3f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:12.076638 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3613/7210] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:11 2022] PUT /identity/v3/projects/96c2fc5f042540529fd56e1d50236be7/users/6816c91e08904a7a9a81adcf6b4beb3c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:12.134328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9d271625-0403-495e-ae40-157345f3f7d1 None None] MFA Rules not processed for user `6816c91e08904a7a9a81adcf6b4beb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:12.136839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9d271625-0403-495e-ae40-157345f3f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:12.233071 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3598/7211] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:12.246799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:12.248732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:12.379398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918e693-8057-4dc1-b735-233f4e929988 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:12.395083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5b882-fd5b-4969-98eb-96fd679d5c38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:12.395762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b882-fd5b-4969-98eb-96fd679d5c38 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:12.396049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b882-fd5b-4969-98eb-96fd679d5c38 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:12.396334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5b882-fd5b-4969-98eb-96fd679d5c38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:12.545676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5b882-fd5b-4969-98eb-96fd679d5c38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:12.551659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5b882-fd5b-4969-98eb-96fd679d5c38 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:12.585075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3614/7212] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:12.990393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271625-0403-495e-ae40-157345f3f7d1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:13.188609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271625-0403-495e-ae40-157345f3f7d1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:13.227792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:13.228820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:13.248263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:13.248971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] PATH_INFO: `/v3/users/d8536f04f2b140bc8a25c934fccad1a0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:13.255773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8536f04f2b140bc8a25c934fccad1a0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:13.258689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:13.479211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8536f04f2b140bc8a25c934fccad1a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:13.500865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8536f04f2b140bc8a25c934fccad1a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:13.510664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8536f04f2b140bc8a25c934fccad1a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:13.513107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8536f04f2b140bc8a25c934fccad1a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:13.533659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8536f04f2b140bc8a25c934fccad1a0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:13.564447 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3599/7213] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:12 2022] DELETE /identity/v3/users/d8536f04f2b140bc8a25c934fccad1a0 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:13.569439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df4a5-76a7-40cb-a855-02909c80bd66 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:13.570433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df4a5-76a7-40cb-a855-02909c80bd66 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:13.570928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78df4a5-76a7-40cb-a855-02909c80bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:13.623981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a78df4a5-76a7-40cb-a855-02909c80bd66 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:13.625558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a78df4a5-76a7-40cb-a855-02909c80bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:13.739340 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3615/7214] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:13.799877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:13.802028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:13.954492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0f76a-74d2-4392-83b5-649e9dcbd5f4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:13.968826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e04e8b-9dd6-48cb-82a1-86211a384bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:13.969890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e04e8b-9dd6-48cb-82a1-86211a384bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:13.970732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e04e8b-9dd6-48cb-82a1-86211a384bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:13.971372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e04e8b-9dd6-48cb-82a1-86211a384bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:14.034229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e04e8b-9dd6-48cb-82a1-86211a384bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:14.038847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e04e8b-9dd6-48cb-82a1-86211a384bb2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:14.085840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3600/7215] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:16.065950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:16.066849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:16.067319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:16.130628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] MFA Rules not processed for user `c0d2b3c89b6f42f789022f3b43353029`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:16.132088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:16.298849 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3616/7216] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:16.315632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:16.316831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:16.317652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:16.319427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:16.322111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:16.350727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37547fad-3aea-4c26-a0bf-b047128a85eb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:16.358097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:16.359513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:16.360192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:16.360799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] PATH_INFO: `/v3/projects/3b0cf02596134042a99791171f7bbd51` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:16.362688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0cf02596134042a99791171f7bbd51)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:16.371128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:16.403715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] MFA Rules not processed for user `c0d2b3c89b6f42f789022f3b43353029`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:16.406145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:16.453110 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3601/7217] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:16.454272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:16.459254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:16.479202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0cf02596134042a99791171f7bbd51', 'request_id': 'req-25219773-de0d-46c5-ac18-590417a9645c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.503231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0cf02596134042a99791171f7bbd51', 'request_id': 'req-25219773-de0d-46c5-ac18-590417a9645c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.522752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0cf02596134042a99791171f7bbd51', 'request_id': 'req-25219773-de0d-46c5-ac18-590417a9645c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.548837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] The token cache is being invalidate because project 3b0cf02596134042a99791171f7bbd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:16.549275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.551471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.555220 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3617/7218] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:16 2022] DELETE /identity/v3/projects/3b0cf02596134042a99791171f7bbd51 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:16.559934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:16.564321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:16.674455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595423d-99e0-4c38-9424-4fd5b6d4e4ef None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:16.711374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219773-de0d-46c5-ac18-590417a9645c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:16.718207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:16.719495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:16.720249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:16.734906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] PATH_INFO: `/v3/users/6816c91e08904a7a9a81adcf6b4beb3c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:16.738048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6816c91e08904a7a9a81adcf6b4beb3c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:16.743649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:16.802217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4fcc1-d3c6-40b9-b60f-438dd2856364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:16.803240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fcc1-d3c6-40b9-b60f-438dd2856364 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:16.803843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fcc1-d3c6-40b9-b60f-438dd2856364 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:16.804306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fcc1-d3c6-40b9-b60f-438dd2856364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:16.807603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68a4fcc1-d3c6-40b9-b60f-438dd2856364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:16.845976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6816c91e08904a7a9a81adcf6b4beb3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.847179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6816c91e08904a7a9a81adcf6b4beb3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.867178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6816c91e08904a7a9a81adcf6b4beb3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.870070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6816c91e08904a7a9a81adcf6b4beb3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.887532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6816c91e08904a7a9a81adcf6b4beb3c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:16.927726 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3618/7219] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:16 2022] DELETE /identity/v3/users/6816c91e08904a7a9a81adcf6b4beb3c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:16.932753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4fcc1-d3c6-40b9-b60f-438dd2856364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:16.943344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4fcc1-d3c6-40b9-b60f-438dd2856364 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:16.991838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3602/7220] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:19.566640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:19.568564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:19.818762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccd640-7963-4051-a21e-1e695e73addb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:19.837817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:19.838730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:19.839056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:19.839341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] PATH_INFO: `/v3/projects/96c2fc5f042540529fd56e1d50236be7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:19.844180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c2fc5f042540529fd56e1d50236be7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:19.848946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:20.017393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c2fc5f042540529fd56e1d50236be7', 'request_id': 'req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:20.049038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c2fc5f042540529fd56e1d50236be7', 'request_id': 'req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:20.067350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c2fc5f042540529fd56e1d50236be7', 'request_id': 'req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:20.101642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] The token cache is being invalidate because project 96c2fc5f042540529fd56e1d50236be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:20.101817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:20.105889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aec5ad11-aaf3-42c1-ac48-dd7baa1c76d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:20.113479 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3619/7221] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:19 2022] DELETE /identity/v3/projects/96c2fc5f042540529fd56e1d50236be7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:20.118699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f486873-3fae-474c-84dd-254e274dfb09 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:20.119952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f486873-3fae-474c-84dd-254e274dfb09 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:20.120457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f486873-3fae-474c-84dd-254e274dfb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:20.158290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9f486873-3fae-474c-84dd-254e274dfb09 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:20.159764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9f486873-3fae-474c-84dd-254e274dfb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:20.311812 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3603/7222] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:20.325791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3814-8181-4eb5-9818-53de1348ca3f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:20.325791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3814-8181-4eb5-9818-53de1348ca3f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:20.325791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3814-8181-4eb5-9818-53de1348ca3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:20.356475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fead3814-8181-4eb5-9818-53de1348ca3f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:20.357720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fead3814-8181-4eb5-9818-53de1348ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:20.382716 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3620/7223] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:20.387057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f486873-3fae-474c-84dd-254e274dfb09 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:20.420586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f486873-3fae-474c-84dd-254e274dfb09 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:20.432276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:20.433217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:20.433715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:20.434145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:20.435277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:20.435978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:20.445882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:20.480025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead3814-8181-4eb5-9818-53de1348ca3f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:20.486672 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3604/7224] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:09:20.493598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead3814-8181-4eb5-9818-53de1348ca3f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:20.512632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:20.513332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:20.513617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:20.513899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:20.514609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:20.516618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:20.597514 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3621/7225] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:20 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:20.599490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:20.622435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b552-9f1c-45b3-a579-d6a0ae13e287 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:20.782069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:20.783408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:20.783946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:20.784588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:20.785602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:20.787999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:20.830606 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3605/7226] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:20 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:20.834833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:20.858470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a8c34-43eb-4d04-83b7-b0a9025711e0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:20.868530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:20.869252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:20.869919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:20.870201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:20.870989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:20.872951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:20.896840 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3622/7227] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:09:20.902259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:20.926151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c06111-2005-439c-b288-2e455266f2fa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:20.949426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f4cd1-3d97-4b00-a5a3-df129021568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:20.951431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4cd1-3d97-4b00-a5a3-df129021568d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:20.953086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4cd1-3d97-4b00-a5a3-df129021568d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:20.954307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f4cd1-3d97-4b00-a5a3-df129021568d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:20.956736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f4cd1-3d97-4b00-a5a3-df129021568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:20.964862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f4cd1-3d97-4b00-a5a3-df129021568d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:20.996037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3606/7228] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:21.000383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:21.025733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bdf3a-4e95-4980-9952-2ea4f5aec90c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:21.048783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:21.050079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.054742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.059678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] PATH_INFO: `/v3/projects/d98edd5a449c4a118b006639f772fe62/users/ada8024621604c898c95d6f054673eaa/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.112159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98edd5a449c4a118b006639f772fe62, user_id=ada8024621604c898c95d6f054673eaa, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:21.114901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:21.151053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3623/7229] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:20 2022] PUT /identity/v3/projects/d98edd5a449c4a118b006639f772fe62/users/ada8024621604c898c95d6f054673eaa/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:21.162113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9fe48-4450-4c2f-87fd-41583fa33a36 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.162654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9fe48-4450-4c2f-87fd-41583fa33a36 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.162954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9fe48-4450-4c2f-87fd-41583fa33a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.201623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b9c9fe48-4450-4c2f-87fd-41583fa33a36 None None] MFA Rules not processed for user `ada8024621604c898c95d6f054673eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:21.202939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b9c9fe48-4450-4c2f-87fd-41583fa33a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:21.305380 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3607/7230] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:21.310381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:21.381592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd768e-ca17-48ce-ba1c-df3d5244ca24 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:21.392962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:21.393816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.394205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.394586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.396286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:21.398349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:21.442484 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3624/7231] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:21 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:21.447105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9fe48-4450-4c2f-87fd-41583fa33a36 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:21.459514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9fe48-4450-4c2f-87fd-41583fa33a36 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:21.555665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:21.556600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.556992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.557462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.558455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:21.563167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:21.613574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:21.614821 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3608/7232] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:21 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:09:21.627100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25623-478c-430c-97d0-83e374aadaaf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:21.634051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:21.635719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.636276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.636801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.637752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:21.639766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:21.659628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:21.660371 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3625/7233] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:21.674256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc71250-48f5-4b67-8ecb-dadbf563402a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:21.688530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e03f6-f547-4056-b146-d997935f2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:21.689770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e03f6-f547-4056-b146-d997935f2715 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.691515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e03f6-f547-4056-b146-d997935f2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.693185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e03f6-f547-4056-b146-d997935f2715 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.695809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e03f6-f547-4056-b146-d997935f2715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:21.699775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e03f6-f547-4056-b146-d997935f2715 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:21.732102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:21.743682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3a8af-893a-4672-a678-a042b687443b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:21.745759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3609/7234] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:21.761975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:21.763785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.764478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.764997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] PATH_INFO: `/v3/projects/1444cff1a7834e07850e6ec6f4df8424/users/06d6f43afcfb4341bd6c4e8477b41ccd/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.797133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1444cff1a7834e07850e6ec6f4df8424, user_id=06d6f43afcfb4341bd6c4e8477b41ccd, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:21.806618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:21.845696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f0d6-8883-4a74-b3e8-b0e4e3ffcd2e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:21.846200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f0d6-8883-4a74-b3e8-b0e4e3ffcd2e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:21.846582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f0d6-8883-4a74-b3e8-b0e4e3ffcd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:21.848126 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3626/7235] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:21 2022] PUT /identity/v3/projects/1444cff1a7834e07850e6ec6f4df8424/users/06d6f43afcfb4341bd6c4e8477b41ccd/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:09:21.877778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e288f0d6-8883-4a74-b3e8-b0e4e3ffcd2e None None] MFA Rules not processed for user `06d6f43afcfb4341bd6c4e8477b41ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:21.879622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e288f0d6-8883-4a74-b3e8-b0e4e3ffcd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:22.025987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3610/7236] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:22.030677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:22.168118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791c609-9bed-444d-a11f-e173ae666c49 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:22.182116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:22.182823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:22.183120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:22.183578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:22.184490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:22.186230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:22.249939 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3627/7237] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:22 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:22.254191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f0d6-8883-4a74-b3e8-b0e4e3ffcd2e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:22.300941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f0d6-8883-4a74-b3e8-b0e4e3ffcd2e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:22.718956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:22.719951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:22.721202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:22.722299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:22.728945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:22.731476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:22.779392 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3611/7238] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:22 2022] POST /identity/v3/users => generated 297 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:22.781874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:22.804406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5778fdb-8dfd-45ba-abc1-1ea9f0ac1622 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:22.823281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:22.824310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:22.824764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:22.825247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:22.827227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:22.830077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:22.857725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3628/7239] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:09:22.861433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:22.876080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521fbc4-9eb8-43e8-a8d5-cd54d900c713 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:22.881963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:22.887724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:22.888509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:22.888975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] PATH_INFO: `/v3/projects/8e9b35ab64504a0a92a6efafc110149a/users/f6e61ffdd0184223a5b16e2724be2bfa/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:22.908938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9b35ab64504a0a92a6efafc110149a, user_id=f6e61ffdd0184223a5b16e2724be2bfa, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:22.918175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:22.943243 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3612/7240] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:22 2022] PUT /identity/v3/projects/8e9b35ab64504a0a92a6efafc110149a/users/f6e61ffdd0184223a5b16e2724be2bfa/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:22.959397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:22.988690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f6fc8-65f1-43d2-89b2-8fa6f9c8bad8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:23.174675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa131db-e621-48c2-aa27-7b344bcd1a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:23.175747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa131db-e621-48c2-aa27-7b344bcd1a41 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:23.177601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa131db-e621-48c2-aa27-7b344bcd1a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:23.178700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa131db-e621-48c2-aa27-7b344bcd1a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:23.182641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa131db-e621-48c2-aa27-7b344bcd1a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:23.186045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa131db-e621-48c2-aa27-7b344bcd1a41 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:23.206111 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3629/7241] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:23.207549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:23.229908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222da4b-2e81-47d9-8459-fd47c30f4d8e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:23.243869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:23.245227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:23.246119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:23.246649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] PATH_INFO: `/v3/projects/8e9b35ab64504a0a92a6efafc110149a/users/f6e61ffdd0184223a5b16e2724be2bfa/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:23.251223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e9b35ab64504a0a92a6efafc110149a, user_id=f6e61ffdd0184223a5b16e2724be2bfa, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:23.255156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:23.269174 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3613/7242] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:23 2022] PUT /identity/v3/projects/8e9b35ab64504a0a92a6efafc110149a/users/f6e61ffdd0184223a5b16e2724be2bfa/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:23.376425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:23.376706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:23.377137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:23.456055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] MFA Rules not processed for user `f6e61ffdd0184223a5b16e2724be2bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:23.460341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:23.796578 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3630/7243] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:23.822583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:23.824989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:24.051783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a98ac-4ef7-4726-8dab-5e3f9c552cee admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:24.063608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418078e1-8d30-461d-831a-fd00390ef13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:24.066684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418078e1-8d30-461d-831a-fd00390ef13a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:24.067498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418078e1-8d30-461d-831a-fd00390ef13a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:24.067999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418078e1-8d30-461d-831a-fd00390ef13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:24.243799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418078e1-8d30-461d-831a-fd00390ef13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:24.246298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418078e1-8d30-461d-831a-fd00390ef13a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:24.261993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3614/7244] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:34.291610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:34.293907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:34.459174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e8f5f-4482-4036-853a-e73bf813a640 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:34.480960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:34.484684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:34.485299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:34.485740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] PATH_INFO: `/v3/users/a1b011eda2034fe88aec4bed8912abde` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:34.488218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b011eda2034fe88aec4bed8912abde)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:34.490515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:34.592765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b011eda2034fe88aec4bed8912abde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:34.595034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b011eda2034fe88aec4bed8912abde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:34.607256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b011eda2034fe88aec4bed8912abde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:34.608673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b011eda2034fe88aec4bed8912abde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:34.625171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b011eda2034fe88aec4bed8912abde'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:34.669878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3631/7245] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:34 2022] DELETE /identity/v3/users/a1b011eda2034fe88aec4bed8912abde => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:34.674417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:34.675349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:34.675820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:34.707793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:34.709884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:34.846403 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3615/7246] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:34.884635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:34.887463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:35.026834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305236a2-885f-442d-ae61-659bdd04eca4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:35.034125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd03be-06ce-4f22-ad94-a01e46921f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:35.035067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd03be-06ce-4f22-ad94-a01e46921f6d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:35.035521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd03be-06ce-4f22-ad94-a01e46921f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:35.035946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd03be-06ce-4f22-ad94-a01e46921f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:35.049211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd03be-06ce-4f22-ad94-a01e46921f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:35.051367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd03be-06ce-4f22-ad94-a01e46921f6d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:35.089542 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3632/7247] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:36.678275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:36.680241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:36.699735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14946311-0b72-40e0-aa17-7d262b90d6ac None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:36.711256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:36.713398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:36.713899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:36.714498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] PATH_INFO: `/v3/projects/6d3ba93d3f2b424cbe1cd3e4f8623ad5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:36.716421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3ba93d3f2b424cbe1cd3e4f8623ad5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:36.718810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:36.891299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3ba93d3f2b424cbe1cd3e4f8623ad5', 'request_id': 'req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:36.910005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3ba93d3f2b424cbe1cd3e4f8623ad5', 'request_id': 'req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:36.932783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3ba93d3f2b424cbe1cd3e4f8623ad5', 'request_id': 'req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:36.967970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] The token cache is being invalidate because project 6d3ba93d3f2b424cbe1cd3e4f8623ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:36.968539 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:36.971051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-041c6368-7b4e-4bb4-bc97-5c9e40a47cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:36.976215 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3616/7248] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:36 2022] DELETE /identity/v3/projects/6d3ba93d3f2b424cbe1cd3e4f8623ad5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:36.982524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5b15-60ba-47b0-a31c-eb635e7822f6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:36.984321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5b15-60ba-47b0-a31c-eb635e7822f6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:36.984794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5b15-60ba-47b0-a31c-eb635e7822f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:37.029575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-283c5b15-60ba-47b0-a31c-eb635e7822f6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:37.033834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-283c5b15-60ba-47b0-a31c-eb635e7822f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:37.191450 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3633/7249] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:37.197977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7b1b-8144-4ae6-9ec4-514ebfee55ef None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:37.198260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7b1b-8144-4ae6-9ec4-514ebfee55ef None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:37.208768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7b1b-8144-4ae6-9ec4-514ebfee55ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:37.331447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d3ff7b1b-8144-4ae6-9ec4-514ebfee55ef None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:37.339979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d3ff7b1b-8144-4ae6-9ec4-514ebfee55ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:37.370697 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3617/7250] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:37.372477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5b15-60ba-47b0-a31c-eb635e7822f6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:37.392427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5b15-60ba-47b0-a31c-eb635e7822f6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:37.434258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:37.434991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:37.436226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:37.436226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:37.445245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:37.445516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:37.458504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:37.495588 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3634/7251] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:09:37.500335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7b1b-8144-4ae6-9ec4-514ebfee55ef None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:37.521905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7b1b-8144-4ae6-9ec4-514ebfee55ef None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:37.531308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:37.533710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:37.534118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:37.534516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:37.535888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:37.547704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:37.625752 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3618/7252] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:37 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:37.633234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:37.660811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344e6f9-d684-403c-bce6-24d58b6e7d06 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:37.841817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:37.844663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:37.845342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:37.846215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:37.847762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:37.853585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:37.884191 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3635/7253] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:37 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:37.889597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:37.906141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47b6b5-fd9d-480e-81e1-b3813e3273e1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:37.927779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:37.928950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:37.929459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:37.930240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:37.932542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:37.935251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:37.965028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:37.966551 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3619/7254] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:37.977550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4ffef-146c-48c9-9ca6-691455bd243c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:37.997033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a56a6-97b9-46aa-8478-c353175f848c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:37.998582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a56a6-97b9-46aa-8478-c353175f848c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:37.999108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a56a6-97b9-46aa-8478-c353175f848c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:37.999631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a56a6-97b9-46aa-8478-c353175f848c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:38.000593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a56a6-97b9-46aa-8478-c353175f848c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:38.002462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a56a6-97b9-46aa-8478-c353175f848c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:38.030217 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3636/7255] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:38.031688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:38.052869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28111686-e6cd-4521-93d1-2aa4dc2c13cb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:38.073181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:38.077227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:38.077772 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:38.078661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] PATH_INFO: `/v3/projects/f34f4ab05680424998462e594d5ca043/users/fb984ae414d448e28ff76f76b6e14187/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:38.123151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34f4ab05680424998462e594d5ca043, user_id=fb984ae414d448e28ff76f76b6e14187, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:38.126218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:38.158728 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3620/7256] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:38 2022] PUT /identity/v3/projects/f34f4ab05680424998462e594d5ca043/users/fb984ae414d448e28ff76f76b6e14187/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:38.170978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:38.174885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:38.175643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:38.307589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] MFA Rules not processed for user `fb984ae414d448e28ff76f76b6e14187`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:38.308860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:38.573342 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3637/7257] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:38.619822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:38.621985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:38.762178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a94aa7-afbd-40e3-8e04-b72816e6808c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:38.781035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:38.781881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:38.782170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:38.782449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:38.834645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:38.836447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:38.860426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3621/7258] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:43.825969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:43.829176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:43.847642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:43.849110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:43.981034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf2739-672e-474d-ad43-34ab0cce0872 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:43.986907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:43.987961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:43.988380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:43.988753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] PATH_INFO: `/v3/users/c0d2b3c89b6f42f789022f3b43353029` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:43.990201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0d2b3c89b6f42f789022f3b43353029)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:44.008082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:44.064774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34f720-e04d-4a1f-8903-35225a587cce None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:44.078067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:44.079002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:44.080637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:44.081111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] PATH_INFO: `/v3/users/0cd1a3e3a02a4a7889ad46c94fbe8e4d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:44.086514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd1a3e3a02a4a7889ad46c94fbe8e4d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:44.100699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:44.117660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0d2b3c89b6f42f789022f3b43353029'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.135244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0d2b3c89b6f42f789022f3b43353029'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.138168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0d2b3c89b6f42f789022f3b43353029'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.143038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0d2b3c89b6f42f789022f3b43353029'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.168913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0d2b3c89b6f42f789022f3b43353029'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.211048 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3622/7259] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:43 2022] DELETE /identity/v3/users/c0d2b3c89b6f42f789022f3b43353029 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:44.263313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd1a3e3a02a4a7889ad46c94fbe8e4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.264067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd1a3e3a02a4a7889ad46c94fbe8e4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.286277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd1a3e3a02a4a7889ad46c94fbe8e4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.287114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd1a3e3a02a4a7889ad46c94fbe8e4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.301665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd1a3e3a02a4a7889ad46c94fbe8e4d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:44.370936 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3638/7260] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:43 2022] DELETE /identity/v3/users/0cd1a3e3a02a4a7889ad46c94fbe8e4d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:44.834669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:44.837587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:44.921277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905800b-d6dc-40e4-89d9-c9d73b009356 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:44.932647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:44.935518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:45.006932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:45.008398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:45.009558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:45.010101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] PATH_INFO: `/v3/projects/03ab9fa8c41f4e18b0d6c1fb4e8af126` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:45.012406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ab9fa8c41f4e18b0d6c1fb4e8af126)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:45.014997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:45.105368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'request_id': 'req-03ce8d44-bade-45ea-bdf9-77f85e6e4834'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.121122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'request_id': 'req-03ce8d44-bade-45ea-bdf9-77f85e6e4834'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.132102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f6fc6-55df-4f1d-9f39-01c7df202fc1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:45.133395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ab9fa8c41f4e18b0d6c1fb4e8af126', 'request_id': 'req-03ce8d44-bade-45ea-bdf9-77f85e6e4834'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.158996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] The token cache is being invalidate because project 03ab9fa8c41f4e18b0d6c1fb4e8af126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:45.159587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.161945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03ce8d44-bade-45ea-bdf9-77f85e6e4834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.167944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3623/7261] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:44 2022] DELETE /identity/v3/projects/03ab9fa8c41f4e18b0d6c1fb4e8af126 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:45.169633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09765f1f-b803-41a9-9cc9-cbfe8613ed18 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:45.170683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09765f1f-b803-41a9-9cc9-cbfe8613ed18 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:45.171153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09765f1f-b803-41a9-9cc9-cbfe8613ed18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:45.194312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-09765f1f-b803-41a9-9cc9-cbfe8613ed18 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:45.195857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-09765f1f-b803-41a9-9cc9-cbfe8613ed18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:45.229016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:45.229899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:45.231160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:45.231656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] PATH_INFO: `/v3/projects/e5bd7ffaf96c48688d8ebe954dc7912f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:45.233131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bd7ffaf96c48688d8ebe954dc7912f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:45.235945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:45.313731 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3624/7262] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:45.321156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8310ff-68f1-4829-81e8-d97a52236048 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:45.322687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8310ff-68f1-4829-81e8-d97a52236048 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:45.323211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8310ff-68f1-4829-81e8-d97a52236048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:45.354266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'request_id': 'req-ab1d837c-ca88-4c39-b99b-bc829b004dbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.363635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'request_id': 'req-ab1d837c-ca88-4c39-b99b-bc829b004dbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.374507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bd7ffaf96c48688d8ebe954dc7912f', 'request_id': 'req-ab1d837c-ca88-4c39-b99b-bc829b004dbf'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.375603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ed8310ff-68f1-4829-81e8-d97a52236048 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:45.377064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ed8310ff-68f1-4829-81e8-d97a52236048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:45.388472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] The token cache is being invalidate because project e5bd7ffaf96c48688d8ebe954dc7912f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:45.388854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.389599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.394737 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3639/7263] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:44 2022] DELETE /identity/v3/projects/e5bd7ffaf96c48688d8ebe954dc7912f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:45.397121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:45.398718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:45.488584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d837c-ca88-4c39-b99b-bc829b004dbf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:45.494551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:45.496263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:45.496895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:45.497406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] PATH_INFO: `/v3/users/1c6f3bc5cdf64711be658dba4ff584aa` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:45.499350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6f3bc5cdf64711be658dba4ff584aa)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:45.501503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:45.510440 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3625/7264] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:09:45.513461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8310ff-68f1-4829-81e8-d97a52236048 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:45.534923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8310ff-68f1-4829-81e8-d97a52236048 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:45.560294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:45.561376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:45.562556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:45.565584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:45.567728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:45.568277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:45.574889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:45.597895 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3626/7265] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:09:45.614085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:45.622517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6f3bc5cdf64711be658dba4ff584aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.623276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6f3bc5cdf64711be658dba4ff584aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.656017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb0ae-8a5f-491b-82a9-05af611b325a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:45.656931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6f3bc5cdf64711be658dba4ff584aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.658422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6f3bc5cdf64711be658dba4ff584aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.668269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:45.668896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:45.669429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:45.669617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:45.670871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:45.673139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6f3bc5cdf64711be658dba4ff584aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:45.674883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:45.720826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3640/7266] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:45 2022] DELETE /identity/v3/users/1c6f3bc5cdf64711be658dba4ff584aa => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:45.769163 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3627/7267] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:45 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:45.772213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:45.774832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:45.977182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f6671-7e98-44cb-9b2f-064797020e0a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:46.139251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:46.140223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:46.140848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:46.141401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:46.142450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:46.144959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:46.182967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3641/7268] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:45 2022] POST /identity/v3/users => generated 287 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:46.186892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:46.201167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b89e18-7b8e-474f-8056-483d10524be5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:46.212530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:46.215234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:46.215496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:46.216102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:46.221386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:46.228251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:46.259780 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3628/7269] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:46.263964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:46.283257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ddf2b-aec1-4851-b22f-1d8500eb680f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:46.292882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e30333-b8f0-467e-a4a6-2b84ecf4a863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:46.294329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30333-b8f0-467e-a4a6-2b84ecf4a863 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:46.295055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30333-b8f0-467e-a4a6-2b84ecf4a863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:46.295922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e30333-b8f0-467e-a4a6-2b84ecf4a863 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:46.297330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e30333-b8f0-467e-a4a6-2b84ecf4a863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:46.300460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e30333-b8f0-467e-a4a6-2b84ecf4a863 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:46.327257 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3642/7270] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:46.331781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:46.357548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27400a91-8896-442c-a6bf-6998c64c3eac admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:46.370541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:46.371875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:46.372379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:46.372926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] PATH_INFO: `/v3/projects/fb0d2331b1674fe797c71f474a68e096/users/a512b2753f924a1fb873e97cd3cd322c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:46.401407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0d2331b1674fe797c71f474a68e096, user_id=a512b2753f924a1fb873e97cd3cd322c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:46.406433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:46.458699 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3629/7271] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:46 2022] PUT /identity/v3/projects/fb0d2331b1674fe797c71f474a68e096/users/a512b2753f924a1fb873e97cd3cd322c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:46.469415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68aafa-fcf0-4be9-8783-49658163c178 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:46.469712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68aafa-fcf0-4be9-8783-49658163c178 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:46.470023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68aafa-fcf0-4be9-8783-49658163c178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:46.530079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5c68aafa-fcf0-4be9-8783-49658163c178 None None] MFA Rules not processed for user `a512b2753f924a1fb873e97cd3cd322c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:46.531401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5c68aafa-fcf0-4be9-8783-49658163c178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:46.587336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:46.589167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:46.726647 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3643/7272] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:46.741174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:46.741877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:46.742324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:46.776735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c819-0d12-46f9-b9d4-1e18db7317e8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:46.782538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] MFA Rules not processed for user `a512b2753f924a1fb873e97cd3cd322c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:46.783782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:46.783942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:46.785241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:46.785872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:46.786550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] PATH_INFO: `/v3/projects/720fbf0e355c4d9c841f2380a9abce14` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:46.788922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720fbf0e355c4d9c841f2380a9abce14)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:46.793242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:46.812935 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3644/7273] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:46.823026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:46.824364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:46.920228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720fbf0e355c4d9c841f2380a9abce14', 'request_id': 'req-e172acb7-1d36-409e-b444-dda915ae9570'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:46.936436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720fbf0e355c4d9c841f2380a9abce14', 'request_id': 'req-e172acb7-1d36-409e-b444-dda915ae9570'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:46.962395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720fbf0e355c4d9c841f2380a9abce14', 'request_id': 'req-e172acb7-1d36-409e-b444-dda915ae9570'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:47.003309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] The token cache is being invalidate because project 720fbf0e355c4d9c841f2380a9abce14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:47.003831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:47.009062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e172acb7-1d36-409e-b444-dda915ae9570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:47.025867 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3630/7274] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:46 2022] DELETE /identity/v3/projects/720fbf0e355c4d9c841f2380a9abce14 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:47.031461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643fa7-ddec-4563-bd6b-8231b7f8fbec None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.031461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643fa7-ddec-4563-bd6b-8231b7f8fbec None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.031863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5643fa7-ddec-4563-bd6b-8231b7f8fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.088790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d5643fa7-ddec-4563-bd6b-8231b7f8fbec None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:47.090155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d5643fa7-ddec-4563-bd6b-8231b7f8fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:47.126222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6ccb3-f046-4b08-bc3f-e6a18ebf131f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:47.247273 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3631/7275] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:47.249803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f383-5115-4499-b430-52d9e6630c64 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.250305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f383-5115-4499-b430-52d9e6630c64 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.250883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2f383-5115-4499-b430-52d9e6630c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.284780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5dd2f383-5115-4499-b430-52d9e6630c64 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:47.287258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5dd2f383-5115-4499-b430-52d9e6630c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:47.296773 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3632/7276] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:47.301623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f383-5115-4499-b430-52d9e6630c64 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:47.325948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2f383-5115-4499-b430-52d9e6630c64 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:47.339072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:47.340734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.341030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.341196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:47.341716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.342889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.343181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.343462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.344196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:47.345464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:47.350289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:47.354801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:47.385689 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3633/7277] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:09:47.391500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:47.415233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebef22d-0bb0-4813-82ae-5ae51646c222 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:47.443794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:47.444616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.444908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.445190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.446586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:47.449443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:47.503109 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3634/7278] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:47 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:47.507600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:47.520226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:47.522988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:47.568847 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3645/7279] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:47.643137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604901cf-5d0d-4081-bd9f-83f701945f10 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:47.652800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:47.653599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.654456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.655133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.658225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:47.660584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:47.729675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:47.730852 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3635/7280] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:47 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:47.743095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9b3c7-6250-4c6f-926e-2108191b3f0f service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:47.779522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:47.780217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.780499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.780775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.781501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:47.784961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:47.822530 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3646/7281] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:47.826649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:47.839587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3450c2-6755-4e0a-8144-db8fb0c3be9c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:47.847312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be736f7-657a-421a-8d65-1cddbf30d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:47.848310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be736f7-657a-421a-8d65-1cddbf30d4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.848858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be736f7-657a-421a-8d65-1cddbf30d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.849467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be736f7-657a-421a-8d65-1cddbf30d4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.850946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be736f7-657a-421a-8d65-1cddbf30d4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:47.853717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be736f7-657a-421a-8d65-1cddbf30d4b4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:47.880469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:47.882629 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3636/7282] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:47.894308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974dc3-35f1-444d-b1d2-1dc1c4c9fe68 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:47.906303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:47.907627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:47.908056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:47.908490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] PATH_INFO: `/v3/projects/d70782066cce4f2fbf5744b63e4195cb/users/4f4cbf51481d45de862752fe273dceda/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:47.960168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70782066cce4f2fbf5744b63e4195cb, user_id=4f4cbf51481d45de862752fe273dceda, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:47.970242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:48.003591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3542-6c10-4ec0-988e-562b77227674 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:48.003953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3542-6c10-4ec0-988e-562b77227674 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:48.004272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f3542-6c10-4ec0-988e-562b77227674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:48.006423 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3647/7283] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:47 2022] PUT /identity/v3/projects/d70782066cce4f2fbf5744b63e4195cb/users/4f4cbf51481d45de862752fe273dceda/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:48.029156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0d4f3542-6c10-4ec0-988e-562b77227674 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:48.030646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0d4f3542-6c10-4ec0-988e-562b77227674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:48.145105 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3637/7284] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:48.191970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:48.194433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:48.331803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d430af-047b-4f3a-879f-93cd340bacc0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:48.340326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:48.341162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:48.341747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:48.342186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:48.356057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:48.357949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:48.371361 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3648/7285] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:48.717987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:48.718743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:48.718743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:48.752581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] MFA Rules not processed for user `a512b2753f924a1fb873e97cd3cd322c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:48.754172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:48.881595 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3638/7286] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:50.478667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:50.498473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c330f-c630-4eda-b3b9-1c7e8ea30cf0 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:50.502413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1bf4-5b9a-44ba-a0fb-0d6677f47ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:50.503149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1bf4-5b9a-44ba-a0fb-0d6677f47ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:50.503639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1bf4-5b9a-44ba-a0fb-0d6677f47ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:50.504126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1bf4-5b9a-44ba-a0fb-0d6677f47ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:50.508284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-87be1bf4-5b9a-44ba-a0fb-0d6677f47ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:50.730254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be1bf4-5b9a-44ba-a0fb-0d6677f47ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:50.736951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be1bf4-5b9a-44ba-a0fb-0d6677f47ee2 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:50.784338 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3649/7287] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:53.529370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:53.531669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:53.597355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4e50e-ad4d-4470-9401-cbfb3154ef84 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:53.614564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:53.616441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:53.618933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:53.619454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] PATH_INFO: `/v3/users/38e6d754538146aea01b0f51c8e2cc2f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:53.623029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e6d754538146aea01b0f51c8e2cc2f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:53.636502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:53.740311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e6d754538146aea01b0f51c8e2cc2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:53.748816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e6d754538146aea01b0f51c8e2cc2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:53.749604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e6d754538146aea01b0f51c8e2cc2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:53.750204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e6d754538146aea01b0f51c8e2cc2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:53.761179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e6d754538146aea01b0f51c8e2cc2f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:53.806535 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3639/7288] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:09:53 2022] DELETE /identity/v3/users/38e6d754538146aea01b0f51c8e2cc2f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:53.809086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:53.815552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:53.816393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:53.839369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:53.841010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:53.952233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3650/7289] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:54.204503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:54.206409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:54.375109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950409-d483-4887-b1b8-d6c1573aad01 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:54.384647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63113b8-daaf-44db-a715-63d1510f41cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:54.385728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63113b8-daaf-44db-a715-63d1510f41cf service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:54.389402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63113b8-daaf-44db-a715-63d1510f41cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:54.390049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63113b8-daaf-44db-a715-63d1510f41cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:54.438261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63113b8-daaf-44db-a715-63d1510f41cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:54.439903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63113b8-daaf-44db-a715-63d1510f41cf service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:54.456043 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3640/7290] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:09:55.047495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:55.049329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:55.075275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fe9db-59f7-49c8-97e3-8bd4a2de229d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:55.082123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:55.083491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.084539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.085084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] PATH_INFO: `/v3/projects/e2bec96bf83d4fb296cbb8aeb28d576e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.087408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2bec96bf83d4fb296cbb8aeb28d576e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:55.102638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:55.211204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'request_id': 'req-4516e531-1819-47b3-b455-135192caf2ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:55.222697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'request_id': 'req-4516e531-1819-47b3-b455-135192caf2ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:55.238550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2bec96bf83d4fb296cbb8aeb28d576e', 'request_id': 'req-4516e531-1819-47b3-b455-135192caf2ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:55.255532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] The token cache is being invalidate because project e2bec96bf83d4fb296cbb8aeb28d576e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:09:55.256080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:55.257153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4516e531-1819-47b3-b455-135192caf2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:09:55.264334 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3651/7291] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:09:55 2022] DELETE /identity/v3/projects/e2bec96bf83d4fb296cbb8aeb28d576e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:55.265050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835a6b-b988-47e4-9e81-2395e735c971 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.266014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835a6b-b988-47e4-9e81-2395e735c971 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.266300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02835a6b-b988-47e4-9e81-2395e735c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.303159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-02835a6b-b988-47e4-9e81-2395e735c971 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:55.304902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-02835a6b-b988-47e4-9e81-2395e735c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:55.399961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3641/7292] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:55.408408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de077b-57e0-4f4e-bdb7-cd14dd16d205 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.408929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de077b-57e0-4f4e-bdb7-cd14dd16d205 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.409371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de077b-57e0-4f4e-bdb7-cd14dd16d205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.432614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-51de077b-57e0-4f4e-bdb7-cd14dd16d205 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:55.434100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-51de077b-57e0-4f4e-bdb7-cd14dd16d205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:55.448946 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3652/7293] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:55.450036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835a6b-b988-47e4-9e81-2395e735c971 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:55.462099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02835a6b-b988-47e4-9e81-2395e735c971 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:55.472815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:55.476468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.477541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.478184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.479675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:09:55.480674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:55.482942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:55.506832 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3642/7294] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:09:55.509085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de077b-57e0-4f4e-bdb7-cd14dd16d205 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:55.520212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de077b-57e0-4f4e-bdb7-cd14dd16d205 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:55.525495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:55.526233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.526456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.526943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.528001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:55.530126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:55.592555 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3653/7295] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:09:55 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:09:55.597655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:55.613127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd747e-862d-4d9f-9003-6f31e933be64 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:55.711843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:55.713451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.713960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.715061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.715998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:55.719699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:55.754072 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3643/7296] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:09:55 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:09:55.757532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:55.773177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea9e93-f758-4cae-aaab-3b22c53f29db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:55.780891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:55.782452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.783254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.783769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.786169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:55.790812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:55.817304 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3654/7297] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:09:55.818912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:55.829255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f9f08-3fc6-4886-b58f-26b9c13ac39f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:55.834992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4303b-dbe7-4a98-b08b-7a6efea22cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:55.835682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4303b-dbe7-4a98-b08b-7a6efea22cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.836387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4303b-dbe7-4a98-b08b-7a6efea22cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.836387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4303b-dbe7-4a98-b08b-7a6efea22cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.837318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4303b-dbe7-4a98-b08b-7a6efea22cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:55.839027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4303b-dbe7-4a98-b08b-7a6efea22cd1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:55.850473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3644/7298] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:09:55.856652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:55.875754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebce2a-7aac-47d4-af36-c43f850e7cee admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:55.881057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:55.881952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.882237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.882711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] PATH_INFO: `/v3/projects/270c72ab746a472d9bc29941c34f86e5/users/579aa8931a494de8bd0c337d020421d2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:55.910011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=270c72ab746a472d9bc29941c34f86e5, user_id=579aa8931a494de8bd0c337d020421d2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:55.913027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:55.942483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3655/7299] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:09:55 2022] PUT /identity/v3/projects/270c72ab746a472d9bc29941c34f86e5/users/579aa8931a494de8bd0c337d020421d2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:09:55.950577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91368b2-5aa5-4afc-a04f-fcd13c158864 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:55.950943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91368b2-5aa5-4afc-a04f-fcd13c158864 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:55.951937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91368b2-5aa5-4afc-a04f-fcd13c158864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:56.013359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e91368b2-5aa5-4afc-a04f-fcd13c158864 None None] MFA Rules not processed for user `579aa8931a494de8bd0c337d020421d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:09:56.015065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e91368b2-5aa5-4afc-a04f-fcd13c158864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:56.121206 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3645/7300] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:09:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:09:56.132212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:09:56.135962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:09:56.233618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c79d8-13c0-4ffd-a025-6ba10359ac2d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:09:56.237751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:09:56.238535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:09:56.239389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:09:56.239871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:09:56.254883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:09:56.256936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:09:56.283367 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3656/7301] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:09:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:00.371246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b7d2-6ad0-415f-869a-335952658c7f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:00.379400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b7d2-6ad0-415f-869a-335952658c7f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:00.379741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5b7d2-6ad0-415f-869a-335952658c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:00.424356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-68d5b7d2-6ad0-415f-869a-335952658c7f None None] MFA Rules not processed for user `4f4cbf51481d45de862752fe273dceda`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:00.426288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-68d5b7d2-6ad0-415f-869a-335952658c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:00.590826 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3646/7302] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:00.595303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:00.599780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:00.703459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83474b0d-7712-45e1-bd97-f67da1034333 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:00.708801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:00.709744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:00.710196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:00.710639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:00.711634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:00.714046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:00.750886 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3657/7303] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:00 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:10:00.754709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b7d2-6ad0-415f-869a-335952658c7f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:00.771952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5b7d2-6ad0-415f-869a-335952658c7f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:00.915520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:00.916382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:00.916674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:00.917677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:00.917830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:00.919921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:00.948596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3647/7304] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:10:00 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:00.952618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:00.965512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49619938-3dd3-4fb3-8bba-75824b843041 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:00.971440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:00.972508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:00.972874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:00.973353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:00.974423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:00.976205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:00.995898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3658/7305] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:00.997460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:01.010790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf697-7ef2-47aa-aeac-89820ac2fc24 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:01.017667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:01.019116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:01.019430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:01.019693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] PATH_INFO: `/v3/projects/2587862c34a945d193e58b50f42e5382/users/b5fab85a087548ac97f9e0225d0dd4cf/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:01.036949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2587862c34a945d193e58b50f42e5382, user_id=b5fab85a087548ac97f9e0225d0dd4cf, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:01.040483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:01.065535 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3648/7306] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:00 2022] PUT /identity/v3/projects/2587862c34a945d193e58b50f42e5382/users/b5fab85a087548ac97f9e0225d0dd4cf/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:01.065804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:01.078366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aa117-7282-4e51-a567-2169ba65385d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:01.201345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:01.201345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:01.205244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:01.205581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:01.206616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:01.208697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:01.221531 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3659/7307] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:10:01.225569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:01.250476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc10e9c-e41d-45c1-bd13-037ed7f7c624 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:01.261352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:01.262654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:01.264343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:01.265693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] PATH_INFO: `/v3/projects/2587862c34a945d193e58b50f42e5382/users/b5fab85a087548ac97f9e0225d0dd4cf/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:01.271659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2587862c34a945d193e58b50f42e5382, user_id=b5fab85a087548ac97f9e0225d0dd4cf, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:01.281905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:01.295786 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3649/7308] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:01 2022] PUT /identity/v3/projects/2587862c34a945d193e58b50f42e5382/users/b5fab85a087548ac97f9e0225d0dd4cf/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:05.474189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:05.476670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:05.589846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033990e9-f2f0-4ef8-88c8-ab85e8644d42 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:05.653859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e8330-4fd7-482d-8a14-43b8c8048e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:05.656386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8330-4fd7-482d-8a14-43b8c8048e74 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:05.657804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8330-4fd7-482d-8a14-43b8c8048e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:05.658492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e8330-4fd7-482d-8a14-43b8c8048e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:05.662696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-612e8330-4fd7-482d-8a14-43b8c8048e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:05.738244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e8330-4fd7-482d-8a14-43b8c8048e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:05.740537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e8330-4fd7-482d-8a14-43b8c8048e74 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:05.756222 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3660/7309] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:07.190387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:07.342380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c86f6-bd9d-4862-b0d4-73c5946cd634 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:07.349876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:07.353411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:07.353662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:07.354379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] PATH_INFO: `/v3/users/579aa8931a494de8bd0c337d020421d2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:07.356434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=579aa8931a494de8bd0c337d020421d2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:07.360931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:07.450708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579aa8931a494de8bd0c337d020421d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:07.468007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579aa8931a494de8bd0c337d020421d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:07.468780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579aa8931a494de8bd0c337d020421d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:07.470731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579aa8931a494de8bd0c337d020421d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:07.489596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579aa8931a494de8bd0c337d020421d2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:07.528530 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3650/7310] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:07 2022] DELETE /identity/v3/users/579aa8931a494de8bd0c337d020421d2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:07.532843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:07.533355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:07.533454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:07.596077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:07.600934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:07.748359 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3661/7311] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:07.767808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:07.768147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:07.942409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563990fb-1aa8-4e9f-a2bd-9c41b1558d2f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:07.947447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f760ede-d7df-4802-b6d8-593ba3116a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:07.948339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760ede-d7df-4802-b6d8-593ba3116a10 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:07.948797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760ede-d7df-4802-b6d8-593ba3116a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:07.949244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f760ede-d7df-4802-b6d8-593ba3116a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:07.959579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f760ede-d7df-4802-b6d8-593ba3116a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:07.961672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f760ede-d7df-4802-b6d8-593ba3116a10 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:07.977771 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3651/7312] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:09.646998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:09.649818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:09.686950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed5574-75d6-4269-bad0-91e55cd47f39 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:09.703958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:09.704862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:09.705148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:09.705421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] PATH_INFO: `/v3/projects/270c72ab746a472d9bc29941c34f86e5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:09.715194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270c72ab746a472d9bc29941c34f86e5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:09.722414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:09.850425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270c72ab746a472d9bc29941c34f86e5', 'request_id': 'req-654a6b4d-69da-4a49-8ce8-b6fc7b543992'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:09.866813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270c72ab746a472d9bc29941c34f86e5', 'request_id': 'req-654a6b4d-69da-4a49-8ce8-b6fc7b543992'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:09.886038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270c72ab746a472d9bc29941c34f86e5', 'request_id': 'req-654a6b4d-69da-4a49-8ce8-b6fc7b543992'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:09.909861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] The token cache is being invalidate because project 270c72ab746a472d9bc29941c34f86e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:09.910136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:09.912764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-654a6b4d-69da-4a49-8ce8-b6fc7b543992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:09.917401 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3662/7313] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:09 2022] DELETE /identity/v3/projects/270c72ab746a472d9bc29941c34f86e5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:09.921447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d9e10-2cee-4e9d-b771-dc40b8f85350 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:09.921967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d9e10-2cee-4e9d-b771-dc40b8f85350 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:09.922084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d9e10-2cee-4e9d-b771-dc40b8f85350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:09.958038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a26d9e10-2cee-4e9d-b771-dc40b8f85350 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:09.959700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a26d9e10-2cee-4e9d-b771-dc40b8f85350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:10.048587 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3652/7314] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:10.057071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912931eb-1df5-492f-b498-d04ab30198ab None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.057316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912931eb-1df5-492f-b498-d04ab30198ab None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.057595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912931eb-1df5-492f-b498-d04ab30198ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.111210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-912931eb-1df5-492f-b498-d04ab30198ab None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:10.113935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-912931eb-1df5-492f-b498-d04ab30198ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:10.145935 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3663/7315] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:10.150709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d9e10-2cee-4e9d-b771-dc40b8f85350 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.171735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d9e10-2cee-4e9d-b771-dc40b8f85350 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:10.185165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:10.186668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.189039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.189542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.191155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:10:10.194192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:10.198160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:10.226921 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3653/7316] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:10:10.230898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912931eb-1df5-492f-b498-d04ab30198ab None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.244355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912931eb-1df5-492f-b498-d04ab30198ab None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:10.263812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:10.264715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.265174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.265622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.266702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:10.268581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:10.323189 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3664/7317] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:10 2022] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:10.327522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.342947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b2b0d-4ab3-4250-bf7e-1333d9f73481 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:10.358650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.361141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:10.511209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:10.513100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.513391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.514932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.515665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:10.522976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:10.530893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f942eb-7f4a-48f7-8e68-aec3e26e2fec admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:10.542053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:10.543324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.543818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.544275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] PATH_INFO: `/v3/users/fb984ae414d448e28ff76f76b6e14187` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.546303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb984ae414d448e28ff76f76b6e14187)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:10.549784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:10.572831 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3654/7318] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:10:10 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:10.577235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.633665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321081c3-155e-4e3a-9765-06e5f0500984 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:10.645183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:10.645972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.646267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.646545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.649545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:10.652610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:10.681209 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3655/7319] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:10.684154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.713747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297c23-7876-40ef-a5bd-9e2da583845b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:10.719969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb984ae414d448e28ff76f76b6e14187'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:10.723734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:10.724588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.724867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.725220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.725341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb984ae414d448e28ff76f76b6e14187'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:10.726197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:10.733242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:10.740323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb984ae414d448e28ff76f76b6e14187'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:10.745961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb984ae414d448e28ff76f76b6e14187'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:10.747433 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3656/7320] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:10.753019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.756504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:10.759637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e1af0e54-8385-44fb-be54-2a0c31090722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb984ae414d448e28ff76f76b6e14187'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:10.775863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6c0de-833a-4493-ba97-92ba390b8c02 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:10.784020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9bf2-cbdd-4f6d-906a-e4cb49914d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:10.785119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9bf2-cbdd-4f6d-906a-e4cb49914d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.785575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9bf2-cbdd-4f6d-906a-e4cb49914d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.785853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9bf2-cbdd-4f6d-906a-e4cb49914d60 admin admin] PATH_INFO: `/v3/projects/11a7b67ca3b142f09ff7699978984298/users/8b7de7ee67b04fa085d425d16299bef5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.791075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3665/7321] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:10 2022] DELETE /identity/v3/users/fb984ae414d448e28ff76f76b6e14187 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:10.795045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.795326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.795602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.815417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9bf2-cbdd-4f6d-906a-e4cb49914d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a7b67ca3b142f09ff7699978984298, user_id=8b7de7ee67b04fa085d425d16299bef5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:10.818523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:10.819565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9bf2-cbdd-4f6d-906a-e4cb49914d60 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:10.819931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:10.853029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3657/7322] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:10 2022] PUT /identity/v3/projects/11a7b67ca3b142f09ff7699978984298/users/8b7de7ee67b04fa085d425d16299bef5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:10:10.854740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:10.854972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:10.855256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:10.895970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] MFA Rules not processed for user `8b7de7ee67b04fa085d425d16299bef5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:10.897406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:10.945906 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3666/7323] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:10.956166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:10.958213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:11.013987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3658/7324] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:11.029204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:11.031606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:11.110987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029bb5a-302a-4211-8afc-9f6d6d8345ec None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:11.114477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1664682-228b-4a7e-be7b-9069e5d93135 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:11.115452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:11.116082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:11.116375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:11.116636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:11.134525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:11.136663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:11.152582 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3659/7325] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:11.221826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fae68e-ddb1-4a7c-9926-f2dc3eb9dd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:11.222544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fae68e-ddb1-4a7c-9926-f2dc3eb9dd18 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:11.222934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fae68e-ddb1-4a7c-9926-f2dc3eb9dd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:11.223216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fae68e-ddb1-4a7c-9926-f2dc3eb9dd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:11.303099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fae68e-ddb1-4a7c-9926-f2dc3eb9dd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:11.304885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fae68e-ddb1-4a7c-9926-f2dc3eb9dd18 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:11.319366 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3667/7326] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:11.857673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:11.869020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:11.918377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2d6e5-fcc5-424c-b072-5f2f82fbcbbe service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:11.931587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:11.933014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:11.933831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:11.935658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] PATH_INFO: `/v3/projects/f34f4ab05680424998462e594d5ca043` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:11.938322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34f4ab05680424998462e594d5ca043)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:11.944373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:12.048387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34f4ab05680424998462e594d5ca043', 'request_id': 'req-d39c9bac-a323-4078-999f-38db75921bc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:12.066560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34f4ab05680424998462e594d5ca043', 'request_id': 'req-d39c9bac-a323-4078-999f-38db75921bc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:12.087667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34f4ab05680424998462e594d5ca043', 'request_id': 'req-d39c9bac-a323-4078-999f-38db75921bc9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:12.121976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] The token cache is being invalidate because project f34f4ab05680424998462e594d5ca043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:12.123515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:12.125165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d39c9bac-a323-4078-999f-38db75921bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:12.129475 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3660/7327] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:11 2022] DELETE /identity/v3/projects/f34f4ab05680424998462e594d5ca043 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:12.135995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d0ff-976e-4fb1-9137-26f02559ec34 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:12.136881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d0ff-976e-4fb1-9137-26f02559ec34 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:12.137456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501d0ff-976e-4fb1-9137-26f02559ec34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:12.178492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d501d0ff-976e-4fb1-9137-26f02559ec34 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:12.180579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d501d0ff-976e-4fb1-9137-26f02559ec34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:12.379625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3668/7328] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:12.387312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80613-5047-4be5-a0cf-5f873ea59892 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:12.391079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80613-5047-4be5-a0cf-5f873ea59892 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:12.392296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd80613-5047-4be5-a0cf-5f873ea59892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:12.456687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2cd80613-5047-4be5-a0cf-5f873ea59892 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:12.458933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2cd80613-5047-4be5-a0cf-5f873ea59892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:12.488899 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3661/7329] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:12.490619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d0ff-976e-4fb1-9137-26f02559ec34 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:12.511375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501d0ff-976e-4fb1-9137-26f02559ec34 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:12.529274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:12.530334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:12.530800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:12.531269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:12.532179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:10:12.532961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:12.535416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:12.580089 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3669/7330] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:10:12.582789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80613-5047-4be5-a0cf-5f873ea59892 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:12.596460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd80613-5047-4be5-a0cf-5f873ea59892 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:12.611642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:12.613128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:12.613659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:12.614321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:12.620939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:12.623839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:12.733770 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3662/7331] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:12 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:12.738498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:12.777976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3c4d-833e-4748-b453-2530cd330537 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:12.948321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:12.949139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:12.949432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:12.949713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:12.951426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:12.954081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:13.006308 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3670/7332] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:10:12 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:13.013654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:13.031484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e82816-d74a-4944-9daf-ddf3e51e3407 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:13.049591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:13.051810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:13.052480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:13.053469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:13.055580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:13.057658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:13.090680 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3663/7333] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:13.099360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:13.111612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc4b0-0cb7-43de-9213-fe42f7defe9a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:13.116676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc725ef-18f1-4ee6-87df-68d8460f854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:13.117483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc725ef-18f1-4ee6-87df-68d8460f854c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:13.118130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc725ef-18f1-4ee6-87df-68d8460f854c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:13.118130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc725ef-18f1-4ee6-87df-68d8460f854c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:13.118967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc725ef-18f1-4ee6-87df-68d8460f854c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:13.120769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc725ef-18f1-4ee6-87df-68d8460f854c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:13.136821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3671/7334] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:13.138697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:13.148238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dbfcd-cc47-4dae-8ef0-8c6ad6c702c8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:13.153742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:13.154644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:13.154987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:13.155452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] PATH_INFO: `/v3/projects/dceae7b468df4801a694bfb71acb44c0/users/1b12b33bd25e471c828d361093a8d735/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:13.172206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dceae7b468df4801a694bfb71acb44c0, user_id=1b12b33bd25e471c828d361093a8d735, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:13.175230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:13.192595 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3664/7335] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:13 2022] PUT /identity/v3/projects/dceae7b468df4801a694bfb71acb44c0/users/1b12b33bd25e471c828d361093a8d735/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:13.204817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3ea8-ec2b-4de9-93fc-f32f43b2d6ed None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:13.205346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3ea8-ec2b-4de9-93fc-f32f43b2d6ed None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:13.205632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb3ea8-ec2b-4de9-93fc-f32f43b2d6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:13.258258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-95fb3ea8-ec2b-4de9-93fc-f32f43b2d6ed None None] MFA Rules not processed for user `1b12b33bd25e471c828d361093a8d735`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:13.259875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-95fb3ea8-ec2b-4de9-93fc-f32f43b2d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:13.395795 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3672/7336] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:13.458284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:13.460296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:13.558046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ecb0a-163d-4163-98d7-0c54de6b7f06 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:13.569809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e8b74-ae51-4df6-8a16-ff8b917a29b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:13.571159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8b74-ae51-4df6-8a16-ff8b917a29b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:13.571448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8b74-ae51-4df6-8a16-ff8b917a29b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:13.571729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e8b74-ae51-4df6-8a16-ff8b917a29b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:13.591497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e8b74-ae51-4df6-8a16-ff8b917a29b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:13.592991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e8b74-ae51-4df6-8a16-ff8b917a29b3 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:13.609291 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3665/7337] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:14.380688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb3ea8-ec2b-4de9-93fc-f32f43b2d6ed None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:14.448027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb3ea8-ec2b-4de9-93fc-f32f43b2d6ed None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:14.454086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:14.455331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:14.455891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:14.456381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] PATH_INFO: `/v3/users/1b12b33bd25e471c828d361093a8d735` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:14.457832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b12b33bd25e471c828d361093a8d735)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:14.460055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:14.579215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b12b33bd25e471c828d361093a8d735'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:14.580564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b12b33bd25e471c828d361093a8d735'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:14.605507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b12b33bd25e471c828d361093a8d735'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:14.607856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b12b33bd25e471c828d361093a8d735'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:14.622171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b12b33bd25e471c828d361093a8d735'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:14.662886 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3673/7338] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:14 2022] DELETE /identity/v3/users/1b12b33bd25e471c828d361093a8d735 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:14.664999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff2a46-0386-45e3-b100-81831745e8d2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:14.665517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff2a46-0386-45e3-b100-81831745e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:14.665609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff2a46-0386-45e3-b100-81831745e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:14.701756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-28ff2a46-0386-45e3-b100-81831745e8d2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:14.703021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28ff2a46-0386-45e3-b100-81831745e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:14.818582 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3666/7339] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:14.829627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:14.840182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:14.932863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a181e9-1c33-4c5c-b8a6-e2e2fe998f1f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:14.937461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:14.938253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:14.938648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:14.939041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:14.950595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:14.952192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:14.965225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3674/7340] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:16.222509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1370e5-11f6-4f4d-92f8-e74ac491266e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:16.223074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1370e5-11f6-4f4d-92f8-e74ac491266e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:16.223900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1370e5-11f6-4f4d-92f8-e74ac491266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:16.272622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ca1370e5-11f6-4f4d-92f8-e74ac491266e None None] MFA Rules not processed for user `d090d094c44c44519dcd3e98de4fc2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:16.274504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ca1370e5-11f6-4f4d-92f8-e74ac491266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:16.421464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:16.422938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:16.438193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3667/7341] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:16.474890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede80c67-2558-49b0-aeac-c5c9e5a8df3c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:16.505475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:16.506567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:16.507040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:16.507509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] PATH_INFO: `/v3/projects/dceae7b468df4801a694bfb71acb44c0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:16.538236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dceae7b468df4801a694bfb71acb44c0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:16.542385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:16.634173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dceae7b468df4801a694bfb71acb44c0', 'request_id': 'req-ada015ad-5c4b-4919-910a-6f2a18703b43'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:16.642624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dceae7b468df4801a694bfb71acb44c0', 'request_id': 'req-ada015ad-5c4b-4919-910a-6f2a18703b43'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:16.677041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dceae7b468df4801a694bfb71acb44c0', 'request_id': 'req-ada015ad-5c4b-4919-910a-6f2a18703b43'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:16.697927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] The token cache is being invalidate because project dceae7b468df4801a694bfb71acb44c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:16.698592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:16.699534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ada015ad-5c4b-4919-910a-6f2a18703b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:16.701827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3675/7342] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:16 2022] DELETE /identity/v3/projects/dceae7b468df4801a694bfb71acb44c0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:10:16.707546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77c899-9534-4bc8-89ea-bc678165e2e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:16.708079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77c899-9534-4bc8-89ea-bc678165e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:16.708623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77c899-9534-4bc8-89ea-bc678165e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:16.744351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9f77c899-9534-4bc8-89ea-bc678165e2e6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:16.745671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9f77c899-9534-4bc8-89ea-bc678165e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:16.885051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3668/7343] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:10:16.895872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e0945-e7ff-442c-8f5c-46504abb5c54 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:16.895872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e0945-e7ff-442c-8f5c-46504abb5c54 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:16.895872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e0945-e7ff-442c-8f5c-46504abb5c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:16.936968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7b1e0945-e7ff-442c-8f5c-46504abb5c54 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:16.955624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b1e0945-e7ff-442c-8f5c-46504abb5c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:16.979517 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3676/7344] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:16.983271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77c899-9534-4bc8-89ea-bc678165e2e6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:16.997403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77c899-9534-4bc8-89ea-bc678165e2e6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:17.009156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:17.009860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:17.010147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:17.010427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:17.011186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:10:17.011493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:17.017665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:17.054384 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3669/7345] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:10:17.058494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e0945-e7ff-442c-8f5c-46504abb5c54 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:17.075395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e0945-e7ff-442c-8f5c-46504abb5c54 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:17.091263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:17.091939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:17.098191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:17.098544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:17.099396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:17.106266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:17.180428 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3677/7346] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:17 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:17.181648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:17.198220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f6862-7f24-4a5d-bf2c-20e67caa1bca admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:17.356599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:17.357286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:17.357735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:17.358253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:17.359170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:17.363374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:17.437776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:17.456312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e951d-7f6b-497f-88be-158f79948314 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:17.462357 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3670/7347] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:10:17 2022] POST /identity/v3/users => generated 282 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:17.475624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:17.476610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:17.477146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:17.477521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:17.478347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:17.480791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:17.526654 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3678/7348] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:17.532103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:17.554634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57ec9-ebb4-4c62-a88a-6318b944172d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:17.583641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99957910-22eb-44c7-b7c2-a2711d592cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:17.587737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99957910-22eb-44c7-b7c2-a2711d592cea admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:17.588095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99957910-22eb-44c7-b7c2-a2711d592cea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:17.588380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99957910-22eb-44c7-b7c2-a2711d592cea admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:17.591593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99957910-22eb-44c7-b7c2-a2711d592cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:17.596521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99957910-22eb-44c7-b7c2-a2711d592cea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:17.639907 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3671/7349] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:17.641207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:17.659007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f80a-d420-4827-ae24-55ea653dd963 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:17.692798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:17.696864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:17.697355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:17.697822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] PATH_INFO: `/v3/projects/9c3329647b05487f9d63d3c4ec2183b9/users/d6ecbf5ed6eb4468a5ebb87697f52b3c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:17.739757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3329647b05487f9d63d3c4ec2183b9, user_id=d6ecbf5ed6eb4468a5ebb87697f52b3c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:17.742921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:17.784416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3679/7350] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:17 2022] PUT /identity/v3/projects/9c3329647b05487f9d63d3c4ec2183b9/users/d6ecbf5ed6eb4468a5ebb87697f52b3c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:17.802677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d3f3b-de78-4d4f-95a8-16a73be0509f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:17.803386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d3f3b-de78-4d4f-95a8-16a73be0509f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:17.804231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d3f3b-de78-4d4f-95a8-16a73be0509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:17.889412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ea7d3f3b-de78-4d4f-95a8-16a73be0509f None None] MFA Rules not processed for user `d6ecbf5ed6eb4468a5ebb87697f52b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:17.892651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ea7d3f3b-de78-4d4f-95a8-16a73be0509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:18.095676 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3672/7351] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:18.374215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:18.377415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:18.574014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effecec-25e0-409f-b866-40195349b2cc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:18.579534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:18.580740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:18.581344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:18.581863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:18.598030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:18.604448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:18.626487 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3680/7352] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:19.003204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:19.003804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:19.003804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:19.077767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] MFA Rules not processed for user `b5fab85a087548ac97f9e0225d0dd4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:19.079251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:19.243785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:19.248478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:19.340866 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3673/7353] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:19.354824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:19.357044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:19.471436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a602f-e5a1-4cf5-b873-ca99cd3b0353 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:19.477616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:19.480652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:19.481380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:19.481905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] PATH_INFO: `/v3/users/8b7de7ee67b04fa085d425d16299bef5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:19.483790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7de7ee67b04fa085d425d16299bef5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:19.495716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:19.597561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7de7ee67b04fa085d425d16299bef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:19.598595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7de7ee67b04fa085d425d16299bef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:19.599263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375b4e9-f3e9-41ab-9560-65ff9ee161c8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:19.615863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708afa2-2093-4132-a325-486654404b0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:19.619504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708afa2-2093-4132-a325-486654404b0b service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:19.622329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708afa2-2093-4132-a325-486654404b0b service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:19.622329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708afa2-2093-4132-a325-486654404b0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:19.637166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5708afa2-2093-4132-a325-486654404b0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:19.647053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7de7ee67b04fa085d425d16299bef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:19.648127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7de7ee67b04fa085d425d16299bef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:19.662342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2615d182-62e1-4fc3-bf13-e9701e37d5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7de7ee67b04fa085d425d16299bef5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:19.732789 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3681/7354] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:19 2022] DELETE /identity/v3/users/8b7de7ee67b04fa085d425d16299bef5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:10:19.734533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:19.734964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:19.735341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:19.812013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:19.820210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:19.840157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708afa2-2093-4132-a325-486654404b0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:19.842167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708afa2-2093-4132-a325-486654404b0b service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:19.870223 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3674/7355] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:20.005551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3682/7356] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:20.054640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708afa2-2093-4132-a325-486654404b0b service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:20.056445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5708afa2-2093-4132-a325-486654404b0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:20.077525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708afa2-2093-4132-a325-486654404b0b service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:20.179547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:20.180490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:20.180932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:20.181408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:20.201305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:20.206424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:20.229286 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3675/7357] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:10:22.080479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:22.084981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:22.128458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f908d83-b0e3-49fe-9f19-1ee8f861c865 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:22.152936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:22.156536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:22.157518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:22.158750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] PATH_INFO: `/v3/projects/11a7b67ca3b142f09ff7699978984298` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:22.162522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a7b67ca3b142f09ff7699978984298)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:22.167907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:22.341382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a7b67ca3b142f09ff7699978984298', 'request_id': 'req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:22.369336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a7b67ca3b142f09ff7699978984298', 'request_id': 'req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:22.388910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a7b67ca3b142f09ff7699978984298', 'request_id': 'req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:22.413421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] The token cache is being invalidate because project 11a7b67ca3b142f09ff7699978984298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:22.413754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:22.415709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3fe89db4-e68a-4265-8758-4b9eeb0b3fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:22.417699 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3683/7358] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:22 2022] DELETE /identity/v3/projects/11a7b67ca3b142f09ff7699978984298 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:34.252266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:34.253760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:34.289603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca77c7-687e-47d9-aef6-8fec9c861b7b service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:34.387191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:34.388405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:34.388938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:34.389433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] PATH_INFO: `/v3/users/ada8024621604c898c95d6f054673eaa` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:34.391202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada8024621604c898c95d6f054673eaa)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:34.397086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:34.531044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada8024621604c898c95d6f054673eaa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:34.550595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada8024621604c898c95d6f054673eaa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:34.553529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada8024621604c898c95d6f054673eaa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:34.555072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada8024621604c898c95d6f054673eaa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:34.581938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada8024621604c898c95d6f054673eaa'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:34.621525 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3676/7359] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:34 2022] DELETE /identity/v3/users/ada8024621604c898c95d6f054673eaa => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:34.626239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:34.626852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:34.627108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:34.667164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:34.668533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:34.755593 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3684/7360] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:34.813872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:34.815736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:34.914219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4db290-c0f0-491b-9e7d-58728bd2cf10 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:34.926090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:34.926823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:34.927116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:34.927597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:34.940046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:34.941695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:34.964716 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3677/7361] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:35.429100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:35.431245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:35.456494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aabb40-b14f-465f-aef4-be0b6bfb0dc1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:35.468090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:35.470890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:35.485282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:35.485986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] PATH_INFO: `/v3/projects/d98edd5a449c4a118b006639f772fe62` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:35.489648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98edd5a449c4a118b006639f772fe62)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:35.495228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:35.589413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98edd5a449c4a118b006639f772fe62', 'request_id': 'req-59f3782f-5951-4718-a43f-dcfcf297d7a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.600630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98edd5a449c4a118b006639f772fe62', 'request_id': 'req-59f3782f-5951-4718-a43f-dcfcf297d7a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.618011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98edd5a449c4a118b006639f772fe62', 'request_id': 'req-59f3782f-5951-4718-a43f-dcfcf297d7a5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.640328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] The token cache is being invalidate because project d98edd5a449c4a118b006639f772fe62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:35.641372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.643820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.652153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:35.660686 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3685/7362] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:35 2022] DELETE /identity/v3/projects/d98edd5a449c4a118b006639f772fe62 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:35.665843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1859b-b006-48d6-9d83-24fb0738f695 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:35.739710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:35.740836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:35.741308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:35.741599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] PATH_INFO: `/v3/users/06d6f43afcfb4341bd6c4e8477b41ccd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:35.744260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d6f43afcfb4341bd6c4e8477b41ccd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:35.747226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:35.825291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d6f43afcfb4341bd6c4e8477b41ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.833297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d6f43afcfb4341bd6c4e8477b41ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.838413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d6f43afcfb4341bd6c4e8477b41ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.842158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d6f43afcfb4341bd6c4e8477b41ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.857047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-14d7bfb8-5594-48bf-a7a2-4e017f860329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d6f43afcfb4341bd6c4e8477b41ccd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:35.881211 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3678/7363] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:35 2022] DELETE /identity/v3/users/06d6f43afcfb4341bd6c4e8477b41ccd => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:36.048669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:36.050476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:36.074632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3782f-5951-4718-a43f-dcfcf297d7a5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:36.218710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:36.219759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:36.220151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:36.220511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] PATH_INFO: `/v3/users/a512b2753f924a1fb873e97cd3cd322c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:36.221834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a512b2753f924a1fb873e97cd3cd322c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:36.224002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:36.307885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a512b2753f924a1fb873e97cd3cd322c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.309756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a512b2753f924a1fb873e97cd3cd322c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.327547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a512b2753f924a1fb873e97cd3cd322c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.330080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a512b2753f924a1fb873e97cd3cd322c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.344322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a512b2753f924a1fb873e97cd3cd322c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.381528 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3686/7364] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:36 2022] DELETE /identity/v3/users/a512b2753f924a1fb873e97cd3cd322c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:36.386401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:36.386690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:36.387020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:36.432132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:36.433306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:36.570903 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3679/7365] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:36.589672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:36.592047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:36.657809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:36.666144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:36.723456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8991ed6-3f6f-448a-85bb-81aa32863df5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:36.731366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:36.732756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:36.733292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:36.733821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] PATH_INFO: `/v3/projects/1444cff1a7834e07850e6ec6f4df8424` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:36.736262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1444cff1a7834e07850e6ec6f4df8424)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:36.739375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:36.746872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6bbc-ceeb-40f7-a494-1355877bf7ed admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:36.756585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:36.758601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:36.758913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:36.759197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:36.770492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:36.772182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:36.786161 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3687/7366] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:36.826565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1444cff1a7834e07850e6ec6f4df8424', 'request_id': 'req-e847c6a8-8e82-4024-8cc5-91170b3626f6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.837066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1444cff1a7834e07850e6ec6f4df8424', 'request_id': 'req-e847c6a8-8e82-4024-8cc5-91170b3626f6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.851365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1444cff1a7834e07850e6ec6f4df8424', 'request_id': 'req-e847c6a8-8e82-4024-8cc5-91170b3626f6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.871615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] The token cache is being invalidate because project 1444cff1a7834e07850e6ec6f4df8424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:36.872395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.873346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:36.880973 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3680/7367] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:36 2022] DELETE /identity/v3/projects/1444cff1a7834e07850e6ec6f4df8424 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:36.882805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:36.912362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab700db-d912-49f7-bc3c-37bccf2ae489 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:37.047800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:37.050963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:37.051554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:37.052081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] PATH_INFO: `/v3/users/f6e61ffdd0184223a5b16e2724be2bfa` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:37.056363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e61ffdd0184223a5b16e2724be2bfa)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:37.059881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:37.160834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e61ffdd0184223a5b16e2724be2bfa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:37.162249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e61ffdd0184223a5b16e2724be2bfa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:37.183460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e61ffdd0184223a5b16e2724be2bfa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:37.197647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e61ffdd0184223a5b16e2724be2bfa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:37.215258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1cff540f-b5fb-483f-ab60-c47f0e11a981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e61ffdd0184223a5b16e2724be2bfa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:37.268528 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3688/7368] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:10:36 2022] DELETE /identity/v3/users/f6e61ffdd0184223a5b16e2724be2bfa => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:37.832899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:37.834363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:37.899376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847c6a8-8e82-4024-8cc5-91170b3626f6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:38.105641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:38.106862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:38.107259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:38.107660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] PATH_INFO: `/v3/projects/fb0d2331b1674fe797c71f474a68e096` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:38.109475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0d2331b1674fe797c71f474a68e096)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:38.112415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:38.203906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0d2331b1674fe797c71f474a68e096', 'request_id': 'req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:38.228517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0d2331b1674fe797c71f474a68e096', 'request_id': 'req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:38.273541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0d2331b1674fe797c71f474a68e096', 'request_id': 'req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:38.304919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] The token cache is being invalidate because project fb0d2331b1674fe797c71f474a68e096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:38.305247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:38.306278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0d24b16b-3b96-4e9a-8bd7-1bf35e6d45d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:38.308866 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3681/7369] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:37 2022] DELETE /identity/v3/projects/fb0d2331b1674fe797c71f474a68e096 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:38.313942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f9b16-cd75-48c5-adcf-cc8f4ab3c277 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:38.314902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f9b16-cd75-48c5-adcf-cc8f4ab3c277 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:38.315484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f9b16-cd75-48c5-adcf-cc8f4ab3c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:38.345081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-416f9b16-cd75-48c5-adcf-cc8f4ab3c277 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:38.347454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-416f9b16-cd75-48c5-adcf-cc8f4ab3c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:38.489066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3689/7370] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:38.500494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415a3e-f996-452b-89e8-381b4b9628b0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:38.502138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415a3e-f996-452b-89e8-381b4b9628b0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:38.503009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415a3e-f996-452b-89e8-381b4b9628b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:38.541954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c2415a3e-f996-452b-89e8-381b4b9628b0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:38.543969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c2415a3e-f996-452b-89e8-381b4b9628b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:38.570605 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3682/7371] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:38.573570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f9b16-cd75-48c5-adcf-cc8f4ab3c277 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:38.594026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f9b16-cd75-48c5-adcf-cc8f4ab3c277 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:38.617071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:38.618455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:38.618455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:38.619029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:38.622964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:10:38.623291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:38.630539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:38.679548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3690/7372] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:10:38.680915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415a3e-f996-452b-89e8-381b4b9628b0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:38.702519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415a3e-f996-452b-89e8-381b4b9628b0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:38.716583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:38.717239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:38.717521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:38.717797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:38.718498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:38.723231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:38.859738 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3683/7373] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:38 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:38.864725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:38.880687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c83d6-bdcd-4a7d-b5b7-197a9ce35d96 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:38.885008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:38.887529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:39.085593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de33a70-84b5-4ae0-824f-78a0493396c2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:39.096742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:39.104154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.104795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.105299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] PATH_INFO: `/v3/projects/8e9b35ab64504a0a92a6efafc110149a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.109624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e9b35ab64504a0a92a6efafc110149a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:39.112376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:39.172536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:39.174358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.174729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.175151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.186638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:39.189066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:39.255183 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3691/7374] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:10:38 2022] POST /identity/v3/users => generated 283 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:39.256122 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e9b35ab64504a0a92a6efafc110149a', 'request_id': 'req-b7b686c1-b326-49cd-8d48-933c7d5083d5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:39.258443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:39.274200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e9b35ab64504a0a92a6efafc110149a', 'request_id': 'req-b7b686c1-b326-49cd-8d48-933c7d5083d5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:39.286136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb4d53-d577-4a4f-a658-10b5bdf752f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:39.299871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e9b35ab64504a0a92a6efafc110149a', 'request_id': 'req-b7b686c1-b326-49cd-8d48-933c7d5083d5'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:39.336335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] The token cache is being invalidate because project 8e9b35ab64504a0a92a6efafc110149a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:39.348923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:39.353098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b7b686c1-b326-49cd-8d48-933c7d5083d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:39.357735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3684/7375] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:38 2022] DELETE /identity/v3/projects/8e9b35ab64504a0a92a6efafc110149a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:39.365777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968465c4-02d4-4f60-a641-9bc7776c30dc None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.367107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968465c4-02d4-4f60-a641-9bc7776c30dc None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.367615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968465c4-02d4-4f60-a641-9bc7776c30dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.425888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-968465c4-02d4-4f60-a641-9bc7776c30dc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:39.440989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-968465c4-02d4-4f60-a641-9bc7776c30dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:39.478874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:39.479591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.479889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.480399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.481013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:39.486159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:39.516684 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3692/7376] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:39.523232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:39.529635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:39.563110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b602e3-5179-4e82-a9dc-a3dce27f18eb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:39.580526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:39.581668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.582137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.582590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.584441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:39.590220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:39.595504 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3685/7377] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:10:39.618228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8ad01-2f77-49eb-b722-cf9e1d5ac7a6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.620106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8ad01-2f77-49eb-b722-cf9e1d5ac7a6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.620435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8ad01-2f77-49eb-b722-cf9e1d5ac7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.651349 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3693/7378] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:39.655209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:39.670361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5503f8-d716-4e11-acac-ae39b9e7591f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:39.677843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ca4c-f28b-4b61-ad4b-5042292e6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:39.679631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ca4c-f28b-4b61-ad4b-5042292e6f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.681550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ca4c-f28b-4b61-ad4b-5042292e6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.682078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ca4c-f28b-4b61-ad4b-5042292e6f81 admin admin] PATH_INFO: `/v3/projects/b29256ef64d74a5297507ca500a9468e/users/1e6cebb5024540799cabee75ff002d69/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.712353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9fb8ad01-2f77-49eb-b722-cf9e1d5ac7a6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:39.712901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ca4c-f28b-4b61-ad4b-5042292e6f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29256ef64d74a5297507ca500a9468e, user_id=1e6cebb5024540799cabee75ff002d69, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:39.713805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9fb8ad01-2f77-49eb-b722-cf9e1d5ac7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:39.721587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ca4c-f28b-4b61-ad4b-5042292e6f81 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:39.754837 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3686/7379] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:39.760411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8ad01-2f77-49eb-b722-cf9e1d5ac7a6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:39.777522 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3694/7380] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:39 2022] PUT /identity/v3/projects/b29256ef64d74a5297507ca500a9468e/users/1e6cebb5024540799cabee75ff002d69/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:39.784843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:39.785538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:39.787275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:39.806706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8ad01-2f77-49eb-b722-cf9e1d5ac7a6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:39.865405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:39.880886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:40.033266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:40.033266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:40.033266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:40.033266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:40.034184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:10:40.034184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:40.037448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:40.155798 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3687/7381] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:10:40.173458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:40.239307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d4ace-abab-4575-9989-4f8c1a073286 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:40.258632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:40.260029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:40.260579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:40.261116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:40.262084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:40.268092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:40.307598 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3695/7382] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 525 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:40.341996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:40.343735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3688/7383] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:40 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:40.344536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:40.350248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:40.527140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406aa1e-cf71-4ec7-a3e5-649788293dc9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:40.536729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309b78-d722-4443-a54f-cf5f4c3225b8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:40.546426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:40.548153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:40.549765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:40.550499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:40.551613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:40.559628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:40.633184 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3689/7384] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:10:40 2022] POST /identity/v3/users => generated 284 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:40.637054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:40.668060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b1d2a-fa05-43d6-b9b0-38b846a6f0ad admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:40.682157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:40.682919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:40.683205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:40.683481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:40.684323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:40.691975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:40.734326 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3690/7385] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:40.738150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:40.753706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58d640-2aa8-4634-a17f-5059c8f935f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:40.757360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58d640-2aa8-4634-a17f-5059c8f935f1 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:40.758497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58d640-2aa8-4634-a17f-5059c8f935f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:40.758853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58d640-2aa8-4634-a17f-5059c8f935f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:40.773835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce70746-eba5-4dba-8984-1f73d38d1fa4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:40.796025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:40.796025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:40.796025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:40.796025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:40.796538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:40.796636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58d640-2aa8-4634-a17f-5059c8f935f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:40.796785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:40.797747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58d640-2aa8-4634-a17f-5059c8f935f1 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:40.818990 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3691/7386] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:40.824088 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3696/7387] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:40.824916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:40.858589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e66a-bace-498f-92d5-c8bfe157e938 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:40.894836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:40.901056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:40.901342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:40.903468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] PATH_INFO: `/v3/projects/8af77af9b4794e338a417c09016e0fa3/users/00c61a4e6b80412ea9c775b59e5b106a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:40.944970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af77af9b4794e338a417c09016e0fa3, user_id=00c61a4e6b80412ea9c775b59e5b106a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:40.947999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:40.985975 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3692/7388] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:40 2022] PUT /identity/v3/projects/8af77af9b4794e338a417c09016e0fa3/users/00c61a4e6b80412ea9c775b59e5b106a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:41.000114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ff37-274b-4945-9207-029d022d5b41 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:41.000615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ff37-274b-4945-9207-029d022d5b41 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:41.001589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2ff37-274b-4945-9207-029d022d5b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:41.056121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d4c2ff37-274b-4945-9207-029d022d5b41 None None] MFA Rules not processed for user `00c61a4e6b80412ea9c775b59e5b106a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:41.057494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d4c2ff37-274b-4945-9207-029d022d5b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:41.300640 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3697/7389] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:41.305331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:41.468906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc798a-67af-4364-9334-f004a2aa2c25 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:41.482375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:41.484391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:41.484699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:41.484984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:41.498828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:41.500988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:41.564842 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3693/7390] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:41 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:10:41.569247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2ff37-274b-4945-9207-029d022d5b41 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:41.589126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2ff37-274b-4945-9207-029d022d5b41 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:41.757423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:41.758752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:41.758752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:41.758752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:41.759945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:41.766530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:41.829239 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3698/7391] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:10:41 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:10:41.833789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:41.875526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e3e1-a90f-41c3-a08e-a2ed1ebaf91c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:41.885143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:41.886441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:41.887200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:41.887657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:41.893546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:41.897138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:41.912096 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3694/7392] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:10:41.917426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:41.946266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f5960-f97c-4575-ba97-eb5b53973694 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:41.967664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:41.969049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:41.970373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:41.970915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] PATH_INFO: `/v3/projects/28a4884b91054cb58607f65ea001053c/users/b051dba6394d477ca5d93a210e964ed4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:41.995693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a4884b91054cb58607f65ea001053c, user_id=b051dba6394d477ca5d93a210e964ed4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:42.012781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:42.053003 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3699/7393] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:41 2022] PUT /identity/v3/projects/28a4884b91054cb58607f65ea001053c/users/b051dba6394d477ca5d93a210e964ed4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:42.053242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:42.068249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06578df-3600-4f45-ab36-164a8608bfc6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:42.267469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c9b6-b4f7-43c9-ba20-5a82ee17ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:42.275650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c9b6-b4f7-43c9-ba20-5a82ee17ea65 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:42.277053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c9b6-b4f7-43c9-ba20-5a82ee17ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:42.278102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c9b6-b4f7-43c9-ba20-5a82ee17ea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:42.279796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c9b6-b4f7-43c9-ba20-5a82ee17ea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:42.286189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c9b6-b4f7-43c9-ba20-5a82ee17ea65 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:42.342132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:42.343803 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3695/7394] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:10:42.379863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daae08d-79b1-4d6c-a6c0-67654879aaf3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:42.402175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71925a-23e0-4704-8ecd-e94ab6d5d199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:42.403280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71925a-23e0-4704-8ecd-e94ab6d5d199 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:42.403599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71925a-23e0-4704-8ecd-e94ab6d5d199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:42.403880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71925a-23e0-4704-8ecd-e94ab6d5d199 admin admin] PATH_INFO: `/v3/projects/28a4884b91054cb58607f65ea001053c/users/b051dba6394d477ca5d93a210e964ed4/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:42.410223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71925a-23e0-4704-8ecd-e94ab6d5d199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a4884b91054cb58607f65ea001053c, user_id=b051dba6394d477ca5d93a210e964ed4, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:42.413245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71925a-23e0-4704-8ecd-e94ab6d5d199 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:42.443578 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3700/7395] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:10:42 2022] PUT /identity/v3/projects/28a4884b91054cb58607f65ea001053c/users/b051dba6394d477ca5d93a210e964ed4/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:10:42.456557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:42.456871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:42.457376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:42.505847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] MFA Rules not processed for user `b051dba6394d477ca5d93a210e964ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:42.519407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:42.645645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f67a2-54f4-4e0a-a328-e56294b230f4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:42.646544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f67a2-54f4-4e0a-a328-e56294b230f4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:42.646544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f67a2-54f4-4e0a-a328-e56294b230f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:42.696896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e2f67a2-54f4-4e0a-a328-e56294b230f4 None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:42.698234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e2f67a2-54f4-4e0a-a328-e56294b230f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:42.738501 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3696/7396] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:42.740066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:42.741977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:42.882266 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3701/7397] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:42.899785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:42.901177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:42.901530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:42.905146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f91d70-9504-4e55-a35a-4a59a47cfd21 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:42.915268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:42.916310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:42.917132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:42.918028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:42.943870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:42.947565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:42.959582 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3697/7398] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:42.973083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:42.974381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:42.990917 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3702/7399] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:43.003358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:43.005086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:43.094891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f09c7-80b6-4170-85f1-a34ed735e6bf service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:43.102475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:43.103102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:43.103463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:43.103874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:43.116010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:43.118130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:43.129580 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3698/7400] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:10:48.762516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:48.764006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:48.788590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:48.806281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8b3e-e5b9-49be-8c7b-c9d5fe1952d6 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:48.813140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc17447-37b0-49d2-abf6-c8a29cbec6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:48.814176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17447-37b0-49d2-abf6-c8a29cbec6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:48.815463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17447-37b0-49d2-abf6-c8a29cbec6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:48.816061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc17447-37b0-49d2-abf6-c8a29cbec6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:48.818692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6fc17447-37b0-49d2-abf6-c8a29cbec6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:48.844995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc17447-37b0-49d2-abf6-c8a29cbec6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:48.847567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc17447-37b0-49d2-abf6-c8a29cbec6a9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:48.867675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e215-18e8-4852-bd69-ecf689c082e5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:48.872811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:48.873847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3699/7401] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:10:48.874581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:48.875078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:48.875606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:48.878000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:48.899408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:48.901141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:48.915678 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3703/7402] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:10:50.227448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c35a2-ad08-463b-81af-79944e15bd8e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:50.228861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c35a2-ad08-463b-81af-79944e15bd8e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:50.229311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c35a2-ad08-463b-81af-79944e15bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:50.295284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ff7c35a2-ad08-463b-81af-79944e15bd8e None None] MFA Rules not processed for user `4f4cbf51481d45de862752fe273dceda`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:10:50.297053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff7c35a2-ad08-463b-81af-79944e15bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:50.386699 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3700/7403] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:10:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:10:55.747919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:55.776351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270c6b4-44ad-4a68-8cb0-54cf5c7754cc service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:55.792327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b051dba6394d477ca5d93a210e964ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a4884b91054cb58607f65ea001053c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:55.796426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:55.796713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:55.799118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:55.802072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:10:55.805830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:55.810389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:55.838411 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3704/7404] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:10:55.841833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c35a2-ad08-463b-81af-79944e15bd8e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:55.874052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c35a2-ad08-463b-81af-79944e15bd8e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:55.887713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b051dba6394d477ca5d93a210e964ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a4884b91054cb58607f65ea001053c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:55.889459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:55.890160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:55.891470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:55.893301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:55.896581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:55.957796 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3701/7405] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:10:55 2022] POST /identity/v3/projects => generated 347 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:10:55.962434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:55.979997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62028-10bb-4734-b78c-6b412287a457 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:56.113434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b051dba6394d477ca5d93a210e964ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a4884b91054cb58607f65ea001053c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:56.114269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:56.114641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:56.115033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:56.116851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:10:56.117810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:56.126762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:56.158759 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3705/7406] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:10:57.579165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:57.600080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e472264-9f3a-4661-bd56-98850379255d tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:57.606191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b051dba6394d477ca5d93a210e964ed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28a4884b91054cb58607f65ea001053c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:57.607462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:57.608003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:57.608963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] PATH_INFO: `/v3/projects/951ede972cce4549a2eea478abecc3bb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:57.610559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorizing `identity:delete_project(project_id=951ede972cce4549a2eea478abecc3bb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:57.614033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:57.776082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951ede972cce4549a2eea478abecc3bb', 'request_id': 'req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:57.786454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951ede972cce4549a2eea478abecc3bb', 'request_id': 'req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:57.810166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951ede972cce4549a2eea478abecc3bb', 'request_id': 'req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:57.851764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] The token cache is being invalidate because project 951ede972cce4549a2eea478abecc3bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:10:57.852062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:57.852745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-51236ab1-9f10-4ec0-89ab-df5bfd50ab2c tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:10:57.862495 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3702/7407] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:10:57 2022] DELETE /identity/v3/projects/951ede972cce4549a2eea478abecc3bb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:10:57.891991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:10:57.893927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:58.029906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8f3d-2b35-48d7-83e1-4dbf5ae38de3 tempest-RoutersAdminTest-430062177 tempest-RoutersAdminTest-430062177-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:10:58.173882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:10:58.174610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:10:58.175152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:10:58.176318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:10:58.182707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:10:58.347104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:10:58.348724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:10:58.362752 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3706/7408] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:10:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:01.331679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c05ef-0918-411e-a002-86ccf2dbbf35 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:01.332648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c05ef-0918-411e-a002-86ccf2dbbf35 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:01.333124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c05ef-0918-411e-a002-86ccf2dbbf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:01.355476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a40c05ef-0918-411e-a002-86ccf2dbbf35 None None] MFA Rules not processed for user `97ef9a3039534d90ba9d268970cbe9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:01.367567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a40c05ef-0918-411e-a002-86ccf2dbbf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:01.511286 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3703/7409] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:02.810225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:02.814517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:02.832861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdd8a3-9719-4085-8450-140456be1026 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:02.851781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5bce4-5b4b-4427-b442-8b1e800f6e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:02.856681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5bce4-5b4b-4427-b442-8b1e800f6e17 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:02.857006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5bce4-5b4b-4427-b442-8b1e800f6e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:02.857315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5bce4-5b4b-4427-b442-8b1e800f6e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:02.860042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-28b5bce4-5b4b-4427-b442-8b1e800f6e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:02.887098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5bce4-5b4b-4427-b442-8b1e800f6e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:02.891804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5bce4-5b4b-4427-b442-8b1e800f6e17 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:02.921423 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3707/7410] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:03.687689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:03.688284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:03.688284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:03.784806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:03.788142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:03.947067 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3704/7411] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:06.330173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e615902-c15c-4257-90c6-7afc16a22101 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:06.331331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e615902-c15c-4257-90c6-7afc16a22101 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:06.331854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e615902-c15c-4257-90c6-7afc16a22101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:06.382808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5e615902-c15c-4257-90c6-7afc16a22101 None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:06.384064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5e615902-c15c-4257-90c6-7afc16a22101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:06.402696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3708/7412] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:06.604880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:06.606330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:06.732573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72c27a-de7f-4bb0-8bd3-3d721f2714b7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:06.739387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:06.741040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:06.741565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:06.742088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:06.744718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:06.762351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:06.764664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:06.800209 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3705/7413] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:14.701964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e615902-c15c-4257-90c6-7afc16a22101 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:14.735843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e615902-c15c-4257-90c6-7afc16a22101 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:14.748744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c7210-ae39-4dbd-8543-6c118b75a0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:14.750861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7210-ae39-4dbd-8543-6c118b75a0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:14.751348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7210-ae39-4dbd-8543-6c118b75a0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:14.752051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c7210-ae39-4dbd-8543-6c118b75a0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:14.756364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d52c7210-ae39-4dbd-8543-6c118b75a0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:14.948707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c7210-ae39-4dbd-8543-6c118b75a0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:14.951333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c7210-ae39-4dbd-8543-6c118b75a0c9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:14.978817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3709/7414] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:24.527620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:24.529058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:24.710081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48438d7d-0326-48b8-8a6e-6fb6451d9bf2 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:24.782500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:24.788490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:24.789710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:24.796952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] PATH_INFO: `/v3/users/d090d094c44c44519dcd3e98de4fc2ff` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:24.800417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d090d094c44c44519dcd3e98de4fc2ff)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:24.805453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:24.922572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd090d094c44c44519dcd3e98de4fc2ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:24.940244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd090d094c44c44519dcd3e98de4fc2ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:24.941151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd090d094c44c44519dcd3e98de4fc2ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:24.941763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd090d094c44c44519dcd3e98de4fc2ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:24.962676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd090d094c44c44519dcd3e98de4fc2ff'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:24.992873 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3706/7415] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:11:24 2022] DELETE /identity/v3/users/d090d094c44c44519dcd3e98de4fc2ff => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:24.998980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:24.999530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:24.999679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:25.038310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:25.041559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:25.182969 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3710/7416] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:25.201581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:25.203241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:25.310944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030fa286-2714-4c8f-8a0e-234097091882 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:25.317240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:25.319059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:25.319576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:25.320381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:25.336027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:25.337788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:25.354616 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3707/7417] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:26.504040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:26.506006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:26.521889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5fb0f-ad65-43e0-ab20-9254da13ac75 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:26.527988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:26.529290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:26.530000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:26.530522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] PATH_INFO: `/v3/projects/79ad2ea0f3a34003bb7a3f8ff81c58e4` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:26.532353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ad2ea0f3a34003bb7a3f8ff81c58e4)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:26.540400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:26.646738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'request_id': 'req-0e3bde63-68c1-4fc3-8971-ec20fda513af'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.655103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'request_id': 'req-0e3bde63-68c1-4fc3-8971-ec20fda513af'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.672863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ad2ea0f3a34003bb7a3f8ff81c58e4', 'request_id': 'req-0e3bde63-68c1-4fc3-8971-ec20fda513af'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.689959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] The token cache is being invalidate because project 79ad2ea0f3a34003bb7a3f8ff81c58e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:11:26.690542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.691534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.698659 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3711/7418] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:11:26 2022] DELETE /identity/v3/projects/79ad2ea0f3a34003bb7a3f8ff81c58e4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:26.698861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:26.713714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a61599-5499-466f-9f53-a98b756bd0b5 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:26.810329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:26.811911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:26.812380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:26.812869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] PATH_INFO: `/v3/users/a4ef40bb07e64742aac0f8ac6853cfae` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:26.814540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ef40bb07e64742aac0f8ac6853cfae)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:26.817600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:26.898499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ef40bb07e64742aac0f8ac6853cfae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.910400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ef40bb07e64742aac0f8ac6853cfae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.911435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ef40bb07e64742aac0f8ac6853cfae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.913030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ef40bb07e64742aac0f8ac6853cfae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.926806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ef40bb07e64742aac0f8ac6853cfae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:26.959210 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3708/7419] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:11:26 2022] DELETE /identity/v3/users/a4ef40bb07e64742aac0f8ac6853cfae => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:28.444678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:28.446743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:28.464090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bde63-68c1-4fc3-8971-ec20fda513af admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:28.560351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:28.561218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:28.561578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:28.561924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] PATH_INFO: `/v3/projects/807e75468778486fb455f697709a140d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:28.563320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=807e75468778486fb455f697709a140d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:28.565830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:28.644106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807e75468778486fb455f697709a140d', 'request_id': 'req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.667524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807e75468778486fb455f697709a140d', 'request_id': 'req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.689172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807e75468778486fb455f697709a140d', 'request_id': 'req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.718056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] The token cache is being invalidate because project 807e75468778486fb455f697709a140d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:11:28.719351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.721776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.724175 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3712/7420] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:11:28 2022] DELETE /identity/v3/projects/807e75468778486fb455f697709a140d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:28.729655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:28.732623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:28.758972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8410dd4-b929-4ef4-b3e1-e571f6740aae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:28.863291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:28.866581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:28.867990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:28.868478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] PATH_INFO: `/v3/users/feeae322890a4d239a4c6203e8619291` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:28.871278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feeae322890a4d239a4c6203e8619291)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:28.873652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:28.981455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feeae322890a4d239a4c6203e8619291'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.993188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feeae322890a4d239a4c6203e8619291'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.994491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feeae322890a4d239a4c6203e8619291'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:28.995961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feeae322890a4d239a4c6203e8619291'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:29.008663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2fab30bf-98c9-447b-946e-dfd1deb75b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feeae322890a4d239a4c6203e8619291'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:29.041552 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3709/7421] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:11:28 2022] DELETE /identity/v3/users/feeae322890a4d239a4c6203e8619291 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:11:30.383631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:30.385345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:30.410582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6eed7-9d01-4b46-8ae7-1d757fbeb90e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:30.549079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:30.550422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:30.551010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:30.551572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] PATH_INFO: `/v3/projects/f31461527eb340c5b647c2d415581b6c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:30.555711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31461527eb340c5b647c2d415581b6c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:30.561357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:30.671315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31461527eb340c5b647c2d415581b6c', 'request_id': 'req-6bc66ad5-e6c3-4398-be91-7f590760057f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:30.682678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31461527eb340c5b647c2d415581b6c', 'request_id': 'req-6bc66ad5-e6c3-4398-be91-7f590760057f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:30.700564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31461527eb340c5b647c2d415581b6c', 'request_id': 'req-6bc66ad5-e6c3-4398-be91-7f590760057f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:30.718650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] The token cache is being invalidate because project f31461527eb340c5b647c2d415581b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:11:30.719239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:30.720088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6bc66ad5-e6c3-4398-be91-7f590760057f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:30.721834 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3713/7422] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:11:30 2022] DELETE /identity/v3/projects/f31461527eb340c5b647c2d415581b6c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:30.727013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761aa7-d16c-4b79-b591-c8a50cc69da4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:30.728048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761aa7-d16c-4b79-b591-c8a50cc69da4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:30.728521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761aa7-d16c-4b79-b591-c8a50cc69da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:30.763419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-55761aa7-d16c-4b79-b591-c8a50cc69da4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:30.764994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-55761aa7-d16c-4b79-b591-c8a50cc69da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:30.928424 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3710/7423] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:30.934531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5528-3035-44ad-bfd4-684bc04a832b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:30.934847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5528-3035-44ad-bfd4-684bc04a832b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:30.935130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5528-3035-44ad-bfd4-684bc04a832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:30.983197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f1da5528-3035-44ad-bfd4-684bc04a832b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:30.987395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f1da5528-3035-44ad-bfd4-684bc04a832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:31.013888 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3714/7424] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:31.014080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55761aa7-d16c-4b79-b591-c8a50cc69da4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:31.029899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55761aa7-d16c-4b79-b591-c8a50cc69da4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:31.055450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:31.056630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:31.059529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:31.059988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:31.061973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:11:31.063325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:31.067513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:31.091523 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3711/7425] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:11:31.096920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5528-3035-44ad-bfd4-684bc04a832b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:31.110025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5528-3035-44ad-bfd4-684bc04a832b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:31.124640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:31.125326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:31.125923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:31.126209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:31.126986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:31.130563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:31.176618 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3715/7426] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:11:31 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:11:31.178258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:31.193597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a154c26-28c2-4490-b708-2e2c40372ea7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:31.435490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:31.436335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:31.436750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:31.437148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:31.438976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:31.447228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:31.499731 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3712/7427] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:11:31 2022] POST /identity/v3/users => generated 282 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:11:31.504301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:31.528461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597852c8-8652-4f2e-b041-694fd859ab85 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:31.538043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:31.538730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:31.539368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:31.539927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:31.540662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:31.542517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:31.557265 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3716/7428] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:11:31.559617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:31.575874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d200728-1718-4c5b-a125-9e948f901bbc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:31.582614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0957-d228-47af-b4b8-f3c0b0b6ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:31.584135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0957-d228-47af-b4b8-f3c0b0b6ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:31.584542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0957-d228-47af-b4b8-f3c0b0b6ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:31.584893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0957-d228-47af-b4b8-f3c0b0b6ad7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:31.585843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0957-d228-47af-b4b8-f3c0b0b6ad7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:31.589444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0957-d228-47af-b4b8-f3c0b0b6ad7e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:31.610365 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3713/7429] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:11:31.611741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:31.627392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d0ee-9d4e-4095-a036-37497cedff1e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:31.635003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:31.636410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:31.636924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:31.637816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] PATH_INFO: `/v3/projects/0543013ca84b4ebb90ffc461dad90515/users/768e379a5eb34d02ba37f2973173400b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:31.664034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0543013ca84b4ebb90ffc461dad90515, user_id=768e379a5eb34d02ba37f2973173400b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:31.678075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:31.702803 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3717/7430] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:11:31 2022] PUT /identity/v3/projects/0543013ca84b4ebb90ffc461dad90515/users/768e379a5eb34d02ba37f2973173400b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:31.707630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830399-73f2-44e1-9435-4dc43974b2dd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:31.707929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830399-73f2-44e1-9435-4dc43974b2dd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:31.708261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830399-73f2-44e1-9435-4dc43974b2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:31.741653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ed830399-73f2-44e1-9435-4dc43974b2dd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:31.742938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ed830399-73f2-44e1-9435-4dc43974b2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:31.946703 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3714/7431] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:31.977564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:31.981260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:32.121130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343771c7-b04d-4809-a645-408373afb910 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:32.129842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:32.131237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:32.131771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:32.132427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:32.147755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:32.149514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:32.163426 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3718/7432] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:32.567029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf4f7e-beee-4389-bbeb-ba2818190d10 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:32.567322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf4f7e-beee-4389-bbeb-ba2818190d10 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:32.567730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf4f7e-beee-4389-bbeb-ba2818190d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:32.591422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-aeaf4f7e-beee-4389-bbeb-ba2818190d10 None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:32.592868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aeaf4f7e-beee-4389-bbeb-ba2818190d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:32.675077 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3715/7433] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:41.566550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:41.569447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:41.600370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05bbc-8770-4639-95b3-d67fbd285b7c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:41.611745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:41.613424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:41.613879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:41.614608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] PATH_INFO: `/v3/users/463a78a91e954c95b13a993b176b5526` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:41.622870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] RBAC: Authorizing `identity:delete_user(user_id=463a78a91e954c95b13a993b176b5526)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:41.633096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:41.767032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463a78a91e954c95b13a993b176b5526'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:41.776301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463a78a91e954c95b13a993b176b5526'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:41.792305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463a78a91e954c95b13a993b176b5526'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:41.793411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463a78a91e954c95b13a993b176b5526'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:41.809933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463a78a91e954c95b13a993b176b5526'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:41.855298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3719/7434] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:11:41 2022] DELETE /identity/v3/users/463a78a91e954c95b13a993b176b5526 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:41.860167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:41.860706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:41.860706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:41.892034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:41.893420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:42.027839 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3716/7435] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:42.078754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:42.080231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:42.231989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295176e-6fed-4b05-817a-c38e5fda016f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:42.237796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533b46e-e428-42a8-a03f-0de89191daf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:42.238602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533b46e-e428-42a8-a03f-0de89191daf2 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:42.239010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533b46e-e428-42a8-a03f-0de89191daf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:42.239903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533b46e-e428-42a8-a03f-0de89191daf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:42.255487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533b46e-e428-42a8-a03f-0de89191daf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:42.257229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533b46e-e428-42a8-a03f-0de89191daf2 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:42.273040 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3720/7436] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:43.437904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:43.440010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:43.467538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86d181-a9e4-47a7-80f0-2a4c8c98a6de None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:43.477717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:43.478967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:43.479444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:43.480048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] PATH_INFO: `/v3/projects/a45ecca62a364aaabca1717c79558f6f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:43.481350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45ecca62a364aaabca1717c79558f6f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:43.484266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:43.623433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45ecca62a364aaabca1717c79558f6f', 'request_id': 'req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:43.633985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45ecca62a364aaabca1717c79558f6f', 'request_id': 'req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:43.663611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45ecca62a364aaabca1717c79558f6f', 'request_id': 'req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:43.682564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] The token cache is being invalidate because project a45ecca62a364aaabca1717c79558f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:11:43.682879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:43.683571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7b6f1199-1ce5-4b59-9320-7eb14a1fedca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:43.686761 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3717/7437] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:11:43 2022] DELETE /identity/v3/projects/a45ecca62a364aaabca1717c79558f6f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:43.692995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad606-dc31-4faf-9a5f-6e862d92bbd0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:43.694104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad606-dc31-4faf-9a5f-6e862d92bbd0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:43.695596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad606-dc31-4faf-9a5f-6e862d92bbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:43.721594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d06ad606-dc31-4faf-9a5f-6e862d92bbd0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:43.723656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d06ad606-dc31-4faf-9a5f-6e862d92bbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:43.831277 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3721/7438] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:11:43.840034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a608fa8-e5c7-4595-b61a-ee46b7d61a51 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:43.841006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a608fa8-e5c7-4595-b61a-ee46b7d61a51 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:43.841274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a608fa8-e5c7-4595-b61a-ee46b7d61a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:43.867770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6a608fa8-e5c7-4595-b61a-ee46b7d61a51 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:43.870487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6a608fa8-e5c7-4595-b61a-ee46b7d61a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:43.881560 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3718/7439] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:43.886254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ad606-dc31-4faf-9a5f-6e862d92bbd0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:43.900129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ad606-dc31-4faf-9a5f-6e862d92bbd0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:43.907684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:43.908506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:43.909829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:43.910188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:43.913036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:11:43.913036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:43.918411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:43.940835 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3722/7440] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:11:43.948311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a608fa8-e5c7-4595-b61a-ee46b7d61a51 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:43.960350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a608fa8-e5c7-4595-b61a-ee46b7d61a51 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:43.965956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:43.967006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:43.967533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:43.968032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:43.968953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:43.972605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:44.016569 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3719/7441] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:11:43 2022] POST /identity/v3/projects => generated 359 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:11:44.022299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:44.044466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af76ae-a5fe-408f-9847-0e2abdb60312 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:44.167675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:44.168538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.168826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.169104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.169921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:44.186176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:44.244755 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3723/7442] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:11:44 2022] POST /identity/v3/users => generated 280 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:11:44.250196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:44.267376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4438f-2187-4137-b81d-62c655ee6f45 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:44.273593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:44.274665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.275753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.276221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.277245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:44.279412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:44.297811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3720/7443] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:11:44.302095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:44.318151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2e33f-a041-4dd9-b058-76c3dca85b35 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:44.329958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b78e5f-d580-44fa-b128-07c29c77b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:44.331081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78e5f-d580-44fa-b128-07c29c77b775 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.331604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78e5f-d580-44fa-b128-07c29c77b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.332113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b78e5f-d580-44fa-b128-07c29c77b775 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.333340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b78e5f-d580-44fa-b128-07c29c77b775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:44.336018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b78e5f-d580-44fa-b128-07c29c77b775 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:44.353655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3724/7444] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:11:44.358137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:44.374507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104fcec6-0034-4e3f-b267-9ecfce173dea admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:44.383437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a57bb4-ec55-4199-9221-8f05d33241ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:44.384748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a57bb4-ec55-4199-9221-8f05d33241ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.385274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a57bb4-ec55-4199-9221-8f05d33241ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.385834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a57bb4-ec55-4199-9221-8f05d33241ee admin admin] PATH_INFO: `/v3/projects/9871aa16c54d4751ac838e07d52897a6/users/ceb8a4753c9d4d6e965429b0bfc0d308/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.423564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a57bb4-ec55-4199-9221-8f05d33241ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9871aa16c54d4751ac838e07d52897a6, user_id=ceb8a4753c9d4d6e965429b0bfc0d308, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:44.428961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a57bb4-ec55-4199-9221-8f05d33241ee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:44.453898 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3721/7445] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:11:44 2022] PUT /identity/v3/projects/9871aa16c54d4751ac838e07d52897a6/users/ceb8a4753c9d4d6e965429b0bfc0d308/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:44.557007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857791ea-763b-404d-869a-a99430e109dd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.557446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857791ea-763b-404d-869a-a99430e109dd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.558221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857791ea-763b-404d-869a-a99430e109dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.583709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.585057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.589397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.639227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-857791ea-763b-404d-869a-a99430e109dd None None] MFA Rules not processed for user `ceb8a4753c9d4d6e965429b0bfc0d308`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:44.640875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-857791ea-763b-404d-869a-a99430e109dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:44.675244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] MFA Rules not processed for user `768e379a5eb34d02ba37f2973173400b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:44.677102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:44.741679 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3725/7446] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:44.749052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857791ea-763b-404d-869a-a99430e109dd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:44.751669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-857791ea-763b-404d-869a-a99430e109dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:44.785738 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3722/7447] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:11:44.789167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:44.794089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:44.850859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857791ea-763b-404d-869a-a99430e109dd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:44.857562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:44.858296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.858590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.859005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.871304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:44.873757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:44.887970 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3726/7448] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:44 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:11:44.899365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b53daf-7823-40df-a654-09007dff32b4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:44.916597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:44.918545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:44.919135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:44.919878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:44.920842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:44.924021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:44.961919 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3723/7449] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:11:44 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:11:44.965920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:44.986505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff4e86-39c5-4f9b-91b3-df751789213d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:44.997591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1f07f-9dcd-4383-864b-cf25b8acb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:45.001913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1f07f-9dcd-4383-864b-cf25b8acb1fb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:45.002306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1f07f-9dcd-4383-864b-cf25b8acb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:45.003302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1f07f-9dcd-4383-864b-cf25b8acb1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:45.008250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1f07f-9dcd-4383-864b-cf25b8acb1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:45.012072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1f07f-9dcd-4383-864b-cf25b8acb1fb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:45.046988 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3727/7450] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:11:45.050923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:45.072039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887d827-ffe6-4541-895e-a0f88927cc27 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:45.088396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:45.091414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:45.093166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:45.093723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] PATH_INFO: `/v3/system/users/2fb2780c022b4d679849707587c4bce3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:45.123677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2fb2780c022b4d679849707587c4bce3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:45.129496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:45.148200 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3724/7451] 10.222.0.32 () {60 vars in 1377 bytes} [Sat May 7 22:11:45 2022] PUT /identity/v3/system/users/2fb2780c022b4d679849707587c4bce3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:45.159659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4a99-9662-459e-bd7d-656050b7121a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:45.159953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4a99-9662-459e-bd7d-656050b7121a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:45.160762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b4a99-9662-459e-bd7d-656050b7121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:45.241438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c87b4a99-9662-459e-bd7d-656050b7121a None None] MFA Rules not processed for user `2fb2780c022b4d679849707587c4bce3`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:11:45.243152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c87b4a99-9662-459e-bd7d-656050b7121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:45.411937 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3728/7452] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:11:45 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 07 22:11:45.413848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:45.619119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65567179-8fc8-4f20-81d6-b793b4c90f8a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:45.669640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb2780c022b4d679849707587c4bce3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:45.670542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:45.670937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:45.671354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:45.672879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:45.674733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:45.697985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b4a99-9662-459e-bd7d-656050b7121a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:45.698222 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3725/7453] 10.222.0.32 () {58 vars in 1109 bytes} [Sat May 7 22:11:45 2022] GET /identity/v3/services => generated 2191 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:11:45.874067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b4a99-9662-459e-bd7d-656050b7121a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:45.927852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb2780c022b4d679849707587c4bce3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:45.928895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:45.929211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:45.929488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] PATH_INFO: `/v3/limits` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:45.930239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:45.932194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post May 07 22:11:45.986938 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.NoLimitReference May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. May 07 22:11:45.988203 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:11:45.994302 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3729/7454] 10.222.0.32 () {60 vars in 1125 bytes} [Sat May 7 22:11:45 2022] POST /identity/v3/limits => generated 124 bytes in 292 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) May 07 22:11:45.995775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:46.147109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84b26b-04ab-4170-a71d-cea88f2cbc89 None tempest-ImageQuotaTest-2119228505-system-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:46.220024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb2780c022b4d679849707587c4bce3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:46.221324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:46.221871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:46.222241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:46.223105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:46.224844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:46.233232 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3726/7455] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 22:11:45 2022] GET /identity/v3/registered_limits => generated 129 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:11:46.238956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:46.403789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24eab3-48da-4e56-81d0-8613628125ad None tempest-ImageQuotaTest-2119228505-system-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:46.461526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fb2780c022b4d679849707587c4bce3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:46.462443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:46.462735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:46.463065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:46.463767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:46.464872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:46.474579 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3730/7456] 10.222.0.32 () {58 vars in 1136 bytes} [Sat May 7 22:11:46 2022] GET /identity/v3/registered_limits => generated 129 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:11:54.574663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:54.592709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074728d3-c631-4c2a-9de7-575d7007d7e7 None tempest-ImageQuotaTest-2119228505-system-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:54.600669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:54.601983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:54.602444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:54.613362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:54.617419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:54.636922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:54.640201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:54.687515 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3727/7457] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:11:57.133904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:57.151727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404b248-555b-45aa-b433-0d570fb373d2 None tempest-ImageQuotaTest-2119228505-system-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:57.158839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:57.159987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:57.160467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:57.161949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] PATH_INFO: `/v3/users/768e379a5eb34d02ba37f2973173400b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:57.163881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] RBAC: Authorizing `identity:delete_user(user_id=768e379a5eb34d02ba37f2973173400b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:57.167997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:57.246726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768e379a5eb34d02ba37f2973173400b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:57.248624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768e379a5eb34d02ba37f2973173400b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:57.259074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768e379a5eb34d02ba37f2973173400b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:57.259955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768e379a5eb34d02ba37f2973173400b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:57.273887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768e379a5eb34d02ba37f2973173400b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:57.301076 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3731/7458] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:11:57 2022] DELETE /identity/v3/users/768e379a5eb34d02ba37f2973173400b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:58.096692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:58.117947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e41c18-378f-4549-9550-84417e648cca service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:58.253807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:58.255238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:58.255571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:58.256245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] PATH_INFO: `/v3/projects/0543013ca84b4ebb90ffc461dad90515` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:58.258884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0543013ca84b4ebb90ffc461dad90515)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:58.262019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:58.356536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0543013ca84b4ebb90ffc461dad90515', 'request_id': 'req-d547ee2f-b2a7-43ac-bf12-419cf192ee76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.375893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0543013ca84b4ebb90ffc461dad90515', 'request_id': 'req-d547ee2f-b2a7-43ac-bf12-419cf192ee76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.389203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0543013ca84b4ebb90ffc461dad90515', 'request_id': 'req-d547ee2f-b2a7-43ac-bf12-419cf192ee76'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.419477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] The token cache is being invalidate because project 0543013ca84b4ebb90ffc461dad90515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:11:58.420173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.421082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.428543 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3728/7459] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:11:58 2022] DELETE /identity/v3/projects/0543013ca84b4ebb90ffc461dad90515 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:58.432407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:58.434663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:58.448819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4d3af-c3e5-4a6c-886b-7d3d38e1145f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:58.514662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:11:58.516012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:11:58.516261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:11:58.516783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] PATH_INFO: `/v3/users/2fb2780c022b4d679849707587c4bce3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:11:58.518222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb2780c022b4d679849707587c4bce3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:11:58.520857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:11:58.603605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb2780c022b4d679849707587c4bce3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.604421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb2780c022b4d679849707587c4bce3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.639691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb2780c022b4d679849707587c4bce3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.640463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb2780c022b4d679849707587c4bce3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.658995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb2780c022b4d679849707587c4bce3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:11:58.698553 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3732/7460] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:11:58 2022] DELETE /identity/v3/users/2fb2780c022b4d679849707587c4bce3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:11:59.764652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:59.769300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:11:59.792415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547ee2f-b2a7-43ac-bf12-419cf192ee76 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:11:59.833309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:11:59.836631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:00.011404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c69598-088e-426b-b9ef-7a12ce9cc2e8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:00.013534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44adc9-fe17-4def-9b05-67a98cf6c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.014673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44adc9-fe17-4def-9b05-67a98cf6c98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.015196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44adc9-fe17-4def-9b05-67a98cf6c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.015713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44adc9-fe17-4def-9b05-67a98cf6c98d admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.029608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550db0e2-50ec-4bfe-a757-0cd76be17aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.030386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db0e2-50ec-4bfe-a757-0cd76be17aff service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.030739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db0e2-50ec-4bfe-a757-0cd76be17aff service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.031116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550db0e2-50ec-4bfe-a757-0cd76be17aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.032742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44adc9-fe17-4def-9b05-67a98cf6c98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.036286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44adc9-fe17-4def-9b05-67a98cf6c98d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.038713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-550db0e2-50ec-4bfe-a757-0cd76be17aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:00.083574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550db0e2-50ec-4bfe-a757-0cd76be17aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.086875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550db0e2-50ec-4bfe-a757-0cd76be17aff service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-4b44adc9-fe17-4def-9b05-67a98cf6c98d admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:12:00.087708 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. May 07 22:12:00.088947 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:12:00.096035 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3729/7461] 10.222.0.32 () {58 vars in 1148 bytes} [Sat May 7 22:11:59 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 07 22:12:00.098906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff23ff-fda8-46f6-8264-69ec3f7af61c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.099209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff23ff-fda8-46f6-8264-69ec3f7af61c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.099496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff23ff-fda8-46f6-8264-69ec3f7af61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.127339 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3733/7462] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:11:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:00.136345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-31ff23ff-fda8-46f6-8264-69ec3f7af61c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:00.137698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-31ff23ff-fda8-46f6-8264-69ec3f7af61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:00.177550 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3730/7463] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:00.186841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfd11-9bc7-407e-8726-07d3e9867c3a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.187419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfd11-9bc7-407e-8726-07d3e9867c3a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.187895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bfd11-9bc7-407e-8726-07d3e9867c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.224000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e32bfd11-9bc7-407e-8726-07d3e9867c3a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:00.226175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e32bfd11-9bc7-407e-8726-07d3e9867c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:00.248314 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3734/7464] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:00.253931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff23ff-fda8-46f6-8264-69ec3f7af61c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:00.265659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff23ff-fda8-46f6-8264-69ec3f7af61c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:00.281280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.282080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.282439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.282814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.283688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:12:00.284091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.285868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.315776 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3731/7465] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:12:00.321204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bfd11-9bc7-407e-8726-07d3e9867c3a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:00.331023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bfd11-9bc7-407e-8726-07d3e9867c3a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:00.353329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.354532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.355281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.356648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.359454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.363544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.455325 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3735/7466] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:12:00 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:12:00.458199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:00.475443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334be3d-c501-4fe0-bd8f-bf83b070992a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:00.573109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.573895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.574390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.574734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.575497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.579892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.608852 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3732/7467] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:12:00 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:12:00.610410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:00.623099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0dede-2d27-4414-8956-8e11ec9dbd92 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:00.629086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.630494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.630826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.631214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.632123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.634153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.651407 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3736/7468] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:00.652903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:00.668954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce4dd8-19a7-4766-a111-87a287248c8d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:00.684439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b545f3-40c2-4c53-a2a4-4a9c96a9a4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.685610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b545f3-40c2-4c53-a2a4-4a9c96a9a4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.686165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b545f3-40c2-4c53-a2a4-4a9c96a9a4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.686689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b545f3-40c2-4c53-a2a4-4a9c96a9a4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.688823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b545f3-40c2-4c53-a2a4-4a9c96a9a4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.691280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b545f3-40c2-4c53-a2a4-4a9c96a9a4a2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.705915 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3733/7469] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:00.710013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:00.723968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2a930-4318-42d0-b56f-2886c9ec562e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:00.731105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:00.734219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.734992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.735675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] PATH_INFO: `/v3/projects/f3657e8df46a4252b9eb1eb159306a66/users/9b4988836610494ab48a138bd43d5b52/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.757106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3657e8df46a4252b9eb1eb159306a66, user_id=9b4988836610494ab48a138bd43d5b52, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:00.761992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:00.790988 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3737/7470] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:12:00 2022] PUT /identity/v3/projects/f3657e8df46a4252b9eb1eb159306a66/users/9b4988836610494ab48a138bd43d5b52/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:00.796471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959f84-4653-4455-a489-f486351ba980 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:00.797240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959f84-4653-4455-a489-f486351ba980 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:00.797529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959f84-4653-4455-a489-f486351ba980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:00.840905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6a959f84-4653-4455-a489-f486351ba980 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:00.843283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6a959f84-4653-4455-a489-f486351ba980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:00.943357 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3734/7471] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:00.956943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:00.961173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:01.048843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fbd48-e40a-4e0e-b290-e9d5d32caf6a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:01.054632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:01.055378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:01.055913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:01.056582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:01.070042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:01.072080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:01.086059 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3738/7472] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:01.615661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd9ce-845a-4e09-82c0-682ff353697b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:01.616064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd9ce-845a-4e09-82c0-682ff353697b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:01.616472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd9ce-845a-4e09-82c0-682ff353697b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:01.639913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c36bd9ce-845a-4e09-82c0-682ff353697b None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:01.641332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c36bd9ce-845a-4e09-82c0-682ff353697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:01.733718 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3735/7473] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:03.536074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:03.543019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:03.640398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc0a78-8e3c-4d8a-b86b-f1f424d3a1de service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:03.649410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:03.650484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:03.651055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:03.651590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:03.654180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:03.675727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:03.682367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:03.746920 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3739/7474] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:11.691907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da7a5c-17ad-47a9-90b5-56946637ec49 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:11.693366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da7a5c-17ad-47a9-90b5-56946637ec49 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:11.694154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da7a5c-17ad-47a9-90b5-56946637ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:11.801813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d7da7a5c-17ad-47a9-90b5-56946637ec49 None None] MFA Rules not processed for user `9b4988836610494ab48a138bd43d5b52`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:11.803357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d7da7a5c-17ad-47a9-90b5-56946637ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:12.045116 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3736/7475] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:12.051484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:12.085550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde07d75-9b0f-4270-ad2e-9880941f1390 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:12.102956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:12.104563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:12.105098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:12.105613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:12.107101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:12.109818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:12.150291 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3740/7476] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:12:12 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:12:12.154446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da7a5c-17ad-47a9-90b5-56946637ec49 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:12.205773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da7a5c-17ad-47a9-90b5-56946637ec49 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:12.427903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:12.429166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:12.429559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:12.429948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:12.430813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:12.433042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:12.484008 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3737/7477] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:12:12 2022] POST /identity/v3/users => generated 296 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:12:12.488222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:12.506252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e5e37-d630-4d0a-a688-06e9c65084c0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:12.521142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:12.522265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:12.523200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:12.524158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:12.525228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:12.527846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:12.580492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3741/7478] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:12.583673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:12.602743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0afb9-d4c3-4e4f-9137-28cde3733ebc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:12.616903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:12.617925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:12.618596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:12.618596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] PATH_INFO: `/v3/projects/4e3a459b2e514b998bffd4275d7bb847/users/2d22cd748692410bb1d4219aaa4c093c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:12.660441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3a459b2e514b998bffd4275d7bb847, user_id=2d22cd748692410bb1d4219aaa4c093c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:12.668391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:12.699483 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3738/7479] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:12:12 2022] PUT /identity/v3/projects/4e3a459b2e514b998bffd4275d7bb847/users/2d22cd748692410bb1d4219aaa4c093c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:12.704120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:12.717361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e177d-435a-489d-b67f-8e6f7cb2dff3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:12.822397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:12.823385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:12.823753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:12.824094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:12.824914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:12.827265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:12.839362 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3742/7480] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:12.843918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:12.860445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3b1c-c68d-41ed-a71c-ac2a5af980b1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:12.865932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:12.867685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:12.868017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:12.869025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] PATH_INFO: `/v3/projects/4e3a459b2e514b998bffd4275d7bb847/users/2d22cd748692410bb1d4219aaa4c093c/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:12.871432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3a459b2e514b998bffd4275d7bb847, user_id=2d22cd748692410bb1d4219aaa4c093c, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:12.875361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:12.891494 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3739/7481] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:12:12 2022] PUT /identity/v3/projects/4e3a459b2e514b998bffd4275d7bb847/users/2d22cd748692410bb1d4219aaa4c093c/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:20.652720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:20.656055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:20.768570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc26a4-f97b-45d8-9094-838a2b71d856 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:20.860634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855661e3-4ce8-48f8-8ea6-b20fb1020bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:20.861322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855661e3-4ce8-48f8-8ea6-b20fb1020bf4 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:20.861740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855661e3-4ce8-48f8-8ea6-b20fb1020bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:20.862164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855661e3-4ce8-48f8-8ea6-b20fb1020bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:20.864490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-855661e3-4ce8-48f8-8ea6-b20fb1020bf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:20.891532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855661e3-4ce8-48f8-8ea6-b20fb1020bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:20.893767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855661e3-4ce8-48f8-8ea6-b20fb1020bf4 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:20.913841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3743/7482] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:21.984849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:22.017359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f615f-80cd-442c-b3dd-bf26a7a5c718 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:22.034968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:22.036041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:22.036514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:22.039382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:22.048582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:22.093222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:22.095558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:22.133056 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3740/7483] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:23.160645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:23.161187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:23.161346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:23.213984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] MFA Rules not processed for user `2d22cd748692410bb1d4219aaa4c093c`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:23.215896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:23.352660 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3744/7484] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:23.361674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:23.363313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:23.445702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a957bb-cead-44d6-9a2b-64f08d6927da service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:23.450414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118814c-30c1-42a5-b36d-e8059dfa244e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:23.451117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118814c-30c1-42a5-b36d-e8059dfa244e service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:23.451395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118814c-30c1-42a5-b36d-e8059dfa244e service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:23.451923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118814c-30c1-42a5-b36d-e8059dfa244e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:23.533149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118814c-30c1-42a5-b36d-e8059dfa244e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:23.535871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118814c-30c1-42a5-b36d-e8059dfa244e service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:23.563067 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3741/7485] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:25.824164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:25.826160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:26.020048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2b32d-c63f-499a-80e7-141d02fb9359 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:26.028938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:26.030542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:26.032240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:26.032762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] PATH_INFO: `/v3/users/00c61a4e6b80412ea9c775b59e5b106a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:26.036145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c61a4e6b80412ea9c775b59e5b106a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:26.041531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:26.164877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c61a4e6b80412ea9c775b59e5b106a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:26.165838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c61a4e6b80412ea9c775b59e5b106a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:26.177160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c61a4e6b80412ea9c775b59e5b106a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:26.178382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c61a4e6b80412ea9c775b59e5b106a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:26.193074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c61a4e6b80412ea9c775b59e5b106a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:26.219052 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3745/7486] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:12:25 2022] DELETE /identity/v3/users/00c61a4e6b80412ea9c775b59e5b106a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:26.220843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3355-9410-4dc0-824d-c8ddedbea010 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:26.221321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3355-9410-4dc0-824d-c8ddedbea010 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:26.221442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3355-9410-4dc0-824d-c8ddedbea010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:26.245240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5e4b3355-9410-4dc0-824d-c8ddedbea010 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:26.246993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5e4b3355-9410-4dc0-824d-c8ddedbea010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:26.361056 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3742/7487] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:26.373627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:26.376018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:26.556506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86cca2-9c98-4f8e-86a3-bdbc54aabbe9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:26.561166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:26.562088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:26.562358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:26.562637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:26.577435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:26.582923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:26.620711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3746/7488] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:26.761500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f151-aaf4-42e5-a79b-7fefd74c51eb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:26.762297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f151-aaf4-42e5-a79b-7fefd74c51eb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:26.762677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f151-aaf4-42e5-a79b-7fefd74c51eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:26.796366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6383f151-aaf4-42e5-a79b-7fefd74c51eb None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:26.798395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6383f151-aaf4-42e5-a79b-7fefd74c51eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:26.929245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3743/7489] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:27.556916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:27.558561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:27.595476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a579d-91a2-4bba-ab89-15b33a6d749f service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:27.608703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:27.609576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:27.611325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:27.612467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] PATH_INFO: `/v3/projects/8af77af9b4794e338a417c09016e0fa3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:27.617456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af77af9b4794e338a417c09016e0fa3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:27.625404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:27.719454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af77af9b4794e338a417c09016e0fa3', 'request_id': 'req-70feb4dd-5acf-44d9-aba6-e657d29dc965'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:27.727618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af77af9b4794e338a417c09016e0fa3', 'request_id': 'req-70feb4dd-5acf-44d9-aba6-e657d29dc965'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:27.753368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af77af9b4794e338a417c09016e0fa3', 'request_id': 'req-70feb4dd-5acf-44d9-aba6-e657d29dc965'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:27.780602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] The token cache is being invalidate because project 8af77af9b4794e338a417c09016e0fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:12:27.781200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:27.782107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:27.786056 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3747/7490] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:12:27 2022] DELETE /identity/v3/projects/8af77af9b4794e338a417c09016e0fa3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:27.790043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f151-aaf4-42e5-a79b-7fefd74c51eb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:27.813418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383f151-aaf4-42e5-a79b-7fefd74c51eb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:27.924535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:27.926225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:27.927028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:27.928455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] PATH_INFO: `/v3/users/b051dba6394d477ca5d93a210e964ed4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:27.930523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b051dba6394d477ca5d93a210e964ed4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:27.933402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:28.050049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b051dba6394d477ca5d93a210e964ed4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:28.071416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b051dba6394d477ca5d93a210e964ed4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:28.075181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b051dba6394d477ca5d93a210e964ed4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:28.076473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b051dba6394d477ca5d93a210e964ed4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:28.103937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-fa6bd870-13f8-43b1-adfe-b4f34d261757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b051dba6394d477ca5d93a210e964ed4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:28.140347 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3744/7491] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:12:27 2022] DELETE /identity/v3/users/b051dba6394d477ca5d93a210e964ed4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:29.252922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:29.255342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:29.290368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feb4dd-5acf-44d9-aba6-e657d29dc965 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:29.312043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594d42b-3da2-4c6d-9fc6-c7d0e105874e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:29.313547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594d42b-3da2-4c6d-9fc6-c7d0e105874e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:29.314127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594d42b-3da2-4c6d-9fc6-c7d0e105874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:29.342291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2594d42b-3da2-4c6d-9fc6-c7d0e105874e None None] MFA Rules not processed for user `9b4988836610494ab48a138bd43d5b52`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:29.344353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2594d42b-3da2-4c6d-9fc6-c7d0e105874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:29.481986 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3745/7492] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:29.556661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:29.559885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:29.564175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:29.564807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] PATH_INFO: `/v3/projects/28a4884b91054cb58607f65ea001053c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:29.573351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a4884b91054cb58607f65ea001053c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:29.582798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:29.715358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a4884b91054cb58607f65ea001053c', 'request_id': 'req-f6588213-7849-4f29-85c1-073870a9241e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:29.727755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a4884b91054cb58607f65ea001053c', 'request_id': 'req-f6588213-7849-4f29-85c1-073870a9241e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:29.766674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a4884b91054cb58607f65ea001053c', 'request_id': 'req-f6588213-7849-4f29-85c1-073870a9241e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:29.781913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] The token cache is being invalidate because project 28a4884b91054cb58607f65ea001053c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:12:29.782208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:29.784528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f6588213-7849-4f29-85c1-073870a9241e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:29.790289 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3748/7493] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:12:29 2022] DELETE /identity/v3/projects/28a4884b91054cb58607f65ea001053c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:29.795893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec90f-37d6-422a-83f2-f98d1d5b173b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:29.796336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec90f-37d6-422a-83f2-f98d1d5b173b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:29.796743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dec90f-37d6-422a-83f2-f98d1d5b173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:29.871014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f9dec90f-37d6-422a-83f2-f98d1d5b173b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:29.874935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f9dec90f-37d6-422a-83f2-f98d1d5b173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:30.150134 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3746/7494] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:30.158588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc913d-ae5e-4b0d-a100-673fcc993227 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.159024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc913d-ae5e-4b0d-a100-673fcc993227 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.159407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc913d-ae5e-4b0d-a100-673fcc993227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.252586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2fbc913d-ae5e-4b0d-a100-673fcc993227 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:30.257129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2fbc913d-ae5e-4b0d-a100-673fcc993227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:30.298433 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3749/7495] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:30.304638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec90f-37d6-422a-83f2-f98d1d5b173b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:30.331957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dec90f-37d6-422a-83f2-f98d1d5b173b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:30.360950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:30.364085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.364631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.365160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.366378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:12:30.369655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:30.375130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:30.419448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3747/7496] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:12:30.424834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc913d-ae5e-4b0d-a100-673fcc993227 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:30.441805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc913d-ae5e-4b0d-a100-673fcc993227 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:30.454012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:30.454702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.455013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.455532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.456472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:30.464237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:30.508337 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3750/7497] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:12:30 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:12:30.512711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:30.528696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95615-2163-4733-aeb5-6602d94ca319 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:30.564920 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:30.567947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:30.646186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:30.647379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.648015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.648653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.649626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:30.651840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:30.693117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff7572-bd82-4968-8991-f9b84341715f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:30.695239 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3748/7498] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:12:30 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:12:30.698918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:30.702243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:30.703643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.704134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.704637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.716073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:30.721550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac4145-edba-439f-bf47-c0021d657736 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:30.729408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:30.730280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.730652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.734286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.735027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:30.739760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:30.746431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:30.750431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:30.772346 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3749/7499] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:30.776267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:30.784483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3751/7500] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:30.822189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c368419-8481-4b1c-b371-7f278e1e3f5b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:30.838374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02239ec-0f00-4e51-96eb-3b4ba58741c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:30.839224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02239ec-0f00-4e51-96eb-3b4ba58741c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.839634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02239ec-0f00-4e51-96eb-3b4ba58741c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.839921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02239ec-0f00-4e51-96eb-3b4ba58741c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.840650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02239ec-0f00-4e51-96eb-3b4ba58741c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:30.842430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02239ec-0f00-4e51-96eb-3b4ba58741c1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:30.857407 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3750/7501] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:30.863155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:30.880962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd3bd8-9940-43b6-9666-c7c8d3275948 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:30.888862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:30.890062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.898189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.899775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] PATH_INFO: `/v3/projects/586495fb86064013a37b42a6b3d382fb/users/dfc77c00843b4867833f423b78bb4f76/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:30.932949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=586495fb86064013a37b42a6b3d382fb, user_id=dfc77c00843b4867833f423b78bb4f76, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:30.936416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:30.975069 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3752/7502] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:12:30 2022] PUT /identity/v3/projects/586495fb86064013a37b42a6b3d382fb/users/dfc77c00843b4867833f423b78bb4f76/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:30.987062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:30.987870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:30.988654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:31.033224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] MFA Rules not processed for user `dfc77c00843b4867833f423b78bb4f76`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:31.035111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:31.210464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3751/7503] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:31.216527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:31.313151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83bbc-71f4-4d8f-bdcd-57c4d3af2d02 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:31.321164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b0e8-bc15-4d15-bb0d-d5eb00507e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:31.322649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b0e8-bc15-4d15-bb0d-d5eb00507e4f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:31.323216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b0e8-bc15-4d15-bb0d-d5eb00507e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:31.324310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b0e8-bc15-4d15-bb0d-d5eb00507e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:31.339204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b0e8-bc15-4d15-bb0d-d5eb00507e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:31.341533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b0e8-bc15-4d15-bb0d-d5eb00507e4f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:31.368458 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3753/7504] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:40.123369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:40.125093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:40.234899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95708b-01b9-40a8-a29f-5e55e97af78d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:40.265906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:40.266810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:40.267315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:40.267596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] PATH_INFO: `/v3/users/d6ecbf5ed6eb4468a5ebb87697f52b3c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:40.269501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ecbf5ed6eb4468a5ebb87697f52b3c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:40.271611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:40.391717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ecbf5ed6eb4468a5ebb87697f52b3c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:40.409250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ecbf5ed6eb4468a5ebb87697f52b3c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:40.410115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ecbf5ed6eb4468a5ebb87697f52b3c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:40.411032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ecbf5ed6eb4468a5ebb87697f52b3c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:40.423661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ecbf5ed6eb4468a5ebb87697f52b3c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:40.449514 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3752/7505] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:12:40 2022] DELETE /identity/v3/users/d6ecbf5ed6eb4468a5ebb87697f52b3c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:40.454805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757558c5-57eb-455a-96d0-c848835e847a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:40.455342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757558c5-57eb-455a-96d0-c848835e847a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:40.455524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757558c5-57eb-455a-96d0-c848835e847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:40.486910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-757558c5-57eb-455a-96d0-c848835e847a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:40.490178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-757558c5-57eb-455a-96d0-c848835e847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:40.622170 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3754/7506] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:40.658242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:40.669251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:40.891625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923783b2-c47e-4256-9c81-59863f6c23e8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:40.903767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f22bd-86e2-4c9b-8bbd-91162e0c9c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:40.904896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f22bd-86e2-4c9b-8bbd-91162e0c9c26 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:40.904896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f22bd-86e2-4c9b-8bbd-91162e0c9c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:40.905319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f22bd-86e2-4c9b-8bbd-91162e0c9c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:40.945993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f22bd-86e2-4c9b-8bbd-91162e0c9c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:40.947555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f22bd-86e2-4c9b-8bbd-91162e0c9c26 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:40.958355 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3753/7507] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:42.070587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757558c5-57eb-455a-96d0-c848835e847a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.072382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-757558c5-57eb-455a-96d0-c848835e847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:42.086173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757558c5-57eb-455a-96d0-c848835e847a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.092524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.093675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.094167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.094444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] PATH_INFO: `/v3/projects/9c3329647b05487f9d63d3c4ec2183b9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.096014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3329647b05487f9d63d3c4ec2183b9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.098580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:42.154957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3329647b05487f9d63d3c4ec2183b9', 'request_id': 'req-86847e4b-cab3-4b01-8b12-20978f292a0f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:42.171891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3329647b05487f9d63d3c4ec2183b9', 'request_id': 'req-86847e4b-cab3-4b01-8b12-20978f292a0f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:42.184686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3329647b05487f9d63d3c4ec2183b9', 'request_id': 'req-86847e4b-cab3-4b01-8b12-20978f292a0f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:42.199618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] The token cache is being invalidate because project 9c3329647b05487f9d63d3c4ec2183b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:12:42.200012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:42.200743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-86847e4b-cab3-4b01-8b12-20978f292a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:42.203643 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3755/7508] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:12:42 2022] DELETE /identity/v3/projects/9c3329647b05487f9d63d3c4ec2183b9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:42.209247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017d3e-33c8-402b-94d9-3a06163a4387 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.209684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017d3e-33c8-402b-94d9-3a06163a4387 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.209801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1017d3e-33c8-402b-94d9-3a06163a4387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.259208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f1017d3e-33c8-402b-94d9-3a06163a4387 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:42.261120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1017d3e-33c8-402b-94d9-3a06163a4387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:42.376080 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3754/7509] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:42.378269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bdbd-c61a-4c70-8181-990d062dd98b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.378642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bdbd-c61a-4c70-8181-990d062dd98b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.379382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24bdbd-c61a-4c70-8181-990d062dd98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.399206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bd24bdbd-c61a-4c70-8181-990d062dd98b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:42.400531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bd24bdbd-c61a-4c70-8181-990d062dd98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:42.413606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3756/7510] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:42.415449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1017d3e-33c8-402b-94d9-3a06163a4387 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.426033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1017d3e-33c8-402b-94d9-3a06163a4387 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.431173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.431945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.432300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.432652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.433448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:12:42.433829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.435706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:42.450273 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3755/7511] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:12:42.454683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bdbd-c61a-4c70-8181-990d062dd98b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.465674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24bdbd-c61a-4c70-8181-990d062dd98b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.471344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.472200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.472491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.472775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.473481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.475487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:42.504497 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3757/7512] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:12:42 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:12:42.508801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.521088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277b4b3-2a16-40a4-b384-0a982e6ae304 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.585823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.586734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.586734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.587060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.587925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.589910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:42.620113 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3756/7513] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:12:42 2022] POST /identity/v3/users => generated 279 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:12:42.630002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.640989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a993577-47b2-4378-8041-ed3c07650802 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.645868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.646559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.646875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.647376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.648117 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.650063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:42.664908 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3758/7514] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:42.668779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.681328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc65ba-edfa-4c82-ae6d-4e417f4f0ed5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.686656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37a10e-79a5-4919-9c47-8e95fde6da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.688651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a10e-79a5-4919-9c47-8e95fde6da5c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.688957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a10e-79a5-4919-9c47-8e95fde6da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.689245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37a10e-79a5-4919-9c47-8e95fde6da5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.690007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37a10e-79a5-4919-9c47-8e95fde6da5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.692693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37a10e-79a5-4919-9c47-8e95fde6da5c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:42.706195 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3757/7515] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:42.708122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.719928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a9518-3f3f-4eb9-b7a7-c50ad0e70533 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.726305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.727527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.727816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.728095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] PATH_INFO: `/v3/projects/4dbdd61ff73f47a88777a750e5994457/users/ac26310ffe63499cb9d12b9c4e2c8ad3/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.746370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbdd61ff73f47a88777a750e5994457, user_id=ac26310ffe63499cb9d12b9c4e2c8ad3, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.749389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:42.769347 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3759/7516] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:12:42 2022] PUT /identity/v3/projects/4dbdd61ff73f47a88777a750e5994457/users/ac26310ffe63499cb9d12b9c4e2c8ad3/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:42.780201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb28c8-556d-4c27-87e3-df99fd3db411 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.780502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb28c8-556d-4c27-87e3-df99fd3db411 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.780785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb28c8-556d-4c27-87e3-df99fd3db411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.812580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dacb28c8-556d-4c27-87e3-df99fd3db411 None None] MFA Rules not processed for user `ac26310ffe63499cb9d12b9c4e2c8ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:42.813896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dacb28c8-556d-4c27-87e3-df99fd3db411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:42.894387 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3758/7517] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:42.899024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:42.972014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003524-f6f6-4b96-9eae-8ac78d58f999 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:42.977318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:42.977984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:42.978268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:42.978740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:42.979729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:42.981656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:43.014921 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3760/7518] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:12:42 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:12:43.019019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb28c8-556d-4c27-87e3-df99fd3db411 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:43.031295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb28c8-556d-4c27-87e3-df99fd3db411 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:43.123168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:43.124321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.124601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.125560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:43.126292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:43.129948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:43.158106 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3759/7519] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:12:43 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:12:43.162303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:43.175255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00955302-00f3-45f1-9dad-e2550351aa53 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:43.181960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:43.183073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.184078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.184358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:43.185407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:43.187436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:43.202142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3761/7520] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:43.206816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:43.232093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186a9d3-5b17-4eef-93c6-5bb1fb5c3153 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:43.249114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:43.250899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.251189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.251474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] PATH_INFO: `/v3/projects/4e967133349e418281a4ad5174e1ffc7/users/a7eafea4be7d4f66a26f8e8368cb9d8a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:43.269094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e967133349e418281a4ad5174e1ffc7, user_id=a7eafea4be7d4f66a26f8e8368cb9d8a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:43.271827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:43.286140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3760/7521] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:12:43 2022] PUT /identity/v3/projects/4e967133349e418281a4ad5174e1ffc7/users/a7eafea4be7d4f66a26f8e8368cb9d8a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:43.290086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:43.302732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e6577-e9e1-4faf-b2e6-642f4a1c080e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:43.371609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f3d7-5d17-40ca-9d46-736bdbde06c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:43.373017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f3d7-5d17-40ca-9d46-736bdbde06c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.373634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f3d7-5d17-40ca-9d46-736bdbde06c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.373942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f3d7-5d17-40ca-9d46-736bdbde06c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:43.376076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f3d7-5d17-40ca-9d46-736bdbde06c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:43.378744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f3d7-5d17-40ca-9d46-736bdbde06c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:43.391558 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3762/7522] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:12:43.399408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:43.413050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcf41c-def6-4a38-893d-a9399ed81e6e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:43.422243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:43.423360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.423643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.424097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] PATH_INFO: `/v3/projects/4e967133349e418281a4ad5174e1ffc7/users/a7eafea4be7d4f66a26f8e8368cb9d8a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:43.428926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e967133349e418281a4ad5174e1ffc7, user_id=a7eafea4be7d4f66a26f8e8368cb9d8a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:43.433230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:43.455091 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3761/7523] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:12:43 2022] PUT /identity/v3/projects/4e967133349e418281a4ad5174e1ffc7/users/a7eafea4be7d4f66a26f8e8368cb9d8a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:12:43.466905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e825-2870-4b0a-8cff-8fa549ae35dd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.467267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e825-2870-4b0a-8cff-8fa549ae35dd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.467457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e825-2870-4b0a-8cff-8fa549ae35dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:43.501690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-beb8e825-2870-4b0a-8cff-8fa549ae35dd None None] MFA Rules not processed for user `a7eafea4be7d4f66a26f8e8368cb9d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:43.503947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-beb8e825-2870-4b0a-8cff-8fa549ae35dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:43.623400 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3763/7524] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:12:43.633295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:43.638941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:43.773108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c3108-5de7-4d6c-a6bd-5548a4339835 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:43.777338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:43.778640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.778640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.778640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:43.799257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:43.804052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:43.817468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3762/7525] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:43.936471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e825-2870-4b0a-8cff-8fa549ae35dd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:43.953825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e825-2870-4b0a-8cff-8fa549ae35dd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:43.959150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:43.960188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:43.960577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:43.960949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:44.031578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:44.033065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:44.044399 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3764/7526] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:12:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:12:48.241431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:48.243484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:48.376662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5baa89-fa8b-4f8f-83e7-aeb054094909 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:48.390746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:48.392148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:48.392568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:48.394068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] PATH_INFO: `/v3/users/4f4cbf51481d45de862752fe273dceda` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:48.396223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4cbf51481d45de862752fe273dceda)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:48.399032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:48.502383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4cbf51481d45de862752fe273dceda'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:48.511165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4cbf51481d45de862752fe273dceda'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:48.511926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4cbf51481d45de862752fe273dceda'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:48.512610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4cbf51481d45de862752fe273dceda'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:48.537761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4cbf51481d45de862752fe273dceda'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:48.561218 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3763/7527] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:12:48 2022] DELETE /identity/v3/users/4f4cbf51481d45de862752fe273dceda => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:49.338957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:49.358823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563de13-1695-415f-99df-ea5c64fcf294 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:49.545299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:49.546178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:49.547410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:49.548203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] PATH_INFO: `/v3/projects/d70782066cce4f2fbf5744b63e4195cb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:49.550054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70782066cce4f2fbf5744b63e4195cb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:49.552881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:49.668564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70782066cce4f2fbf5744b63e4195cb', 'request_id': 'req-0787df59-529e-4d22-88fd-fb84e5e80fc1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.683534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70782066cce4f2fbf5744b63e4195cb', 'request_id': 'req-0787df59-529e-4d22-88fd-fb84e5e80fc1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.697604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70782066cce4f2fbf5744b63e4195cb', 'request_id': 'req-0787df59-529e-4d22-88fd-fb84e5e80fc1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.712683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] The token cache is being invalidate because project d70782066cce4f2fbf5744b63e4195cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:12:49.713133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.713750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.716012 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3765/7528] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:12:49 2022] DELETE /identity/v3/projects/d70782066cce4f2fbf5744b63e4195cb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:49.722408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:49.729022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:49.743924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bef4ea-8378-45fc-b13c-1898c7e55ccf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:49.825525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:49.826343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:49.826621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:49.827233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] PATH_INFO: `/v3/users/b5fab85a087548ac97f9e0225d0dd4cf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:49.828462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5fab85a087548ac97f9e0225d0dd4cf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:49.830598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:49.883991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5fab85a087548ac97f9e0225d0dd4cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.890888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5fab85a087548ac97f9e0225d0dd4cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.891571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5fab85a087548ac97f9e0225d0dd4cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.892189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5fab85a087548ac97f9e0225d0dd4cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.900280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-266fc0de-fb55-41e5-8212-23e46ba1d924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5fab85a087548ac97f9e0225d0dd4cf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:49.919837 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3764/7529] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:12:49 2022] DELETE /identity/v3/users/b5fab85a087548ac97f9e0225d0dd4cf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:50.223510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:12:50.226648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:50.262302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787df59-529e-4d22-88fd-fb84e5e80fc1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:12:50.400416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:12:50.401292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:50.402022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:50.402571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] PATH_INFO: `/v3/projects/2587862c34a945d193e58b50f42e5382` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:50.405841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2587862c34a945d193e58b50f42e5382)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:12:50.407858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:12:50.525351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2587862c34a945d193e58b50f42e5382', 'request_id': 'req-5e568e71-2f4c-471f-bfec-d20ab62aa53f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:50.537769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2587862c34a945d193e58b50f42e5382', 'request_id': 'req-5e568e71-2f4c-471f-bfec-d20ab62aa53f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:50.552525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2587862c34a945d193e58b50f42e5382', 'request_id': 'req-5e568e71-2f4c-471f-bfec-d20ab62aa53f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:50.573952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] The token cache is being invalidate because project 2587862c34a945d193e58b50f42e5382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:12:50.574518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:50.575505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:12:50.578669 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3766/7530] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:12:50 2022] DELETE /identity/v3/projects/2587862c34a945d193e58b50f42e5382 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:12:55.127964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63a411-8526-48ce-a59d-b1adf535b7f5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:12:55.128946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63a411-8526-48ce-a59d-b1adf535b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:12:55.129440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63a411-8526-48ce-a59d-b1adf535b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:12:55.157062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6c63a411-8526-48ce-a59d-b1adf535b7f5 None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:12:55.159306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6c63a411-8526-48ce-a59d-b1adf535b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:12:55.292868 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3765/7531] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:02.188495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:02.190660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:02.278884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e568e71-2f4c-471f-bfec-d20ab62aa53f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:02.288784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:02.290116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:02.290581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:02.291090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] PATH_INFO: `/v3/users/ac26310ffe63499cb9d12b9c4e2c8ad3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:02.292518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac26310ffe63499cb9d12b9c4e2c8ad3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:02.294674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:02.387221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac26310ffe63499cb9d12b9c4e2c8ad3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:02.388320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac26310ffe63499cb9d12b9c4e2c8ad3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:02.398300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac26310ffe63499cb9d12b9c4e2c8ad3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:02.399502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac26310ffe63499cb9d12b9c4e2c8ad3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:02.411894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac26310ffe63499cb9d12b9c4e2c8ad3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:02.444864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3767/7532] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:13:02 2022] DELETE /identity/v3/users/ac26310ffe63499cb9d12b9c4e2c8ad3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:02.450686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:02.451584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:02.452194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:02.481569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:02.483270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:02.563486 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3766/7533] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:02.609431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:02.610730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:02.708872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf66b-07ee-444f-8c4c-5440f01ee94b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:02.717702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:02.718462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:02.718879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:02.719167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:02.733978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:02.745613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:02.774613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3768/7534] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:13:03.557869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:03.561361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:03.589525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5be4-9d75-4f6d-9957-08c55cc38b83 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:03.607574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:03.609013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:03.609472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:03.609922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] PATH_INFO: `/v3/projects/4dbdd61ff73f47a88777a750e5994457` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:03.612119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbdd61ff73f47a88777a750e5994457)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:03.614310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:03.686338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbdd61ff73f47a88777a750e5994457', 'request_id': 'req-672ce3da-8a6c-43e2-939e-b13c465c0c24'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.692589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbdd61ff73f47a88777a750e5994457', 'request_id': 'req-672ce3da-8a6c-43e2-939e-b13c465c0c24'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.703234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbdd61ff73f47a88777a750e5994457', 'request_id': 'req-672ce3da-8a6c-43e2-939e-b13c465c0c24'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.715436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] The token cache is being invalidate because project 4dbdd61ff73f47a88777a750e5994457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:13:03.716071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.716943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.719108 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3767/7535] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:13:03 2022] DELETE /identity/v3/projects/4dbdd61ff73f47a88777a750e5994457 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:03.723980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:03.741409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e27f05-6bd4-4d66-9acc-318a727c4313 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:03.851912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:03.853134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:03.853314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:03.853531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] PATH_INFO: `/v3/users/a7eafea4be7d4f66a26f8e8368cb9d8a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:03.855427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7eafea4be7d4f66a26f8e8368cb9d8a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:03.857461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:03.910671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7eafea4be7d4f66a26f8e8368cb9d8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.911521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7eafea4be7d4f66a26f8e8368cb9d8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.918375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7eafea4be7d4f66a26f8e8368cb9d8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.919042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7eafea4be7d4f66a26f8e8368cb9d8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.926992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-edc92a33-5a7b-4b77-a015-412776ac4312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7eafea4be7d4f66a26f8e8368cb9d8a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:03.944850 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3769/7536] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:13:03 2022] DELETE /identity/v3/users/a7eafea4be7d4f66a26f8e8368cb9d8a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:13:04.940450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:04.942127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:04.961557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ce3da-8a6c-43e2-939e-b13c465c0c24 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:05.110276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:05.112356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.114069 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.114463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] PATH_INFO: `/v3/projects/4e967133349e418281a4ad5174e1ffc7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.117978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e967133349e418281a4ad5174e1ffc7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:05.120942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:05.202223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e967133349e418281a4ad5174e1ffc7', 'request_id': 'req-9aca8c43-d434-4376-b470-804bc40e8fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:05.209550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e967133349e418281a4ad5174e1ffc7', 'request_id': 'req-9aca8c43-d434-4376-b470-804bc40e8fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:05.223325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e967133349e418281a4ad5174e1ffc7', 'request_id': 'req-9aca8c43-d434-4376-b470-804bc40e8fd4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:05.243303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] The token cache is being invalidate because project 4e967133349e418281a4ad5174e1ffc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:13:05.243677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:05.244732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9aca8c43-d434-4376-b470-804bc40e8fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:05.249723 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3768/7537] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:13:04 2022] DELETE /identity/v3/projects/4e967133349e418281a4ad5174e1ffc7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:05.254937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb912422-25eb-4c83-bbe7-299a5a803178 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.255477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb912422-25eb-4c83-bbe7-299a5a803178 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.255477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb912422-25eb-4c83-bbe7-299a5a803178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.274953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cb912422-25eb-4c83-bbe7-299a5a803178 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:05.276186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb912422-25eb-4c83-bbe7-299a5a803178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:05.372636 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3770/7538] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:05.382444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145285-a86d-496b-b11c-3183181abd19 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.382751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145285-a86d-496b-b11c-3183181abd19 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.383133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14145285-a86d-496b-b11c-3183181abd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.414530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-14145285-a86d-496b-b11c-3183181abd19 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:05.416518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-14145285-a86d-496b-b11c-3183181abd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:05.430564 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3769/7539] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:05.433865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb912422-25eb-4c83-bbe7-299a5a803178 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:05.449908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb912422-25eb-4c83-bbe7-299a5a803178 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:05.475897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d739e7-9bc0-4481-8637-2c344c49f990 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.476779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d739e7-9bc0-4481-8637-2c344c49f990 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.477391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d739e7-9bc0-4481-8637-2c344c49f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.484006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:05.487386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.488070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.488547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.489371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:13:05.489688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:05.491386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:05.512281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c6d739e7-9bc0-4481-8637-2c344c49f990 None None] MFA Rules not processed for user `9b4988836610494ab48a138bd43d5b52`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:05.513523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c6d739e7-9bc0-4481-8637-2c344c49f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:05.525115 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3771/7540] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:13:05.532296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:05.557569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871db11-ad5f-4b37-a53f-fa9bfbdaf0de admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:05.563042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:05.563775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.563988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.564994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.566002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:05.568114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:05.587774 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3770/7541] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:05.617901 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3772/7542] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:13:05 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:05.621720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d739e7-9bc0-4481-8637-2c344c49f990 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:05.639859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d739e7-9bc0-4481-8637-2c344c49f990 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:05.760380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:05.763525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.764701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.766447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.768726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:05.775493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:05.831128 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3771/7543] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:13:05 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:13:05.835510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:05.853509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cdd86-a901-4212-a280-0dc88d3bd13f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:05.867332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:05.868028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.868316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.868593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.869367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:05.873642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:05.905854 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3773/7544] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:05.906263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:05.918387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ec3a2-e3a7-42ac-b811-b8d31026654b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:05.943940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e83ca-8aee-4150-81af-3a8c83093f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:05.945485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e83ca-8aee-4150-81af-3a8c83093f8c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.946273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e83ca-8aee-4150-81af-3a8c83093f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.946801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e83ca-8aee-4150-81af-3a8c83093f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:05.947781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e83ca-8aee-4150-81af-3a8c83093f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:05.949713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e83ca-8aee-4150-81af-3a8c83093f8c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:05.966974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:05.974941 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3772/7545] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:13:05.978840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c5c45-1618-4df9-8a52-6513ee36e5a6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:05.994133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:05.994384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:05.994516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:05.994916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] PATH_INFO: `/v3/projects/a6d9793444c547b781cf0c34beb818cd/users/7adf05af487d47d5abf6a1e87cfaafb7/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:06.016528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d9793444c547b781cf0c34beb818cd, user_id=7adf05af487d47d5abf6a1e87cfaafb7, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:06.020810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:06.047065 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3774/7546] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:05 2022] PUT /identity/v3/projects/a6d9793444c547b781cf0c34beb818cd/users/7adf05af487d47d5abf6a1e87cfaafb7/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:06.057199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a355c8-60f6-4018-86ed-2b48ee6c0b3f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:06.057525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a355c8-60f6-4018-86ed-2b48ee6c0b3f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:06.057785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a355c8-60f6-4018-86ed-2b48ee6c0b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:06.177793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a5a355c8-60f6-4018-86ed-2b48ee6c0b3f None None] MFA Rules not processed for user `7adf05af487d47d5abf6a1e87cfaafb7`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:06.180036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a5a355c8-60f6-4018-86ed-2b48ee6c0b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:06.349323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:06.350864 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3773/7547] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:06.452057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9c561-4e39-4849-a275-811dfbbabe9a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:06.457420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:06.458243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:06.458634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:06.459096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:06.459907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:06.462706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:06.517289 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3775/7548] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:13:06 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:06.523191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a355c8-60f6-4018-86ed-2b48ee6c0b3f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:06.538798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a355c8-60f6-4018-86ed-2b48ee6c0b3f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:06.627453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:06.631410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:06.632042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:06.632549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:06.633507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:06.636381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:06.668638 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3774/7549] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:13:06 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:06.672282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:06.685291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e681-b143-42a7-ae23-9bb39989b2e0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:06.693844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:06.694559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:06.694917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:06.695206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:06.696402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:06.698260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:06.712461 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3776/7550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:13:06.716916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:06.734620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb144f67-721b-4407-9e7e-ef1ceac02e7a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:06.751865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:06.754099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:06.754976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:06.755532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] PATH_INFO: `/v3/projects/699549fa4eff47c8878bbd2c70278602/users/cf82ac80809b49aeb2506cecd04f51a1/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:06.781712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=699549fa4eff47c8878bbd2c70278602, user_id=cf82ac80809b49aeb2506cecd04f51a1, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:06.786944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:06.825335 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3775/7551] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:06 2022] PUT /identity/v3/projects/699549fa4eff47c8878bbd2c70278602/users/cf82ac80809b49aeb2506cecd04f51a1/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:06.826291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:06.838051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778386f-f1c0-45c2-9d6b-2e82dc4985c0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:06.978618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933795f-dff6-485d-86c3-4654d42459da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:06.979360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933795f-dff6-485d-86c3-4654d42459da admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:06.979807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933795f-dff6-485d-86c3-4654d42459da admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:06.980094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933795f-dff6-485d-86c3-4654d42459da admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:06.980838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933795f-dff6-485d-86c3-4654d42459da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:06.983074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933795f-dff6-485d-86c3-4654d42459da admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:07.007657 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3777/7552] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:13:07.008792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:07.029660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cbef7-4e58-4fed-a599-a0498a86a793 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:07.037889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:07.046983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:07.047833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:07.048344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] PATH_INFO: `/v3/projects/699549fa4eff47c8878bbd2c70278602/users/cf82ac80809b49aeb2506cecd04f51a1/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:07.053329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] RBAC: Authorizing `identity:create_grant(project_id=699549fa4eff47c8878bbd2c70278602, user_id=cf82ac80809b49aeb2506cecd04f51a1, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:07.057310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:07.073822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3776/7553] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:07 2022] PUT /identity/v3/projects/699549fa4eff47c8878bbd2c70278602/users/cf82ac80809b49aeb2506cecd04f51a1/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:07.084913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7454-ca32-4bbc-b362-87a7044f0181 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:07.086008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7454-ca32-4bbc-b362-87a7044f0181 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:07.086568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b7454-ca32-4bbc-b362-87a7044f0181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:07.128600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9f2b7454-ca32-4bbc-b362-87a7044f0181 None None] MFA Rules not processed for user `cf82ac80809b49aeb2506cecd04f51a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:07.130073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9f2b7454-ca32-4bbc-b362-87a7044f0181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:07.348050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3778/7554] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:07.362224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:07.364668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:07.511930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f0923-d197-4334-89fb-b1fcc79fbcab admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:07.518941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740c5b7-8c96-4b21-abc4-b831e191b2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:07.520667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740c5b7-8c96-4b21-abc4-b831e191b2ae service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:07.520667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740c5b7-8c96-4b21-abc4-b831e191b2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:07.520956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740c5b7-8c96-4b21-abc4-b831e191b2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:07.555467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740c5b7-8c96-4b21-abc4-b831e191b2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:07.557746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740c5b7-8c96-4b21-abc4-b831e191b2ae service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:07.593612 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3777/7555] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:13:07.708760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b7454-ca32-4bbc-b362-87a7044f0181 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:07.861446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b7454-ca32-4bbc-b362-87a7044f0181 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:07.875775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:07.877631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:07.877925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:07.878259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] PATH_INFO: `/v3/users/7adf05af487d47d5abf6a1e87cfaafb7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:07.879615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7adf05af487d47d5abf6a1e87cfaafb7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:07.881587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:07.979841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7adf05af487d47d5abf6a1e87cfaafb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:07.980789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7adf05af487d47d5abf6a1e87cfaafb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:08.007881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7adf05af487d47d5abf6a1e87cfaafb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:08.008977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7adf05af487d47d5abf6a1e87cfaafb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:08.021096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7adf05af487d47d5abf6a1e87cfaafb7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:08.093827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3779/7556] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:13:07 2022] DELETE /identity/v3/users/7adf05af487d47d5abf6a1e87cfaafb7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:08.098583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:08.099169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:08.099268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:08.129360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:08.130519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:08.288391 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3778/7557] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:08.316553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:08.319359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:08.485632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42748a91-abe5-4209-9356-181c677af75e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:08.496732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:08.499667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:08.501668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:08.503798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:08.527813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:08.529288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:08.552440 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3780/7558] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:13:09.088134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:09.089642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:09.138192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834f8df-722a-4804-bf62-3868644c7034 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:09.158922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:09.160099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:09.166563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:09.166563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] PATH_INFO: `/v3/projects/a6d9793444c547b781cf0c34beb818cd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:09.169994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d9793444c547b781cf0c34beb818cd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:09.174548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:09.312430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d9793444c547b781cf0c34beb818cd', 'request_id': 'req-e3efc6cd-5b53-41cd-ad46-c457299dccd0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.326763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d9793444c547b781cf0c34beb818cd', 'request_id': 'req-e3efc6cd-5b53-41cd-ad46-c457299dccd0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.345790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d9793444c547b781cf0c34beb818cd', 'request_id': 'req-e3efc6cd-5b53-41cd-ad46-c457299dccd0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.369479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] The token cache is being invalidate because project a6d9793444c547b781cf0c34beb818cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:13:09.370359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.371615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.373380 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3779/7559] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:13:09 2022] DELETE /identity/v3/projects/a6d9793444c547b781cf0c34beb818cd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:13:09.379037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:09.395836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7416a4-651d-4a5e-92c6-eb468baca974 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:09.500672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:09.502450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:09.502993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:09.503869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] PATH_INFO: `/v3/users/cf82ac80809b49aeb2506cecd04f51a1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:09.505584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf82ac80809b49aeb2506cecd04f51a1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:09.507882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:09.604552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf82ac80809b49aeb2506cecd04f51a1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.605672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf82ac80809b49aeb2506cecd04f51a1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.621992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf82ac80809b49aeb2506cecd04f51a1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.628216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf82ac80809b49aeb2506cecd04f51a1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.659457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f82de6cd-bd56-4dea-92d6-e000e2b93037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf82ac80809b49aeb2506cecd04f51a1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:09.693238 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3781/7560] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:13:09 2022] DELETE /identity/v3/users/cf82ac80809b49aeb2506cecd04f51a1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:11.462728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:11.464763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:11.496165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efc6cd-5b53-41cd-ad46-c457299dccd0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:11.637043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:11.637927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:11.638370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:11.638815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] PATH_INFO: `/v3/projects/699549fa4eff47c8878bbd2c70278602` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:11.640692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] RBAC: Authorizing `identity:delete_project(project_id=699549fa4eff47c8878bbd2c70278602)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:11.644169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:11.772318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699549fa4eff47c8878bbd2c70278602', 'request_id': 'req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:11.815890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699549fa4eff47c8878bbd2c70278602', 'request_id': 'req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:11.829429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699549fa4eff47c8878bbd2c70278602', 'request_id': 'req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:11.846174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] The token cache is being invalidate because project 699549fa4eff47c8878bbd2c70278602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:13:11.846993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:11.849801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7cdd4efd-aad8-4aac-a2ad-84bc0265a10f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:11.853198 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3780/7561] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:13:11 2022] DELETE /identity/v3/projects/699549fa4eff47c8878bbd2c70278602 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:11.859234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ffbd-7983-49f4-a8f4-b401ea4076c7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:11.859659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ffbd-7983-49f4-a8f4-b401ea4076c7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:11.860406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0ffbd-7983-49f4-a8f4-b401ea4076c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:11.896170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0cd0ffbd-7983-49f4-a8f4-b401ea4076c7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:11.898657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0cd0ffbd-7983-49f4-a8f4-b401ea4076c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:11.998044 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3782/7562] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:13:11.999112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca8e08-98cd-41d5-a1a7-ad38f7cf4e3c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:11.999411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca8e08-98cd-41d5-a1a7-ad38f7cf4e3c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:11.999693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca8e08-98cd-41d5-a1a7-ad38f7cf4e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.026045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-34ca8e08-98cd-41d5-a1a7-ad38f7cf4e3c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:12.027482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-34ca8e08-98cd-41d5-a1a7-ad38f7cf4e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:12.038671 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3781/7563] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:12.043572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0ffbd-7983-49f4-a8f4-b401ea4076c7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:12.066529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0ffbd-7983-49f4-a8f4-b401ea4076c7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:12.073238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:12.074241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:12.074796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:12.075278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.076263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:13:12.076857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:12.079113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:12.097277 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3783/7564] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:13:12.098059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca8e08-98cd-41d5-a1a7-ad38f7cf4e3c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:12.121429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca8e08-98cd-41d5-a1a7-ad38f7cf4e3c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:12.144674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:12.145910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:12.163702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:12.164578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.169314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:12.171973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:12.316389 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3782/7565] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:13:12 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:13:12.320412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:12.354962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e3e6-5210-4d73-a554-2430abbcb44c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:12.493032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:12.494896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:12.495192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:12.495472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.496248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:12.498269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:12.561806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3784/7566] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:13:12 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:12.563224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:12.590412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12898737-7edf-406b-9e20-c6faa1950c5c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:12.603402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:12.604082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:12.604370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:12.604637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.605367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:12.607146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:12.634074 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3783/7567] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:12.638751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:12.656626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40bdec-72bd-467e-b4e8-b681b312b5c8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:12.666219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904c51-b03c-4669-9a04-6c26bf01a771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:12.667520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904c51-b03c-4669-9a04-6c26bf01a771 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:12.667957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904c51-b03c-4669-9a04-6c26bf01a771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:12.668379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904c51-b03c-4669-9a04-6c26bf01a771 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.669287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904c51-b03c-4669-9a04-6c26bf01a771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:12.671107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904c51-b03c-4669-9a04-6c26bf01a771 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:12.698121 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3785/7568] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:12.702273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:12.721776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081d07-f3d5-447d-9055-47c346a80f26 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:12.727882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:12.728989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:12.729398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:12.729840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] PATH_INFO: `/v3/projects/d62508bea6e7484ea316f52f4d3b8471/users/313cb56eefdd49cab9f9ddcbfea4ab72/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.771021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62508bea6e7484ea316f52f4d3b8471, user_id=313cb56eefdd49cab9f9ddcbfea4ab72, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:12.773713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:12.802044 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3784/7569] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:12 2022] PUT /identity/v3/projects/d62508bea6e7484ea316f52f4d3b8471/users/313cb56eefdd49cab9f9ddcbfea4ab72/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:12.804120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:12.804400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:12.804684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:12.852731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:12.854353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:13.012556 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3786/7570] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:13.053056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:13.056574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:13.144635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a74632-dfdd-4316-a0e0-5dcd7ef1b684 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:13.148878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1804a-3d1d-4bea-8dd3-a025d8fe1aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:13.150158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1804a-3d1d-4bea-8dd3-a025d8fe1aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:13.150444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1804a-3d1d-4bea-8dd3-a025d8fe1aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:13.150726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1804a-3d1d-4bea-8dd3-a025d8fe1aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:13.163465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1804a-3d1d-4bea-8dd3-a025d8fe1aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:13.165154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1804a-3d1d-4bea-8dd3-a025d8fe1aa3 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:13.180840 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3785/7571] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:13:13.349655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:13.351239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:13.489924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9d51-3657-404d-9b7d-66af49f6176a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:13.498921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:13.499961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:13.500436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:13.500922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:13.516000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:13.624123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:13.626257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:13.637805 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3787/7572] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:13:15.887816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cec56-3219-4091-ac2b-f2aa01397b88 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:15.888708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cec56-3219-4091-ac2b-f2aa01397b88 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:15.889154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cec56-3219-4091-ac2b-f2aa01397b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:15.979020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7d8cec56-3219-4091-ac2b-f2aa01397b88 None None] MFA Rules not processed for user `313cb56eefdd49cab9f9ddcbfea4ab72`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:15.981103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7d8cec56-3219-4091-ac2b-f2aa01397b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:16.077849 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3786/7573] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:16.082546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:16.094941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea0714-c680-4423-898c-84627d6737eb service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:16.101572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69549b4-d0ae-4682-b712-5e45af703a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:16.103033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69549b4-d0ae-4682-b712-5e45af703a4c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:16.103528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69549b4-d0ae-4682-b712-5e45af703a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:16.104006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69549b4-d0ae-4682-b712-5e45af703a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:16.105111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69549b4-d0ae-4682-b712-5e45af703a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:16.107361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69549b4-d0ae-4682-b712-5e45af703a4c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:16.145723 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3788/7574] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:13:16 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:16.146387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cec56-3219-4091-ac2b-f2aa01397b88 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:16.161995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cec56-3219-4091-ac2b-f2aa01397b88 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:16.218329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb90c8e-d27a-4a79-a0e2-100e28d53c9d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:16.218329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb90c8e-d27a-4a79-a0e2-100e28d53c9d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:16.218587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb90c8e-d27a-4a79-a0e2-100e28d53c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:16.248324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1cb90c8e-d27a-4a79-a0e2-100e28d53c9d None None] MFA Rules not processed for user `1e6cebb5024540799cabee75ff002d69`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:16.249706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1cb90c8e-d27a-4a79-a0e2-100e28d53c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:16.306329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:16.307503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:16.309003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:16.309478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:16.311682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:16.314102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:16.363517 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3789/7575] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:16.365646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb90c8e-d27a-4a79-a0e2-100e28d53c9d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:16.365783 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3787/7576] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:13:16 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:16.383295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb90c8e-d27a-4a79-a0e2-100e28d53c9d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:16.390372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:16.391475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:16.393344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:16.393773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:16.394674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:16.396858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:16.415337 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3790/7577] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:16.420255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:16.439507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839da8f-13aa-45ca-b56c-539c7cd96d77 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:16.450988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:16.452079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:16.452373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:16.452666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] PATH_INFO: `/v3/projects/c1301e210921401c9e3fddc818534f36/users/d7e6991fba1346d58d49f5952fbafb79/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:16.493036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1301e210921401c9e3fddc818534f36, user_id=d7e6991fba1346d58d49f5952fbafb79, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:16.496041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:16.529448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3788/7578] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:16 2022] PUT /identity/v3/projects/c1301e210921401c9e3fddc818534f36/users/d7e6991fba1346d58d49f5952fbafb79/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:13:16.532000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:16.580877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9cd5d-f306-469b-b75e-342b51417d6c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:16.688527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8c45b-14d1-4696-a763-44eb8e86b849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:16.689873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8c45b-14d1-4696-a763-44eb8e86b849 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:16.690382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8c45b-14d1-4696-a763-44eb8e86b849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:16.690735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8c45b-14d1-4696-a763-44eb8e86b849 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:16.691566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8c45b-14d1-4696-a763-44eb8e86b849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:16.693948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8c45b-14d1-4696-a763-44eb8e86b849 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:16.712967 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3791/7579] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:16.714805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:16.750344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91223637-acfd-470f-acf4-87bf93699f0b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:16.763108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a069d-388f-4e0e-a5b8-976ca059f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:16.764579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a069d-388f-4e0e-a5b8-976ca059f6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:16.765084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a069d-388f-4e0e-a5b8-976ca059f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:16.765799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a069d-388f-4e0e-a5b8-976ca059f6d5 admin admin] PATH_INFO: `/v3/projects/c1301e210921401c9e3fddc818534f36/users/d7e6991fba1346d58d49f5952fbafb79/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:16.776777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a069d-388f-4e0e-a5b8-976ca059f6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1301e210921401c9e3fddc818534f36, user_id=d7e6991fba1346d58d49f5952fbafb79, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:16.781306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a069d-388f-4e0e-a5b8-976ca059f6d5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:16.804895 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3789/7580] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:16 2022] PUT /identity/v3/projects/c1301e210921401c9e3fddc818534f36/users/d7e6991fba1346d58d49f5952fbafb79/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:18.647240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bd43b-aaf4-4d2f-851c-7ab540551f81 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:18.647697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bd43b-aaf4-4d2f-851c-7ab540551f81 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:18.647769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bd43b-aaf4-4d2f-851c-7ab540551f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:18.707250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-616bd43b-aaf4-4d2f-851c-7ab540551f81 None None] MFA Rules not processed for user `d7e6991fba1346d58d49f5952fbafb79`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:18.710011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-616bd43b-aaf4-4d2f-851c-7ab540551f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:18.868423 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3792/7581] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:18.880912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120d32-c85a-4456-827e-f11c763b66a0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:18.881439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120d32-c85a-4456-827e-f11c763b66a0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:18.881742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00120d32-c85a-4456-827e-f11c763b66a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:18.930985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-00120d32-c85a-4456-827e-f11c763b66a0 None None] MFA Rules not processed for user `313cb56eefdd49cab9f9ddcbfea4ab72`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:18.935070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00120d32-c85a-4456-827e-f11c763b66a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:19.148634 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3790/7582] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:19.277314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bd43b-aaf4-4d2f-851c-7ab540551f81 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:19.516639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bd43b-aaf4-4d2f-851c-7ab540551f81 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:19.535850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:19.536699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:19.536829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:19.537074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:19.562143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:19.563810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:19.593046 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3793/7583] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:13:28.728359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5709b4d-af12-4081-8e0b-250ea3518d7e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:28.729196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5709b4d-af12-4081-8e0b-250ea3518d7e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:28.729477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5709b4d-af12-4081-8e0b-250ea3518d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:28.751848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e5709b4d-af12-4081-8e0b-250ea3518d7e None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:28.753293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e5709b4d-af12-4081-8e0b-250ea3518d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:28.850242 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3791/7584] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:13:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:28.924288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:28.926488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:29.155616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd4b6a-ddef-4603-a3ed-0de52f0b9307 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:29.179976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:29.181081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:29.189597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:29.190260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:29.226533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:29.229146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:29.251009 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3794/7585] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:13:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:13:29.719617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:29.720738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:29.721228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:29.741081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] MFA Rules not processed for user `9b4988836610494ab48a138bd43d5b52`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:29.743132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:29.826852 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3792/7586] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:40.368466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:40.448603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b7dcf-f38d-4514-b323-b02b4c067d56 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:40.453130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:40.453846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:40.454197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:40.454817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:40.457216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:40.546569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:40.549180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:40.560141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3795/7587] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:13:42.039841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:42.042518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:42.086707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd3444-1e6f-4e2e-8187-093ca14960f8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:42.101583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:42.102811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:42.104063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:42.106666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] PATH_INFO: `/v3/users/97ef9a3039534d90ba9d268970cbe9d4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:42.108919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ef9a3039534d90ba9d268970cbe9d4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:42.111755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:42.249150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ef9a3039534d90ba9d268970cbe9d4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:42.260944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ef9a3039534d90ba9d268970cbe9d4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:42.262763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ef9a3039534d90ba9d268970cbe9d4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:42.270706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ef9a3039534d90ba9d268970cbe9d4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:42.284720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3c4f5e2d-9976-4248-931c-56236d34f8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ef9a3039534d90ba9d268970cbe9d4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:42.317645 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3793/7588] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:13:42 2022] DELETE /identity/v3/users/97ef9a3039534d90ba9d268970cbe9d4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:42.957135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:42.985462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ea471-3755-448d-8eef-4388e8b3a509 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:43.158394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:43.159306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:43.159591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:43.159869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] PATH_INFO: `/v3/projects/72be56c2d4a54014a8f741c451fe014e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:43.162038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72be56c2d4a54014a8f741c451fe014e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:43.169411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:43.274633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72be56c2d4a54014a8f741c451fe014e', 'request_id': 'req-0d772d68-a53a-41b6-8328-845b0fd1aa57'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:43.301035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72be56c2d4a54014a8f741c451fe014e', 'request_id': 'req-0d772d68-a53a-41b6-8328-845b0fd1aa57'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:43.316401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72be56c2d4a54014a8f741c451fe014e', 'request_id': 'req-0d772d68-a53a-41b6-8328-845b0fd1aa57'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:43.342028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] The token cache is being invalidate because project 72be56c2d4a54014a8f741c451fe014e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:13:43.342634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:43.344124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0d772d68-a53a-41b6-8328-845b0fd1aa57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:13:43.346476 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3796/7589] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:13:42 2022] DELETE /identity/v3/projects/72be56c2d4a54014a8f741c451fe014e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:43.351346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e051d12-a43e-4562-89ca-eea5996cc55e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:43.351854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e051d12-a43e-4562-89ca-eea5996cc55e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:43.351965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e051d12-a43e-4562-89ca-eea5996cc55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:43.383857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8e051d12-a43e-4562-89ca-eea5996cc55e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:43.387488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8e051d12-a43e-4562-89ca-eea5996cc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:43.478920 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3794/7590] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:43.487988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc7f8-6ec7-4412-bb3f-4729f5c004cc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:43.487988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc7f8-6ec7-4412-bb3f-4729f5c004cc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:43.488223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc7f8-6ec7-4412-bb3f-4729f5c004cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:43.523903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d83dc7f8-6ec7-4412-bb3f-4729f5c004cc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:43.525103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d83dc7f8-6ec7-4412-bb3f-4729f5c004cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:43.554350 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3797/7591] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:43.558321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e051d12-a43e-4562-89ca-eea5996cc55e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:43.574397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e051d12-a43e-4562-89ca-eea5996cc55e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:43.591041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:43.592354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:43.592825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:43.593654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:43.594701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:13:43.595787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:43.603045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:43.658877 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3795/7592] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:13:43.663839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc7f8-6ec7-4412-bb3f-4729f5c004cc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:43.684405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc7f8-6ec7-4412-bb3f-4729f5c004cc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:43.695367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:43.696309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:43.696734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:43.702950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:43.705066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:43.708004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:43.753767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:43.758716 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3798/7593] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:13:43 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:43.772176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242762a-55aa-4950-bee8-066c4e809589 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:43.877967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:43.878286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:43.878784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:43.879230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:43.880063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:43.883555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:43.928676 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3796/7594] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:13:43 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:43.936156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:43.952837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501164e1-54e2-4aed-b783-81349e0ee8cd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:43.969089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:43.971341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:43.971853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:43.972541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:43.976558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:43.980291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:44.008070 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3799/7595] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:44.012278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:44.037254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a44521-e12e-4c8e-8285-3b57e549f326 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:44.044004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4d6f2-f700-49f4-99bb-fccf04718167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:44.044869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d6f2-f700-49f4-99bb-fccf04718167 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:44.045326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d6f2-f700-49f4-99bb-fccf04718167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:44.045754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d6f2-f700-49f4-99bb-fccf04718167 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:44.046851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4d6f2-f700-49f4-99bb-fccf04718167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:44.051521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4d6f2-f700-49f4-99bb-fccf04718167 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:44.076235 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3797/7596] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:44.082058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:44.098663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ba88-578f-43b9-854c-967e5b65620b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:44.105654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:44.106719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:44.107612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:44.108023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] PATH_INFO: `/v3/projects/c642a488de414517ac98cee7e2cc2406/users/a29e307a46c4444cbe01dbeb1ebbed81/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:44.132889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c642a488de414517ac98cee7e2cc2406, user_id=a29e307a46c4444cbe01dbeb1ebbed81, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:44.137369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:44.194231 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3800/7597] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:44 2022] PUT /identity/v3/projects/c642a488de414517ac98cee7e2cc2406/users/a29e307a46c4444cbe01dbeb1ebbed81/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:44.196741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:44.197168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:44.197554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:44.203315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:44.205508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:44.248560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:44.260455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:44.348965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027dc97-f8ba-4b77-9f35-0916dbb48284 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:44.370794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef5e8b-2542-4e84-b2a3-71fccafc6af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:44.370794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5e8b-2542-4e84-b2a3-71fccafc6af0 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:44.370794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5e8b-2542-4e84-b2a3-71fccafc6af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:44.370794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef5e8b-2542-4e84-b2a3-71fccafc6af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:44.372746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-85ef5e8b-2542-4e84-b2a3-71fccafc6af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:44.418626 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3798/7598] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:44.432960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:44.434713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:44.528135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef5e8b-2542-4e84-b2a3-71fccafc6af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:44.531414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef5e8b-2542-4e84-b2a3-71fccafc6af0 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:44.555568 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3801/7599] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:13:44.569073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6d243-d38f-4fb0-a712-a9878a4978b2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:44.573665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:44.574600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:44.575135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:44.575630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:44.594873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:44.596779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:44.627475 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3799/7600] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:13:48.507364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52375ff8-d045-4982-bfca-43b840cd4c18 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:48.512370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52375ff8-d045-4982-bfca-43b840cd4c18 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:48.512692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52375ff8-d045-4982-bfca-43b840cd4c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:48.573502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-52375ff8-d045-4982-bfca-43b840cd4c18 None None] MFA Rules not processed for user `a29e307a46c4444cbe01dbeb1ebbed81`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:48.575056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-52375ff8-d045-4982-bfca-43b840cd4c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:48.704549 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3802/7601] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:48.706170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:48.717811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95242d-e9c5-4f7c-bb90-ee6aaa5c080e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:48.724033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:48.724974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:48.725425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:48.725857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:48.726712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:48.729633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:48.788148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52375ff8-d045-4982-bfca-43b840cd4c18 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:48.803219 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3800/7602] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:13:48 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:13:48.812260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52375ff8-d045-4982-bfca-43b840cd4c18 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:49.007303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:49.010328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:49.011433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:49.011781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:49.013729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:49.019484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:49.072390 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3803/7603] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:13:48 2022] POST /identity/v3/users => generated 295 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:13:49.076602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:49.098990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd68ba-909d-498c-82aa-841d17af092a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:49.107657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:49.108675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:49.109064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:49.109432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:49.113505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:49.116312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:49.136285 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3801/7604] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:49.140410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:49.150311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:49.158549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ad969-7797-43e7-a925-a279ab59a704 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:49.158792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:49.166714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:49.167951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:49.168313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:49.169428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] PATH_INFO: `/v3/projects/50894f3848d740ad9eae95bed504d406/users/04028d57695e49db9230f9b6e0674327/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:49.196283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50894f3848d740ad9eae95bed504d406, user_id=04028d57695e49db9230f9b6e0674327, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:49.201703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:49.241027 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3804/7605] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:49 2022] PUT /identity/v3/projects/50894f3848d740ad9eae95bed504d406/users/04028d57695e49db9230f9b6e0674327/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:49.242654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:49.332330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d0d98-0a7e-48fd-9cf2-e9887069381d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:49.342541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd1a49-35ad-42dd-9ce5-52d5a8d048f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:49.351303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:49.352062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:49.352448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:49.352859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:49.355927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:49.358064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:49.373192 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3805/7606] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:13:49.377195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:49.408994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8fb2-daee-4b9f-8344-c8dbc4304d38 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:49.415653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cf5c7-ef4c-4f49-98bc-00d795ffd932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:49.416745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf5c7-ef4c-4f49-98bc-00d795ffd932 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:49.417226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf5c7-ef4c-4f49-98bc-00d795ffd932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:49.417613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cf5c7-ef4c-4f49-98bc-00d795ffd932 admin admin] PATH_INFO: `/v3/projects/50894f3848d740ad9eae95bed504d406/users/04028d57695e49db9230f9b6e0674327/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:49.431213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cf5c7-ef4c-4f49-98bc-00d795ffd932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50894f3848d740ad9eae95bed504d406, user_id=04028d57695e49db9230f9b6e0674327, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:49.434804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0e50a-9a0c-4fbe-b923-ffc03114ccd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:49.435811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e50a-9a0c-4fbe-b923-ffc03114ccd3 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:49.436254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e50a-9a0c-4fbe-b923-ffc03114ccd3 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:49.436690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e50a-9a0c-4fbe-b923-ffc03114ccd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:49.437998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cf5c7-ef4c-4f49-98bc-00d795ffd932 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:49.439475 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38a0e50a-9a0c-4fbe-b923-ffc03114ccd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:49.458812 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3806/7607] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:13:49 2022] PUT /identity/v3/projects/50894f3848d740ad9eae95bed504d406/users/04028d57695e49db9230f9b6e0674327/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:13:49.470900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0e50a-9a0c-4fbe-b923-ffc03114ccd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:49.472676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0e50a-9a0c-4fbe-b923-ffc03114ccd3 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:49.495357 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3802/7608] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:13:50.625463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:50.626666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:50.626666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:50.664970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] MFA Rules not processed for user `04028d57695e49db9230f9b6e0674327`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:50.666241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:50.839878 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3807/7609] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:13:50.851798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:50.852351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:50.852351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:50.887485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] MFA Rules not processed for user `a29e307a46c4444cbe01dbeb1ebbed81`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:13:50.888808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:51.012680 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3803/7610] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:13:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:13:51.024160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:13:51.026051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:13:51.209325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421eff0-fa01-410a-a7dc-89d0d6203859 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:13:51.238023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:13:51.238933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:13:51.242456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:13:51.242882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:13:51.271287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:13:51.273006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:13:51.309748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3808/7611] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:13:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:10.002128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:10.007173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:10.124653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f12af-d755-478b-8dc7-a0b9ab52b091 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:10.138879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:10.139785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:10.142473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:10.142977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] PATH_INFO: `/v3/users/313cb56eefdd49cab9f9ddcbfea4ab72` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:10.145223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=313cb56eefdd49cab9f9ddcbfea4ab72)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:10.148145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:10.240136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313cb56eefdd49cab9f9ddcbfea4ab72'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.248364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313cb56eefdd49cab9f9ddcbfea4ab72'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.249210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313cb56eefdd49cab9f9ddcbfea4ab72'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.249884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313cb56eefdd49cab9f9ddcbfea4ab72'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.259220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313cb56eefdd49cab9f9ddcbfea4ab72'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.280913 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3804/7612] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:10 2022] DELETE /identity/v3/users/313cb56eefdd49cab9f9ddcbfea4ab72 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:10.488934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:10.503942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a825a6-4241-44ce-b146-dce0ade28b3a service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:10.616080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:10.616958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:10.617239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:10.617513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] PATH_INFO: `/v3/projects/d62508bea6e7484ea316f52f4d3b8471` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:10.618811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62508bea6e7484ea316f52f4d3b8471)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:10.620848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:10.705099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62508bea6e7484ea316f52f4d3b8471', 'request_id': 'req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.717171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62508bea6e7484ea316f52f4d3b8471', 'request_id': 'req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.736958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62508bea6e7484ea316f52f4d3b8471', 'request_id': 'req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.752398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] The token cache is being invalidate because project d62508bea6e7484ea316f52f4d3b8471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:10.752921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.753637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:10.755278 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3809/7613] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:10 2022] DELETE /identity/v3/projects/d62508bea6e7484ea316f52f4d3b8471 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:10.760209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:10.762466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:10.785000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34b9b4-eb44-41a1-a25b-0faf7edc99bd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:10.879278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:10.880457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:10.881279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:10.881709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] PATH_INFO: `/v3/users/d7e6991fba1346d58d49f5952fbafb79` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:10.884612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e6991fba1346d58d49f5952fbafb79)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:10.887315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:10.998191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e6991fba1346d58d49f5952fbafb79'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:11.007257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e6991fba1346d58d49f5952fbafb79'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:11.008848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e6991fba1346d58d49f5952fbafb79'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:11.012856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e6991fba1346d58d49f5952fbafb79'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:11.036212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-934a4dc1-cd05-49f4-9ab2-d0ac0d59300f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e6991fba1346d58d49f5952fbafb79'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:11.065750 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3805/7614] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:10 2022] DELETE /identity/v3/users/d7e6991fba1346d58d49f5952fbafb79 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:11.563213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:11.564981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:11.598699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cdd19-de66-4273-9d10-78ccd8b9a89f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:11.712826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:11.714252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:11.714570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:11.757026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] PATH_INFO: `/v3/projects/c1301e210921401c9e3fddc818534f36` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:11.763418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1301e210921401c9e3fddc818534f36)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:11.770604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:11.930484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1301e210921401c9e3fddc818534f36', 'request_id': 'req-31059e0b-1e96-48a6-b3a3-826fb63be8ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:11.948031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1301e210921401c9e3fddc818534f36', 'request_id': 'req-31059e0b-1e96-48a6-b3a3-826fb63be8ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:11.970806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1301e210921401c9e3fddc818534f36', 'request_id': 'req-31059e0b-1e96-48a6-b3a3-826fb63be8ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:12.021461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] The token cache is being invalidate because project c1301e210921401c9e3fddc818534f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:12.022396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:12.024877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-31059e0b-1e96-48a6-b3a3-826fb63be8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:12.032117 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3810/7615] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:11 2022] DELETE /identity/v3/projects/c1301e210921401c9e3fddc818534f36 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:12.037220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e28e2-a964-4207-9c27-caeff0923622 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.037689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e28e2-a964-4207-9c27-caeff0923622 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.037812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e28e2-a964-4207-9c27-caeff0923622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.083023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-469e28e2-a964-4207-9c27-caeff0923622 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:12.086191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-469e28e2-a964-4207-9c27-caeff0923622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:12.228182 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3806/7616] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:12.236127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae58c0-f58e-48d0-b984-6d275faf0c2a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.236552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae58c0-f58e-48d0-b984-6d275faf0c2a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.236835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae58c0-f58e-48d0-b984-6d275faf0c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.274647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-beae58c0-f58e-48d0-b984-6d275faf0c2a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:12.276083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-beae58c0-f58e-48d0-b984-6d275faf0c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:12.302820 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3811/7617] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:12.305154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e28e2-a964-4207-9c27-caeff0923622 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:12.317896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e28e2-a964-4207-9c27-caeff0923622 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:12.323961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:12.324998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.325293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.325573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.326465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:12.326796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:12.329792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:12.359075 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3807/7618] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:12.360925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae58c0-f58e-48d0-b984-6d275faf0c2a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:12.376126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae58c0-f58e-48d0-b984-6d275faf0c2a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:12.383301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:12.384280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.384969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.385422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.386328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:12.388700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:12.445742 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3812/7619] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:12 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:12.451082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:12.467017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18b543-ced7-46fc-ab3c-5b2913de91fe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:12.555724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:12.556851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.558733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.559249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.560191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:12.564316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:12.599047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:12.600096 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3808/7620] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:12 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:12.617156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6583d-5feb-4160-97b1-fcf9ec33030f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:12.626473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:12.626893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.627176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.627445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.628178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:12.629843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:12.646451 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3813/7621] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:12.650279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:12.663954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab1df5-2bd3-4d9d-8749-7147b6cab250 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:12.670632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d446f5-7beb-46e9-86fe-6f98397388aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:12.671359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d446f5-7beb-46e9-86fe-6f98397388aa admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.672228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d446f5-7beb-46e9-86fe-6f98397388aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.672534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d446f5-7beb-46e9-86fe-6f98397388aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.673337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d446f5-7beb-46e9-86fe-6f98397388aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:12.675449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d446f5-7beb-46e9-86fe-6f98397388aa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:12.695639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3809/7622] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:12.697922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:12.710998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91834cfe-38d7-4d2a-8264-a4e8b8dc2703 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:12.719158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:12.720615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.721131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.721620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] PATH_INFO: `/v3/projects/c9548c9329cb4d1faef44a66d7c11a5c/users/bb78a689b62644ec84725e7d8dba0141/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.747383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9548c9329cb4d1faef44a66d7c11a5c, user_id=bb78a689b62644ec84725e7d8dba0141, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:12.752455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:12.783217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:12.783775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:12.784214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:12.785976 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3814/7623] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:12 2022] PUT /identity/v3/projects/c9548c9329cb4d1faef44a66d7c11a5c/users/bb78a689b62644ec84725e7d8dba0141/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:14:12.811571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:12.814975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:12.918862 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3810/7624] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:12.938953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:12.940759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:13.094842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b338b8e-e426-41a0-9da9-fc48b08f0231 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:13.106660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:13.106870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:13.107405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:13.107523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:13.134217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:13.137232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:13.152309 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3815/7625] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:17.787655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:17.789522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:17.941549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04660e55-4290-442f-9c50-5b9069e46d01 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:17.950340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a368c8-b91d-4f80-8058-83338f0d497b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:17.951191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a368c8-b91d-4f80-8058-83338f0d497b service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:17.951616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a368c8-b91d-4f80-8058-83338f0d497b service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:17.951961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a368c8-b91d-4f80-8058-83338f0d497b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:17.955449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-42a368c8-b91d-4f80-8058-83338f0d497b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:17.988373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a368c8-b91d-4f80-8058-83338f0d497b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:17.990129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a368c8-b91d-4f80-8058-83338f0d497b service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:18.007897 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3811/7626] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:19.430728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:19.440063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:19.475914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a5e5a-3ec0-4d2b-907e-c492f7aed8ef service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:19.482352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:19.483280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:19.483570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:19.483850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] PATH_INFO: `/v3/users/ceb8a4753c9d4d6e965429b0bfc0d308` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:19.485855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb8a4753c9d4d6e965429b0bfc0d308)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:19.488411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:19.598905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb8a4753c9d4d6e965429b0bfc0d308'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:19.600493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb8a4753c9d4d6e965429b0bfc0d308'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:19.620908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb8a4753c9d4d6e965429b0bfc0d308'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:19.621710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb8a4753c9d4d6e965429b0bfc0d308'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:19.642786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb8a4753c9d4d6e965429b0bfc0d308'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:19.700968 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3816/7627] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:19 2022] DELETE /identity/v3/users/ceb8a4753c9d4d6e965429b0bfc0d308 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:19.704382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:19.704902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:19.705093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:19.734948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:19.737017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:19.830536 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3812/7628] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:19.873636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:19.875233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:19.987038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1d15e-eaba-42c1-9e41-48733470c7d9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:20.003750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:20.004316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:20.004602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:20.004971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:20.025030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:20.026551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:20.040055 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3817/7629] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:20.817028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:20.819132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:20.835838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fc175-c1a4-43fe-aad0-85fa341d68b4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:20.842821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:20.844110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:20.844566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:20.845035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] PATH_INFO: `/v3/projects/9871aa16c54d4751ac838e07d52897a6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:20.846526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9871aa16c54d4751ac838e07d52897a6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:20.848874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:20.903216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:20.905313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:20.953052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6abe9-874d-4f0f-a4db-3a850a4b35c3 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:20.957995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9871aa16c54d4751ac838e07d52897a6', 'request_id': 'req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:20.979383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9871aa16c54d4751ac838e07d52897a6', 'request_id': 'req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:20.993316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9871aa16c54d4751ac838e07d52897a6', 'request_id': 'req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.010684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] The token cache is being invalidate because project 9871aa16c54d4751ac838e07d52897a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:21.011166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.012098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8c16b1fa-f974-46da-82e6-7ac71eeba9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.014290 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3813/7630] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:20 2022] DELETE /identity/v3/projects/9871aa16c54d4751ac838e07d52897a6 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:21.021860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586c2e-b6dd-4586-933f-99de4ccc073d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.022276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586c2e-b6dd-4586-933f-99de4ccc073d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.022599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586c2e-b6dd-4586-933f-99de4ccc073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.048519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-90586c2e-b6dd-4586-933f-99de4ccc073d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:21.050479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90586c2e-b6dd-4586-933f-99de4ccc073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:21.100327 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:21.101422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.101767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.102403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] PATH_INFO: `/v3/users/1e6cebb5024540799cabee75ff002d69` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.104466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6cebb5024540799cabee75ff002d69)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:21.108552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:21.133818 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3814/7631] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:14:21.141740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6301-337a-4013-9e91-cb232979c5dd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.143032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6301-337a-4013-9e91-cb232979c5dd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.143643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca6301-337a-4013-9e91-cb232979c5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.174464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7aca6301-337a-4013-9e91-cb232979c5dd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:21.187488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7aca6301-337a-4013-9e91-cb232979c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:21.219704 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3815/7632] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:21.222652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6301-337a-4013-9e91-cb232979c5dd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:21.225050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6cebb5024540799cabee75ff002d69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.225852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6cebb5024540799cabee75ff002d69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.238355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca6301-337a-4013-9e91-cb232979c5dd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:21.246148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:21.246340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6cebb5024540799cabee75ff002d69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.246843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6cebb5024540799cabee75ff002d69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.247628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.248866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.249437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.250737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:21.251411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:21.253613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:21.261832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6cebb5024540799cabee75ff002d69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:21.276089 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3816/7633] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:21.277117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:21.279523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:21.300953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891b53e-fa60-4a94-852c-f1c44cdf8b2c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:21.308158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:21.309716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.310292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.310877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.312723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:21.316111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:21.322193 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3818/7634] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:20 2022] DELETE /identity/v3/users/1e6cebb5024540799cabee75ff002d69 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:21.399673 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3817/7635] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:21 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:21.402024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:21.519953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d3f0a-217b-4180-b9d8-d3a8b0b6a8e5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:21.602258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:21.603045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.603334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.603611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.604347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:21.606582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:21.636802 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3819/7636] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:21 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:14:21.641212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:21.656936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8715f0-f18a-4f25-9655-4569ad933e2c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:21.666490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:21.667452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.667739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.668605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.669375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:21.673444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:21.691335 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3818/7637] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:21.695223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:21.727889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e114e01-fdbf-447d-ac1e-8bdad405747e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:21.742311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995356c-8ed7-4df1-b07f-3cfda5ed35df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:21.745159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995356c-8ed7-4df1-b07f-3cfda5ed35df admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.745620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995356c-8ed7-4df1-b07f-3cfda5ed35df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.746884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995356c-8ed7-4df1-b07f-3cfda5ed35df admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.751196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995356c-8ed7-4df1-b07f-3cfda5ed35df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:21.756046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995356c-8ed7-4df1-b07f-3cfda5ed35df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:21.775813 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3820/7638] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:14:21.780582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:21.797291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755490c-ab13-40af-9179-e04a3be204fe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:21.805705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:21.806917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.807290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.807636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] PATH_INFO: `/v3/projects/d92ef52cd10747ffbb5c5d494e0ed006/users/b26898640e33414c9f52151aa2104bd2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.832457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92ef52cd10747ffbb5c5d494e0ed006, user_id=b26898640e33414c9f52151aa2104bd2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:21.836672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:21.873079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:21.873602 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3819/7639] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:21 2022] PUT /identity/v3/projects/d92ef52cd10747ffbb5c5d494e0ed006/users/b26898640e33414c9f52151aa2104bd2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:21.873747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:21.873902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:21.943993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:21.949184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:21.955926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] MFA Rules not processed for user `b26898640e33414c9f52151aa2104bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:21.957910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.108109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f0bb-4731-43f1-8ee7-5e387615db0b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:22.115079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:22.116030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.116847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.117315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] PATH_INFO: `/v3/projects/b29256ef64d74a5297507ca500a9468e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.118899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29256ef64d74a5297507ca500a9468e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:22.121140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:22.144902 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3821/7640] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:22.145666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.147308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.174083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902ff68-eafd-4f78-9d83-3ebee0eb8bc9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:22.190128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:22.191037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.191346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.191762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] PATH_INFO: `/v3/users/dfc77c00843b4867833f423b78bb4f76` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.195777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc77c00843b4867833f423b78bb4f76)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:22.203826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:22.248233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29256ef64d74a5297507ca500a9468e', 'request_id': 'req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.263196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29256ef64d74a5297507ca500a9468e', 'request_id': 'req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.280056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29256ef64d74a5297507ca500a9468e', 'request_id': 'req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.292936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc77c00843b4867833f423b78bb4f76'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.293815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc77c00843b4867833f423b78bb4f76'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.303501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc77c00843b4867833f423b78bb4f76'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.306430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc77c00843b4867833f423b78bb4f76'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.308639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] The token cache is being invalidate because project b29256ef64d74a5297507ca500a9468e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:22.309109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.310154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.313360 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3820/7641] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:21 2022] DELETE /identity/v3/projects/b29256ef64d74a5297507ca500a9468e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:22.314353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.316899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.342589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1e367f4b-4839-4204-b43e-d213f7582dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc77c00843b4867833f423b78bb4f76'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:22.377469 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3822/7642] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:22 2022] DELETE /identity/v3/users/dfc77c00843b4867833f423b78bb4f76 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:22.379195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8353-1b9b-4f6b-ad54-80f0753fd7dc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.380359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8353-1b9b-4f6b-ad54-80f0753fd7dc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.381007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea8353-1b9b-4f6b-ad54-80f0753fd7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.429620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-40ea8353-1b9b-4f6b-ad54-80f0753fd7dc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:22.431243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-40ea8353-1b9b-4f6b-ad54-80f0753fd7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.451209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dce9f-c070-4389-a49c-e0a014d3b1b4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:22.563344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:22.564021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.564514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.564634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.566416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.567789 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3823/7643] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:22.576088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635772ce-f9c8-446f-8629-108b6ed66d8f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.576528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635772ce-f9c8-446f-8629-108b6ed66d8f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.576803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635772ce-f9c8-446f-8629-108b6ed66d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.606353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-635772ce-f9c8-446f-8629-108b6ed66d8f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:22.608040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-635772ce-f9c8-446f-8629-108b6ed66d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.618127 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3824/7644] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:22.619783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.620200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.620490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.642282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:22.644039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.656498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:22.656823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:22.657319 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3825/7645] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:22.658508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.660239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.669206 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3821/7646] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:22.670092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.679529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb48e55-f9ac-46ea-8872-30068ba35768 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:22.684081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:22.684504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1412bd-cdd8-4bca-a40f-e49e59c9d7ee service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:22.686015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.686657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.687918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.690126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:22.690914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.691206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.691484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.692394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:22.692707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:22.694888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:22.706434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:22.712774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:22.718009 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3822/7647] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:22.722486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.730032 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3826/7648] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:22.737804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec8bb3-de2f-4c86-85e5-811350da4dc4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:22.744950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:22.745797 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.746118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.746397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.747781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:22.751501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:22.818477 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3823/7649] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:22 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:22.819067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.834709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b840e4-0083-4d1c-83b1-e6c43ba1936d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:22.934921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:22.935763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:22.936281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:22.936658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:22.938014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:22.940618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:22.974506 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3827/7650] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:22 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:22.977161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.982617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:22.985151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:22.998130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2584de-e90c-4308-864f-52486e19df8a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.008339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.009259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.009725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.014321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.016664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.019352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.041493 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3824/7651] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:23.042666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:23.060481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7b084-051b-49e5-ba22-bfda8dcf2b13 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.065282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe60766-c8ed-4d23-bc39-ec352afd1fc6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.068853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.069691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.070160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.070519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.071822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.074003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.080793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.081693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.088488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.088792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] PATH_INFO: `/v3/projects/586495fb86064013a37b42a6b3d382fb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.090457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=586495fb86064013a37b42a6b3d382fb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.092582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.100800 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3825/7652] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:23.104939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:23.127072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcbfb-770c-4865-805e-0ca6e57eb116 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.134925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdf685-cc82-4e14-8fe7-061472e30a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.136255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf685-cc82-4e14-8fe7-061472e30a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.137741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf685-cc82-4e14-8fe7-061472e30a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.138482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf685-cc82-4e14-8fe7-061472e30a88 admin admin] PATH_INFO: `/v3/projects/a957e2fe79f14ab594c4edbb13bce7bd/users/5bb1c1f4d3874463a29a59a93c769640/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.177726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdf685-cc82-4e14-8fe7-061472e30a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a957e2fe79f14ab594c4edbb13bce7bd, user_id=5bb1c1f4d3874463a29a59a93c769640, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.180906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdf685-cc82-4e14-8fe7-061472e30a88 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.208624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586495fb86064013a37b42a6b3d382fb', 'request_id': 'req-63506411-975c-4a02-be23-9d48aaddf657'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:23.209860 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3826/7653] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:23 2022] PUT /identity/v3/projects/a957e2fe79f14ab594c4edbb13bce7bd/users/5bb1c1f4d3874463a29a59a93c769640/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:23.212842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.213137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.213515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.224980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586495fb86064013a37b42a6b3d382fb', 'request_id': 'req-63506411-975c-4a02-be23-9d48aaddf657'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:23.238256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586495fb86064013a37b42a6b3d382fb', 'request_id': 'req-63506411-975c-4a02-be23-9d48aaddf657'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:23.240395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:23.241835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:23.260347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] The token cache is being invalidate because project 586495fb86064013a37b42a6b3d382fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:23.260726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:23.261599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-63506411-975c-4a02-be23-9d48aaddf657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:23.264690 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3828/7654] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:22 2022] DELETE /identity/v3/projects/586495fb86064013a37b42a6b3d382fb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:23.270341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991e44-fb8e-4f66-884a-bec1984b8be0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.270809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991e44-fb8e-4f66-884a-bec1984b8be0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.271184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47991e44-fb8e-4f66-884a-bec1984b8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.301687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-47991e44-fb8e-4f66-884a-bec1984b8be0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:23.303007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-47991e44-fb8e-4f66-884a-bec1984b8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:23.336838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3827/7655] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:23.418132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:23.419850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:23.462737 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3829/7656] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:23.472730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405033d-0b93-4de0-8318-c6930f01d6c6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.473300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405033d-0b93-4de0-8318-c6930f01d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.473805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405033d-0b93-4de0-8318-c6930f01d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.497991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5405033d-0b93-4de0-8318-c6930f01d6c6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:23.501712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5405033d-0b93-4de0-8318-c6930f01d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:23.522377 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3830/7657] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:23.525859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405033d-0b93-4de0-8318-c6930f01d6c6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:23.543550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405033d-0b93-4de0-8318-c6930f01d6c6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.570575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.572605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.573359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.573720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.575166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:23.575547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.580055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.596134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77fc3d-7b82-463a-b04b-ab6e949c9924 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.602290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.603084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.603509 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3831/7658] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:23.603623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.606800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.609443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:23.624203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db3f14-7e50-4fef-b2dc-f426e7022b9d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.631000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.631716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.633620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.634138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.634492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.634997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.635702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.638572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.662973 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3828/7659] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:23.696643 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3832/7660] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:23 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:23.697123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:23.722557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4737e96-3952-4936-a265-04525d40332c service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.853469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.854164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.854468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.854732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.855513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.864830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.912214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:23.918710 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3829/7661] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:23 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:14:23.931854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8e3e-8429-4db2-b249-8ba503c66fb8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:23.945093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:23.946064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:23.947443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:23.948012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:23.949381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:23.956381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:23.975082 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3833/7662] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:23.977151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:24.001892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d5ad8-7fba-41c0-bad5-b4ea65983685 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:24.010251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e6d36-4ed7-4e9c-bd7f-b18728f5daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:24.011458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e6d36-4ed7-4e9c-bd7f-b18728f5daf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.011902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e6d36-4ed7-4e9c-bd7f-b18728f5daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.012654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e6d36-4ed7-4e9c-bd7f-b18728f5daf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.019005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e6d36-4ed7-4e9c-bd7f-b18728f5daf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:24.021124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e6d36-4ed7-4e9c-bd7f-b18728f5daf6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:24.041858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:24.066003 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3830/7663] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:24.075489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd2f9b-9701-42fa-8fa8-3431e23325c9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:24.088786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:24.091216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.092208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.092208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] PATH_INFO: `/v3/projects/83a413a548bf42c4b5262d58f90ffeb2/users/0779add7ece84899adbd56c1b9b407d8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.118353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a413a548bf42c4b5262d58f90ffeb2, user_id=0779add7ece84899adbd56c1b9b407d8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:24.122307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:24.152075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3834/7664] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:24 2022] PUT /identity/v3/projects/83a413a548bf42c4b5262d58f90ffeb2/users/0779add7ece84899adbd56c1b9b407d8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:24.167218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68817f-42b8-4017-a8b0-10c9bad4fe0c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.167595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68817f-42b8-4017-a8b0-10c9bad4fe0c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.167874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68817f-42b8-4017-a8b0-10c9bad4fe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.211867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2e68817f-42b8-4017-a8b0-10c9bad4fe0c None None] MFA Rules not processed for user `0779add7ece84899adbd56c1b9b407d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:24.213631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2e68817f-42b8-4017-a8b0-10c9bad4fe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:24.334726 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3831/7665] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:24.352662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:24.355621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:24.435675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff882f-e551-46b4-b356-e9c59b642abe admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:24.441434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe7e6b-95a9-4060-a2dd-84ca7525831e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:24.442296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe7e6b-95a9-4060-a2dd-84ca7525831e service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.442742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe7e6b-95a9-4060-a2dd-84ca7525831e service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.443370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe7e6b-95a9-4060-a2dd-84ca7525831e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.454067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe7e6b-95a9-4060-a2dd-84ca7525831e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:24.455700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe7e6b-95a9-4060-a2dd-84ca7525831e service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:24.467902 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3835/7666] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:14:24.482117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68817f-42b8-4017-a8b0-10c9bad4fe0c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:24.575180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0334-1fa1-45ba-bef6-5a2234a76110 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.575751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0334-1fa1-45ba-bef6-5a2234a76110 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.576096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0334-1fa1-45ba-bef6-5a2234a76110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.589615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68817f-42b8-4017-a8b0-10c9bad4fe0c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:24.595909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:24.596796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.597083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.597368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] PATH_INFO: `/v3/users/0779add7ece84899adbd56c1b9b407d8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.598613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0779add7ece84899adbd56c1b9b407d8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:24.601746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:24.609871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-079d0334-1fa1-45ba-bef6-5a2234a76110 None None] MFA Rules not processed for user `bb78a689b62644ec84725e7d8dba0141`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:24.611657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-079d0334-1fa1-45ba-bef6-5a2234a76110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:24.657462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0779add7ece84899adbd56c1b9b407d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:24.667531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0779add7ece84899adbd56c1b9b407d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:24.668150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0779add7ece84899adbd56c1b9b407d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:24.672445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0779add7ece84899adbd56c1b9b407d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:24.688891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0779add7ece84899adbd56c1b9b407d8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:24.707802 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3836/7667] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:14:24.712286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75701d8b-c5c7-4f02-a628-d1dc82bdd744 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.712798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75701d8b-c5c7-4f02-a628-d1dc82bdd744 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.712935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75701d8b-c5c7-4f02-a628-d1dc82bdd744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.736834 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3832/7668] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:24 2022] DELETE /identity/v3/users/0779add7ece84899adbd56c1b9b407d8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:24.746904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:24.753427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:24.759038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-75701d8b-c5c7-4f02-a628-d1dc82bdd744 None None] MFA Rules not processed for user `5bb1c1f4d3874463a29a59a93c769640`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:24.760262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-75701d8b-c5c7-4f02-a628-d1dc82bdd744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:24.860563 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3837/7669] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:24.862602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec75e-dbf3-4af0-b335-b09c411f0997 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.862932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec75e-dbf3-4af0-b335-b09c411f0997 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.863210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec75e-dbf3-4af0-b335-b09c411f0997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.882230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca2222-3109-4e4f-acf2-705ce6d4f583 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:24.888590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:24.889268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.889657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.890946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.890946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:24.893517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:24.900780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b3eec75e-dbf3-4af0-b335-b09c411f0997 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:24.902442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3eec75e-dbf3-4af0-b335-b09c411f0997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:24.923529 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3838/7670] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:24.929131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:24.931298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:24.931791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:24.939940 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3833/7671] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:24 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:24.944013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:24.950728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] MFA Rules not processed for user `5bb1c1f4d3874463a29a59a93c769640`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:24.952172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:25.079650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4a012-9ae3-471a-aec5-8a7db3f7e2cd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:25.086911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:25.088028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:25.088417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:25.088858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:25.089671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:25.092392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:25.095912 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3839/7672] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:25.096957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:25.103881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:25.140174 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3834/7673] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:24 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:25.142002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:25.147258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:25.221412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5cdd0-6ede-40fe-8793-a15bc4e3401f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:25.226105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:25.227766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:25.228260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:25.228551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:25.252480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:25.257286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:25.285531 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3840/7674] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:25.288437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:25.309987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf674a-f3d9-43a6-afce-2854a7cb90e5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:25.326853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:25.328189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:25.328486 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:25.328766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:25.329260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622854c1-3317-41f5-95de-a0cf2440b9db admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:25.330701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:25.334799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:25.342463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:25.343979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:25.344424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:25.344877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:25.363834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:25.368850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:25.381357 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3841/7675] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:25.387539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:25.398369 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3835/7676] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:25.433542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e4f0-9283-4eb6-a7aa-bed28d35bb91 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:25.449760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:25.450842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:25.451135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:25.452963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] PATH_INFO: `/v3/projects/9bf1a2d386684999b5a1d51a8c7593e2/users/1344b6e07143496498837b67e507b57a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:25.520815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf1a2d386684999b5a1d51a8c7593e2, user_id=1344b6e07143496498837b67e507b57a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:25.528066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:25.571724 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3842/7677] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:25 2022] PUT /identity/v3/projects/9bf1a2d386684999b5a1d51a8c7593e2/users/1344b6e07143496498837b67e507b57a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:25.573119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:25.590308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624d812-2abb-42de-988f-77dcf13c8611 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:25.749362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:25.750243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:25.750735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:25.751050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:25.751787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:25.757515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:25.784948 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3836/7678] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:14:25.789749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:25.822957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a97d-e464-49d4-9c28-0e94f531f860 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:25.837976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b00bc-9e0f-4c14-a1b6-f9729fb84664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:25.841880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b00bc-9e0f-4c14-a1b6-f9729fb84664 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:25.841880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b00bc-9e0f-4c14-a1b6-f9729fb84664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:25.842166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b00bc-9e0f-4c14-a1b6-f9729fb84664 admin admin] PATH_INFO: `/v3/projects/9bf1a2d386684999b5a1d51a8c7593e2/users/1344b6e07143496498837b67e507b57a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:25.848961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b00bc-9e0f-4c14-a1b6-f9729fb84664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf1a2d386684999b5a1d51a8c7593e2, user_id=1344b6e07143496498837b67e507b57a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:25.854657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b00bc-9e0f-4c14-a1b6-f9729fb84664 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:25.887136 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3843/7679] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:25 2022] PUT /identity/v3/projects/9bf1a2d386684999b5a1d51a8c7593e2/users/1344b6e07143496498837b67e507b57a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:26.345471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:26.351496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:26.377222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fa98f-950d-41ef-86da-82872a199b2f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:26.520419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:26.521775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:26.522186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:26.522642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] PATH_INFO: `/v3/projects/83a413a548bf42c4b5262d58f90ffeb2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:26.526838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a413a548bf42c4b5262d58f90ffeb2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:26.532512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:26.650393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a413a548bf42c4b5262d58f90ffeb2', 'request_id': 'req-41bda798-2fa2-49cf-9e05-6d282a5d47a1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:26.668819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a413a548bf42c4b5262d58f90ffeb2', 'request_id': 'req-41bda798-2fa2-49cf-9e05-6d282a5d47a1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:26.692413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a413a548bf42c4b5262d58f90ffeb2', 'request_id': 'req-41bda798-2fa2-49cf-9e05-6d282a5d47a1'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:26.723142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] The token cache is being invalidate because project 83a413a548bf42c4b5262d58f90ffeb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:26.723436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:26.724137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-41bda798-2fa2-49cf-9e05-6d282a5d47a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:26.729151 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3837/7680] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:26 2022] DELETE /identity/v3/projects/83a413a548bf42c4b5262d58f90ffeb2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:26.734467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874d91-f3cb-46e6-9991-04cedefc1564 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:26.734991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874d91-f3cb-46e6-9991-04cedefc1564 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:26.735263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5874d91-f3cb-46e6-9991-04cedefc1564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:26.771211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c5874d91-f3cb-46e6-9991-04cedefc1564 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:26.772650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c5874d91-f3cb-46e6-9991-04cedefc1564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:26.904701 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3844/7681] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:26.905113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3a8b3-ec2e-489e-a961-0f03780d358e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:26.905409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3a8b3-ec2e-489e-a961-0f03780d358e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:26.905728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3a8b3-ec2e-489e-a961-0f03780d358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:26.944038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6ea3a8b3-ec2e-489e-a961-0f03780d358e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:26.947087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6ea3a8b3-ec2e-489e-a961-0f03780d358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:26.966190 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3838/7682] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:14:26.972048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874d91-f3cb-46e6-9991-04cedefc1564 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:27.010627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5874d91-f3cb-46e6-9991-04cedefc1564 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:27.033530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:27.035371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.035973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.036406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.039342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:27.047998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:27.051895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:27.133879 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3845/7683] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:27.136878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3a8b3-ec2e-489e-a961-0f03780d358e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:27.168454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3a8b3-ec2e-489e-a961-0f03780d358e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:27.219402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:27.223525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.226317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.226940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.229982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:27.239893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:27.292641 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3839/7684] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:27 2022] POST /identity/v3/projects => generated 351 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:27.297411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:27.310608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9f91d-6b50-4248-a3a2-6134aab34b6d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:27.459966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:27.460856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.461293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.461638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.462504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:27.465749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:27.520789 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3846/7685] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:27 2022] POST /identity/v3/users => generated 276 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:27.526996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:27.549141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f88eb-9263-45c9-92d6-7ff27b04fd73 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:27.563652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:27.566378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.570355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.570721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.571903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:27.573899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:27.605981 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3840/7686] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:27.612929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:27.632496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0eaf7-760e-4363-b5b5-93d7172481e4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:27.639256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:27.639582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.640426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.642478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.642478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:27.644488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:27.672006 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3847/7687] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:14:27.672986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:27.693491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e91551-a3be-41e1-9051-8c535d21792e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:27.707404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a6285-20e6-4eca-a70a-156a6d0474f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:27.708323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a6285-20e6-4eca-a70a-156a6d0474f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.708599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a6285-20e6-4eca-a70a-156a6d0474f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.708879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a6285-20e6-4eca-a70a-156a6d0474f8 admin admin] PATH_INFO: `/v3/projects/961cc84a4d754c138b34d7e19217669b/users/074bcdd408cb4d63b1b515e93174d315/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.754525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a6285-20e6-4eca-a70a-156a6d0474f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=961cc84a4d754c138b34d7e19217669b, user_id=074bcdd408cb4d63b1b515e93174d315, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:27.758364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a6285-20e6-4eca-a70a-156a6d0474f8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:27.763449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:27.767142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:27.787318 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3841/7688] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:27 2022] PUT /identity/v3/projects/961cc84a4d754c138b34d7e19217669b/users/074bcdd408cb4d63b1b515e93174d315/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:27.799622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.800449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.800743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.804489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15b4ff-aeca-4955-8be4-346a6d68bbb0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:27.873786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] MFA Rules not processed for user `074bcdd408cb4d63b1b515e93174d315`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:27.877373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:27.897360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:27.898401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:27.898729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:27.899301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] PATH_INFO: `/v3/users/5bb1c1f4d3874463a29a59a93c769640` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:27.900916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb1c1f4d3874463a29a59a93c769640)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:27.903673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:28.006734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb1c1f4d3874463a29a59a93c769640'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.017103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb1c1f4d3874463a29a59a93c769640'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.045846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb1c1f4d3874463a29a59a93c769640'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.047319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb1c1f4d3874463a29a59a93c769640'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.053970 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3842/7689] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:27 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:28.071734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb1c1f4d3874463a29a59a93c769640'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.096744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:28.098249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:28.180158 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3848/7690] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:27 2022] DELETE /identity/v3/users/5bb1c1f4d3874463a29a59a93c769640 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:28.181425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:28.185723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:28.295757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be244a-5f56-4528-a782-f7ba3b0f401a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:28.398095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37282d-5059-4b1e-93ec-2abde17aac4c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:28.407737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:28.408641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:28.409483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:28.409483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] PATH_INFO: `/v3/users/a29e307a46c4444cbe01dbeb1ebbed81` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:28.410935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a29e307a46c4444cbe01dbeb1ebbed81)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:28.412884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:28.420454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:28.422256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:28.422256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:28.422476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:28.434458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:28.508462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a29e307a46c4444cbe01dbeb1ebbed81'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.510318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a29e307a46c4444cbe01dbeb1ebbed81'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.543303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a29e307a46c4444cbe01dbeb1ebbed81'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.544905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a29e307a46c4444cbe01dbeb1ebbed81'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.557276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:28.558809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:28.561565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c39cc446-222a-4fa3-bc82-5c8e750f75eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a29e307a46c4444cbe01dbeb1ebbed81'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.571534 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3843/7691] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:28 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:14:28.610157 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3849/7692] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:28 2022] DELETE /identity/v3/users/a29e307a46c4444cbe01dbeb1ebbed81 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:28.616548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:28.618012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:28.641556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20740-c445-49d6-9b29-8695c1e7c87e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:28.755121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:28.757438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:28.757834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:28.759690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] PATH_INFO: `/v3/projects/a957e2fe79f14ab594c4edbb13bce7bd` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:28.761851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a957e2fe79f14ab594c4edbb13bce7bd)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:28.767980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:28.887514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a957e2fe79f14ab594c4edbb13bce7bd', 'request_id': 'req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.904978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a957e2fe79f14ab594c4edbb13bce7bd', 'request_id': 'req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.928382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a957e2fe79f14ab594c4edbb13bce7bd', 'request_id': 'req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.947264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] The token cache is being invalidate because project a957e2fe79f14ab594c4edbb13bce7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:28.947581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.948328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:28.958967 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3844/7693] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:28 2022] DELETE /identity/v3/projects/a957e2fe79f14ab594c4edbb13bce7bd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:28.962040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165a23-bf74-4b2d-9051-4ded51b1c9c3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:28.962512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165a23-bf74-4b2d-9051-4ded51b1c9c3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:28.962634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72165a23-bf74-4b2d-9051-4ded51b1c9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:29.002136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:29.004604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:29.007693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-72165a23-bf74-4b2d-9051-4ded51b1c9c3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:29.009615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-72165a23-bf74-4b2d-9051-4ded51b1c9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:29.186739 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3850/7694] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:29.188730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f448-ac8d-4779-bfab-21aaac347aca None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:29.189281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f448-ac8d-4779-bfab-21aaac347aca None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:29.189657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f448-ac8d-4779-bfab-21aaac347aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:29.207442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7219ff4-708f-45c3-b7b3-8e631ac1d8a4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:29.222497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:29.223750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:29.228228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:29.229188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] PATH_INFO: `/v3/projects/c642a488de414517ac98cee7e2cc2406` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:29.241741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c642a488de414517ac98cee7e2cc2406)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:29.258658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:29.260663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-29a7f448-ac8d-4779-bfab-21aaac347aca None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:29.261895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-29a7f448-ac8d-4779-bfab-21aaac347aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:29.281862 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3851/7695] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:29.286513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f448-ac8d-4779-bfab-21aaac347aca None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:29.310593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f448-ac8d-4779-bfab-21aaac347aca None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:29.323338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:29.324234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:29.324943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:29.325240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:29.325996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:29.329324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:29.330482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:29.369678 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3852/7696] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:29.370653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:29.396929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c642a488de414517ac98cee7e2cc2406', 'request_id': 'req-a03acf76-fd62-4589-9a23-6b811ec88f04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.409907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2a03-c227-4039-b0ab-ca2f91ac470a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:29.410087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c642a488de414517ac98cee7e2cc2406', 'request_id': 'req-a03acf76-fd62-4589-9a23-6b811ec88f04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.441457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c642a488de414517ac98cee7e2cc2406', 'request_id': 'req-a03acf76-fd62-4589-9a23-6b811ec88f04'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.485789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] The token cache is being invalidate because project c642a488de414517ac98cee7e2cc2406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:29.488306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.491639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.500166 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3845/7697] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:29 2022] DELETE /identity/v3/projects/c642a488de414517ac98cee7e2cc2406 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:29.501975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:29.507027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:29.619394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:29.620080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:29.620369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:29.620653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:29.621352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:29.623852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:29.669474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03acf76-fd62-4589-9a23-6b811ec88f04 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:29.684677 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3853/7698] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:29 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:29.685152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:29.686189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:29.686460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:29.687272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] PATH_INFO: `/v3/users/04028d57695e49db9230f9b6e0674327` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:29.687582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:29.688899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04028d57695e49db9230f9b6e0674327)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:29.690918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:29.692160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:29.834860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04028d57695e49db9230f9b6e0674327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.852616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04028d57695e49db9230f9b6e0674327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.854690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04028d57695e49db9230f9b6e0674327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.855926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04028d57695e49db9230f9b6e0674327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.867603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06561eac-b40f-4837-9efb-eceb661fae89 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:29.876199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:29.877133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:29.877441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:29.877755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:29.878717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:29.879720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04028d57695e49db9230f9b6e0674327'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:29.881989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:29.909034 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3846/7699] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:29 2022] DELETE /identity/v3/users/04028d57695e49db9230f9b6e0674327 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:29.914868 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3854/7700] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:29 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:29.917272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:29.918805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:30.077085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799ea71-c9f3-4925-bfad-9986f1ed0566 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:30.088096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:30.089290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.089649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.089994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.094224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:30.097602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:30.129025 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3847/7701] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:30.134317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:30.152431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0b4f4-09e2-4bff-8c8e-30e0f75872df admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:30.161694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:30.163114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.163503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.166623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.167975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:30.172277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:30.190717 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3855/7702] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:30.200306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:30.224929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be4f02-7bab-473f-9ac4-2d9bd6941b41 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:30.236127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fafdc-525a-4d2d-bb98-ddd19782e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:30.237274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fafdc-525a-4d2d-bb98-ddd19782e1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.237848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fafdc-525a-4d2d-bb98-ddd19782e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.238199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fafdc-525a-4d2d-bb98-ddd19782e1c7 admin admin] PATH_INFO: `/v3/projects/39938e8eedcd4eca818171baa6a53cba/users/a96c59e1f5d64e0ba7559328f5ae9e1d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.277394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fafdc-525a-4d2d-bb98-ddd19782e1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39938e8eedcd4eca818171baa6a53cba, user_id=a96c59e1f5d64e0ba7559328f5ae9e1d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:30.278568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:30.281586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:30.282733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fafdc-525a-4d2d-bb98-ddd19782e1c7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:30.307300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6f3b-5e35-4f0a-9b5f-1df6213dc722 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:30.335857 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3848/7703] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:30 2022] PUT /identity/v3/projects/39938e8eedcd4eca818171baa6a53cba/users/a96c59e1f5d64e0ba7559328f5ae9e1d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:30.427170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.427509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.427731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.481334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] MFA Rules not processed for user `a96c59e1f5d64e0ba7559328f5ae9e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:30.482600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:30.501872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:30.503627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.504138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.507334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] PATH_INFO: `/v3/projects/50894f3848d740ad9eae95bed504d406` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.508869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50894f3848d740ad9eae95bed504d406)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:30.512165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:30.569726 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3849/7704] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:30.572958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:30.576131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:30.597987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50894f3848d740ad9eae95bed504d406', 'request_id': 'req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:30.608824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50894f3848d740ad9eae95bed504d406', 'request_id': 'req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:30.618085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50894f3848d740ad9eae95bed504d406', 'request_id': 'req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:30.641971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] The token cache is being invalidate because project 50894f3848d740ad9eae95bed504d406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:30.642263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:30.643854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ee8c696a-8d3d-4e1b-8bab-1cd64dddc316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:30.646811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3856/7705] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:30 2022] DELETE /identity/v3/projects/50894f3848d740ad9eae95bed504d406 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:30.651202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1ec4-5aa3-4d23-99e9-30a2f8378c1c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.651749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1ec4-5aa3-4d23-99e9-30a2f8378c1c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.652028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1ec4-5aa3-4d23-99e9-30a2f8378c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.682798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a71a1ec4-5aa3-4d23-99e9-30a2f8378c1c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:30.685153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a71a1ec4-5aa3-4d23-99e9-30a2f8378c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:30.776243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33bb6e-2d88-4763-b981-98a422faae35 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:30.807621 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3857/7706] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:30.809763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93fc27-e36c-411c-99ea-2e76b0dde7b4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.810668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93fc27-e36c-411c-99ea-2e76b0dde7b4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.811062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93fc27-e36c-411c-99ea-2e76b0dde7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.845708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cc93fc27-e36c-411c-99ea-2e76b0dde7b4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:30.847579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cc93fc27-e36c-411c-99ea-2e76b0dde7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:30.865995 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3858/7707] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:14:30.867172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93fc27-e36c-411c-99ea-2e76b0dde7b4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:30.883261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93fc27-e36c-411c-99ea-2e76b0dde7b4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:30.897132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:30.897846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.898112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.898376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.900272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:30.901057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:30.906647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:30.918353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:30.919842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.920130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.920423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.923370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:30.944267 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3859/7708] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:30.946277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:30.969640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed03c58-ceee-4b13-9b57-3bab2abfa53c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:30.984571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:30.985257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:30.987065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:30.994905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:30.997734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:31.005446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:31.048346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:31.052084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:31.082749 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3860/7709] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:30 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:31.091518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:31.095314 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3850/7710] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:31.224513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5016a-58ab-4349-a230-aecfa488d458 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:31.230163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:31.231302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:31.231587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:31.231868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:31.232630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:31.235216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:31.274815 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3861/7711] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:31 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:31.277593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:31.292036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0a3eb-a859-4d4c-a5d9-e2b699bb8ac1 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:31.298992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72519-3265-4452-a452-66797da36152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:31.300144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72519-3265-4452-a452-66797da36152 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:31.300573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72519-3265-4452-a452-66797da36152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:31.301038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c72519-3265-4452-a452-66797da36152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:31.301903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72519-3265-4452-a452-66797da36152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:31.303690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c72519-3265-4452-a452-66797da36152 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:31.316496 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3851/7712] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:31.320269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:31.336852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63236cad-7f35-4816-ac7b-161053643442 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:31.343637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72638a2e-aba4-4e4a-8af7-2ac6083d5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:31.344504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72638a2e-aba4-4e4a-8af7-2ac6083d5484 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:31.345052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72638a2e-aba4-4e4a-8af7-2ac6083d5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:31.345476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72638a2e-aba4-4e4a-8af7-2ac6083d5484 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:31.346492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72638a2e-aba4-4e4a-8af7-2ac6083d5484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:31.349181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72638a2e-aba4-4e4a-8af7-2ac6083d5484 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:31.363076 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3862/7713] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:14:31.367406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72519-3265-4452-a452-66797da36152 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:31.384399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c72519-3265-4452-a452-66797da36152 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:31.393531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:31.396660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:31.401636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:31.402123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] PATH_INFO: `/v3/projects/de8505b33dbf41ffb3f14bfddea6c103/users/2c4d46ef99794532b7de756b929e6d17/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:31.424875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8505b33dbf41ffb3f14bfddea6c103, user_id=2c4d46ef99794532b7de756b929e6d17, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:31.427909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:31.453033 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3852/7714] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:31 2022] PUT /identity/v3/projects/de8505b33dbf41ffb3f14bfddea6c103/users/2c4d46ef99794532b7de756b929e6d17/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:14:31.459057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:31.459583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:31.460398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:31.503081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:31.505165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:31.652882 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3863/7715] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:31.679435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:31.681518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:31.784658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50afd7f-8fd8-4219-b00b-5f9ecf0f5a54 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:31.789980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f7b60-026f-4788-8b61-7e2dc6692e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:31.793411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b60-026f-4788-8b61-7e2dc6692e35 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:31.793723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b60-026f-4788-8b61-7e2dc6692e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:31.794001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f7b60-026f-4788-8b61-7e2dc6692e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:31.817283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f7b60-026f-4788-8b61-7e2dc6692e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:31.818871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f7b60-026f-4788-8b61-7e2dc6692e35 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:31.833876 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3853/7716] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:33.092013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:33.093526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:33.118212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89208d56-a7a0-4aba-85b4-6dc863c2d698 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:33.127200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:33.136914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:33.136914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:33.136914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] PATH_INFO: `/v3/users/074bcdd408cb4d63b1b515e93174d315` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:33.140252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=074bcdd408cb4d63b1b515e93174d315)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:33.142941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:33.269898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '074bcdd408cb4d63b1b515e93174d315'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:33.270811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '074bcdd408cb4d63b1b515e93174d315'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:33.290404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '074bcdd408cb4d63b1b515e93174d315'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:33.291880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '074bcdd408cb4d63b1b515e93174d315'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:33.315909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '074bcdd408cb4d63b1b515e93174d315'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:33.350827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3864/7717] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:33 2022] DELETE /identity/v3/users/074bcdd408cb4d63b1b515e93174d315 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:33.353212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:33.354010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:33.354474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:33.391762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:33.393042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:33.532076 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3854/7718] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:33.542698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:33.544285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:33.626905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ff60-7d42-491e-887d-0115ab17d630 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:33.633176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7490a8-a7ab-482a-9d47-d23fa73e9fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:33.633176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7490a8-a7ab-482a-9d47-d23fa73e9fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:33.633176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7490a8-a7ab-482a-9d47-d23fa73e9fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:33.633631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7490a8-a7ab-482a-9d47-d23fa73e9fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:33.651589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7490a8-a7ab-482a-9d47-d23fa73e9fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:33.653088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7490a8-a7ab-482a-9d47-d23fa73e9fe1 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:33.664957 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3865/7719] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:33.897224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:33.899365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:33.922208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bae3ae-92d0-4abe-8073-e830401d1d19 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:33.942290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:33.942290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:33.942290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:33.942290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] PATH_INFO: `/v3/projects/961cc84a4d754c138b34d7e19217669b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:33.945419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961cc84a4d754c138b34d7e19217669b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:33.947388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:34.068990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961cc84a4d754c138b34d7e19217669b', 'request_id': 'req-0399ca7c-9533-4658-8a34-d75218ccf1a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:34.077877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961cc84a4d754c138b34d7e19217669b', 'request_id': 'req-0399ca7c-9533-4658-8a34-d75218ccf1a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:34.095734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961cc84a4d754c138b34d7e19217669b', 'request_id': 'req-0399ca7c-9533-4658-8a34-d75218ccf1a9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:34.113789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] The token cache is being invalidate because project 961cc84a4d754c138b34d7e19217669b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:34.114353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:34.115312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0399ca7c-9533-4658-8a34-d75218ccf1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:34.123018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c17cb-c728-4c7d-8bd1-4c2be7a65714 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.123578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c17cb-c728-4c7d-8bd1-4c2be7a65714 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.123734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3855/7720] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:33 2022] DELETE /identity/v3/projects/961cc84a4d754c138b34d7e19217669b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:34.123886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c17cb-c728-4c7d-8bd1-4c2be7a65714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.152529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-941c17cb-c728-4c7d-8bd1-4c2be7a65714 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:34.154205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-941c17cb-c728-4c7d-8bd1-4c2be7a65714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:34.269574 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3866/7721] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:34.271883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc28b1-78b4-486e-835e-2d0a58c62f12 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.272946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc28b1-78b4-486e-835e-2d0a58c62f12 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.273519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc28b1-78b4-486e-835e-2d0a58c62f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.298646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d0dc28b1-78b4-486e-835e-2d0a58c62f12 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:34.300859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d0dc28b1-78b4-486e-835e-2d0a58c62f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:34.315474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c17cb-c728-4c7d-8bd1-4c2be7a65714 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:34.316603 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3856/7722] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:34.335101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c17cb-c728-4c7d-8bd1-4c2be7a65714 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:34.343522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:34.344210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.344488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.344760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.345491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:34.345859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:34.347516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:34.365936 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3867/7723] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:34.367524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc28b1-78b4-486e-835e-2d0a58c62f12 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:34.378979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc28b1-78b4-486e-835e-2d0a58c62f12 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:34.384974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:34.385759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.386133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.386534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.387418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:34.390705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:34.428064 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3857/7724] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:34 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:14:34.429137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:34.446761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569803c9-0a5e-4746-9cdc-68155f1e6f8b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:34.618452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:34.622205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.623239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.625312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.634501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:34.640401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:34.675521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:34.682654 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3868/7725] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:34 2022] POST /identity/v3/users => generated 291 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:34.690706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec947b9-feea-4af7-b6de-7fbe47e3ae61 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:34.696858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:34.697701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.697993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.698351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.699994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:34.702600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:34.725331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:34.735193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3858/7726] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:34.741000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0987-fc74-4db8-acf2-c1d552e05dde admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:34.748981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289de32-b0b2-462d-b55b-2eab3bac24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:34.749798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289de32-b0b2-462d-b55b-2eab3bac24c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.750139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289de32-b0b2-462d-b55b-2eab3bac24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.750483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289de32-b0b2-462d-b55b-2eab3bac24c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.751393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289de32-b0b2-462d-b55b-2eab3bac24c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:34.753316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289de32-b0b2-462d-b55b-2eab3bac24c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:34.768631 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3869/7727] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:34.773379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:34.788250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00a399-2014-469b-a13d-fabb5b7bad63 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:34.793924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:34.795041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.795338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.795616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] PATH_INFO: `/v3/projects/2d3c999387164ee980313aa31b9f46c8/users/b94d59dc7ca144ef8b5726e17e0ef324/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.817984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3c999387164ee980313aa31b9f46c8, user_id=b94d59dc7ca144ef8b5726e17e0ef324, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:34.822188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:34.872855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec7a2-59cd-498c-a5b1-eebbb692c14f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:34.873289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec7a2-59cd-498c-a5b1-eebbb692c14f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:34.873584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec7a2-59cd-498c-a5b1-eebbb692c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:34.875083 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3859/7728] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:34 2022] PUT /identity/v3/projects/2d3c999387164ee980313aa31b9f46c8/users/b94d59dc7ca144ef8b5726e17e0ef324/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:34.961934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b7fec7a2-59cd-498c-a5b1-eebbb692c14f None None] MFA Rules not processed for user `b94d59dc7ca144ef8b5726e17e0ef324`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:34.964951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b7fec7a2-59cd-498c-a5b1-eebbb692c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:35.155405 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3870/7729] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:35.163089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:35.349407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c752c-fef1-4869-a49a-8fad1f48945f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:35.381920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:35.404579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:35.405056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:35.406239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:35.407217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:35.416291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:35.522594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fec7a2-59cd-498c-a5b1-eebbb692c14f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:35.531754 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3860/7730] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:35 2022] POST /identity/v3/projects => generated 381 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:35.536910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fec7a2-59cd-498c-a5b1-eebbb692c14f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:35.674364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:35.676138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:35.676138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:35.676138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:35.682228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:35.685786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:35.718574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:35.725102 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3871/7731] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:35 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:14:35.732040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c81a1-8b93-4c3c-aaa8-5a2b614c466d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:35.739787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:35.740494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:35.740865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:35.741148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:35.750974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:35.753535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:35.823805 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3861/7732] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:35.828133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:35.845227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220a4b9-e094-4e2f-b410-20769e4e82a4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:35.853374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:35.854744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:35.855694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:35.856078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] PATH_INFO: `/v3/projects/a6414a0ab3524c35acc79fca009c7cec/users/ce55988a1805465db77848defe12ba12/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:35.888650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6414a0ab3524c35acc79fca009c7cec, user_id=ce55988a1805465db77848defe12ba12, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:35.898945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:35.946594 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3872/7733] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:35 2022] PUT /identity/v3/projects/a6414a0ab3524c35acc79fca009c7cec/users/ce55988a1805465db77848defe12ba12/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:35.951856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:35.975028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0272afb-cdfd-4216-ad78-9d8ba277edd9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:36.106695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd3402-11cf-4267-95b9-8da08de53679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:36.107905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3402-11cf-4267-95b9-8da08de53679 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:36.108932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3402-11cf-4267-95b9-8da08de53679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:36.109516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd3402-11cf-4267-95b9-8da08de53679 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:36.110367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd3402-11cf-4267-95b9-8da08de53679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:36.113330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd3402-11cf-4267-95b9-8da08de53679 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:36.138328 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3862/7734] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:36.139749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:36.152196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398431df-2327-42a5-8f66-06318db8a8db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:36.158691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:36.160289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:36.160730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:36.161181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] PATH_INFO: `/v3/projects/a6414a0ab3524c35acc79fca009c7cec/users/ce55988a1805465db77848defe12ba12/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:36.163473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6414a0ab3524c35acc79fca009c7cec, user_id=ce55988a1805465db77848defe12ba12, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:36.166606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:36.190936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105eb47-31ff-4ac0-8b69-a4ee8ec13fd0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:36.192478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105eb47-31ff-4ac0-8b69-a4ee8ec13fd0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:36.192478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105eb47-31ff-4ac0-8b69-a4ee8ec13fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:36.193978 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3873/7735] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:36 2022] PUT /identity/v3/projects/a6414a0ab3524c35acc79fca009c7cec/users/ce55988a1805465db77848defe12ba12/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:36.241682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e105eb47-31ff-4ac0-8b69-a4ee8ec13fd0 None None] MFA Rules not processed for user `ce55988a1805465db77848defe12ba12`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:36.243195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e105eb47-31ff-4ac0-8b69-a4ee8ec13fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:36.347738 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3863/7736] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:36.354616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:36.357971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:36.452634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad9da3-f144-4f40-833f-e5094da18b83 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:36.457949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f546eb9-a63f-406d-896f-19565b6f7be4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:36.458489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f546eb9-a63f-406d-896f-19565b6f7be4 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:36.458802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f546eb9-a63f-406d-896f-19565b6f7be4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:36.459092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f546eb9-a63f-406d-896f-19565b6f7be4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:36.473732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f546eb9-a63f-406d-896f-19565b6f7be4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:36.475293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f546eb9-a63f-406d-896f-19565b6f7be4 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:36.489743 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3874/7737] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:36.614657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105eb47-31ff-4ac0-8b69-a4ee8ec13fd0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:36.641437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105eb47-31ff-4ac0-8b69-a4ee8ec13fd0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:36.646879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:36.648013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:36.648960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:36.649579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:36.751780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:36.753779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:36.767617 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3864/7738] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:38.587866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:38.588740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:38.589303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:38.641379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:38.649107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:38.744780 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3875/7739] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:14:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:38.825226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:38.831255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:39.045971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc1a71-22a4-4075-8fd5-9b2f96b3808d service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:39.056092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6c330-e3d6-4d66-b4cb-19f394017aa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:39.057285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c330-e3d6-4d66-b4cb-19f394017aa3 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:39.057773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c330-e3d6-4d66-b4cb-19f394017aa3 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:39.058243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6c330-e3d6-4d66-b4cb-19f394017aa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:39.080844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c330-e3d6-4d66-b4cb-19f394017aa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:39.082468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6c330-e3d6-4d66-b4cb-19f394017aa3 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:39.107649 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3865/7740] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:14:40.820667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:40.823308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:40.937954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d91c9a-f846-4b2f-91c2-fc9434f28327 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:40.952987 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:40.965166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:40.965697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:40.966195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] PATH_INFO: `/v3/users/a96c59e1f5d64e0ba7559328f5ae9e1d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:40.968582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96c59e1f5d64e0ba7559328f5ae9e1d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:40.971623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:41.033280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:41.033825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:41.033825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:41.055760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96c59e1f5d64e0ba7559328f5ae9e1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:41.056567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96c59e1f5d64e0ba7559328f5ae9e1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:41.069214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96c59e1f5d64e0ba7559328f5ae9e1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:41.070653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96c59e1f5d64e0ba7559328f5ae9e1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:41.091278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] MFA Rules not processed for user `1344b6e07143496498837b67e507b57a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:41.093463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:41.104384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-ac0b29bb-cf67-4355-bb92-45e961e0e823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96c59e1f5d64e0ba7559328f5ae9e1d'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:41.136680 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3876/7741] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:40 2022] DELETE /identity/v3/users/a96c59e1f5d64e0ba7559328f5ae9e1d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:41.140301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:41.140651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:41.140933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:41.183048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:41.184798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:41.278138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3866/7742] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:41.286370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:41.287817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:41.293145 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3877/7743] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:41.356438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:41.363480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:41.477551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902ea9-cdbe-454f-b76e-4900c7cc4536 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:41.547842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a9227-ad47-4915-96ff-95003aef5bf6 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:41.559982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456693a-5156-4112-b7d5-5040a241c2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:41.560662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456693a-5156-4112-b7d5-5040a241c2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:41.560950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456693a-5156-4112-b7d5-5040a241c2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:41.561227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456693a-5156-4112-b7d5-5040a241c2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:41.585767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456693a-5156-4112-b7d5-5040a241c2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:41.586861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8456693a-5156-4112-b7d5-5040a241c2e9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:41.618968 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3878/7744] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:14:41.714309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:41.715001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:41.715277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:41.715721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:41.971890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:41.974798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:42.011173 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3867/7745] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:14:43.235242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:43.235719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:43.235889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:43.271733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] MFA Rules not processed for user `2c4d46ef99794532b7de756b929e6d17`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:43.274282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:43.437452 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3879/7746] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:43.444185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:43.445893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:43.477016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20d198-266c-49d2-949e-c46c16637a26 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:43.504243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:43.506795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:43.509988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:43.510686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:43.510986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:43.514590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:43.516825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:43.522547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:43.662646 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3868/7747] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:43 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:43.680397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:43.781720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430bb63-48c4-4c00-9a9d-9a4842aa4d23 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:43.836275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d127cd-23e3-4af3-8a57-c0030776a7fd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:43.853435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:43.854557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:43.855172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:43.855618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:43.856465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:43.860062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:43.885335 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3869/7748] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:43 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:43.889708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:43.906635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d859b-16c1-46f0-b669-5209736b9de5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:43.912585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:43.913547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:43.913983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:43.914429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:43.915395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:43.917367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:43.934044 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3870/7749] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:14:43.935248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:43.946934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e495440-6ff3-4aeb-a0dd-4bea83977823 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:43.948411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:43.949098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:43.949387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:43.949667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:43.953601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:43.954881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:43.955369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:43.955822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] PATH_INFO: `/v3/projects/7258ee48454a4985a79b7f26d184493f/users/8cddd0e679bc49369c57f5679f8226ee/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:43.956764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:43.976110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7258ee48454a4985a79b7f26d184493f, user_id=8cddd0e679bc49369c57f5679f8226ee, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:43.978987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:43.996725 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3871/7750] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:43 2022] PUT /identity/v3/projects/7258ee48454a4985a79b7f26d184493f/users/8cddd0e679bc49369c57f5679f8226ee/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:43.998183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:44.001395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:44.001725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:44.003430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:44.036508 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3880/7751] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:14:44.037481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:44.068636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53c7e6-e199-4a74-8e13-26c0be1bb3a0 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:44.227155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62bc20-30c7-4def-bb50-95e5937fb265 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:44.244484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:44.245540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:44.245833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:44.246112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] PATH_INFO: `/v3/projects/39938e8eedcd4eca818171baa6a53cba` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:44.247693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39938e8eedcd4eca818171baa6a53cba)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:44.255271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:44.274682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:44.275455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:44.275743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:44.276025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:44.276801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:44.284303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:44.314301 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3881/7752] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:44.316031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:44.345543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a73ed-8c4c-4233-b438-83a785d7a513 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:44.359037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b06bc-2f25-43ba-ae68-cf0ffff36cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:44.360199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b06bc-2f25-43ba-ae68-cf0ffff36cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:44.360637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b06bc-2f25-43ba-ae68-cf0ffff36cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:44.361093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b06bc-2f25-43ba-ae68-cf0ffff36cb7 admin admin] PATH_INFO: `/v3/projects/7258ee48454a4985a79b7f26d184493f/users/8cddd0e679bc49369c57f5679f8226ee/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:44.367245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b06bc-2f25-43ba-ae68-cf0ffff36cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7258ee48454a4985a79b7f26d184493f, user_id=8cddd0e679bc49369c57f5679f8226ee, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:44.373170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b06bc-2f25-43ba-ae68-cf0ffff36cb7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:44.422547 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3882/7753] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:44 2022] PUT /identity/v3/projects/7258ee48454a4985a79b7f26d184493f/users/8cddd0e679bc49369c57f5679f8226ee/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:44.501940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39938e8eedcd4eca818171baa6a53cba', 'request_id': 'req-e48621b6-afff-4c57-b7b5-19f9b689c66a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:44.529076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39938e8eedcd4eca818171baa6a53cba', 'request_id': 'req-e48621b6-afff-4c57-b7b5-19f9b689c66a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:44.559173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39938e8eedcd4eca818171baa6a53cba', 'request_id': 'req-e48621b6-afff-4c57-b7b5-19f9b689c66a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:44.586882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] The token cache is being invalidate because project 39938e8eedcd4eca818171baa6a53cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:44.588124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:44.590713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:44.595605 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3872/7754] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:43 2022] DELETE /identity/v3/projects/39938e8eedcd4eca818171baa6a53cba => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:44.603046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a032a2-f895-4f91-951c-186a4fa0ff30 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:44.603339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a032a2-f895-4f91-951c-186a4fa0ff30 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:44.603622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a032a2-f895-4f91-951c-186a4fa0ff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:44.651826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:44.653858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:44.664252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b8a032a2-f895-4f91-951c-186a4fa0ff30 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:44.666380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b8a032a2-f895-4f91-951c-186a4fa0ff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:44.874783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48621b6-afff-4c57-b7b5-19f9b689c66a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:44.884818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3883/7755] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:44.886666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2532c8-fbd4-48a6-adc0-8a8f9058ae4b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:44.887072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2532c8-fbd4-48a6-adc0-8a8f9058ae4b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:44.887760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2532c8-fbd4-48a6-adc0-8a8f9058ae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:44.894068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:44.899216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:44.899591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:44.900795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:44.904894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:44.954297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1e2532c8-fbd4-48a6-adc0-8a8f9058ae4b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:44.955329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1e2532c8-fbd4-48a6-adc0-8a8f9058ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:44.962104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:44.976598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:45.008358 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3884/7756] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:45.010106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2532c8-fbd4-48a6-adc0-8a8f9058ae4b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:45.015479 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3873/7757] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:14:45.034702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2532c8-fbd4-48a6-adc0-8a8f9058ae4b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:45.044454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:45.046746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:45.047166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:45.048154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:45.049009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:45.050484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:45.060264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:45.127344 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3885/7758] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:45.127553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:45.182479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd1a26-34a2-4073-990b-dc3632d428f4 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:45.199703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:45.204161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:45.216427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:45.217983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:45.225604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:45.236160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:45.371323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3874/7759] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:45 2022] POST /identity/v3/projects => generated 391 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:14:45.372799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:45.396478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309dbc-ee13-4c04-9e5a-0601cd7d7b86 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:45.503167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:45.504189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:45.504666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:45.505325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:45.506513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:45.512198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:45.559109 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3886/7760] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:45 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:45.564324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:45.586127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992d167-4485-4103-8150-622b0ef72c52 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:45.601225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:45.602232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:45.602516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:45.602853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:45.605364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:45.612965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:45.636906 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3875/7761] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:45.645631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:45.672398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021c5f5-51d8-4d52-ae46-90260cacf91c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:45.692446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9bdb3-b942-4fb9-9444-41485dfd318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:45.693634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bdb3-b942-4fb9-9444-41485dfd318a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:45.694128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bdb3-b942-4fb9-9444-41485dfd318a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:45.694564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bdb3-b942-4fb9-9444-41485dfd318a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:45.706898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9bdb3-b942-4fb9-9444-41485dfd318a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:45.710540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9bdb3-b942-4fb9-9444-41485dfd318a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:45.743289 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3887/7762] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:45.748078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:45.772026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490c222-e83b-4bb3-921d-e957e4e51ae5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:45.795096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:45.799234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:45.799777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:45.800072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] PATH_INFO: `/v3/projects/aee5607226124471a1af28dd9cc1743c/users/a6cba46ebf09407bb4066c7c84c3b48b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:45.835532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee5607226124471a1af28dd9cc1743c, user_id=a6cba46ebf09407bb4066c7c84c3b48b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:45.843207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:45.878883 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3876/7763] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:45 2022] PUT /identity/v3/projects/aee5607226124471a1af28dd9cc1743c/users/a6cba46ebf09407bb4066c7c84c3b48b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:45.887677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa95b-c71c-4f81-be6d-81d07787d74f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:45.888022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa95b-c71c-4f81-be6d-81d07787d74f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:45.888237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa95b-c71c-4f81-be6d-81d07787d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:45.979565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6f8fa95b-c71c-4f81-be6d-81d07787d74f None None] MFA Rules not processed for user `a6cba46ebf09407bb4066c7c84c3b48b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:45.984962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6f8fa95b-c71c-4f81-be6d-81d07787d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:46.250316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:46.251001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3888/7764] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:46.440118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f08f4-0630-4ae4-b8ec-fa47d9dd0f1e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:46.449300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:46.450170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:46.450617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:46.451097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:46.452163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:46.456222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:46.558083 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3877/7765] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:46 2022] POST /identity/v3/projects => generated 389 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:46.561851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa95b-c71c-4f81-be6d-81d07787d74f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:46.594866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa95b-c71c-4f81-be6d-81d07787d74f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:46.777200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:46.778128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:46.778816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:46.781344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:46.783842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:46.786313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:46.791170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:46.792968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:46.830050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3889/7766] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:46 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:46.833636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:46.838810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce82c4-8d12-4f97-855c-e9f8cc89e67f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:46.853900 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:46.855214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:46.855695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:46.856159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] PATH_INFO: `/v3/users/b94d59dc7ca144ef8b5726e17e0ef324` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:46.858681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2324194-c8d7-4f58-8691-1dcc20069695 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:46.860037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94d59dc7ca144ef8b5726e17e0ef324)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:46.865729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:46.884461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:46.885552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:46.886003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:46.887343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:46.888385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:46.891633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:46.918876 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3890/7767] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:14:46.922908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:46.952167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af7f09-9f61-45f6-b7b0-b278bd03af09 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:46.973785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:46.974705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:46.975376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:46.975678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] PATH_INFO: `/v3/projects/0af78cb74e5646058c31f2d10f641c0b/users/89381a841d6845cea3680c0f92f9fd25/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:46.983950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94d59dc7ca144ef8b5726e17e0ef324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:46.999843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94d59dc7ca144ef8b5726e17e0ef324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:47.000757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af78cb74e5646058c31f2d10f641c0b, user_id=89381a841d6845cea3680c0f92f9fd25, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:47.003359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94d59dc7ca144ef8b5726e17e0ef324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:47.004530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:47.005756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94d59dc7ca144ef8b5726e17e0ef324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:47.051979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7c27b9a0-a0e3-48d6-bf8e-a6b7e418b2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94d59dc7ca144ef8b5726e17e0ef324'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:47.094141 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3891/7768] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:46 2022] PUT /identity/v3/projects/0af78cb74e5646058c31f2d10f641c0b/users/89381a841d6845cea3680c0f92f9fd25/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:47.095445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:47.104580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:47.141931 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3878/7769] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:46 2022] DELETE /identity/v3/users/b94d59dc7ca144ef8b5726e17e0ef324 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:14:47.146596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8e9b-a3ff-46e1-97a8-1d671f964fac None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:47.149832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8e9b-a3ff-46e1-97a8-1d671f964fac None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:47.150394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd8e9b-a3ff-46e1-97a8-1d671f964fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:47.208150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b6cd8e9b-a3ff-46e1-97a8-1d671f964fac None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:47.212769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b6cd8e9b-a3ff-46e1-97a8-1d671f964fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:47.286182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c0854-284a-4b94-83dc-59f8ec8659ab admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:47.413749 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3879/7770] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:47.422692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:47.423809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:47.424239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:47.424927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:47.425835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:47.428027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:47.446427 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3892/7771] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:47.447835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd8e9b-a3ff-46e1-97a8-1d671f964fac None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:47.462132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd8e9b-a3ff-46e1-97a8-1d671f964fac None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:47.466435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:47.469175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:47.470851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5ab3a-3869-4a74-b197-723853c31cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:47.472252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5ab3a-3869-4a74-b197-723853c31cef admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:47.472790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5ab3a-3869-4a74-b197-723853c31cef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:47.473282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5ab3a-3869-4a74-b197-723853c31cef admin admin] PATH_INFO: `/v3/projects/0af78cb74e5646058c31f2d10f641c0b/users/89381a841d6845cea3680c0f92f9fd25/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:47.475924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5ab3a-3869-4a74-b197-723853c31cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af78cb74e5646058c31f2d10f641c0b, user_id=89381a841d6845cea3680c0f92f9fd25, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:47.479835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5ab3a-3869-4a74-b197-723853c31cef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:47.507760 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3880/7772] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:47 2022] PUT /identity/v3/projects/0af78cb74e5646058c31f2d10f641c0b/users/89381a841d6845cea3680c0f92f9fd25/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:47.518965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a885c-079f-4780-b380-8fb1c6ab6775 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:47.522171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a885c-079f-4780-b380-8fb1c6ab6775 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:47.522598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a885c-079f-4780-b380-8fb1c6ab6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:47.586926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3f8a885c-079f-4780-b380-8fb1c6ab6775 None None] MFA Rules not processed for user `89381a841d6845cea3680c0f92f9fd25`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:47.588335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3f8a885c-079f-4780-b380-8fb1c6ab6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:47.596037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cfa85-8fbf-471b-a21e-1ab90f05fc41 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:47.712831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:47.716750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:47.717462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:47.718278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:47.780919 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3881/7773] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:47.782076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a885c-079f-4780-b380-8fb1c6ab6775 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:47.800290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a885c-079f-4780-b380-8fb1c6ab6775 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:47.826079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:47.829981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:47.831800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:47.833086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:47.834503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:47.836632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:47.872586 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3882/7774] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:14:47 2022] POST /identity/v3/domains => generated 276 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:47.872992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:47.875984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:47.878468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:47.924724 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3893/7775] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:14:48.010031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53ce1-20b1-4e8b-aa11-368fbe0f32ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.017338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.018517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.019084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.019766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51/config` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.021162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=89f2bd96098343868fe28bf04f781c51)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.024430 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:48.024430 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:14:48.024430 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:14:48.025972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.118884 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3883/7776] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:14:47 2022] PUT /identity/v3/domains/89f2bd96098343868fe28bf04f781c51/config => generated 138 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:48.120541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.134908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d776add-4953-482e-bd53-2d6ec50f54d7 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.148938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.154709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.154709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.154709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51/config/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.154709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=89f2bd96098343868fe28bf04f781c51, group=identity)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.155796 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:48.155796 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:14:48.155796 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:14:48.156651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.171994 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3894/7777] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:14:48 2022] GET /identity/v3/domains/89f2bd96098343868fe28bf04f781c51/config/identity => generated 45 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:48.173609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.184677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63fe4-dfbf-4669-9fb3-fb48f2647a88 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.193786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.195091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.196732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.196732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51/config/identity/driver` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.203649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=89f2bd96098343868fe28bf04f781c51, group=identity, option=driver)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.205855 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:48.205855 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:14:48.205855 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:14:48.209030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.247768 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3884/7778] 10.222.0.32 () {58 vars in 1295 bytes} [Sat May 7 22:14:48 2022] GET /identity/v3/domains/89f2bd96098343868fe28bf04f781c51/config/identity/driver => generated 31 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:48.252994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.269961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c7f49-506e-4e8e-a54b-3cd54a097faf tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.278991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.280171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.281101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.281497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51/config/ldap` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.283213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=89f2bd96098343868fe28bf04f781c51, group=ldap)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.285996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.294048 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3895/7779] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:14:48 2022] GET /identity/v3/domains/89f2bd96098343868fe28bf04f781c51/config/ldap => generated 106 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:48.299822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.324763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36263efe-bc22-49bd-aeed-4ee0af612148 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.365775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.366985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.367436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.367907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51/config/ldap/url` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.370114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=89f2bd96098343868fe28bf04f781c51, group=ldap, option=url)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.383252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.392268 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3885/7780] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:14:48 2022] GET /identity/v3/domains/89f2bd96098343868fe28bf04f781c51/config/ldap/url => generated 46 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:48.395902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.408680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2570230-8048-4796-8f7a-e0163faf56e8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.415592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.416759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.417398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.417982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51/config/ldap/user_tree_dn` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.420089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=89f2bd96098343868fe28bf04f781c51, group=ldap, option=user_tree_dn)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.423039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.433722 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3896/7781] 10.222.0.32 () {58 vars in 1301 bytes} [Sat May 7 22:14:48 2022] GET /identity/v3/domains/89f2bd96098343868fe28bf04f781c51/config/ldap/user_tree_dn => generated 63 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:48.438693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.450514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca0696-8eaf-4f49-a9c5-e729e2595d08 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.466087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.467634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.468458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.469963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51/config` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.471621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=89f2bd96098343868fe28bf04f781c51)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.474446 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:48.474446 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:14:48.474446 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:14:48.476166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.493987 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3886/7782] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:48 2022] DELETE /identity/v3/domains/89f2bd96098343868fe28bf04f781c51/config => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:48.498506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.513684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8d39-9e27-409e-9fae-f8c24255680a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.523249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.524365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.524759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.525167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.527398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=89f2bd96098343868fe28bf04f781c51)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.529763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.587029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '89f2bd96098343868fe28bf04f781c51'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:48.588003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '89f2bd96098343868fe28bf04f781c51'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:48.684293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '89f2bd96098343868fe28bf04f781c51'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:48.685430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '89f2bd96098343868fe28bf04f781c51'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:48.694728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:48.696590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:48.699313 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3897/7783] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:14:48 2022] PATCH /identity/v3/domains/89f2bd96098343868fe28bf04f781c51 => generated 277 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:14:48.713864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacd82-b27a-41bf-bb50-6efd6f189b3e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:48.862636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:48.863596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:48.863934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:48.864222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:48.886682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=89f2bd96098343868fe28bf04f781c51)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:48.888434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:48.928673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '89f2bd96098343868fe28bf04f781c51'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:48.933721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '89f2bd96098343868fe28bf04f781c51'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.032262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f2bd96098343868fe28bf04f781c51', 'request_id': 'req-11ef5602-9cd0-483d-b549-d3af371e7db0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.050266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f2bd96098343868fe28bf04f781c51', 'request_id': 'req-11ef5602-9cd0-483d-b549-d3af371e7db0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.063444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f2bd96098343868fe28bf04f781c51', 'request_id': 'req-11ef5602-9cd0-483d-b549-d3af371e7db0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.081476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] The token cache is being invalidate because project 89f2bd96098343868fe28bf04f781c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:49.081824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.083919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.104152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '89f2bd96098343868fe28bf04f781c51', 'request_id': 'req-11ef5602-9cd0-483d-b549-d3af371e7db0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.105919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '89f2bd96098343868fe28bf04f781c51', 'request_id': 'req-11ef5602-9cd0-483d-b549-d3af371e7db0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.121132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '89f2bd96098343868fe28bf04f781c51', 'request_id': 'req-11ef5602-9cd0-483d-b549-d3af371e7db0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.144199 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3887/7784] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:14:48 2022] DELETE /identity/v3/domains/89f2bd96098343868fe28bf04f781c51 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:49.153062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.185088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0927f82-be8d-462f-8cb4-ff38391d3002 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.305174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.306182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.306484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.306790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.307552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.309205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.334082 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3898/7785] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:14:49 2022] POST /identity/v3/domains => generated 276 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:49.334969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.336497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:49.352180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef5602-9cd0-483d-b549-d3af371e7db0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.426098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198197d0-6095-4090-9440-f0e7192af3be tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.427223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198197d0-6095-4090-9440-f0e7192af3be tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.427708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198197d0-6095-4090-9440-f0e7192af3be tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.428065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198197d0-6095-4090-9440-f0e7192af3be tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.429259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198197d0-6095-4090-9440-f0e7192af3be tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.431697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198197d0-6095-4090-9440-f0e7192af3be tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.479196 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3888/7786] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:14:49 2022] PUT /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config => generated 138 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:49.483880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.496101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0aa8a-5f9c-44b8-bf85-e0f485e7dc8a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.509290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.510302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.513941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.514985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.515846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.517026 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:49.517026 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:14:49.517026 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:14:49.530800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.537652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c7384-f878-4fd4-89db-acbc686229fd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.538102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c7384-f878-4fd4-89db-acbc686229fd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.538406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c7384-f878-4fd4-89db-acbc686229fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.578582 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3899/7787] 10.222.0.32 () {60 vars in 1270 bytes} [Sat May 7 22:14:49 2022] PATCH /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config => generated 141 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:49.579983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.596578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ad0c7384-f878-4fd4-89db-acbc686229fd None None] MFA Rules not processed for user `9b4988836610494ab48a138bd43d5b52`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:49.599402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ad0c7384-f878-4fd4-89db-acbc686229fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:49.611283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5859b21-5083-4e18-8ba0-93aa06624141 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.619962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.621195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.621694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.622293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.623879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.625850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.641946 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3900/7788] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:49 2022] GET /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config => generated 141 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:49.643380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.664342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616cbe6-381e-436e-815c-265e3f81174b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.678714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.679875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.680387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.680888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.681777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.690026 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:49.690026 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:14:49.690026 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:14:49.691996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.716311 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3901/7789] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:49 2022] DELETE /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:49.720632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.721487 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3889/7790] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:49.738848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd1d11-eb3a-47d1-82e7-5d1fc6153c37 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.752913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.754057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.754498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.754985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.756497 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.758314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Could not find any options in domain configuration for domain 5b0f5f47d8d94c379755b39afe3668cc.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 5b0f5f47d8d94c379755b39afe3668cc. May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:14:49.788622 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 5b0f5f47d8d94c379755b39afe3668cc. May 07 22:14:49.789711 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:49.790907 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3902/7791] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:49 2022] GET /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config => generated 151 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:14:49.795723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c7384-f878-4fd4-89db-acbc686229fd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.839986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c7384-f878-4fd4-89db-acbc686229fd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.853813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.855410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.857843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.859619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.860336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.862061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.881007 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3890/7792] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:49 2022] DELETE /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc/config => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:49.884900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.902576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11089c-3e39-48cd-84e3-9c3a268bee79 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:49.908373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:49.910090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:49.911280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:49.911778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:49.913613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:49.915637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:49.944498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.945626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.986618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.988260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:49.992963 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3903/7793] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:14:49 2022] PATCH /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc => generated 277 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:49.997298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:49.999680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:50.015110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcd95d-0ff9-401e-8e7d-a5eea14c28fa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:50.075923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:50.076858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:50.077152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:50.077433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:50.089813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5b0f5f47d8d94c379755b39afe3668cc)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:50.091561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:50.116339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.125055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.213522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc', 'request_id': 'req-db8882dc-55a0-4737-a4cd-e2f40198f0b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.219949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc', 'request_id': 'req-db8882dc-55a0-4737-a4cd-e2f40198f0b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.235836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc', 'request_id': 'req-db8882dc-55a0-4737-a4cd-e2f40198f0b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.252487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] The token cache is being invalidate because project 5b0f5f47d8d94c379755b39afe3668cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:50.252785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.253477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.264161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc', 'request_id': 'req-db8882dc-55a0-4737-a4cd-e2f40198f0b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.265201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc', 'request_id': 'req-db8882dc-55a0-4737-a4cd-e2f40198f0b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.269299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5b0f5f47d8d94c379755b39afe3668cc', 'request_id': 'req-db8882dc-55a0-4737-a4cd-e2f40198f0b8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.282124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3891/7794] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:14:49 2022] DELETE /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:50.283682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:50.295232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bb18f-fb17-4fc5-a07d-ebf4e0e54f1c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:50.307930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:50.309570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:50.407052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:50.408255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:50.408547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:50.408914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:50.409718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:50.411955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:50.442731 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3904/7795] 10.222.0.32 () {60 vars in 1148 bytes} [Sat May 7 22:14:50 2022] POST /identity/v3/domains => generated 277 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:50.446684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:50.449146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:50.463586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8882dc-55a0-4737-a4cd-e2f40198f0b8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:50.549693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679cff-7af2-4db0-82b6-aeef066c1a9a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:50.558542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:50.560333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:50.561908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:50.562353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:50.563751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:50.565096 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:50.565096 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:14:50.565096 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:14:50.566873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:50.600919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:50.602147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:50.602702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:50.603627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] PATH_INFO: `/v3/projects/2d3c999387164ee980313aa31b9f46c8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:50.607297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3c999387164ee980313aa31b9f46c8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:50.612172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:50.627806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3905/7796] 10.222.0.32 () {60 vars in 1268 bytes} [Sat May 7 22:14:50 2022] PUT /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config => generated 138 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:50.632630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:50.678526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2534191-ce13-47e6-8a53-a90bbe6a0be3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:50.685870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:50.691856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:50.693168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:50.693604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:50.694730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5, group=identity)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:50.697100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:50.741998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3c999387164ee980313aa31b9f46c8', 'request_id': 'req-b9939a2f-423b-48cf-b07f-702e4e06d8fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.751167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3906/7797] 10.222.0.32 () {60 vars in 1296 bytes} [Sat May 7 22:14:50 2022] PATCH /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity => generated 176 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:14:50.755086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:50.761339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3c999387164ee980313aa31b9f46c8', 'request_id': 'req-b9939a2f-423b-48cf-b07f-702e4e06d8fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.770136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103e766-dabb-43ea-8771-5df02f85c6a2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:50.782641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3c999387164ee980313aa31b9f46c8', 'request_id': 'req-b9939a2f-423b-48cf-b07f-702e4e06d8fd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.803443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] The token cache is being invalidate because project 2d3c999387164ee980313aa31b9f46c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:50.805966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.808862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:50.814042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3892/7798] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:50 2022] DELETE /identity/v3/projects/2d3c999387164ee980313aa31b9f46c8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:14:50.815345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:50.818638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:50.911079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9939a2f-423b-48cf-b07f-702e4e06d8fd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:50.917180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:50.918587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:50.919227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:50.919611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] PATH_INFO: `/v3/users/ce55988a1805465db77848defe12ba12` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:50.921970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce55988a1805465db77848defe12ba12)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:50.924695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:50.950298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:50.952236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:50.952684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:50.953113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity/driver` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:50.954023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5, group=identity, option=driver)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:50.957312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.021437 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3907/7799] 10.222.0.32 () {60 vars in 1317 bytes} [Sat May 7 22:14:50 2022] PATCH /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity/driver => generated 176 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:14:51.025091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.027025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:51.028887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce55988a1805465db77848defe12ba12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.038639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce55988a1805465db77848defe12ba12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.039515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce55988a1805465db77848defe12ba12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.040332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce55988a1805465db77848defe12ba12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.055480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce55988a1805465db77848defe12ba12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.059384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb71160-c5df-4899-9025-76d347a802d5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.075124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.075744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.076031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.077439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity/driver` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.077619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5, group=identity, option=driver)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.085069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.099768 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3893/7800] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:50 2022] DELETE /identity/v3/users/ce55988a1805465db77848defe12ba12 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:51.132089 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3908/7801] 10.222.0.32 () {58 vars in 1298 bytes} [Sat May 7 22:14:51 2022] DELETE /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity/driver => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:51.143467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.147114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:51.302015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2aafe-8df3-461e-9875-c80e85c864b9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.316118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.317524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.319935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.321018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity/driver` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.322952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5, group=identity, option=driver)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.326341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Could not find option driver in group identity in domain configuration for domain 52fceeff4d9144d5b7ffc6500ab132d5.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 52fceeff4d9144d5b7ffc6500ab132d5. May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:14:51.354933 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 52fceeff4d9144d5b7ffc6500ab132d5. May 07 22:14:51.356010 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:14:51.360004 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3894/7802] 10.222.0.32 () {58 vars in 1295 bytes} [Sat May 7 22:14:51 2022] GET /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity/driver => generated 171 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:14:51.361387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.378101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5657ba-a942-48b8-9913-b8b898be9c81 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.383789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.384804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.385186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.385873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.386682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5, group=identity)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.389722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.416471 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3909/7803] 10.222.0.32 () {58 vars in 1277 bytes} [Sat May 7 22:14:51 2022] DELETE /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:51.420779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.440731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776a9f3-f542-4f07-ae09-7730790e7ed2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.446195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.447249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.447632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.448007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.449335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5, group=identity)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.451093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Could not find group identity in domain configuration for domain 52fceeff4d9144d5b7ffc6500ab132d5.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 52fceeff4d9144d5b7ffc6500ab132d5. May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:14:51.470185 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 52fceeff4d9144d5b7ffc6500ab132d5. May 07 22:14:51.471284 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:14:51.473508 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3895/7804] 10.222.0.32 () {58 vars in 1274 bytes} [Sat May 7 22:14:51 2022] GET /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config/identity => generated 154 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:14:51.477295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.488432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570894b-9da9-4bae-85e4-9884dbe42de1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.494511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.495560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.495941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.496316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.497070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=52fceeff4d9144d5b7ffc6500ab132d5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.499778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.510609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.513102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:51.526323 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3910/7805] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:51 2022] DELETE /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5/config => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:51.531277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.551071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18fa7d-5f26-4624-888c-ace6520165a3 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.566541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.568113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.568113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.568451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.570563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=52fceeff4d9144d5b7ffc6500ab132d5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.572649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.619283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.624562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.640101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b6177-3cd6-42d7-9aba-74339765232e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.680183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.682230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.691278 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3911/7806] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:14:51 2022] PATCH /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5 => generated 278 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:51.692510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:51.694004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:51.777096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.777769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.778048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.778316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.780982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:51.816284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.817674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.846535 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3896/7807] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:51.861642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95658c91-1044-4aca-b462-61199a0c8b31 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:51.866873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:51.867752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:51.868033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:51.868314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:51.880940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=52fceeff4d9144d5b7ffc6500ab132d5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:51.883429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:51.918105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.925059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:51.989348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5', 'request_id': 'req-7bed67bd-3518-4880-a16a-6726f558c973'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.002807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5', 'request_id': 'req-7bed67bd-3518-4880-a16a-6726f558c973'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.015458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5', 'request_id': 'req-7bed67bd-3518-4880-a16a-6726f558c973'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.033501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] The token cache is being invalidate because project 52fceeff4d9144d5b7ffc6500ab132d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:52.033867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.034583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.049689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5', 'request_id': 'req-7bed67bd-3518-4880-a16a-6726f558c973'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.054428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5', 'request_id': 'req-7bed67bd-3518-4880-a16a-6726f558c973'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.055908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '52fceeff4d9144d5b7ffc6500ab132d5', 'request_id': 'req-7bed67bd-3518-4880-a16a-6726f558c973'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:52.062398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3912/7808] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:14:51 2022] DELETE /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:52.067932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.082384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95216dd1-fd5a-415c-8856-14ee79edf521 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.234745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.235404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.235684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.235956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.236595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.237639 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:52.237639 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:14:52.237639 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:14:52.239352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.259426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3897/7809] 10.222.0.32 () {58 vars in 1172 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:52.262096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.263691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:52.293647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed67bd-3518-4880-a16a-6726f558c973 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.307662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.308465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.308752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.309029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.309690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.310722 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:14:52.310722 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:14:52.310722 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:14:52.311705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.313061 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3913/7810] 10.222.0.32 () {58 vars in 1199 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.317633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.329775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcff36-e417-44ea-a208-772bbb8a3476 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.349913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.349913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.349913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.350440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.351092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.352753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.358380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.375067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e3ae-01a2-45ea-bdd6-b504a6ed272e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.375739 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3898/7811] 10.222.0.32 () {58 vars in 1220 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.385326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.386747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.388015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.388015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.388015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.391752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.397639 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3914/7812] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 07 22:14:52.399114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.420931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449ac15-2c15-45e4-a0c3-a9d1ff7ba225 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.439080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.439854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.440139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.440412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.441063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.442707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.447993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3899/7813] 10.222.0.32 () {58 vars in 1187 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:52.452577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.469123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d21898-dec6-4fd5-ba83-e3170d11af38 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.489885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.490660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.490975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.491248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.491912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.501009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.510920 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3915/7814] 10.222.0.32 () {58 vars in 1199 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.515458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.525891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716cb3f-ea00-454f-b695-9081b3356368 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.557675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.558480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.558764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.559065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.559731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.561632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.566087 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3900/7815] 10.222.0.32 () {58 vars in 1202 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.567124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.589398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be8c76-233b-4087-bddf-8d00a68e11ac tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.600002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.601065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.601522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.601933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.602939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.604737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.606376 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3916/7816] 10.222.0.32 () {58 vars in 1208 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.610284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.623884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e58ad-ffaf-4de3-a9e5-78f624d30ff1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.637469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.638272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.638554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.638854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.640068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.642834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.646395 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3901/7817] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.647826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.660850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818f739-55ff-4877-b381-b9c0fce51b6f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.673631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.674956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.675892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.676414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.677293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.679737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.682502 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3917/7818] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 07 22:14:52.687038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.701003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e79ba2-f303-4d68-b84e-56d3e7b685d0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.709422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.710388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.711454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.711454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.712478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.713686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.715341 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3902/7819] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.719174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.731347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f821ac-242b-4925-b3ed-105c728020bb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.738066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.739229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.739675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.740134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.741241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.743122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.748100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3918/7820] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.749313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.767060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a9bb6-5d2d-4c43-916c-d5a8a2a1d424 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.778495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.779482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.779911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.780288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.781060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.782878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.787323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3903/7821] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 07 22:14:52.788769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.806528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb29546-cb88-42b6-b562-ea91cb9df90f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.820266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.821319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.821921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.822692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.823571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.827954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.838575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.840164 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3919/7822] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.858480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb64310-631a-4438-921e-8e26ac729cc2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.869566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.870561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.870916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.871201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.872046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.874241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.876977 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3904/7823] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.879480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.898073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7a86f-5366-4b53-8f12-98cfc46188fc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.914908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.916477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.916776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.917063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.917741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.920095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.928058 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3920/7824] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.932281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.952423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f339ea0-7b45-4110-bec5-68871af83de5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:52.958380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:52.959239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:52.959524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:52.959802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:52.960468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:52.962103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:52.965734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3905/7825] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:52.969472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:52.981312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43db814-0d8f-404f-b921-99da909245e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.007161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.009435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.009935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.011119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.014885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.020211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.027602 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3921/7826] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:52 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.030807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.045223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06755b8f-7b50-4564-b368-475a00498b09 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.061740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.063031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.063534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.064048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.064924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.070380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.075325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3906/7827] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.077041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.091933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66a1c-25e2-460a-a336-7eaeb3d32255 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.106411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.107549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.108972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.109469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.111092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.113206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.118903 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3922/7828] 10.222.0.32 () {58 vars in 1268 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.121343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.136502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485e8d4-7f50-43b4-8f02-487da41a492b tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.149301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.152284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.152922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.153420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.154329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.159820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.161571 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3907/7829] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.166144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.179001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784e647-e62e-4525-a6bc-9b67007611de tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.206695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.207848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.208346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.208833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.222799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.226098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.229510 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3923/7830] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.232803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.248001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ab340-48e6-41ae-a241-553e0e1370e4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.262563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.263564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.263953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.265000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.265927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.270038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.273661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3908/7831] 10.222.0.32 () {58 vars in 1247 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.276792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.292442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a4705-1bff-4e0d-93bd-51a53c03f49a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.337562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.337562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.338080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.338439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.339824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.348395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.355041 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3924/7832] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.356415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.376023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18d783-7b51-44a0-9d50-513733be3e3a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.395696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.396953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.399661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.402615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.404481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.413594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.420720 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3909/7833] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.422492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.441823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0fddd-d070-49c1-9cdb-f7ac59462d1a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.464470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.465415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.469220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.470439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.471303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.475701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.485704 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3925/7834] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.489001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.517673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d8f5a-3edd-4624-8afa-199b168985b1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.546364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.547335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.554523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.556458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.557416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.566646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.570112 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3910/7835] 10.222.0.32 () {58 vars in 1289 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.574108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.590263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921d6b4-63ce-4c11-9a49-49d99cbea26a tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.614877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.616224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.616703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.618284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.627482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.643401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.647279 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3926/7836] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.651443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.670688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af8792-7341-4a9f-9520-7416c18ad9c2 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.696355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.700832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.701522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.704150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.705162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.722616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.746657 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3911/7837] 10.222.0.32 () {58 vars in 1265 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.749033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.761756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f7e68-9ebd-42d7-b660-0fea1cfe020c tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.777202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.778225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.778727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.779032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.779841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.781862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.789945 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3927/7838] 10.222.0.32 () {58 vars in 1307 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.793978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.812849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7ee52-692a-42d4-98dd-a96fa5e34ab0 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.824444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.825665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.826178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.827472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.828567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.833527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.839702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.860868 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3912/7839] 10.222.0.32 () {58 vars in 1289 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.861629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd11639-d7e3-4218-8625-1ff23e9f83cc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.873020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.875190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.881832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.882325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.883231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.885230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.889456 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3928/7840] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.890817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.906670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bea1a-930f-4dd9-b3e5-afbf69879596 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.934417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.935485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.936532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.937012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.937966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.944822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.951194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.951829 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3913/7841] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.967349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430aeeb-3fae-415d-aa0e-531e130105a8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:53.977058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:53.977935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:53.980311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:53.980798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:53.986961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:53.988932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:53.994642 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3929/7842] 10.222.0.32 () {58 vars in 1241 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:53.995630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:53.997965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:53.998356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.021494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224538-52f1-45f8-baea-e3dfe7c8aefa tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.036869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.038861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.040601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.041046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.042473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.045004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.050848 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3930/7843] 10.222.0.32 () {58 vars in 1244 bytes} [Sat May 7 22:14:53 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.053507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.078695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c32a51-dde8-48b6-a233-d6b6996aada5 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.097743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.099035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.099325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.099613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.100290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.105651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.111190 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3931/7844] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.116023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.133430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76133d0-9536-44ac-a714-cb9a43af513e tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.134133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b2c91-5e99-4f60-bfc7-962a6ac803c4 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.147766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.150045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.150384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.151364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] PATH_INFO: `/v3/projects/a6414a0ab3524c35acc79fca009c7cec` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.151628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.152615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.152779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.153332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.154210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6414a0ab3524c35acc79fca009c7cec)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.157867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.158295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.161514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.167688 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3932/7845] 10.222.0.32 () {58 vars in 1253 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.173219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.195355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781c2d9-c1f6-4955-9076-709aba0067fe tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.213426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.214452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.214900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.215287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.216157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.228404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.249804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3933/7846] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.251453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.278558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807d6f6-4f39-4934-a632-da40f047c347 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.280936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6414a0ab3524c35acc79fca009c7cec', 'request_id': 'req-68df9e62-2b55-470a-b691-d5d359221abc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:54.294132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6414a0ab3524c35acc79fca009c7cec', 'request_id': 'req-68df9e62-2b55-470a-b691-d5d359221abc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:54.312274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6414a0ab3524c35acc79fca009c7cec', 'request_id': 'req-68df9e62-2b55-470a-b691-d5d359221abc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:54.326195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] The token cache is being invalidate because project a6414a0ab3524c35acc79fca009c7cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:54.330606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:54.331945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-68df9e62-2b55-470a-b691-d5d359221abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:54.337105 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3914/7847] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:53 2022] DELETE /identity/v3/projects/a6414a0ab3524c35acc79fca009c7cec => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:54.345166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13cd1-7635-4858-9f13-d82b2aa36cb8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.345799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13cd1-7635-4858-9f13-d82b2aa36cb8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.347544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13cd1-7635-4858-9f13-d82b2aa36cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.388201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b2b13cd1-7635-4858-9f13-d82b2aa36cb8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:54.390268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b2b13cd1-7635-4858-9f13-d82b2aa36cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:54.420314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.421650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.425300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.426125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.428783 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.431800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.434701 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3934/7848] 10.222.0.32 () {58 vars in 1250 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.439233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.441688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:54.461816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f9543-e558-4608-907d-a6aff512aadc tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.469748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.471061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.471495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.472100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.473189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.475828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.478908 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3935/7849] 10.222.0.32 () {58 vars in 1256 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.484789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.513777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c03cb-c3a8-408f-a79d-c3f8d4c7fca1 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.537470 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3915/7850] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:54.542336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840005a-f5ef-4089-a77d-f3d9c8dc8a48 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.545892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840005a-f5ef-4089-a77d-f3d9c8dc8a48 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.547036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840005a-f5ef-4089-a77d-f3d9c8dc8a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.563339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.564338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.564822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.565241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.566080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.568013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.570413 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3936/7851] 10.222.0.32 () {58 vars in 1292 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.573921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.598751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfacc6f-12bf-4e0c-8748-720e5fce1dfb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.612979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7840005a-f5ef-4089-a77d-f3d9c8dc8a48 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:54.614352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7840005a-f5ef-4089-a77d-f3d9c8dc8a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:54.615173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.616109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.616466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.617196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.620556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.627018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.631667 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3916/7852] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:54.632103 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3937/7853] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.636552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840005a-f5ef-4089-a77d-f3d9c8dc8a48 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.638371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.648862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840005a-f5ef-4089-a77d-f3d9c8dc8a48 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.658108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.659053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.659340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.659622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.660363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:14:54.660659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.665000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503dde-172d-4ab1-9fa4-ea368cfce2fb tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.672039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.679466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.680436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.680928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.681481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.682519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.686036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.690688 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3938/7854] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.694202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3917/7855] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:14:54.698324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.698787 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.713822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71d78-674e-4d06-85aa-504939d6bc12 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.721826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.722706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f1fe1-3067-433f-8638-a92558b010de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.723465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.724085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.724660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.725864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.728648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.730401 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3939/7856] 10.222.0.32 () {58 vars in 1211 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.734290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.741138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.742489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.742881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.743104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.743891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.747830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.749306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de6654-e96b-4ed6-acb8-246b7d0f1744 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.757580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.758639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.759281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.759839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.760884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.762761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.765328 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3940/7857] 10.222.0.32 () {58 vars in 1226 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 07 22:14:54.768790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.786344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eeed44-27e2-431e-ac1b-0bc92902b54f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.797012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.800960 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3918/7858] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:54 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:54.802058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.802295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.802823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.803659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.804273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.807580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.809655 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3941/7859] 10.222.0.32 () {58 vars in 1214 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 07 22:14:54.814740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.834393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1c989-4727-433b-8341-291c3e59a0b6 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.908098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1ec76-73cd-406b-89b2-382ae431d1bb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.913114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.914405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.914405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.914598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.915583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.917373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.950839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.952550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.952894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.953178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.953994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.955733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.959888 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3942/7860] 10.222.0.32 () {58 vars in 1217 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 07 22:14:54.961465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.973437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e3f27-0aa3-4caf-9897-8371d10bed9d tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:54.975338 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3919/7861] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:54 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:14:54.979854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:54.980339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:54.980850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:54.981167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:54.981411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:54.982344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:54.984811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:54.989603 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3943/7862] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:54.992451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.004750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bfbe8-fa92-4ce7-971e-cd65c071ffd7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.010628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780f28-048b-4d95-b3e2-b25fbbf27293 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.031045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.032410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.033600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.034250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.037941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.037941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.044594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.053456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.053456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.053720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.054650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.056817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.056961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3920/7863] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:14:55.061789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.062703 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3944/7864] 10.222.0.32 () {58 vars in 1238 bytes} [Sat May 7 22:14:54 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:55.068705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.088332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918868-32b5-4f61-8ee3-1372e010476a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.093035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85fa4-5bf1-4f49-a018-bcb5e30883d8 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.098016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.099026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.100191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.100191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.100537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.102312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.102576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.103432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.103716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.104066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3945/7865] 10.222.0.32 () {58 vars in 1259 bytes} [Sat May 7 22:14:55 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) May 07 22:14:55.107694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.108882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.110730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.117201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.124476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee8d21-38e5-4c50-8ec6-556d46cf7b07 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.134016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.135042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.135428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.135838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.136586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.138549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.140937 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3946/7866] 10.222.0.32 () {58 vars in 1262 bytes} [Sat May 7 22:14:55 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:55.144669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.150611 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3921/7867] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:55.151568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.166349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c681b03-447f-4901-8a8f-7c3348ce2e4b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.174881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7613051-d71c-4028-bef2-74b450ae1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.177896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613051-d71c-4028-bef2-74b450ae1978 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.178986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613051-d71c-4028-bef2-74b450ae1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.180230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7613051-d71c-4028-bef2-74b450ae1978 admin admin] PATH_INFO: `/v3/projects/0915e3f568564652bbb67d8df1f997af/users/b067fb7cbdf4475f90f192e00e32d89e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.180885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7b539-4dc2-41d8-9a3b-38664999ab74 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.196639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.197596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.197969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.198334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.199102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.202447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.209811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3947/7868] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:14:55 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:55.211235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.237410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2955a4-b902-42fc-97a7-cc51d4a54643 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.250832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.251646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.251934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.252213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.252878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.254859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.258496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7613051-d71c-4028-bef2-74b450ae1978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0915e3f568564652bbb67d8df1f997af, user_id=b067fb7cbdf4475f90f192e00e32d89e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.259801 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3948/7869] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:55 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:55.264597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.265747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7613051-d71c-4028-bef2-74b450ae1978 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.293994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826807e-ed1b-4a0d-9532-3181723fac44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.313939 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3922/7870] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:55 2022] PUT /identity/v3/projects/0915e3f568564652bbb67d8df1f997af/users/b067fb7cbdf4475f90f192e00e32d89e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:55.332937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807070-f4a7-4eee-9677-19fd71cb2179 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.333645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807070-f4a7-4eee-9677-19fd71cb2179 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.335170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807070-f4a7-4eee-9677-19fd71cb2179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.456396 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-65807070-f4a7-4eee-9677-19fd71cb2179 None None] MFA Rules not processed for user `b067fb7cbdf4475f90f192e00e32d89e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:55.459913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65807070-f4a7-4eee-9677-19fd71cb2179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:55.504733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.505876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.506354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.506845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.508058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.510029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.523459 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3949/7871] 10.222.0.32 () {58 vars in 1277 bytes} [Sat May 7 22:14:55 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) May 07 22:14:55.531068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.573941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5100d34-ce72-4933-af01-b25cd342bcb7 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.587558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.588554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.588913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.589264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.604820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Could not find domain: 52fceeff4d9144d5b7ffc6500ab132d5.: keystone.exception.DomainNotFound: Could not find domain: 52fceeff4d9144d5b7ffc6500ab132d5. May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 52fceeff4d9144d5b7ffc6500ab132d5. May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:14:55.622164 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:14:55.624013 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:14:55.625128 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 52fceeff4d9144d5b7ffc6500ab132d5. May 07 22:14:55.626362 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.631211 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3950/7872] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:14:55 2022] PATCH /identity/v3/domains/52fceeff4d9144d5b7ffc6500ab132d5 => generated 112 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:14:55.631211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.661220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369dfd-ebf2-4dc0-ac8f-0b7ef1ac787f tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.663706 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3923/7873] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:55.668553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807070-f4a7-4eee-9677-19fd71cb2179 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.685161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.690085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.690480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.690907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/5b0f5f47d8d94c379755b39afe3668cc` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.703216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Could not find domain: 5b0f5f47d8d94c379755b39afe3668cc.: keystone.exception.DomainNotFound: Could not find domain: 5b0f5f47d8d94c379755b39afe3668cc. May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5b0f5f47d8d94c379755b39afe3668cc. May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:14:55.739018 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:14:55.740055 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:14:55.740895 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 5b0f5f47d8d94c379755b39afe3668cc. May 07 22:14:55.741801 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.741801 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3951/7874] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:14:55 2022] PATCH /identity/v3/domains/5b0f5f47d8d94c379755b39afe3668cc => generated 112 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:14:55.744368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.780565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677404af-36bf-4c62-a1a7-ea7940f11b44 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.795873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89381a841d6845cea3680c0f92f9fd25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0af78cb74e5646058c31f2d10f641c0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.797848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.801412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.801919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] PATH_INFO: `/v3/domains/89f2bd96098343868fe28bf04f781c51` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.822699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Could not find domain: 89f2bd96098343868fe28bf04f781c51.: keystone.exception.DomainNotFound: Could not find domain: 89f2bd96098343868fe28bf04f781c51. May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 89f2bd96098343868fe28bf04f781c51. May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:14:55.834745 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:14:55.835988 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application with Lock( May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self._enter() May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.creator() May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application created_value = creator( May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 07 22:14:55.836958 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 89f2bd96098343868fe28bf04f781c51. May 07 22:14:55.837869 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:14:55.838045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807070-f4a7-4eee-9677-19fd71cb2179 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:55.840501 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3952/7875] 10.222.0.32 () {60 vars in 1248 bytes} [Sat May 7 22:14:55 2022] PATCH /identity/v3/domains/89f2bd96098343868fe28bf04f781c51 => generated 112 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:14:55.843018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:55.844211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:55.844351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:55.844608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:55.845381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:55.848411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:55.851139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.855663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:55.900606 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3924/7876] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:14:55 2022] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:55.905422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:55.911945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c5801-a233-47ba-8fee-3a56df4f1f76 tempest-DomainConfigurationTestJSON-626835215 tempest-DomainConfigurationTestJSON-626835215-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:56.051775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:56.052949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.053233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.054248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] PATH_INFO: `/v3/users/a6cba46ebf09407bb4066c7c84c3b48b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.057711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cba46ebf09407bb4066c7c84c3b48b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:56.059748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:56.062694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506992cb-cfad-4b14-868b-477d24731b6b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:56.070256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:56.070976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.071263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.071540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.073313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:56.077489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:56.126256 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3925/7877] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:14:55 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:14:56.135295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:56.164640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cba46ebf09407bb4066c7c84c3b48b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:56.164779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec317eb-c57e-4974-b802-edede165aaae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:56.165552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cba46ebf09407bb4066c7c84c3b48b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:56.177529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:56.180245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.180538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.182230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.183017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:56.184663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:56.186544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cba46ebf09407bb4066c7c84c3b48b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:56.187860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cba46ebf09407bb4066c7c84c3b48b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:56.203921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f5d09274-2b99-439e-99fe-e0b628144c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cba46ebf09407bb4066c7c84c3b48b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:56.216996 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3926/7878] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:56.220874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:56.223465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:56.249950 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3953/7879] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:55 2022] DELETE /identity/v3/users/a6cba46ebf09407bb4066c7c84c3b48b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:56.251702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.252000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.252283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.260411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498e168-aec1-4a04-badc-c2e77d1eddff admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:56.301968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:56.305612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:56.432467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:56.433117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.433406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.433685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] PATH_INFO: `/v3/projects/4b5ccaf6668c46bd94cf08b123c62758/users/ee9d7bf1c1244a459637525349fea3c3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.486560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5ccaf6668c46bd94cf08b123c62758, user_id=ee9d7bf1c1244a459637525349fea3c3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:56.490878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:56.502836 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3954/7880] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:56.528010 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3927/7881] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:56 2022] PUT /identity/v3/projects/4b5ccaf6668c46bd94cf08b123c62758/users/ee9d7bf1c1244a459637525349fea3c3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:56.530371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:56.531863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:56.532146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:56.669326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c6329-8827-4863-b008-c17c440731e9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:56.682324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aed1d0-a2d7-4efa-b06a-c2b935643b68 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:56.693944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:56.699419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.700282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.700282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.703852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:56.710344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:56.751793 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3928/7882] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:14:56.753237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:56.798240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847a27f-591f-4713-b026-b2703ec93341 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:56.822060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8a56c-9850-4b88-bc1b-4aa72ae6a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:56.825232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8a56c-9850-4b88-bc1b-4aa72ae6a379 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.827188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8a56c-9850-4b88-bc1b-4aa72ae6a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.827701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8a56c-9850-4b88-bc1b-4aa72ae6a379 admin admin] PATH_INFO: `/v3/projects/4b5ccaf6668c46bd94cf08b123c62758/users/ee9d7bf1c1244a459637525349fea3c3/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.833073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8a56c-9850-4b88-bc1b-4aa72ae6a379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5ccaf6668c46bd94cf08b123c62758, user_id=ee9d7bf1c1244a459637525349fea3c3, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:56.841340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8a56c-9850-4b88-bc1b-4aa72ae6a379 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:56.869807 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3929/7883] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:14:56 2022] PUT /identity/v3/projects/4b5ccaf6668c46bd94cf08b123c62758/users/ee9d7bf1c1244a459637525349fea3c3/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:56.882529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.883346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.883860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.892529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:56.893259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:56.893479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:56.893755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:56.913345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:56.914960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:56.942606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3955/7884] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:56.945065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] MFA Rules not processed for user `ee9d7bf1c1244a459637525349fea3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:14:56.946638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:57.100152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3930/7885] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:14:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:14:57.111237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:57.112924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:57.252744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5513f2-311a-4f8e-b2e7-ff56c59f77d5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:57.339058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:57.340141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:57.340703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:57.341153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:57.344787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:57.445334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:57.449281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:57.494136 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3956/7886] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:14:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:14:58.239493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:58.242074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:14:58.481514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d014e6f-0b70-42fb-abf0-acd06257451b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:58.498105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:58.500128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:58.501094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:58.501542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] PATH_INFO: `/v3/projects/aee5607226124471a1af28dd9cc1743c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:58.505166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee5607226124471a1af28dd9cc1743c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:58.510671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:58.625440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee5607226124471a1af28dd9cc1743c', 'request_id': 'req-c91f0143-8280-4020-9e89-6a5ec06d137c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:58.646325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee5607226124471a1af28dd9cc1743c', 'request_id': 'req-c91f0143-8280-4020-9e89-6a5ec06d137c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:58.668634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee5607226124471a1af28dd9cc1743c', 'request_id': 'req-c91f0143-8280-4020-9e89-6a5ec06d137c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:58.710135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] The token cache is being invalidate because project aee5607226124471a1af28dd9cc1743c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:14:58.710434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:58.713554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c91f0143-8280-4020-9e89-6a5ec06d137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:58.715828 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3931/7887] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:14:58 2022] DELETE /identity/v3/projects/aee5607226124471a1af28dd9cc1743c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:14:58.721144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:14:58.749040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e13aa0-5f7a-4435-812d-70ded1f9ba87 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:14:58.906495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:14:58.907429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:14:58.907717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:14:58.907995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] PATH_INFO: `/v3/users/89381a841d6845cea3680c0f92f9fd25` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:14:58.909243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=89381a841d6845cea3680c0f92f9fd25)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:14:58.911446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:14:59.010076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89381a841d6845cea3680c0f92f9fd25'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:59.015026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89381a841d6845cea3680c0f92f9fd25'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:59.037433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89381a841d6845cea3680c0f92f9fd25'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:59.038240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89381a841d6845cea3680c0f92f9fd25'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:59.048610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89381a841d6845cea3680c0f92f9fd25'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:14:59.131296 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3957/7888] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:14:58 2022] DELETE /identity/v3/users/89381a841d6845cea3680c0f92f9fd25 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:00.484126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:00.484602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:00.484796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:00.550728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] MFA Rules not processed for user `8cddd0e679bc49369c57f5679f8226ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:00.552869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:00.697691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:00.699230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:00.730612 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3932/7889] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:00.748448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:00.750805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:00.798352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6f65d-c658-4aba-9e14-e6bad03a86ea admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:00.809053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45f2d2-59f4-4b0e-ade0-b9bf4c602ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:00.811046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f2d2-59f4-4b0e-ade0-b9bf4c602ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:00.812496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f2d2-59f4-4b0e-ade0-b9bf4c602ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:00.813429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45f2d2-59f4-4b0e-ade0-b9bf4c602ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:00.818580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-db45f2d2-59f4-4b0e-ade0-b9bf4c602ff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:00.944357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f67ee-7a6a-44f6-8851-d8fb447e6fe4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:00.955628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:00.956423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:00.956858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:00.957107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:00.972607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45f2d2-59f4-4b0e-ade0-b9bf4c602ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:00.974098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45f2d2-59f4-4b0e-ade0-b9bf4c602ff5 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:00.980098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:00.981808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:00.986696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3958/7890] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:01.006219 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3933/7891] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:01.099004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561013b-2cb3-4731-ab18-59c50ea6919a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:01.099190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561013b-2cb3-4731-ab18-59c50ea6919a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:01.099624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561013b-2cb3-4731-ab18-59c50ea6919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:01.157570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3561013b-2cb3-4731-ab18-59c50ea6919a None None] MFA Rules not processed for user `2c4d46ef99794532b7de756b929e6d17`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:01.163917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3561013b-2cb3-4731-ab18-59c50ea6919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:01.309711 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3959/7892] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:01.326100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:01.327768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:01.461247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a71df-b288-48fa-8dc4-79d3786fca5f service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:01.476279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:01.477161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:01.477448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:01.477840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] PATH_INFO: `/v3/projects/0af78cb74e5646058c31f2d10f641c0b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:01.479149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af78cb74e5646058c31f2d10f641c0b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:01.481129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:01.593929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af78cb74e5646058c31f2d10f641c0b', 'request_id': 'req-eda71a19-7525-427e-9be9-75dac2031338'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:01.612068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af78cb74e5646058c31f2d10f641c0b', 'request_id': 'req-eda71a19-7525-427e-9be9-75dac2031338'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:01.634159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af78cb74e5646058c31f2d10f641c0b', 'request_id': 'req-eda71a19-7525-427e-9be9-75dac2031338'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:01.653055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] The token cache is being invalidate because project 0af78cb74e5646058c31f2d10f641c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:01.653356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:01.659231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eda71a19-7525-427e-9be9-75dac2031338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:01.661553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3934/7893] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:01 2022] DELETE /identity/v3/projects/0af78cb74e5646058c31f2d10f641c0b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:01.667042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95df08-b7ad-48a3-9025-86b192403050 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:01.667405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95df08-b7ad-48a3-9025-86b192403050 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:01.667871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95df08-b7ad-48a3-9025-86b192403050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:01.741425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e95df08-b7ad-48a3-9025-86b192403050 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:01.746913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e95df08-b7ad-48a3-9025-86b192403050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:01.971298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3960/7894] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:01.979370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857574e1-73d2-482a-acf3-7594afa4d4bb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:01.979660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857574e1-73d2-482a-acf3-7594afa4d4bb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:01.980263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857574e1-73d2-482a-acf3-7594afa4d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.033451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-857574e1-73d2-482a-acf3-7594afa4d4bb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:02.035174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-857574e1-73d2-482a-acf3-7594afa4d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:02.055140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3935/7895] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:02.063811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95df08-b7ad-48a3-9025-86b192403050 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:02.093085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95df08-b7ad-48a3-9025-86b192403050 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:02.113325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:02.114308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:02.115600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:02.116129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.118840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:02.119371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:02.121208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:02.154090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857574e1-73d2-482a-acf3-7594afa4d4bb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:02.156612 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3961/7896] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:02.164873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857574e1-73d2-482a-acf3-7594afa4d4bb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:02.172447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:02.173391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:02.183461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:02.184095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.186432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:02.195751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:02.299627 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3936/7897] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:02 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:02.303029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:02.330533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbb3e4-07d8-4275-a72d-83f4c9f0bd5a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:02.533062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:02.534216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:02.534962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:02.535579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.536884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:02.539326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:02.586668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:02.587338 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3962/7898] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:02 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:02.603447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad9614-064b-4c78-aa67-6a1b46f06ba7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:02.624423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:02.625300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:02.625740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:02.626186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.627148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:02.629482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:02.646521 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3937/7899] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:02.651164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:02.664989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d3dea-ce77-4891-bf49-c485fd7a2218 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:02.673057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0fa98-f14c-48fe-803f-f580f858567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:02.674747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fa98-f14c-48fe-803f-f580f858567e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:02.676969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fa98-f14c-48fe-803f-f580f858567e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:02.677437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fa98-f14c-48fe-803f-f580f858567e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.678705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0fa98-f14c-48fe-803f-f580f858567e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:02.680861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0fa98-f14c-48fe-803f-f580f858567e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:02.705606 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3963/7900] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:02.712353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:02.737094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6e41d-9591-42c7-818e-52ddf711e987 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:02.753535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:02.755179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:02.755608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:02.756032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] PATH_INFO: `/v3/projects/6af136223d92400982c7fcd0e58ea235/users/e3750354c49743088c411431d1ed0c84/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.781763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af136223d92400982c7fcd0e58ea235, user_id=e3750354c49743088c411431d1ed0c84, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:02.785628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:02.821007 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3938/7901] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:02 2022] PUT /identity/v3/projects/6af136223d92400982c7fcd0e58ea235/users/e3750354c49743088c411431d1ed0c84/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:02.824008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef381ca-29d5-46e0-bd0c-7cf79d4f1f90 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:02.824521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef381ca-29d5-46e0-bd0c-7cf79d4f1f90 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:02.824607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef381ca-29d5-46e0-bd0c-7cf79d4f1f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:02.859045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cef381ca-29d5-46e0-bd0c-7cf79d4f1f90 None None] MFA Rules not processed for user `e3750354c49743088c411431d1ed0c84`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:02.861191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cef381ca-29d5-46e0-bd0c-7cf79d4f1f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:03.068575 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3964/7902] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:03.073134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:03.276585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d7ea-c248-4816-8422-abab90b3a24f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:03.291548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:03.292235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:03.292703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:03.293156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:03.294018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:03.296766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:03.353412 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3939/7903] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:03 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:03.357590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef381ca-29d5-46e0-bd0c-7cf79d4f1f90 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:03.382044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef381ca-29d5-46e0-bd0c-7cf79d4f1f90 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:03.526761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:03.527568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:03.527906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:03.528167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:03.528899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:03.533635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:03.572949 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3965/7904] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:03 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:03.577425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:03.594594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08125564-647e-4965-821c-9bd850ddb390 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:03.606384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:03.608908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:03.609261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:03.609555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:03.611466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:03.614621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:03.648405 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3940/7905] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:03.653194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:03.687906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eb799-1494-4fa4-814d-8bd528b0e54f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:03.703068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:03.703981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:03.704282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:03.704866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] PATH_INFO: `/v3/projects/2abee8c28e024906963aa78b8013c51e/users/1e90f24bfacd426ca14e4baeb67fcc31/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:03.747646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abee8c28e024906963aa78b8013c51e, user_id=1e90f24bfacd426ca14e4baeb67fcc31, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:03.751479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:03.772187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3966/7906] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:03 2022] PUT /identity/v3/projects/2abee8c28e024906963aa78b8013c51e/users/1e90f24bfacd426ca14e4baeb67fcc31/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:03.775980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:03.791180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfdacf-b854-4282-b777-ead3ca604f44 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:03.903428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d1001-a6b2-47d0-84d4-a407cc23601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:03.909137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d1001-a6b2-47d0-84d4-a407cc23601d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:03.909607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d1001-a6b2-47d0-84d4-a407cc23601d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:03.909895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d1001-a6b2-47d0-84d4-a407cc23601d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:03.911456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d1001-a6b2-47d0-84d4-a407cc23601d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:03.913998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d1001-a6b2-47d0-84d4-a407cc23601d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:03.938821 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3941/7907] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:03.943131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:03.959959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8d3ac-663b-499f-a799-b382d112b3bc admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:03.985020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:03.986673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:03.987076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:03.987363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] PATH_INFO: `/v3/projects/2abee8c28e024906963aa78b8013c51e/users/1e90f24bfacd426ca14e4baeb67fcc31/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:03.989875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abee8c28e024906963aa78b8013c51e, user_id=1e90f24bfacd426ca14e4baeb67fcc31, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:03.993440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.008725 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3967/7908] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:03 2022] PUT /identity/v3/projects/2abee8c28e024906963aa78b8013c51e/users/1e90f24bfacd426ca14e4baeb67fcc31/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:04.022070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043ee0-bce8-49bf-bbeb-0c27e63584d3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.022412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043ee0-bce8-49bf-bbeb-0c27e63584d3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.022785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73043ee0-bce8-49bf-bbeb-0c27e63584d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.093027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-73043ee0-bce8-49bf-bbeb-0c27e63584d3 None None] MFA Rules not processed for user `1e90f24bfacd426ca14e4baeb67fcc31`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:04.094525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-73043ee0-bce8-49bf-bbeb-0c27e63584d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:04.265700 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3942/7909] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:04.266911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.285361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d140d-d227-46e9-8bd6-3ad76d889645 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.300251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.300944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.302575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.302889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.303696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.306097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.338813 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3968/7910] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:04 2022] POST /identity/v3/services => generated 289 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:04.343641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73043ee0-bce8-49bf-bbeb-0c27e63584d3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.359801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73043ee0-bce8-49bf-bbeb-0c27e63584d3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.396878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.399679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.400156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.400689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.401769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.404324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: On instance['enabled']: May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: On instance['enabled']: May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: 'False' May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise error May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application 'False' May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.415232 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:15:04.416922 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application 'False' May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.422763 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3943/7911] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:15:04 2022] POST /identity/v3/endpoints => generated 283 bytes in 74 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:15:04.423686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.442640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798326c-8807-4234-ac34-5b942d71622d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.459299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.460535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.463844 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.465906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.467885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.472120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: On instance['enabled']: May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: On instance['enabled']: May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: 'True' May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise error May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application 'True' May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:04.496668 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:15:04.498679 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application 'True' May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:04.499768 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3969/7912] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:15:04 2022] POST /identity/v3/endpoints => generated 281 bytes in 77 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:15:04.507501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.540706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073252ed-c85d-47e5-ba72-a5deb262fc88 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.565025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.565868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.568482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.569317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.571138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.578998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.645948 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-489304092. To ensure interoperability, identifiers should be a valid uuid. May 07 22:15:04.645948 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 22:15:04.645948 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:15:04.709250 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3944/7913] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:15:04 2022] POST /identity/v3/endpoints => generated 357 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:04.718523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.736420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ee69-bd64-45d6-9d88-7a3cf141bc9e tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.783006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.785237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.786438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.787213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/regions/tempest-region-489304092` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.788818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-489304092)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.790884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.797448 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3970/7914] 10.222.0.32 () {58 vars in 1202 bytes} [Sat May 7 22:15:04 2022] GET /identity/v3/regions/tempest-region-489304092 => generated 178 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:04.801557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.818932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6585d7b-c899-44d9-afc8-adf42ca8cae4 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.828782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.829672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.829969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.830248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints/30caa821df654ebc9dc463ffafdc41d5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.838330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=30caa821df654ebc9dc463ffafdc41d5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.842653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: On instance['enabled']: May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: On instance['enabled']: May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: 'False' May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise error May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application 'False' May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.861453 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:15:04.862942 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application 'False' May 07 22:15:04.863876 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:04.868053 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3945/7915] 10.222.0.32 () {60 vars in 1254 bytes} [Sat May 7 22:15:04 2022] PATCH /identity/v3/endpoints/30caa821df654ebc9dc463ffafdc41d5 => generated 283 bytes in 67 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) May 07 22:15:04.872518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.883957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9cc83-11d9-4476-87e5-0888f4da26bc tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.889219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.890282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.890690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.891102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints/30caa821df654ebc9dc463ffafdc41d5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.892546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=30caa821df654ebc9dc463ffafdc41d5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.894303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:04.903613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '30caa821df654ebc9dc463ffafdc41d5', 'request_id': 'req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:04.925173 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3971/7916] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:04 2022] DELETE /identity/v3/endpoints/30caa821df654ebc9dc463ffafdc41d5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:04.929379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:04.942974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529691c2-bf48-48ce-b8b3-969db1a09d7a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:04.980996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:04.987032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:04.987661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:04.987942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/regions/tempest-region-489304092` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:04.988652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-489304092)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:04.992443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.026676 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3946/7917] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 22:15:04 2022] DELETE /identity/v3/regions/tempest-region-489304092 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:05.027460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:05.044808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b11b4-6443-4b04-8c6b-9092a2fa3ec0 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:05.075895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:05.077119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:05.077406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:05.077682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:05.078448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:05.083618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.115811 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-916980116. To ensure interoperability, identifiers should be a valid uuid. May 07 22:15:05.115811 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' May 07 22:15:05.115811 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:15:05.170447 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3972/7918] 10.222.0.32 () {60 vars in 1155 bytes} [Sat May 7 22:15:05 2022] POST /identity/v3/endpoints => generated 359 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:05.174883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:05.192237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb4c88-35e1-470e-bfb1-2bc92f03775a tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:05.213506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:05.214252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:05.214535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:05.214865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/regions/tempest-region-916980116` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:05.215497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-916980116)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:05.216643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.222814 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3947/7919] 10.222.0.32 () {58 vars in 1202 bytes} [Sat May 7 22:15:05 2022] GET /identity/v3/regions/tempest-region-916980116 => generated 178 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:05.225090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:05.254259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e143f08-3cd8-44b6-9f71-ccf174eb7215 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:05.269538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:05.270654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:05.270981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:05.271360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints/af3dbc7b039a4eb7973cb79da3cbb059` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:05.285684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=af3dbc7b039a4eb7973cb79da3cbb059)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:05.286817 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:15:05.286817 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:15:05.286817 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:15:05.288167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: On instance['enabled']: May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: On instance['enabled']: May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: 'True' May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise error May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application 'True' May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:05.311924 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) May 07 22:15:05.313644 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application On instance['enabled']: May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application 'True' May 07 22:15:05.314883 ncdv-master-1 devstack@keystone.service[91076]: ERROR keystone.server.flask.application May 07 22:15:05.320950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:05.321309 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3973/7920] 10.222.0.32 () {60 vars in 1254 bytes} [Sat May 7 22:15:05 2022] PATCH /identity/v3/endpoints/af3dbc7b039a4eb7973cb79da3cbb059 => generated 281 bytes in 97 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) May 07 22:15:05.339277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2700c0-29ec-4ee5-bf91-e4a4f9f23b0d tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:05.345870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:05.346932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:05.347441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:05.347778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/endpoints/af3dbc7b039a4eb7973cb79da3cbb059` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:05.349064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=af3dbc7b039a4eb7973cb79da3cbb059)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:05.350694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.360902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'af3dbc7b039a4eb7973cb79da3cbb059', 'request_id': 'req-a139d47b-16aa-458c-bfdd-621a972482df'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:05.376589 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3948/7921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat May 7 22:15:05 2022] DELETE /identity/v3/endpoints/af3dbc7b039a4eb7973cb79da3cbb059 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:05.378192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:05.393091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17484e5-88eb-4ae1-8b96-7c4d4b16676c tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:05.421725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:05.423326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:05.423326 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:05.423613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/regions/tempest-region-916980116` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:05.424694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-916980116)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:05.428477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.468820 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3974/7922] 10.222.0.32 () {58 vars in 1205 bytes} [Sat May 7 22:15:05 2022] DELETE /identity/v3/regions/tempest-region-916980116 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:05.471372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:05.491445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d47b-16aa-458c-bfdd-621a972482df tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:05.538977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898b19-7f6e-450a-8c10-d52175547607 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e90f24bfacd426ca14e4baeb67fcc31', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2abee8c28e024906963aa78b8013c51e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:05.540152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898b19-7f6e-450a-8c10-d52175547607 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:05.541917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898b19-7f6e-450a-8c10-d52175547607 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:05.543438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898b19-7f6e-450a-8c10-d52175547607 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] PATH_INFO: `/v3/services/6c9c45aa45a845f3acd3a322f59e915e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:05.547074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898b19-7f6e-450a-8c10-d52175547607 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6c9c45aa45a845f3acd3a322f59e915e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:05.550960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898b19-7f6e-450a-8c10-d52175547607 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.649170 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3949/7923] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:05 2022] DELETE /identity/v3/services/6c9c45aa45a845f3acd3a322f59e915e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:05.652990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:05.835446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a6d60-0b54-4414-bcd7-f237fa199166 tempest-EndpointsNegativeTestJSON-246488492 tempest-EndpointsNegativeTestJSON-246488492-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:05.864263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:05.866429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:05.866930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:05.867364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] PATH_INFO: `/v3/users/e3750354c49743088c411431d1ed0c84` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:05.870000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3750354c49743088c411431d1ed0c84)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:05.875049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:05.946575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3750354c49743088c411431d1ed0c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:05.947677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3750354c49743088c411431d1ed0c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:05.960592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3750354c49743088c411431d1ed0c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:05.962321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3750354c49743088c411431d1ed0c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:05.978945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3750354c49743088c411431d1ed0c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:06.009017 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3975/7924] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:05 2022] DELETE /identity/v3/users/e3750354c49743088c411431d1ed0c84 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:06.016995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:06.017700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:06.018146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:06.046141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:06.048323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:06.133349 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3950/7925] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:06.168194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:06.170539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:06.326968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d51ec9-c532-4897-b72c-742fd4f95f86 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:06.337074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:06.337823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:06.338177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:06.338573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:06.364018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:06.365813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:06.394539 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3976/7926] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:07.664511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:07.666951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:07.689762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8fe64-661a-467b-b3c5-2e59655c5d6c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:07.706146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:07.707096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:07.707384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:07.707670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] PATH_INFO: `/v3/projects/6af136223d92400982c7fcd0e58ea235` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:07.709891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af136223d92400982c7fcd0e58ea235)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:07.712077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:07.840027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af136223d92400982c7fcd0e58ea235', 'request_id': 'req-bf55c613-5cd2-4061-94b6-147fcf50bc6a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:07.849146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af136223d92400982c7fcd0e58ea235', 'request_id': 'req-bf55c613-5cd2-4061-94b6-147fcf50bc6a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:07.867459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af136223d92400982c7fcd0e58ea235', 'request_id': 'req-bf55c613-5cd2-4061-94b6-147fcf50bc6a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:07.893507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] The token cache is being invalidate because project 6af136223d92400982c7fcd0e58ea235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:07.893957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:07.895082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:07.897270 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3951/7927] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:07 2022] DELETE /identity/v3/projects/6af136223d92400982c7fcd0e58ea235 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:07.900885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:07.940948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff871-bc02-468c-9d91-622381d283e2 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:08.135124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:08.136040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:08.136398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:08.136591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] PATH_INFO: `/v3/users/1e90f24bfacd426ca14e4baeb67fcc31` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:08.156886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e90f24bfacd426ca14e4baeb67fcc31)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:08.164220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:08.313410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e90f24bfacd426ca14e4baeb67fcc31'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:08.314264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e90f24bfacd426ca14e4baeb67fcc31'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:08.329706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e90f24bfacd426ca14e4baeb67fcc31'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:08.330487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e90f24bfacd426ca14e4baeb67fcc31'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:08.354460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e90f24bfacd426ca14e4baeb67fcc31'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:08.392713 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3977/7928] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:07 2022] DELETE /identity/v3/users/1e90f24bfacd426ca14e4baeb67fcc31 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:08.980195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:08.981662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:09.009105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55c613-5cd2-4061-94b6-147fcf50bc6a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:09.136462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:09.139235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.139615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.140679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] PATH_INFO: `/v3/users/bb78a689b62644ec84725e7d8dba0141` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.142228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb78a689b62644ec84725e7d8dba0141)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:09.145171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:09.239474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb78a689b62644ec84725e7d8dba0141'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.246325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:09.247631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:09.259192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb78a689b62644ec84725e7d8dba0141'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.260853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb78a689b62644ec84725e7d8dba0141'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.261516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb78a689b62644ec84725e7d8dba0141'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.264897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960e52-8ae5-41ad-9f29-6c481bc049d2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:09.270598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:09.271744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.272246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.272682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] PATH_INFO: `/v3/projects/2abee8c28e024906963aa78b8013c51e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.274099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abee8c28e024906963aa78b8013c51e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:09.275334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f5ee5f8f-94e6-4fb5-97d2-c1b9f21f8076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb78a689b62644ec84725e7d8dba0141'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.276603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:09.303006 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3952/7929] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:08 2022] DELETE /identity/v3/users/bb78a689b62644ec84725e7d8dba0141 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:09.355190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abee8c28e024906963aa78b8013c51e', 'request_id': 'req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.366211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abee8c28e024906963aa78b8013c51e', 'request_id': 'req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.376794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abee8c28e024906963aa78b8013c51e', 'request_id': 'req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.401271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] The token cache is being invalidate because project 2abee8c28e024906963aa78b8013c51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:09.403223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.404956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b060e2fd-75e3-40d3-be1c-2eb5398d64c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.409692 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3978/7930] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:09 2022] DELETE /identity/v3/projects/2abee8c28e024906963aa78b8013c51e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:09.414643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6b4f-2ce5-4391-b404-7030663059b0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.415757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6b4f-2ce5-4391-b404-7030663059b0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.416217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c6b4f-2ce5-4391-b404-7030663059b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.456763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4a5c6b4f-2ce5-4391-b404-7030663059b0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:09.460559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a5c6b4f-2ce5-4391-b404-7030663059b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:09.551922 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3953/7931] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:09.553731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.554123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.554414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.591267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:09.593140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:09.607804 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3979/7932] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:09.608848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6b4f-2ce5-4391-b404-7030663059b0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:09.635967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c6b4f-2ce5-4391-b404-7030663059b0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:09.647484 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:09.668220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.668533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.668823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.673214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:09.673580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:09.676703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:09.703058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:09.709083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:09.713550 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3954/7933] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:09.715958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:09.730257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94f254-3caf-4738-9b3a-ddce744502d1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:09.739547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:09.741882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.742433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.742548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622813b-8e50-4f07-a2d9-805829fe7a1a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:09.743070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.744055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:09.747259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:09.755947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:09.756841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.757262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.757545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] PATH_INFO: `/v3/users/b26898640e33414c9f52151aa2104bd2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.758832 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26898640e33414c9f52151aa2104bd2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:09.760806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:09.807008 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3955/7934] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:09 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:09.808171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:09.811233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:09.857905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26898640e33414c9f52151aa2104bd2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.859055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26898640e33414c9f52151aa2104bd2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.870294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26898640e33414c9f52151aa2104bd2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.871191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26898640e33414c9f52151aa2104bd2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.883608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26898640e33414c9f52151aa2104bd2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:09.901319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c88b50-78b4-4227-9c2b-20caa855ab95 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:09.909198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:09.910206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:09.910594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:09.911096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] PATH_INFO: `/v3/projects/c9548c9329cb4d1faef44a66d7c11a5c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:09.915897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9548c9329cb4d1faef44a66d7c11a5c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:09.916005 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3980/7935] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:09 2022] DELETE /identity/v3/users/b26898640e33414c9f52151aa2104bd2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:09.916005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:09.916199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:09.917111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.001026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9548c9329cb4d1faef44a66d7c11a5c', 'request_id': 'req-bc94ff4d-fa76-4565-8046-61664690a0dd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.016358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9548c9329cb4d1faef44a66d7c11a5c', 'request_id': 'req-bc94ff4d-fa76-4565-8046-61664690a0dd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.044268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9548c9329cb4d1faef44a66d7c11a5c', 'request_id': 'req-bc94ff4d-fa76-4565-8046-61664690a0dd'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.067641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd2fd-0952-466b-b5a4-6f7a6bcce760 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.074918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] The token cache is being invalidate because project c9548c9329cb4d1faef44a66d7c11a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:10.075225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.077814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bc94ff4d-fa76-4565-8046-61664690a0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.083256 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3956/7936] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:09 2022] DELETE /identity/v3/projects/c9548c9329cb4d1faef44a66d7c11a5c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:10.086392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.086712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.087023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.130997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:10.132515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.154999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.155699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.156161 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.156454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.157147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.160309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.194182 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3981/7937] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:09 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:10.197310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.199728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.223548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c3965-7147-4771-b13a-1315c326c972 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.229166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.230116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.230402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.230678 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] PATH_INFO: `/v3/users/1344b6e07143496498837b67e507b57a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.234693 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3957/7938] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:10.234693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.234693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.241316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1344b6e07143496498837b67e507b57a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.243622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.247215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3421fb7-97a7-4b27-84b7-516f58c0c1ee None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.252403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.253219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.253559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.253843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.254570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.256541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.267848 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3958/7939] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:10.268698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.270483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.305625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1344b6e07143496498837b67e507b57a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.307156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1344b6e07143496498837b67e507b57a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.315271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1344b6e07143496498837b67e507b57a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.316110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1344b6e07143496498837b67e507b57a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.330575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1344b6e07143496498837b67e507b57a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.345518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde2f4c-9d33-46a0-b52f-f8638b4a7787 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.349542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.350350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.350513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.350763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.353117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.365013 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3982/7940] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:10 2022] DELETE /identity/v3/users/1344b6e07143496498837b67e507b57a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:10.367961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.367961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.370021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.372082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.385393 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3959/7941] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:10.459485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5b761-ab4a-4159-a494-9d4dec188fe2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.465645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad3f87-0162-42ff-a6b7-8462e926ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.466360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3f87-0162-42ff-a6b7-8462e926ae5e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.466719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3f87-0162-42ff-a6b7-8462e926ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.467558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad3f87-0162-42ff-a6b7-8462e926ae5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.468298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad3f87-0162-42ff-a6b7-8462e926ae5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.469926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad3f87-0162-42ff-a6b7-8462e926ae5e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.482528 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3983/7942] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:10.488008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.498570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b931745-f7a1-46f8-84df-4a29d9267491 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.503986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.504741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.504927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.505430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] PATH_INFO: `/v3/projects/9da7337de2db4f85935a796443f76701/users/0999b5959af04cb7bd5b3655460a8ba9/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.522894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da7337de2db4f85935a796443f76701, user_id=0999b5959af04cb7bd5b3655460a8ba9, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.526221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.542681 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3960/7943] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:10 2022] PUT /identity/v3/projects/9da7337de2db4f85935a796443f76701/users/0999b5959af04cb7bd5b3655460a8ba9/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:10.553312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6e37d-6da9-4ac9-bccf-70938baa0d7e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.553943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6e37d-6da9-4ac9-bccf-70938baa0d7e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.553943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6e37d-6da9-4ac9-bccf-70938baa0d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.588243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3da6e37d-6da9-4ac9-bccf-70938baa0d7e None None] MFA Rules not processed for user `0999b5959af04cb7bd5b3655460a8ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:10.589593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3da6e37d-6da9-4ac9-bccf-70938baa0d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.602442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.604336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.692315 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3984/7944] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:10.696969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6e37d-6da9-4ac9-bccf-70938baa0d7e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.721969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343f93-7a5a-4d0d-9bde-8814d16fd74f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.728443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.729548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.729902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.730259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] PATH_INFO: `/v3/projects/9bf1a2d386684999b5a1d51a8c7593e2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.731927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf1a2d386684999b5a1d51a8c7593e2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.734034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.791088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6e37d-6da9-4ac9-bccf-70938baa0d7e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.799497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf1a2d386684999b5a1d51a8c7593e2', 'request_id': 'req-aab8fe91-78ff-4329-91b4-7f390a97a551'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.807597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf1a2d386684999b5a1d51a8c7593e2', 'request_id': 'req-aab8fe91-78ff-4329-91b4-7f390a97a551'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.819241 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf1a2d386684999b5a1d51a8c7593e2', 'request_id': 'req-aab8fe91-78ff-4329-91b4-7f390a97a551'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.836586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] The token cache is being invalidate because project 9bf1a2d386684999b5a1d51a8c7593e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:10.836969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.838214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:10.839875 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3961/7945] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:10 2022] DELETE /identity/v3/projects/9bf1a2d386684999b5a1d51a8c7593e2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:10.844332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.856180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:10.858381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.859119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.859410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.859691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.860422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.862804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.875276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8fe91-78ff-4329-91b4-7f390a97a551 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:10.899786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:10.900771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:10.901130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:10.911278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] PATH_INFO: `/v3/projects/d92ef52cd10747ffbb5c5d494e0ed006` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:10.912816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92ef52cd10747ffbb5c5d494e0ed006)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:10.915077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:10.917128 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3985/7946] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:10 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:10.925080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:10.934543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:11.001579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92ef52cd10747ffbb5c5d494e0ed006', 'request_id': 'req-07394828-651c-43f6-b988-a1e41b7448b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:11.014684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92ef52cd10747ffbb5c5d494e0ed006', 'request_id': 'req-07394828-651c-43f6-b988-a1e41b7448b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:11.028763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92ef52cd10747ffbb5c5d494e0ed006', 'request_id': 'req-07394828-651c-43f6-b988-a1e41b7448b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:11.048176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] The token cache is being invalidate because project d92ef52cd10747ffbb5c5d494e0ed006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:11.048460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:11.049537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-07394828-651c-43f6-b988-a1e41b7448b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:11.055416 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3962/7947] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:10 2022] DELETE /identity/v3/projects/d92ef52cd10747ffbb5c5d494e0ed006 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:11.056748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233bc4a-7e43-4186-8118-6972ee5e17e2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.057042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233bc4a-7e43-4186-8118-6972ee5e17e2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.057443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233bc4a-7e43-4186-8118-6972ee5e17e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.067770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eac1c-833a-493f-87b2-5bf78b3f139c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.085874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e233bc4a-7e43-4186-8118-6972ee5e17e2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:11.087206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e233bc4a-7e43-4186-8118-6972ee5e17e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:11.137466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.138618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.138910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.139344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.140157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.143000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.167448 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3963/7948] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:11.171512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1c5b-6d14-4f2a-9b54-ba4e1148e025 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.171928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1c5b-6d14-4f2a-9b54-ba4e1148e025 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.172758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b1c5b-6d14-4f2a-9b54-ba4e1148e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.190062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3986/7949] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:10 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:11.194153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.197277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:11.203353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-896b1c5b-6d14-4f2a-9b54-ba4e1148e025 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:11.204732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-896b1c5b-6d14-4f2a-9b54-ba4e1148e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:11.222734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3964/7950] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:11.227301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b1c5b-6d14-4f2a-9b54-ba4e1148e025 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.236661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2c08e-6f7c-4322-aab4-e0cc29bbfcc5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.251400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.253357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.254806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.254806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.257605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.259082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b1c5b-6d14-4f2a-9b54-ba4e1148e025 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.259508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.265272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.266026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.266443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.266734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.267596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:11.267916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.269671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.281248 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3987/7951] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:11.287082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.289494 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3965/7952] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:11.296757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.303938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c025-39ef-4dad-b85e-f3f850c630d7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.309282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c9d1-56b9-456b-aa05-c08121c8e8dc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.311408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.312482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.312926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.313490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] PATH_INFO: `/v3/projects/0172753595b046d787c13fca498183a0/users/228dd9025fd24620ab6ee4199154076a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.316637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.318017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.318357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.318643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.319471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.321455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.335244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0172753595b046d787c13fca498183a0, user_id=228dd9025fd24620ab6ee4199154076a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.340309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.368803 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3988/7953] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:11 2022] PUT /identity/v3/projects/0172753595b046d787c13fca498183a0/users/228dd9025fd24620ab6ee4199154076a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:11.372883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.382171 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3966/7954] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:11.385274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.509580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b582d6-7c8a-4493-830d-e51942f88e6f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.516362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.517112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.517403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.518146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.518637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.521109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.540894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392cd4-16d0-4743-b361-5fbd17dc70b7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.550087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.550965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.551449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.551936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.552857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.554022 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3967/7955] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:11.555078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.558033 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.572964 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3989/7956] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:11.574555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.575954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c8314-58b9-493a-b82c-060d589ddaf1 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.585136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.585980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.586348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.586760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.587600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.588341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c8a7-5f82-4329-8533-4b9739e25ecd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.589365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.596388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c8381-f843-41b5-af5b-0da2c1ad5b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.597823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8381-f843-41b5-af5b-0da2c1ad5b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.598109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8381-f843-41b5-af5b-0da2c1ad5b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.598388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c8381-f843-41b5-af5b-0da2c1ad5b7f admin admin] PATH_INFO: `/v3/projects/0172753595b046d787c13fca498183a0/users/228dd9025fd24620ab6ee4199154076a/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.600432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c8381-f843-41b5-af5b-0da2c1ad5b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0172753595b046d787c13fca498183a0, user_id=228dd9025fd24620ab6ee4199154076a, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.601812 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3968/7957] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:11.603491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c8381-f843-41b5-af5b-0da2c1ad5b7f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.605638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.616210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3990/7958] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:11 2022] PUT /identity/v3/projects/0172753595b046d787c13fca498183a0/users/228dd9025fd24620ab6ee4199154076a/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:11.618843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d5acd-9b4c-4c61-9e4d-5a0eaaf461a8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.626487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fc85-df16-499f-9e1c-2f075a015a24 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.627045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fc85-df16-499f-9e1c-2f075a015a24 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.627606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7fc85-df16-499f-9e1c-2f075a015a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.658175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-55f7fc85-df16-499f-9e1c-2f075a015a24 None None] MFA Rules not processed for user `228dd9025fd24620ab6ee4199154076a`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:11.659618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-55f7fc85-df16-499f-9e1c-2f075a015a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:11.686593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.686988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.687278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.687559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.688287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.689926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.700872 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3969/7959] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:11.704924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.715476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21075e4e-a723-45ba-9b56-0c9c7faf2810 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.720740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef333f-43cb-4aab-bdaf-13f8eed6e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.721656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef333f-43cb-4aab-bdaf-13f8eed6e5a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.721973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef333f-43cb-4aab-bdaf-13f8eed6e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.722245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef333f-43cb-4aab-bdaf-13f8eed6e5a7 admin admin] PATH_INFO: `/v3/projects/0b2121fd5dbf49cdb851fee1395ebc87/users/9f612fe04cb74ef99233d1a5938b6005/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.735885 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3991/7960] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:11.746962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fc85-df16-499f-9e1c-2f075a015a24 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.754682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef333f-43cb-4aab-bdaf-13f8eed6e5a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b2121fd5dbf49cdb851fee1395ebc87, user_id=9f612fe04cb74ef99233d1a5938b6005, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.757631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7fc85-df16-499f-9e1c-2f075a015a24 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.758006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef333f-43cb-4aab-bdaf-13f8eed6e5a7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.764164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.765289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.765716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.766911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.769178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.770859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.775980 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3970/7961] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:11 2022] PUT /identity/v3/projects/0b2121fd5dbf49cdb851fee1395ebc87/users/9f612fe04cb74ef99233d1a5938b6005/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:11.787750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.788266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.789100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.789946 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3992/7962] 10.222.0.32 () {60 vars in 1151 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/services => generated 240 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:11.793981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.815992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef1174-eea3-4abd-8d0a-40b658ef6474 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.818246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] MFA Rules not processed for user `9f612fe04cb74ef99233d1a5938b6005`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:11.819795 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:11.872303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.873898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.874178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.874454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/0fda83e03b68470fb590f10c39a52aeb` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.875127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0fda83e03b68470fb590f10c39a52aeb)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.876727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.888344 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3971/7963] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:11.896892 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3993/7964] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:11 2022] DELETE /identity/v3/services/0fda83e03b68470fb590f10c39a52aeb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:11.899370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.901138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:11.901269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.921060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa680-176f-4dc9-aaad-a64308b041ed tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.925952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.926599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.927136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.927259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.927882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.929472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:11.948387 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3994/7965] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:11 2022] POST /identity/v3/services => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:11.949273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:11.972347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87c5eb-113b-4ef0-9095-0335023de22c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:11.979725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:11.980706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:11.981067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:11.981406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/fef8165f1e424d93b3fd5b0a05fe7216` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:11.982952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:update_service(service_id=fef8165f1e424d93b3fd5b0a05fe7216)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:11.984740 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:15:11.984740 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:15:11.984740 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:15:11.985961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.005092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e96a9d-87a8-41e8-9028-2344f03bc58d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.011064 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3995/7966] 10.222.0.32 () {60 vars in 1251 bytes} [Sat May 7 22:15:11 2022] PATCH /identity/v3/services/fef8165f1e424d93b3fd5b0a05fe7216 => generated 283 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:12.012011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.032008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.033155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.033755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.034273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.035396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265ae41-09f1-4249-9f10-ff52a0c1be12 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.045816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.047387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.047387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.047621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/fef8165f1e424d93b3fd5b0a05fe7216` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.048158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:get_service(service_id=fef8165f1e424d93b3fd5b0a05fe7216)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.050939 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.051248 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:15:12.051248 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:15:12.051248 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:15:12.052292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.053851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.058740 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3996/7967] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:15:12 2022] GET /identity/v3/services/fef8165f1e424d93b3fd5b0a05fe7216 => generated 283 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:12.063342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.079518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090d300-838f-4979-8e82-28a3afc6f998 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.091026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.091929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.092218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.092335 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3972/7968] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:11 2022] GET /identity/v3/auth/tokens => generated 3383 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:12.092502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/fef8165f1e424d93b3fd5b0a05fe7216` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.093467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=fef8165f1e424d93b3fd5b0a05fe7216)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.095144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.132295 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3997/7969] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:12 2022] DELETE /identity/v3/services/fef8165f1e424d93b3fd5b0a05fe7216 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:12.133647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.149758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc593802-01fc-47dd-aa4d-b0d40aee67e0 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.175343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.176410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.176732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.177154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/fef8165f1e424d93b3fd5b0a05fe7216` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.177976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:get_service(service_id=fef8165f1e424d93b3fd5b0a05fe7216)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.179216 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:15:12.179216 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:15:12.179216 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:15:12.180418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Could not find service: fef8165f1e424d93b3fd5b0a05fe7216.: keystone.exception.ServiceNotFound: Could not find service: fef8165f1e424d93b3fd5b0a05fe7216. May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: fef8165f1e424d93b3fd5b0a05fe7216. May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application Traceback (most recent call last): May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 07 22:15:12.219898 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._get_service(service_id) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 07 22:15:12.220940 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.get_or_create( May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application with Lock( May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self._enter() May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application return self.creator() May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application created_value = creator( May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: fef8165f1e424d93b3fd5b0a05fe7216. May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: ERROR keystone.server.flask.application May 07 22:15:12.221997 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3973/7970] 10.222.0.32 () {58 vars in 1229 bytes} [Sat May 7 22:15:12 2022] GET /identity/v3/services/fef8165f1e424d93b3fd5b0a05fe7216 => generated 113 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 07 22:15:12.226959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.244659 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb4442-b519-4462-b42b-7ae1cf44fb50 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.251572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.252525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.252912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.254160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.255047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.262710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.286275 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3998/7971] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:12 2022] POST /identity/v3/services => generated 274 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:12.290907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.304166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692ab9d-b95d-4e85-8380-ece14c86af26 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.330161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.330851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.331137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.331412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.332171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.333745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.351814 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3974/7972] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:12 2022] POST /identity/v3/services => generated 274 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:12.355781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.368044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b72b8-2ea7-4be5-a9e8-c2d3d137f4e6 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.384625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.385585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.385760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.386138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.386952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.388969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.410587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 3999/7973] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:12 2022] POST /identity/v3/services => generated 274 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:12.414853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.427621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ea656-0659-4412-8eae-cf55103a4496 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.443339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.444083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.444356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.444633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.445341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.446535 ncdv-master-1 devstack@keystone.service[91075]: WARNING py.warnings [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:15:12.446535 ncdv-master-1 devstack@keystone.service[91075]: warnings.warn(msg) May 07 22:15:12.446535 ncdv-master-1 devstack@keystone.service[91075]: May 07 22:15:12.447468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.455506 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3975/7974] 10.222.0.32 () {58 vars in 1130 bytes} [Sat May 7 22:15:12 2022] GET /identity/v3/services => generated 2977 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:12.459685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.470646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1dece-9070-4001-8583-1c7ca096e33d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.475647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.476385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.476665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.476937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.477904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1577937644) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:12.478172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.479337 ncdv-master-1 devstack@keystone.service[91076]: WARNING py.warnings [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 07 22:15:12.479337 ncdv-master-1 devstack@keystone.service[91076]: warnings.warn(msg) May 07 22:15:12.479337 ncdv-master-1 devstack@keystone.service[91076]: May 07 22:15:12.480264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.485969 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4000/7975] 10.222.0.32 () {58 vars in 1221 bytes} [Sat May 7 22:15:12 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1577937644 => generated 417 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:12.489912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.499862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f6e1e-20bb-4854-b10a-d01c97580aa0 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.504818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.505550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.505942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.506820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.507612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-800318444) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:12.507928 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.509524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.515294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3976/7976] 10.222.0.32 () {58 vars in 1219 bytes} [Sat May 7 22:15:12 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-800318444 => generated 416 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:12.519162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.531812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1599ea-551f-4e90-a838-447f537b0ec8 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.537331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.538109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.538422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.538825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.539894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1905782623) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:12.540259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.542120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.550810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4001/7977] 10.222.0.32 () {58 vars in 1221 bytes} [Sat May 7 22:15:12 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1905782623 => generated 417 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:12.553229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.563765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37ac21-ab33-47b6-a13c-bf19f7e3ebf3 tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.570720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.571776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.572508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.572916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/d7675c12782b4787b7755931cdb8db0a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.573644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d7675c12782b4787b7755931cdb8db0a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.575368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.619867 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3977/7978] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:12 2022] DELETE /identity/v3/services/d7675c12782b4787b7755931cdb8db0a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:12.625230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.645444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50804387-ed9c-4d27-9275-6dbd9a40595e tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.670426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.671586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.671946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.672272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/c05b4dcf8c614a82b32ad270053cbc1a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.673030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c05b4dcf8c614a82b32ad270053cbc1a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.675328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.713102 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4002/7979] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:12 2022] DELETE /identity/v3/services/c05b4dcf8c614a82b32ad270053cbc1a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:12.718443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.731082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc967-648c-4fbc-bd95-723ee289117c tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.748761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfb144-4ff2-473f-a9aa-0365ee03992d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '228dd9025fd24620ab6ee4199154076a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0172753595b046d787c13fca498183a0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.749770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb144-4ff2-473f-a9aa-0365ee03992d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.750285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb144-4ff2-473f-a9aa-0365ee03992d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.750574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb144-4ff2-473f-a9aa-0365ee03992d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] PATH_INFO: `/v3/services/5bd672d6ff514b6fa0e6e79a6eadb111` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.751305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfb144-4ff2-473f-a9aa-0365ee03992d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5bd672d6ff514b6fa0e6e79a6eadb111)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.753035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cfb144-4ff2-473f-a9aa-0365ee03992d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.786473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3978/7980] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:12 2022] DELETE /identity/v3/services/5bd672d6ff514b6fa0e6e79a6eadb111 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:12.792162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:12.910267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131a633-8231-4d52-a839-33454927bd4d tempest-ServicesTestJSON-457976906 tempest-ServicesTestJSON-457976906-project-admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:12.924636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:12.925512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:12.925797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:12.926070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] PATH_INFO: `/v3/users/0999b5959af04cb7bd5b3655460a8ba9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:12.927324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0999b5959af04cb7bd5b3655460a8ba9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:12.929271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:12.986366 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0999b5959af04cb7bd5b3655460a8ba9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:12.987432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0999b5959af04cb7bd5b3655460a8ba9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:12.996667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0999b5959af04cb7bd5b3655460a8ba9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:12.997428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0999b5959af04cb7bd5b3655460a8ba9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:13.011543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0999b5959af04cb7bd5b3655460a8ba9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:13.056794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f51e-166c-4091-b811-151cc801f406 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:13.057311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f51e-166c-4091-b811-151cc801f406 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:13.057394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f51e-166c-4091-b811-151cc801f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:13.058810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4003/7981] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:12 2022] DELETE /identity/v3/users/0999b5959af04cb7bd5b3655460a8ba9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:13.085198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1b49f51e-166c-4091-b811-151cc801f406 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:13.086477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1b49f51e-166c-4091-b811-151cc801f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:13.162809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3979/7982] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:13.171640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:13.173217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:13.267931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e53b2-a741-41d1-9edf-f3dad73bb4e2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:13.272175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:13.272905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:13.273214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:13.273489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:13.283702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:13.285429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:13.315522 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4004/7983] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:13.315945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49f51e-166c-4091-b811-151cc801f406 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:13.334639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49f51e-166c-4091-b811-151cc801f406 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:13.340846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:13.341811 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:13.342374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:13.342800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:13.345470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:13.472064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:13.473728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:13.501112 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3980/7984] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:15:13.747348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:13.749202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:13.766687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeaf81-f021-41a8-8f18-92cd1a59d0cb service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:13.776574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:13.777790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:13.778755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:13.779647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] PATH_INFO: `/v3/projects/9da7337de2db4f85935a796443f76701` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:13.781034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da7337de2db4f85935a796443f76701)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:13.783066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:13.837985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da7337de2db4f85935a796443f76701', 'request_id': 'req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:13.845321 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da7337de2db4f85935a796443f76701', 'request_id': 'req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:13.853148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da7337de2db4f85935a796443f76701', 'request_id': 'req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:13.864652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] The token cache is being invalidate because project 9da7337de2db4f85935a796443f76701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:13.864948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:13.865603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:13.867225 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4005/7985] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:13 2022] DELETE /identity/v3/projects/9da7337de2db4f85935a796443f76701 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:13.871279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:13.881905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35b74a-26bd-4a6f-89ed-f664d9e4847a service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:13.955830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:13.961565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:13.961565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:13.961565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] PATH_INFO: `/v3/users/228dd9025fd24620ab6ee4199154076a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:13.961565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=228dd9025fd24620ab6ee4199154076a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:13.964965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:14.018737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228dd9025fd24620ab6ee4199154076a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:14.031323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228dd9025fd24620ab6ee4199154076a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:14.032184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228dd9025fd24620ab6ee4199154076a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:14.032835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228dd9025fd24620ab6ee4199154076a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:14.044336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6e8b926-08e7-41a5-989e-f56288e505b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228dd9025fd24620ab6ee4199154076a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:14.075719 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3981/7986] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:13 2022] DELETE /identity/v3/users/228dd9025fd24620ab6ee4199154076a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:14.939959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:14.942570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:14.957286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2de1f-b6e2-4fc6-a91b-1f76a873540c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:15.055669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:15.058351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.063032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.064447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] PATH_INFO: `/v3/projects/0172753595b046d787c13fca498183a0` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.074247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0172753595b046d787c13fca498183a0)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:15.081749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:15.176280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0172753595b046d787c13fca498183a0', 'request_id': 'req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:15.185337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0172753595b046d787c13fca498183a0', 'request_id': 'req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:15.200263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0172753595b046d787c13fca498183a0', 'request_id': 'req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:15.223013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] The token cache is being invalidate because project 0172753595b046d787c13fca498183a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:15.223318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:15.224068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0008ba00-95cf-42b7-8bec-6bfd7fc7836e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:15.226713 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4006/7987] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:14 2022] DELETE /identity/v3/projects/0172753595b046d787c13fca498183a0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:15.234352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dce5f-56ab-4fa9-8562-80ce64fbffc9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.234888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dce5f-56ab-4fa9-8562-80ce64fbffc9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.235043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dce5f-56ab-4fa9-8562-80ce64fbffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.256906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-687dce5f-56ab-4fa9-8562-80ce64fbffc9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:15.258327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-687dce5f-56ab-4fa9-8562-80ce64fbffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:15.378239 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3982/7988] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:15.387379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f5a4b-2a4d-4f1b-8f68-c19c9ca8eba7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.387649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f5a4b-2a4d-4f1b-8f68-c19c9ca8eba7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.387932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f5a4b-2a4d-4f1b-8f68-c19c9ca8eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.421400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e86f5a4b-2a4d-4f1b-8f68-c19c9ca8eba7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:15.422889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e86f5a4b-2a4d-4f1b-8f68-c19c9ca8eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:15.434811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4007/7989] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:15.438785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dce5f-56ab-4fa9-8562-80ce64fbffc9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:15.452839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dce5f-56ab-4fa9-8562-80ce64fbffc9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:15.459147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:15.459871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.460156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.460432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.461154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:15.461487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:15.463575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:15.476478 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3983/7990] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:15.481013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f5a4b-2a4d-4f1b-8f68-c19c9ca8eba7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:15.491356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f5a4b-2a4d-4f1b-8f68-c19c9ca8eba7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:15.500431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:15.501333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.501775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.502253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.502996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:15.505846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:15.544867 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4008/7991] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:15 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:15.546010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:15.559823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31176d2-3140-49c9-823d-c92bc6e7b7f4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:15.659970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:15.661272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.661814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.662663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.663425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:15.665703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:15.690021 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3984/7992] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:15 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:15.695119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:15.708165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89b2c-b43b-4078-b532-fbf6af0c2b55 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:15.716505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:15.718001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.718202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.718575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.719493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:15.721237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:15.733873 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4009/7993] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:15.737916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:15.757890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fee59-003d-4a77-8654-230f086ff0ff admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:15.767264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1272c94-5e74-4e7a-9b03-dfb5de99b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:15.771207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272c94-5e74-4e7a-9b03-dfb5de99b412 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.771207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272c94-5e74-4e7a-9b03-dfb5de99b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.771207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1272c94-5e74-4e7a-9b03-dfb5de99b412 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.771207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1272c94-5e74-4e7a-9b03-dfb5de99b412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:15.771207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1272c94-5e74-4e7a-9b03-dfb5de99b412 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:15.787428 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3985/7994] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:15.791581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:15.813476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e79fea-8b79-424c-b405-4fca25fe9990 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:15.820791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:15.821896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.822172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.822447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] PATH_INFO: `/v3/projects/cdfcebbfe45046ac92bf8e80dae4a82d/users/425c601e5f5a4740bd7f822518317f25/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.847116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfcebbfe45046ac92bf8e80dae4a82d, user_id=425c601e5f5a4740bd7f822518317f25, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:15.851447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:15.872924 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4010/7995] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:15 2022] PUT /identity/v3/projects/cdfcebbfe45046ac92bf8e80dae4a82d/users/425c601e5f5a4740bd7f822518317f25/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:15.883193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbef2f-f0cf-4c15-a7c7-1b47503da152 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:15.883556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbef2f-f0cf-4c15-a7c7-1b47503da152 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:15.883906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbef2f-f0cf-4c15-a7c7-1b47503da152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:15.924167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-53cbef2f-f0cf-4c15-a7c7-1b47503da152 None None] MFA Rules not processed for user `425c601e5f5a4740bd7f822518317f25`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:15.926152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-53cbef2f-f0cf-4c15-a7c7-1b47503da152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:16.016476 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3986/7996] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:16.021770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:16.033849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d889d-b3c3-44c6-b1f9-ad11ce27c04f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:16.038559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c83bd-c3b3-45d2-b1a8-ab50e1fc10ee tempest-IdentityCatalogTest-1814853410 tempest-IdentityCatalogTest-1814853410-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425c601e5f5a4740bd7f822518317f25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdfcebbfe45046ac92bf8e80dae4a82d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:16.039210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c83bd-c3b3-45d2-b1a8-ab50e1fc10ee tempest-IdentityCatalogTest-1814853410 tempest-IdentityCatalogTest-1814853410-project] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:16.039494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c83bd-c3b3-45d2-b1a8-ab50e1fc10ee tempest-IdentityCatalogTest-1814853410 tempest-IdentityCatalogTest-1814853410-project] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:16.039937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c83bd-c3b3-45d2-b1a8-ab50e1fc10ee tempest-IdentityCatalogTest-1814853410 tempest-IdentityCatalogTest-1814853410-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:16.040589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c83bd-c3b3-45d2-b1a8-ab50e1fc10ee tempest-IdentityCatalogTest-1814853410 tempest-IdentityCatalogTest-1814853410-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:16.041816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c83bd-c3b3-45d2-b1a8-ab50e1fc10ee tempest-IdentityCatalogTest-1814853410 tempest-IdentityCatalogTest-1814853410-project] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:16.044144 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4011/7997] 10.222.0.32 () {58 vars in 1142 bytes} [Sat May 7 22:15:16 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:16.049817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbef2f-f0cf-4c15-a7c7-1b47503da152 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:16.150259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbef2f-f0cf-4c15-a7c7-1b47503da152 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:16.160589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:16.161674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:16.163056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:16.163631 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] PATH_INFO: `/v3/users/425c601e5f5a4740bd7f822518317f25` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:16.165432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=425c601e5f5a4740bd7f822518317f25)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:16.167625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:16.245981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425c601e5f5a4740bd7f822518317f25'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:16.255295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425c601e5f5a4740bd7f822518317f25'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:16.256024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425c601e5f5a4740bd7f822518317f25'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:16.256641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425c601e5f5a4740bd7f822518317f25'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:16.265180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425c601e5f5a4740bd7f822518317f25'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:16.286184 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3987/7998] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:16 2022] DELETE /identity/v3/users/425c601e5f5a4740bd7f822518317f25 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:16.291137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:16.291912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:16.292348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:16.312997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:16.314203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:16.382945 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4012/7999] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:16.400455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:16.401183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:16.470336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3aeb6-8348-483f-8b4e-228dbc778e3e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:16.475031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2de34-f42c-4b92-ad1a-972f5065b6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:16.476249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2de34-f42c-4b92-ad1a-972f5065b6ef service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:16.476541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2de34-f42c-4b92-ad1a-972f5065b6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:16.477007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2de34-f42c-4b92-ad1a-972f5065b6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:16.491060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2de34-f42c-4b92-ad1a-972f5065b6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:16.492545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2de34-f42c-4b92-ad1a-972f5065b6ef service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:16.507204 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3988/8000] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:16.966063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:16.968495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:16.985150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b91bb-b17b-48d3-98ae-ead6c6690c0b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:16.990660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:16.991415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:16.991779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:16.992132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] PATH_INFO: `/v3/projects/cdfcebbfe45046ac92bf8e80dae4a82d` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:16.993673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfcebbfe45046ac92bf8e80dae4a82d)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:16.995906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.052470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfcebbfe45046ac92bf8e80dae4a82d', 'request_id': 'req-bdc1f868-76ad-4e60-9a37-fa4763f37e69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:17.061020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfcebbfe45046ac92bf8e80dae4a82d', 'request_id': 'req-bdc1f868-76ad-4e60-9a37-fa4763f37e69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:17.073880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfcebbfe45046ac92bf8e80dae4a82d', 'request_id': 'req-bdc1f868-76ad-4e60-9a37-fa4763f37e69'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:17.087110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] The token cache is being invalidate because project cdfcebbfe45046ac92bf8e80dae4a82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:17.087413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:17.088243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bdc1f868-76ad-4e60-9a37-fa4763f37e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:17.089913 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4013/8001] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:16 2022] DELETE /identity/v3/projects/cdfcebbfe45046ac92bf8e80dae4a82d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:17.097395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eb829-e966-4aa1-a279-bb6035638eb2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.097395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eb829-e966-4aa1-a279-bb6035638eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.097395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eb829-e966-4aa1-a279-bb6035638eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.117403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bc2eb829-e966-4aa1-a279-bb6035638eb2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:17.118881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bc2eb829-e966-4aa1-a279-bb6035638eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:17.196783 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3989/8002] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:17.198934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d655a8-bfb6-4318-a09a-3e56407ab5b4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.199725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d655a8-bfb6-4318-a09a-3e56407ab5b4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.200296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d655a8-bfb6-4318-a09a-3e56407ab5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.239623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-28d655a8-bfb6-4318-a09a-3e56407ab5b4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:17.240869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-28d655a8-bfb6-4318-a09a-3e56407ab5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:17.268854 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4014/8003] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:17.272792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eb829-e966-4aa1-a279-bb6035638eb2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.288612 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eb829-e966-4aa1-a279-bb6035638eb2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:17.296781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:17.297763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.298254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.298715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.299885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:17.301319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:17.303346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.317804 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3990/8004] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:17.323056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d655a8-bfb6-4318-a09a-3e56407ab5b4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.337268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d655a8-bfb6-4318-a09a-3e56407ab5b4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:17.343367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:17.344324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.344793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.345279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.346183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:17.349103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.393026 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4015/8005] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:17 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:17.393676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.407314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b5f99-f9aa-46aa-9140-6e27721e682c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:17.506239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:17.507053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.507594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.507951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.508912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:17.510998 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.540213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.540974 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3991/8006] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:17 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:17.552580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e93e-982b-4c0a-b464-b5a39ba0696c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:17.558695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:17.559577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.559871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.560689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.561432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:17.563134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.575167 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4016/8007] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:17.579732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.589922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49da0-e450-4213-bdf3-90f66cf5f911 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:17.595176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed572a3-7dfa-4759-8c42-e74f9fcdf5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:17.595853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed572a3-7dfa-4759-8c42-e74f9fcdf5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.596139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed572a3-7dfa-4759-8c42-e74f9fcdf5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.596417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed572a3-7dfa-4759-8c42-e74f9fcdf5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.597175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed572a3-7dfa-4759-8c42-e74f9fcdf5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:17.598817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed572a3-7dfa-4759-8c42-e74f9fcdf5c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.610552 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3992/8008] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:17.614144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.625606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fd029-7ef2-4fc4-bcad-9e7f2599de3a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:17.630822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:17.631503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.631792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.632068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] PATH_INFO: `/v3/projects/c019ffb8c8ba4901a014b70e3fd90b14/users/0d07f5258b614bdbabcd26686372ed3e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.647384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c019ffb8c8ba4901a014b70e3fd90b14, user_id=0d07f5258b614bdbabcd26686372ed3e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:17.650057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.664644 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4017/8009] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:17 2022] PUT /identity/v3/projects/c019ffb8c8ba4901a014b70e3fd90b14/users/0d07f5258b614bdbabcd26686372ed3e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:17.675432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526bca-14a3-49fd-807e-de21b37b2914 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.675658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526bca-14a3-49fd-807e-de21b37b2914 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.675936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526bca-14a3-49fd-807e-de21b37b2914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.715249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-75526bca-14a3-49fd-807e-de21b37b2914 None None] MFA Rules not processed for user `0d07f5258b614bdbabcd26686372ed3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:17.716549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-75526bca-14a3-49fd-807e-de21b37b2914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:17.790851 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3993/8010] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:17.795830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.878425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4947b-6919-4e67-8f8d-0ebca0dd5015 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:17.885244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:17.885934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:17.886224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:17.886505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:17.887285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:17.889473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:17.927643 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4018/8011] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:17 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:17.932669 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526bca-14a3-49fd-807e-de21b37b2914 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:17.947010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526bca-14a3-49fd-807e-de21b37b2914 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:18.045781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:18.046618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.046970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.047248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.047963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:18.051245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:18.092041 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3994/8012] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:17 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:18.093666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:18.109836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795e40e-61ad-47f2-8891-b0708d55a48b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:18.120169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:18.120897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.121193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.121474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.122246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:18.124671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:18.142993 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4019/8013] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:18.145618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:18.156771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c159-ccd7-4811-9c97-d19eb7485c0f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:18.164322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6aacd-c0f7-4173-bb3f-44f8edcad231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:18.165489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6aacd-c0f7-4173-bb3f-44f8edcad231 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.165489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6aacd-c0f7-4173-bb3f-44f8edcad231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.165675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6aacd-c0f7-4173-bb3f-44f8edcad231 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.166426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6aacd-c0f7-4173-bb3f-44f8edcad231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:18.168381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6aacd-c0f7-4173-bb3f-44f8edcad231 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:18.179937 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3995/8014] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:18.183932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:18.194315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97522c0-040f-4c8e-9394-71c50a0bd71b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:18.207731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:18.210031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.210483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.210978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] PATH_INFO: `/v3/projects/5fddbf79a38043b9a1f29f4188bced31/users/53d5bac44b6d4871bf73f08c9b8de71c/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.231434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fddbf79a38043b9a1f29f4188bced31, user_id=53d5bac44b6d4871bf73f08c9b8de71c, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:18.249549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:18.273358 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4020/8015] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:18 2022] PUT /identity/v3/projects/5fddbf79a38043b9a1f29f4188bced31/users/53d5bac44b6d4871bf73f08c9b8de71c/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:18.284940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00aba5-5f27-43fe-9a69-195bc3744129 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.287318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00aba5-5f27-43fe-9a69-195bc3744129 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.287872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00aba5-5f27-43fe-9a69-195bc3744129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.325115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7f00aba5-5f27-43fe-9a69-195bc3744129 None None] MFA Rules not processed for user `53d5bac44b6d4871bf73f08c9b8de71c`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:18.327365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7f00aba5-5f27-43fe-9a69-195bc3744129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:18.431484 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3996/8016] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:18.451814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:18.454510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:18.530980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eaf43-ebe7-4ac2-824e-cf26b137ac4e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.531642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eaf43-ebe7-4ac2-824e-cf26b137ac4e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.532024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eaf43-ebe7-4ac2-824e-cf26b137ac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.564103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-4f9eaf43-ebe7-4ac2-824e-cf26b137ac4e None None] MFA Rules not processed for user `2c4d46ef99794532b7de756b929e6d17`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:18.566281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4f9eaf43-ebe7-4ac2-824e-cf26b137ac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:18.574612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56006a16-6019-49c7-9541-a5a64542da09 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:18.579024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:18.580211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.580508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.580790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.654144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:18.656109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:18.656636 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3997/8017] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:18.667370 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4021/8018] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:18.814410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:18.815000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:18.815481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:18.840867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:18.842143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:18.934037 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3998/8019] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:18.946824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:18.950085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.039580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a6574-335c-4a31-a7ab-ced819279c0a service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.045261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.045906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.046187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.046460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.055177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.056900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.065591 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4022/8020] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:15:19.168560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.170794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.255691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4effd16-a94e-49e7-8e85-c45aec002e57 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.276858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.276858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.281453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.281453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] PATH_INFO: `/v3/users/9f612fe04cb74ef99233d1a5938b6005` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.283766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f612fe04cb74ef99233d1a5938b6005)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.285951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.307866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.323583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc4024-d0ff-4ece-ac8b-b8fd41f7faeb service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.329536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.330640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.331842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.332386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.344408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.345988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.351835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f612fe04cb74ef99233d1a5938b6005'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.357835 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4023/8021] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:19.359041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.360238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f612fe04cb74ef99233d1a5938b6005'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.360793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.361251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f612fe04cb74ef99233d1a5938b6005'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.361979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f612fe04cb74ef99233d1a5938b6005'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.375617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-18122a62-9603-4216-a9e8-bb9153328710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f612fe04cb74ef99233d1a5938b6005'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.378402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1cc09-b128-4e5a-8e63-da2dd6cad3b4 service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.389503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.390389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.390931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.391245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] PATH_INFO: `/v3/users/b067fb7cbdf4475f90f192e00e32d89e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.392883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b067fb7cbdf4475f90f192e00e32d89e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.395981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.400296 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 3999/8022] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:19 2022] DELETE /identity/v3/users/9f612fe04cb74ef99233d1a5938b6005 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:19.406116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdf6c-2a1d-4cdb-b7b2-af7ab7ca9987 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.406752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdf6c-2a1d-4cdb-b7b2-af7ab7ca9987 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.407277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cdf6c-2a1d-4cdb-b7b2-af7ab7ca9987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.433995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f32cdf6c-2a1d-4cdb-b7b2-af7ab7ca9987 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:19.435790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f32cdf6c-2a1d-4cdb-b7b2-af7ab7ca9987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.456222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b067fb7cbdf4475f90f192e00e32d89e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.457143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b067fb7cbdf4475f90f192e00e32d89e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.466291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b067fb7cbdf4475f90f192e00e32d89e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.467747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b067fb7cbdf4475f90f192e00e32d89e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.476150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0cb6680f-914a-44a7-b05c-c1e8f4bf7eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b067fb7cbdf4475f90f192e00e32d89e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.495659 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4024/8023] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:19 2022] DELETE /identity/v3/users/b067fb7cbdf4475f90f192e00e32d89e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:19.498952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.498952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.498952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.511121 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4000/8024] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:19.511121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.511121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.511121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.517329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:19.518888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.534175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:19.535428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.588748 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4025/8025] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:15:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:19.589817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.592052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.612052 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4001/8026] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:19.612869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.614191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.660245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c988a-d971-4249-90f2-dcdadabf2d9f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.664135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.665009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.665419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.665798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.675572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.677074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.687958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4026/8027] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:19.688862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.691624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f86de-7116-469d-b12e-26d1d2873c8a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.702875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.703831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.704300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.704758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.714688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8b62-d394-432c-a64a-c3251cfe01d9 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.715534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.717253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.722680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.723449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.724334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.724334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.726796 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4002/8028] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:15:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:15:19.735540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.737504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.749182 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4027/8029] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:19.902081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.903861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.918957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eae536-f223-4a04-8a1d-b3363c1b0de0 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.924604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.925794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.926158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.926404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] PATH_INFO: `/v3/users/0d07f5258b614bdbabcd26686372ed3e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.927869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d07f5258b614bdbabcd26686372ed3e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.929963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:19.954540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:19.957083 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:19.975329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a97531-5a7e-4cb5-a576-212bba91cc98 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:19.986239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:19.989791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:19.990226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:19.990745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] PATH_INFO: `/v3/projects/0b2121fd5dbf49cdb851fee1395ebc87` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:19.993154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b2121fd5dbf49cdb851fee1395ebc87)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:19.995009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d07f5258b614bdbabcd26686372ed3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:19.998389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.006234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d07f5258b614bdbabcd26686372ed3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.007649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d07f5258b614bdbabcd26686372ed3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.008413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d07f5258b614bdbabcd26686372ed3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.026639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f6841e44-d9f4-47ec-9430-d11aba7019a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d07f5258b614bdbabcd26686372ed3e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.053373 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4003/8030] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:19 2022] DELETE /identity/v3/users/0d07f5258b614bdbabcd26686372ed3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:20.054962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504be27-3420-4813-b780-231fe728cfde None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.055542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504be27-3420-4813-b780-231fe728cfde None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.055849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504be27-3420-4813-b780-231fe728cfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.080858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b504be27-3420-4813-b780-231fe728cfde None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:20.083106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b504be27-3420-4813-b780-231fe728cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.091691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2121fd5dbf49cdb851fee1395ebc87', 'request_id': 'req-cdf4a288-516f-4359-aace-82a9be6592dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.099144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2121fd5dbf49cdb851fee1395ebc87', 'request_id': 'req-cdf4a288-516f-4359-aace-82a9be6592dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.112724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2121fd5dbf49cdb851fee1395ebc87', 'request_id': 'req-cdf4a288-516f-4359-aace-82a9be6592dc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.128289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] The token cache is being invalidate because project 0b2121fd5dbf49cdb851fee1395ebc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:20.128815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.129786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cdf4a288-516f-4359-aace-82a9be6592dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.132072 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4028/8031] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:19 2022] DELETE /identity/v3/projects/0b2121fd5dbf49cdb851fee1395ebc87 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:20.137085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d813-b14d-43e9-9ec5-fcb190bb1131 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.137451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d813-b14d-43e9-9ec5-fcb190bb1131 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.137857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6d813-b14d-43e9-9ec5-fcb190bb1131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.158098 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4004/8032] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:20.162999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a7e6d813-b14d-43e9-9ec5-fcb190bb1131 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:20.164304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a7e6d813-b14d-43e9-9ec5-fcb190bb1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.170752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504be27-3420-4813-b780-231fe728cfde None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.177460 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4029/8033] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:20.183477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b504be27-3420-4813-b780-231fe728cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.185888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.186183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.186460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.215818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:20.217181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.231066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4030/8034] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:20.231066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.231066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.245500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b6e78-7729-4a81-92bc-09fe44275b22 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.251658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.252532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.252819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.253102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] PATH_INFO: `/v3/projects/0915e3f568564652bbb67d8df1f997af` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.254314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0915e3f568564652bbb67d8df1f997af)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.256297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.263637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504be27-3420-4813-b780-231fe728cfde None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.268379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.269234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.269508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.269906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.280341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.281886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.292836 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4005/8035] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:15:20.295238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.306256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf2f50-64a9-4b34-8ef2-cd300b53159c service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.314670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0915e3f568564652bbb67d8df1f997af', 'request_id': 'req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.322050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0915e3f568564652bbb67d8df1f997af', 'request_id': 'req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.335657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0915e3f568564652bbb67d8df1f997af', 'request_id': 'req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.354545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] The token cache is being invalidate because project 0915e3f568564652bbb67d8df1f997af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:20.355581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.356815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.359402 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4031/8036] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:20 2022] DELETE /identity/v3/projects/0915e3f568564652bbb67d8df1f997af => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:20.363529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.364965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.390019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.390805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.391139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.391424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.392937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:20.393358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.395514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.412525 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4006/8037] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:20.417659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.420422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.434489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e76b-43e6-4588-9a5b-05da3c51eaa9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.442423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.442809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.443124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.443388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.444089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.446498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.470970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ddcd1-f9af-4e1a-9ee1-d5bb965cc989 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.476406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.477311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.477600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.478019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] PATH_INFO: `/v3/users/ee9d7bf1c1244a459637525349fea3c3` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.479662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9d7bf1c1244a459637525349fea3c3)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.481628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.486132 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4007/8038] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:20 2022] POST /identity/v3/projects => generated 357 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:20.507703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.543698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9d7bf1c1244a459637525349fea3c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.545014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9d7bf1c1244a459637525349fea3c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.552467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9d7bf1c1244a459637525349fea3c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.553232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9d7bf1c1244a459637525349fea3c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.562234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9d7bf1c1244a459637525349fea3c3'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.579740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72631ad2-67d5-431e-9166-3230db8c776c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.584919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.585602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.585883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.586153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.586808 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4032/8039] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:20 2022] DELETE /identity/v3/users/ee9d7bf1c1244a459637525349fea3c3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:20.586951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.588803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.610886 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4008/8040] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:20 2022] POST /identity/v3/users => generated 279 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:20.613963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.615437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.648845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.650844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.664264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22c7d-b648-459e-9fdf-d10def099e86 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.703229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d6a80-0066-4f51-83c1-07bb753a941c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.708972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.709652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.709938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.710227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.710993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.712692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.728650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4033/8041] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:20.730068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.746453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7ff8d-72aa-4d74-88ba-79aa5062db14 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.748285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.749734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.750022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.750303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] PATH_INFO: `/v3/projects/c019ffb8c8ba4901a014b70e3fd90b14` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.752363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c019ffb8c8ba4901a014b70e3fd90b14)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.755196 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.767123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.768138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.768583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.769190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.771300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.775664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.798327 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4034/8042] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:20.801502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.816227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874926f-ffc1-42b5-9c41-8a7f1e7f53c1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.827927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c019ffb8c8ba4901a014b70e3fd90b14', 'request_id': 'req-4f67b33f-e210-4802-9492-ee59d616b537'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.839307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c019ffb8c8ba4901a014b70e3fd90b14', 'request_id': 'req-4f67b33f-e210-4802-9492-ee59d616b537'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.850186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c019ffb8c8ba4901a014b70e3fd90b14', 'request_id': 'req-4f67b33f-e210-4802-9492-ee59d616b537'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.869923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] The token cache is being invalidate because project c019ffb8c8ba4901a014b70e3fd90b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:20.869923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.870266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:20.876698 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4009/8043] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:20 2022] DELETE /identity/v3/projects/c019ffb8c8ba4901a014b70e3fd90b14 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:20.877374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:20.878962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:20.953758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe80a8-4bcd-4153-aa0a-628e1204e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.954842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe80a8-4bcd-4153-aa0a-628e1204e0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.955213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe80a8-4bcd-4153-aa0a-628e1204e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.955904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe80a8-4bcd-4153-aa0a-628e1204e0e4 admin admin] PATH_INFO: `/v3/projects/98a950af6f40465aae55ff7e3a8455b8/users/57440be27d2e4a3e8841644b8e9790fe/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.977138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67b33f-e210-4802-9492-ee59d616b537 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:20.980690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe80a8-4bcd-4153-aa0a-628e1204e0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a950af6f40465aae55ff7e3a8455b8, user_id=57440be27d2e4a3e8841644b8e9790fe, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.984082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe80a8-4bcd-4153-aa0a-628e1204e0e4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:20.991864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:20.992841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:20.993134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:20.993505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] PATH_INFO: `/v3/users/53d5bac44b6d4871bf73f08c9b8de71c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:20.995558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d5bac44b6d4871bf73f08c9b8de71c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:20.997700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.004067 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4035/8044] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:20 2022] PUT /identity/v3/projects/98a950af6f40465aae55ff7e3a8455b8/users/57440be27d2e4a3e8841644b8e9790fe/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:21.015164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.015533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.016599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.079803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] MFA Rules not processed for user `57440be27d2e4a3e8841644b8e9790fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:21.081913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.111636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d5bac44b6d4871bf73f08c9b8de71c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.120029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d5bac44b6d4871bf73f08c9b8de71c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.120690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d5bac44b6d4871bf73f08c9b8de71c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.121317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d5bac44b6d4871bf73f08c9b8de71c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.131350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d5bac44b6d4871bf73f08c9b8de71c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.151288 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4010/8045] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:20 2022] DELETE /identity/v3/users/53d5bac44b6d4871bf73f08c9b8de71c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:21.152407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:21.155180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.170349 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4036/8046] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:21 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:21.195496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:21.197357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.247103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7700f0-a998-490c-9174-5a9f056655d0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:21.254460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:21.255445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.255871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.256161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] PATH_INFO: `/v3/projects/4b5ccaf6668c46bd94cf08b123c62758` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.257583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5ccaf6668c46bd94cf08b123c62758)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:21.259802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.310895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeba34-3f1f-4cda-9509-cec452b66e04 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:21.328622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5ccaf6668c46bd94cf08b123c62758', 'request_id': 'req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.337346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5ccaf6668c46bd94cf08b123c62758', 'request_id': 'req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.352359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5ccaf6668c46bd94cf08b123c62758', 'request_id': 'req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.365406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] The token cache is being invalidate because project 4b5ccaf6668c46bd94cf08b123c62758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:21.365701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.366938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6f8ed3f7-b8a9-4336-bab2-f98f0d03e459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.369641 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4011/8047] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:21 2022] DELETE /identity/v3/projects/4b5ccaf6668c46bd94cf08b123c62758 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:21.375390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220724d3-833d-4ae7-8900-5e14c168e862 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.375390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220724d3-833d-4ae7-8900-5e14c168e862 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.375632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220724d3-833d-4ae7-8900-5e14c168e862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.391887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:21.392811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.393207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.393600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.396217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.398936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-220724d3-833d-4ae7-8900-5e14c168e862 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:21.400136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-220724d3-833d-4ae7-8900-5e14c168e862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.459379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:21.461096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.467124 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4012/8048] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:21.475316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e08ee-8ab1-41bb-9585-a4ad3a95d910 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.475611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e08ee-8ab1-41bb-9585-a4ad3a95d910 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.476832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e08ee-8ab1-41bb-9585-a4ad3a95d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.479260 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4037/8049] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:15:21.501420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-877e08ee-8ab1-41bb-9585-a4ad3a95d910 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:21.502653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-877e08ee-8ab1-41bb-9585-a4ad3a95d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.518352 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4013/8050] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:21.522885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:21.536794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c186-380e-40c6-aacb-e3ab3d7c6ffc service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:21.542762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:21.543533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.543824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.544104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.545417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:21.545731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:21.547674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.581690 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4038/8051] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:21.586073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e08ee-8ab1-41bb-9585-a4ad3a95d910 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:21.603666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e08ee-8ab1-41bb-9585-a4ad3a95d910 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:21.611972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:21.612673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.612960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.613240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.614098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:21.616528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.620681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:21.622556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.643471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff32edc-5125-41f1-9828-04920fa1ca72 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:21.662514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:21.664939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.665263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.665546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] PATH_INFO: `/v3/projects/5fddbf79a38043b9a1f29f4188bced31` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.670029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4014/8052] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:21 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:21.671059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fddbf79a38043b9a1f29f4188bced31)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:21.673572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.676216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:21.806557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9cb90-5af6-4960-96a5-7752f758ed8d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:21.840288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fddbf79a38043b9a1f29f4188bced31', 'request_id': 'req-4d6bf285-dc29-4ec2-9968-418cd0041c80'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.860270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fddbf79a38043b9a1f29f4188bced31', 'request_id': 'req-4d6bf285-dc29-4ec2-9968-418cd0041c80'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.877466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fddbf79a38043b9a1f29f4188bced31', 'request_id': 'req-4d6bf285-dc29-4ec2-9968-418cd0041c80'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.894550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] The token cache is being invalidate because project 5fddbf79a38043b9a1f29f4188bced31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:21.895025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.896263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4d6bf285-dc29-4ec2-9968-418cd0041c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:21.908837 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4039/8053] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:21 2022] DELETE /identity/v3/projects/5fddbf79a38043b9a1f29f4188bced31 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:21.909197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:21.911015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.912456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.912743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.913775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:21.913908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f2cd-14de-4d87-94dd-7fac34a2e9d3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.914614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f2cd-14de-4d87-94dd-7fac34a2e9d3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.915023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f2cd-14de-4d87-94dd-7fac34a2e9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.921050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.944613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8815f2cd-14de-4d87-94dd-7fac34a2e9d3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:21.945985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8815f2cd-14de-4d87-94dd-7fac34a2e9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.949654 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4015/8054] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:21 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:21.951921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:21.953594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.964533 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4040/8055] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:21.966872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f521a8-fd9e-4a69-987e-20eb0c308f39 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.967441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f521a8-fd9e-4a69-987e-20eb0c308f39 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.967903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f521a8-fd9e-4a69-987e-20eb0c308f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.971253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d620a-8f0c-4d59-9ff8-386464727c4e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:21.977012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:21.977983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:21.979235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:21.979235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:21.980902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:21.982883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:21.991612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-91f521a8-fd9e-4a69-987e-20eb0c308f39 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:21.993439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-91f521a8-fd9e-4a69-987e-20eb0c308f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:21.999995 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4016/8056] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:22.001944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.006958 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4041/8057] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:22.007930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f521a8-fd9e-4a69-987e-20eb0c308f39 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.018548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97931d-7c30-4319-9613-28273379379a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.020023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f521a8-fd9e-4a69-987e-20eb0c308f39 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.025091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.026183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.026316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.026433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.026524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.027147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.027574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:22.027690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.027880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.028097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.029621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.030205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.031951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.044389 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4042/8058] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:22.050911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4017/8059] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:22.052561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.053161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.065683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d1b9-a083-4747-91de-a3c2bee7bf1f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.067149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae9dd-895d-4e59-b5b3-a1bf7d56e8dd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.071582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.072404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.072808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.073356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.074163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.075258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61870f4a-899a-4ab9-85fa-343b45f50290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.076379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61870f4a-899a-4ab9-85fa-343b45f50290 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.076827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61870f4a-899a-4ab9-85fa-343b45f50290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.076973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.077392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61870f4a-899a-4ab9-85fa-343b45f50290 admin admin] PATH_INFO: `/v3/projects/54b684b0f2ad42f09a2f5f65ab933a36/users/7307ff743bd64b3194403cd061d6683e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.096605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61870f4a-899a-4ab9-85fa-343b45f50290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b684b0f2ad42f09a2f5f65ab933a36, user_id=7307ff743bd64b3194403cd061d6683e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.099848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61870f4a-899a-4ab9-85fa-343b45f50290 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.128356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4043/8060] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:22 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:22.128831 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4018/8061] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:22 2022] PUT /identity/v3/projects/54b684b0f2ad42f09a2f5f65ab933a36/users/7307ff743bd64b3194403cd061d6683e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:22.135784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.140432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd48ef-1057-4dca-8354-686408cdd056 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.141061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd48ef-1057-4dca-8354-686408cdd056 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.141627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd48ef-1057-4dca-8354-686408cdd056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.183158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-26dd48ef-1057-4dca-8354-686408cdd056 None None] MFA Rules not processed for user `7307ff743bd64b3194403cd061d6683e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:22.184902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-26dd48ef-1057-4dca-8354-686408cdd056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:22.235457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221312c-b760-46fd-9240-82c89476217a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.240864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.241782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.242068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.242345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.243069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.245196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.277424 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4044/8062] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:22 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:22.281939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.296312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf56e5f-d63e-497c-84bd-fff4bfbc9590 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.303197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.303952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.304337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.304696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.305548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.307947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.319995 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4019/8063] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:22.323094 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4045/8064] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:22.324047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd48ef-1057-4dca-8354-686408cdd056 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.338811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.343824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:22.351801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd48ef-1057-4dca-8354-686408cdd056 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.359372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.361605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.362111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.362625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.364306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.366727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.390149 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4020/8065] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:22.391506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.410331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7102e-0757-488c-8f04-3b0c0a68c05e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.419173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fee9f-6639-4ea0-b3e6-17bbf11c6cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.423586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fee9f-6639-4ea0-b3e6-17bbf11c6cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.426469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fee9f-6639-4ea0-b3e6-17bbf11c6cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.427292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fee9f-6639-4ea0-b3e6-17bbf11c6cb0 admin admin] PATH_INFO: `/v3/projects/4fdda4cda3b543218d98019f17a4c31f/users/00ab6fa9cdae431c8fa08dacf673e6b2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.446852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d2cd7-09d4-4d2f-b0fd-9f8c192dc6ee admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.458745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fee9f-6639-4ea0-b3e6-17bbf11c6cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdda4cda3b543218d98019f17a4c31f, user_id=00ab6fa9cdae431c8fa08dacf673e6b2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.459866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.460814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.461198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.461557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.462133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fee9f-6639-4ea0-b3e6-17bbf11c6cb0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.475594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.477365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.482883 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4021/8066] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:22 2022] PUT /identity/v3/projects/4fdda4cda3b543218d98019f17a4c31f/users/00ab6fa9cdae431c8fa08dacf673e6b2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:22.496294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8466c3-4e2e-4f93-a34a-dab118a863a9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.496294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8466c3-4e2e-4f93-a34a-dab118a863a9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.496607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8466c3-4e2e-4f93-a34a-dab118a863a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.497983 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4046/8067] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:15:22.526221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fd8466c3-4e2e-4f93-a34a-dab118a863a9 None None] MFA Rules not processed for user `00ab6fa9cdae431c8fa08dacf673e6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:22.528300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fd8466c3-4e2e-4f93-a34a-dab118a863a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:22.623446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.623819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4022/8068] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:22.644437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4354-ecc1-4268-8b00-05fa06112a9c service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:22.787931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:22.789104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:22.789609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:22.790500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:22.791770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:22.794215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:22.842317 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4047/8069] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:22 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:22.847165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8466c3-4e2e-4f93-a34a-dab118a863a9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:22.867571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8466c3-4e2e-4f93-a34a-dab118a863a9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:23.014621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:23.015776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:23.017218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:23.017515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:23.018278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:23.025569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:23.074586 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4023/8070] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:22 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:23.076443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:23.108441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ea00e-86fa-4466-9e77-8e3a6db186f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:23.118284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:23.119216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:23.119565 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:23.120017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:23.120840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:23.130847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:23.161775 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4048/8071] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:23.163757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:23.179752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5f38d-e35c-4d8b-88c4-03f71b076be3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:23.208583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57e2b2-0314-412b-88b9-686006c16f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:23.212474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e2b2-0314-412b-88b9-686006c16f8a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:23.212802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e2b2-0314-412b-88b9-686006c16f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:23.215379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57e2b2-0314-412b-88b9-686006c16f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:23.222818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57e2b2-0314-412b-88b9-686006c16f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:23.222818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57e2b2-0314-412b-88b9-686006c16f8a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:23.258913 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4024/8072] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:23.263803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:23.277102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f623da-cf9a-4e76-98de-aa0a3a0f9b9c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:23.287735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:23.289358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:23.289851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:23.290345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] PATH_INFO: `/v3/projects/af779f7c532d4260b10c954aed32a264/users/775022940bca4c69b45104efdd3c29f5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:23.316116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af779f7c532d4260b10c954aed32a264, user_id=775022940bca4c69b45104efdd3c29f5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:23.320185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:23.359774 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4049/8073] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:23 2022] PUT /identity/v3/projects/af779f7c532d4260b10c954aed32a264/users/775022940bca4c69b45104efdd3c29f5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:23.361415 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3ae26-56bc-4fa9-9451-10f44e777927 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:23.361883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3ae26-56bc-4fa9-9451-10f44e777927 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:23.362258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3ae26-56bc-4fa9-9451-10f44e777927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:23.424497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b0b3ae26-56bc-4fa9-9451-10f44e777927 None None] MFA Rules not processed for user `775022940bca4c69b45104efdd3c29f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:23.427129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0b3ae26-56bc-4fa9-9451-10f44e777927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:23.546801 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4025/8074] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:23.561686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:23.658490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4630ae-eb49-4654-b9ab-3c16f7fe306a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:23.669245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:23.671012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:23.671680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:23.672259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:23.797581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:23.801935 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:23.817539 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4050/8075] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:23.941060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3ae26-56bc-4fa9-9451-10f44e777927 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:23.954503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3ae26-56bc-4fa9-9451-10f44e777927 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:23.958509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b51f19-8ac4-4959-b533-2e8ef121cd1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:23.959292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b51f19-8ac4-4959-b533-2e8ef121cd1c service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:23.959585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b51f19-8ac4-4959-b533-2e8ef121cd1c service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:23.959870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b51f19-8ac4-4959-b533-2e8ef121cd1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:23.970182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b51f19-8ac4-4959-b533-2e8ef121cd1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:23.971780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b51f19-8ac4-4959-b533-2e8ef121cd1c service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:23.983545 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4026/8076] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:25.650933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:25.752355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d1031-685e-41a2-9b76-2aa15bd97d4c service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:25.757846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:25.758718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:25.759028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:25.759303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] PATH_INFO: `/v3/users/00ab6fa9cdae431c8fa08dacf673e6b2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:25.760755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ab6fa9cdae431c8fa08dacf673e6b2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:25.762707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:25.846822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ab6fa9cdae431c8fa08dacf673e6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:25.848977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ab6fa9cdae431c8fa08dacf673e6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:25.859777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ab6fa9cdae431c8fa08dacf673e6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:25.861021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ab6fa9cdae431c8fa08dacf673e6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:25.875247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ab6fa9cdae431c8fa08dacf673e6b2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:25.921895 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4051/8077] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:25 2022] DELETE /identity/v3/users/00ab6fa9cdae431c8fa08dacf673e6b2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:25.926302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:25.926756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:25.927191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:25.951334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:25.952757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:26.029666 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4027/8078] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:26.041305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:26.042797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:26.131253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36730b83-1534-4be7-a93a-ad8e0ca9b6c5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:26.141344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:26.141979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:26.142278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:26.142679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:26.161924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:26.163776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:26.178544 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4052/8079] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:15:26.679310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:26.680991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:26.694721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274ae11-afa3-4ae8-8052-561ec8398145 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:26.700072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:26.701535 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:26.701773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:26.702044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] PATH_INFO: `/v3/projects/4fdda4cda3b543218d98019f17a4c31f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:26.703598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdda4cda3b543218d98019f17a4c31f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:26.705556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:26.763774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdda4cda3b543218d98019f17a4c31f', 'request_id': 'req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:26.783713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdda4cda3b543218d98019f17a4c31f', 'request_id': 'req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:26.795049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdda4cda3b543218d98019f17a4c31f', 'request_id': 'req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:26.812174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] The token cache is being invalidate because project 4fdda4cda3b543218d98019f17a4c31f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:26.812504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:26.813183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:26.814954 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4028/8080] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:26 2022] DELETE /identity/v3/projects/4fdda4cda3b543218d98019f17a4c31f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:26.819253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:26.831103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc1ff2-fb0f-4f9b-8006-9130e02018b5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:26.948231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:26.951488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:26.952031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:26.952380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] PATH_INFO: `/v3/users/775022940bca4c69b45104efdd3c29f5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:26.957194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775022940bca4c69b45104efdd3c29f5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:26.959729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:27.041726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775022940bca4c69b45104efdd3c29f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.042671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775022940bca4c69b45104efdd3c29f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.068018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775022940bca4c69b45104efdd3c29f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.068759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775022940bca4c69b45104efdd3c29f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.079341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-59ce416d-e24e-4a51-9a5e-f0c8c5f925a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775022940bca4c69b45104efdd3c29f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.111450 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4053/8081] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:26 2022] DELETE /identity/v3/users/775022940bca4c69b45104efdd3c29f5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:27.588695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:27.590491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:27.615862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0cfe5-6008-4fa9-ad2f-d30393e0847b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:27.702953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:27.704157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:27.704664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:27.705163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] PATH_INFO: `/v3/projects/af779f7c532d4260b10c954aed32a264` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:27.706587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af779f7c532d4260b10c954aed32a264)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:27.708768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:27.767263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af779f7c532d4260b10c954aed32a264', 'request_id': 'req-f06850bd-200f-4280-8874-bc062583c6f8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.786568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af779f7c532d4260b10c954aed32a264', 'request_id': 'req-f06850bd-200f-4280-8874-bc062583c6f8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.799374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af779f7c532d4260b10c954aed32a264', 'request_id': 'req-f06850bd-200f-4280-8874-bc062583c6f8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.817282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] The token cache is being invalidate because project af779f7c532d4260b10c954aed32a264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:27.817583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.818248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f06850bd-200f-4280-8874-bc062583c6f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:27.819853 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4029/8082] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:27 2022] DELETE /identity/v3/projects/af779f7c532d4260b10c954aed32a264 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:27.826829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a648-3d37-4970-8d6f-a4d0a0e16bc9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:27.827723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a648-3d37-4970-8d6f-a4d0a0e16bc9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:27.828162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215a648-3d37-4970-8d6f-a4d0a0e16bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:27.851583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2215a648-3d37-4970-8d6f-a4d0a0e16bc9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:27.853368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2215a648-3d37-4970-8d6f-a4d0a0e16bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:27.933171 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4054/8083] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:27.941599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0919-b32e-4555-a7b7-a8d84614bcd7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:27.941912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0919-b32e-4555-a7b7-a8d84614bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:27.942474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0919-b32e-4555-a7b7-a8d84614bcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:27.965516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f15c0919-b32e-4555-a7b7-a8d84614bcd7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:27.966878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f15c0919-b32e-4555-a7b7-a8d84614bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:27.975671 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4030/8084] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:27.979923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a648-3d37-4970-8d6f-a4d0a0e16bc9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:27.989978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215a648-3d37-4970-8d6f-a4d0a0e16bc9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:27.994635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:27.995354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:27.995642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:27.995922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:27.996655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:27.996964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:27.999162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.014123 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4055/8085] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:28.018920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c0919-b32e-4555-a7b7-a8d84614bcd7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.030030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.031566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c0919-b32e-4555-a7b7-a8d84614bcd7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.032726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:28.036335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.037006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.037289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.037914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.038761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.040880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.046511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58723-1e2a-4b8d-939f-208ba24391f6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.051551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.052420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.052709 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.052993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] PATH_INFO: `/v3/users/7307ff743bd64b3194403cd061d6683e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.054212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7307ff743bd64b3194403cd061d6683e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.056192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.072040 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4031/8086] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:28 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:28.076507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.112815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7307ff743bd64b3194403cd061d6683e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:28.113642 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7307ff743bd64b3194403cd061d6683e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:28.125515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7307ff743bd64b3194403cd061d6683e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:28.126528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7307ff743bd64b3194403cd061d6683e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:28.135908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-406c450d-922b-4449-8564-58e498370e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7307ff743bd64b3194403cd061d6683e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:28.149056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27035a73-58ff-4fe3-89a3-3531aafdfa62 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.155052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.156131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.156534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.156913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.157788 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.160075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4056/8087] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:28 2022] DELETE /identity/v3/users/7307ff743bd64b3194403cd061d6683e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:28.160326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.164993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.165364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.167075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.188732 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4032/8088] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:28 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:28.192030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:28.193334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.193470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:28.194613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:28.208648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efae80e-bda1-425f-82f8-ba28e76d04c5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.264440 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4057/8089] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:28.272625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.273410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.273747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.274059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.274959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.276589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.279046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.281524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:28.288020 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4033/8090] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:28.292004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.304305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672814e-030a-4979-a4fc-776e654ff1d9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.309159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.310587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.311247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.311247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.312021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.313636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.325251 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4034/8091] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:28.329158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.339279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990d2b0-1bf4-40b2-8236-62019098e208 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.345214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db73f96-5465-48c4-9f8a-fce28df6b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.346098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73f96-5465-48c4-9f8a-fce28df6b85f admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.346940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73f96-5465-48c4-9f8a-fce28df6b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.346940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db73f96-5465-48c4-9f8a-fce28df6b85f admin admin] PATH_INFO: `/v3/projects/dc58896944b4453089bc72b5241c7ff1/users/5eeec4c54fb54cf198b671f19ee7f5b7/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.351007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f73fe-cb61-42ce-b72b-f508ffaa0107 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.358804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.359858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.360157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.360719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.362487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73f96-5465-48c4-9f8a-fce28df6b85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc58896944b4453089bc72b5241c7ff1, user_id=5eeec4c54fb54cf198b671f19ee7f5b7, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.365218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db73f96-5465-48c4-9f8a-fce28df6b85f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.371724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.373854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.380421 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4035/8092] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:28 2022] PUT /identity/v3/projects/dc58896944b4453089bc72b5241c7ff1/users/5eeec4c54fb54cf198b671f19ee7f5b7/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:28.384559 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4058/8093] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:28.393778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975bfd-fffd-426e-b81d-877e4ff6cdce None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.394156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975bfd-fffd-426e-b81d-877e4ff6cdce None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.394567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9975bfd-fffd-426e-b81d-877e4ff6cdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.424274 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b9975bfd-fffd-426e-b81d-877e4ff6cdce None None] MFA Rules not processed for user `5eeec4c54fb54cf198b671f19ee7f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:28.425597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b9975bfd-fffd-426e-b81d-877e4ff6cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:28.502685 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4036/8094] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:28.514731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.516252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:28.585331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15e69c-1206-4560-9da6-f50e2b8432c6 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.647363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.648263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.648722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.649284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.659791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.661500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.675072 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4059/8095] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:28.797673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9975bfd-fffd-426e-b81d-877e4ff6cdce None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.814969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:28.816562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:28.910640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9975bfd-fffd-426e-b81d-877e4ff6cdce None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.917919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.918552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06971d6b-d552-48ab-96d8-c392310a563b service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:28.920201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.921402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.922074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] PATH_INFO: `/v3/users/5eeec4c54fb54cf198b671f19ee7f5b7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.925232 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eeec4c54fb54cf198b671f19ee7f5b7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.927497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.938575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:28.939502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:28.939990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:28.940450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] PATH_INFO: `/v3/projects/54b684b0f2ad42f09a2f5f65ab933a36` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:28.941870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b684b0f2ad42f09a2f5f65ab933a36)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:28.944007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:28.995850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eeec4c54fb54cf198b671f19ee7f5b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.005104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eeec4c54fb54cf198b671f19ee7f5b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.006181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eeec4c54fb54cf198b671f19ee7f5b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.007080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eeec4c54fb54cf198b671f19ee7f5b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.016379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7fa6fc97-efc7-44e4-b9bd-6cd94f04f378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eeec4c54fb54cf198b671f19ee7f5b7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.016845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b684b0f2ad42f09a2f5f65ab933a36', 'request_id': 'req-b4c99beb-0729-43cb-8fb0-e457039c24d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.024198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b684b0f2ad42f09a2f5f65ab933a36', 'request_id': 'req-b4c99beb-0729-43cb-8fb0-e457039c24d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.032079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b684b0f2ad42f09a2f5f65ab933a36', 'request_id': 'req-b4c99beb-0729-43cb-8fb0-e457039c24d6'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.036021 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4037/8096] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:28 2022] DELETE /identity/v3/users/5eeec4c54fb54cf198b671f19ee7f5b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:29.040328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.040862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.041147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.043548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] The token cache is being invalidate because project 54b684b0f2ad42f09a2f5f65ab933a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:29.043846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.044684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b4c99beb-0729-43cb-8fb0-e457039c24d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.046494 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4060/8097] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:28 2022] DELETE /identity/v3/projects/54b684b0f2ad42f09a2f5f65ab933a36 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:29.051558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c6864-fc5e-4d76-8bb9-1daeca665d9b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.051857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c6864-fc5e-4d76-8bb9-1daeca665d9b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.052141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c6864-fc5e-4d76-8bb9-1daeca665d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.064522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:29.065918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:29.074672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fc9c6864-fc5e-4d76-8bb9-1daeca665d9b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:29.076435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fc9c6864-fc5e-4d76-8bb9-1daeca665d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:29.131412 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4038/8098] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:29.142440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.145432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:29.161752 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4061/8099] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:29.163355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bfafc-9a1a-49fb-9f4b-5ad80eb29eb3 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.163650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bfafc-9a1a-49fb-9f4b-5ad80eb29eb3 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.164105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bfafc-9a1a-49fb-9f4b-5ad80eb29eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.183714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-595bfafc-9a1a-49fb-9f4b-5ad80eb29eb3 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:29.184956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-595bfafc-9a1a-49fb-9f4b-5ad80eb29eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:29.195098 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4062/8100] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:29.198663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bfafc-9a1a-49fb-9f4b-5ad80eb29eb3 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.213340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bfafc-9a1a-49fb-9f4b-5ad80eb29eb3 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.221778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.222806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.222977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.223189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.223883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:29.224191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.225801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.229023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61921e6f-54b0-4f94-aaec-a01622aac3e8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.232884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.233576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.233864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.234137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.242652 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4063/8101] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:29.243708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.244565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.246035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.255731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56f903-f8f3-46bb-bb81-27cd082ec68b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.266252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.267103 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.267338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.267651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.268802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.271328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.272142 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4039/8102] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:29.299702 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4064/8103] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:29 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:29.303967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.313875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142e464-3802-429f-ba32-69a871f707ea service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.371930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.372642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.372925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.373364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.374075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.376170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.398917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4040/8104] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:29 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:29.403131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.414099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527434ae-411c-4c4c-8190-06aadad2bf78 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.419068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.419789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.420095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.420394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.421140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.422790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.433382 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4065/8105] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:29.438028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.448303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8cc4a-21d3-4a37-a085-a82accade68b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.454094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7637f-6af9-4ad8-ab29-2245e7599a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.454755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7637f-6af9-4ad8-ab29-2245e7599a01 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.455065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7637f-6af9-4ad8-ab29-2245e7599a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.455442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7637f-6af9-4ad8-ab29-2245e7599a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.456159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7637f-6af9-4ad8-ab29-2245e7599a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.457746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7637f-6af9-4ad8-ab29-2245e7599a01 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.468148 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4041/8106] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:29.472426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.488992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c4d6-7428-40a6-979f-864c2f161bf4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.494892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.495791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.496079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.496361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] PATH_INFO: `/v3/projects/d8cb50bdf4a84c5b86d53ceb0021a81d/users/3f124f0e42464680adc1e3bc4c4b12ef/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.516155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cb50bdf4a84c5b86d53ceb0021a81d, user_id=3f124f0e42464680adc1e3bc4c4b12ef, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.519562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.535419 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4066/8107] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:29 2022] PUT /identity/v3/projects/d8cb50bdf4a84c5b86d53ceb0021a81d/users/3f124f0e42464680adc1e3bc4c4b12ef/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:29.545683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.546054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.546408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.577290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] MFA Rules not processed for user `3f124f0e42464680adc1e3bc4c4b12ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:29.589897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:29.678353 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4042/8108] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:29.691510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.693362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:29.753906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:29.755468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:29.798376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8f3b-64a7-4b7b-aab0-1fb885266e48 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.804400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8aa7f-49f1-4316-82e0-96e31ec0ed7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.805742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8aa7f-49f1-4316-82e0-96e31ec0ed7f service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.806540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8aa7f-49f1-4316-82e0-96e31ec0ed7f service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.807126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8aa7f-49f1-4316-82e0-96e31ec0ed7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.820337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8aa7f-49f1-4316-82e0-96e31ec0ed7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.822163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8aa7f-49f1-4316-82e0-96e31ec0ed7f service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.833791 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4067/8109] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:29.872156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2808-06a2-4320-9682-d8a10174ef36 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:29.878554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:29.880477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:29.880477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:29.880477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] PATH_INFO: `/v3/projects/dc58896944b4453089bc72b5241c7ff1` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:29.881791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc58896944b4453089bc72b5241c7ff1)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:29.883933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:29.957153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc58896944b4453089bc72b5241c7ff1', 'request_id': 'req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.965359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc58896944b4453089bc72b5241c7ff1', 'request_id': 'req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.976441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc58896944b4453089bc72b5241c7ff1', 'request_id': 'req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.994726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] The token cache is being invalidate because project dc58896944b4453089bc72b5241c7ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:29.995061 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.995816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e30853fe-a8c6-4fe8-a09a-a2ba2fda06f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:29.998054 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4043/8110] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:29 2022] DELETE /identity/v3/projects/dc58896944b4453089bc72b5241c7ff1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:30.003290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9f61-1de3-443c-a14c-62a5058e1e8f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.003799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9f61-1de3-443c-a14c-62a5058e1e8f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.003896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9f61-1de3-443c-a14c-62a5058e1e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.029634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-36df9f61-1de3-443c-a14c-62a5058e1e8f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:30.031420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-36df9f61-1de3-443c-a14c-62a5058e1e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:30.116357 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4068/8111] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:30.124932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cfea8-e47c-4e97-bde1-726461c3aa11 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.125663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cfea8-e47c-4e97-bde1-726461c3aa11 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.126244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9cfea8-e47c-4e97-bde1-726461c3aa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.151861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ee9cfea8-e47c-4e97-bde1-726461c3aa11 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:30.153234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ee9cfea8-e47c-4e97-bde1-726461c3aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:30.164010 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4044/8112] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:30.168275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df9f61-1de3-443c-a14c-62a5058e1e8f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.195133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df9f61-1de3-443c-a14c-62a5058e1e8f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:30.201300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:30.202048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.202340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.202622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.203562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:30.209292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:30.214314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:30.241485 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4069/8113] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:30.243052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cfea8-e47c-4e97-bde1-726461c3aa11 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.266736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9cfea8-e47c-4e97-bde1-726461c3aa11 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:30.273423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:30.274554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.275211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.275676 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.276541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:30.280283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:30.323142 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4045/8114] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:30 2022] POST /identity/v3/projects => generated 391 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:30.326630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.338277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de1064-a387-4048-aba6-b21fe29202ec admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:30.417385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:30.418541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.418904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.420245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.421094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:30.424006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:30.452413 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4070/8115] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:30 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:30.456863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.473721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c98c7-d84d-4c89-ad96-a098b185ba72 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:30.480802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:30.482395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.482689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.483075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.484233 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:30.486168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:30.502846 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4046/8116] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:30.504571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.518156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55f793-e3dd-4995-9dd3-b918a5e64329 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:30.524585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18603c66-727a-41ea-8925-a660746d0230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:30.526146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603c66-727a-41ea-8925-a660746d0230 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.526543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603c66-727a-41ea-8925-a660746d0230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.526985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603c66-727a-41ea-8925-a660746d0230 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.527828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18603c66-727a-41ea-8925-a660746d0230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:30.532098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18603c66-727a-41ea-8925-a660746d0230 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:30.545557 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4071/8117] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:30.551135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.565656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579f60f-97e4-48e0-b34d-a68cc81a1dc8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:30.572269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:30.573460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.573903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.574288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] PATH_INFO: `/v3/projects/c97cc2eddd154160b778a3336d71bc1a/users/7a1a72aff0004d55aec865834645bedf/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.596695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97cc2eddd154160b778a3336d71bc1a, user_id=7a1a72aff0004d55aec865834645bedf, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:30.600623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:30.627662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4047/8118] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:30 2022] PUT /identity/v3/projects/c97cc2eddd154160b778a3336d71bc1a/users/7a1a72aff0004d55aec865834645bedf/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:30.630358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb76d04-55aa-4a23-860f-58db8780f8da None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.630650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb76d04-55aa-4a23-860f-58db8780f8da None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.631265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb76d04-55aa-4a23-860f-58db8780f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.686887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dcb76d04-55aa-4a23-860f-58db8780f8da None None] MFA Rules not processed for user `7a1a72aff0004d55aec865834645bedf`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:30.688404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dcb76d04-55aa-4a23-860f-58db8780f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:30.772112 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4072/8119] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:30.776472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.878803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bd5a4-f7cb-4ba7-9e9d-0a19d6505457 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:30.889718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:30.890486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:30.890908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:30.891256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:30.892055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:30.895574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:30.933624 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4048/8120] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:30 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:30.937870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb76d04-55aa-4a23-860f-58db8780f8da None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:30.955734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb76d04-55aa-4a23-860f-58db8780f8da None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.005176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.010325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.058754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.061021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.061316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.062093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.062833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.075089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.092667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408cda-d9b7-4712-b9fc-41f8e252e9c0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.098406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.099307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.099588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.099861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] PATH_INFO: `/v3/users/57440be27d2e4a3e8841644b8e9790fe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.101046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57440be27d2e4a3e8841644b8e9790fe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.102802 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4073/8121] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:30 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:31.103039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.106302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.116290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3a288-2db3-4947-a309-d026fb92321a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.123128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.123906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.124296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.124701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.125533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.127286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.138671 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4074/8122] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:31.142694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.152377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57440be27d2e4a3e8841644b8e9790fe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.153994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535664b-ef74-4919-8155-9723eecb6245 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.158620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.159516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.159789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57440be27d2e4a3e8841644b8e9790fe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.159907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.160136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] PATH_INFO: `/v3/projects/d68cfabc02644e5899316723493712e1/users/fa644c83a97a43d4a275e06137514946/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.160645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57440be27d2e4a3e8841644b8e9790fe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.161276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57440be27d2e4a3e8841644b8e9790fe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.168533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ed334834-427b-4e62-ab49-36809d5d8ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57440be27d2e4a3e8841644b8e9790fe'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.176212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68cfabc02644e5899316723493712e1, user_id=fa644c83a97a43d4a275e06137514946, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.179114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.186983 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4049/8123] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:31 2022] DELETE /identity/v3/users/57440be27d2e4a3e8841644b8e9790fe => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:31.191521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.191823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.192103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.198898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4075/8124] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:31 2022] PUT /identity/v3/projects/d68cfabc02644e5899316723493712e1/users/fa644c83a97a43d4a275e06137514946/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:31.202626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.204703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.215747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:31.217378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.306565 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4050/8125] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:31.311502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7fdf2-2486-4962-ba49-1461da7ea207 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.316297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.318905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.320248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.321112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.321438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.321719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.322502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.324262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.341841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4076/8126] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:31.343118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.354498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276207-463f-4556-b490-646a3d2d9713 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.364694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625597f5-5ec7-4e8f-a955-1b12c97a54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.365754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625597f5-5ec7-4e8f-a955-1b12c97a54df admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.366150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625597f5-5ec7-4e8f-a955-1b12c97a54df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.366465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625597f5-5ec7-4e8f-a955-1b12c97a54df admin admin] PATH_INFO: `/v3/projects/d68cfabc02644e5899316723493712e1/users/fa644c83a97a43d4a275e06137514946/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.368707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625597f5-5ec7-4e8f-a955-1b12c97a54df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68cfabc02644e5899316723493712e1, user_id=fa644c83a97a43d4a275e06137514946, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.371608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625597f5-5ec7-4e8f-a955-1b12c97a54df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.385297 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4077/8127] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:31 2022] PUT /identity/v3/projects/d68cfabc02644e5899316723493712e1/users/fa644c83a97a43d4a275e06137514946/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:31.394673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6fd6e-d1d0-4b39-9cea-ed34f46ec124 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.395100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6fd6e-d1d0-4b39-9cea-ed34f46ec124 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.395259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6fd6e-d1d0-4b39-9cea-ed34f46ec124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.395758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6c309-c77e-4606-8897-9f18dbad5170 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.427115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-09c6fd6e-d1d0-4b39-9cea-ed34f46ec124 None None] MFA Rules not processed for user `fa644c83a97a43d4a275e06137514946`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:31.428533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09c6fd6e-d1d0-4b39-9cea-ed34f46ec124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.457110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.457759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.458046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.458329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.523416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4078/8128] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:31.533265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6fd6e-d1d0-4b39-9cea-ed34f46ec124 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.547919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6fd6e-d1d0-4b39-9cea-ed34f46ec124 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.552055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565c043-9709-4b98-994f-8b01360da1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.552873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565c043-9709-4b98-994f-8b01360da1ac service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.553173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565c043-9709-4b98-994f-8b01360da1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.553451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565c043-9709-4b98-994f-8b01360da1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.556954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.557107 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b565c043-9709-4b98-994f-8b01360da1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.558607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.570183 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4051/8129] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:31.645341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565c043-9709-4b98-994f-8b01360da1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.646928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565c043-9709-4b98-994f-8b01360da1ac service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.657840 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4079/8130] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:31.763615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:31.766240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.785042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764a4bc-1f0d-483a-8db5-aa98ba7deffe service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:31.790615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:31.791633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.791985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.792517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] PATH_INFO: `/v3/projects/98a950af6f40465aae55ff7e3a8455b8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.794831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a950af6f40465aae55ff7e3a8455b8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:31.796700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:31.853451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a950af6f40465aae55ff7e3a8455b8', 'request_id': 'req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.860267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a950af6f40465aae55ff7e3a8455b8', 'request_id': 'req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.867523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a950af6f40465aae55ff7e3a8455b8', 'request_id': 'req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.878978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] The token cache is being invalidate because project 98a950af6f40465aae55ff7e3a8455b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:31.879637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.880027 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-58135bc0-cb91-4cd6-bb25-95d65a7ccb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:31.881751 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4052/8131] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:31 2022] DELETE /identity/v3/projects/98a950af6f40465aae55ff7e3a8455b8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:31.886728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352020b-539f-4059-ac9b-eea714f3118a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.887081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352020b-539f-4059-ac9b-eea714f3118a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.887359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352020b-539f-4059-ac9b-eea714f3118a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:31.907016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1352020b-539f-4059-ac9b-eea714f3118a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:31.908364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1352020b-539f-4059-ac9b-eea714f3118a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:31.982298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4080/8132] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:31.984321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66216d04-5275-4cc7-b20e-5c2e19cff2a9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:31.984620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66216d04-5275-4cc7-b20e-5c2e19cff2a9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:31.984927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66216d04-5275-4cc7-b20e-5c2e19cff2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.005959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-66216d04-5275-4cc7-b20e-5c2e19cff2a9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:32.017671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-66216d04-5275-4cc7-b20e-5c2e19cff2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:32.031110 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4053/8133] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:32.033181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352020b-539f-4059-ac9b-eea714f3118a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.047596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352020b-539f-4059-ac9b-eea714f3118a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.052772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.053549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.053921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.054262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.055292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:32.055729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.057628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.075841 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4081/8134] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:32.077818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66216d04-5275-4cc7-b20e-5c2e19cff2a9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.087556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66216d04-5275-4cc7-b20e-5c2e19cff2a9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.093720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.094805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.095322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.095678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.096592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.098640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.129674 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4054/8135] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:32 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:32.133947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.145318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ecadb-87c0-4e53-b21e-5165da4d3e95 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.208915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.209619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.210933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.211643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.212708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.215194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.243649 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4082/8136] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:32 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:32.244989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.255808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dcfe3-adac-426e-bd4f-2d8be5a2777f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.260956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.261739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.262093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.262439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.263816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.265504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.277692 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4055/8137] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:32.282396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.293142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad05d4-6feb-4aa4-b949-29cbd7d77525 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.299970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2dab-98dc-444e-bae3-f4c02b3b3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.300641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2dab-98dc-444e-bae3-f4c02b3b3d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.300921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2dab-98dc-444e-bae3-f4c02b3b3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.301201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2dab-98dc-444e-bae3-f4c02b3b3d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.301925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2dab-98dc-444e-bae3-f4c02b3b3d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.303578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2dab-98dc-444e-bae3-f4c02b3b3d33 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.314115 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4083/8138] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:32.318184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.329179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6bb5c-b825-4f56-851b-a3993193f25f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.333916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.334851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.335257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.335541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] PATH_INFO: `/v3/projects/a6f87f9ee72e49739157cfec7fc06706/users/da39a0b6bd00485182ab185bf507e578/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.352098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f87f9ee72e49739157cfec7fc06706, user_id=da39a0b6bd00485182ab185bf507e578, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.354793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.369799 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4056/8139] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:32 2022] PUT /identity/v3/projects/a6f87f9ee72e49739157cfec7fc06706/users/da39a0b6bd00485182ab185bf507e578/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:32.381835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f8a0-42d3-4ba5-9a16-b94fae56584a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.382206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f8a0-42d3-4ba5-9a16-b94fae56584a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.382433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f8a0-42d3-4ba5-9a16-b94fae56584a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.414845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c789f8a0-42d3-4ba5-9a16-b94fae56584a None None] MFA Rules not processed for user `da39a0b6bd00485182ab185bf507e578`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:32.416369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c789f8a0-42d3-4ba5-9a16-b94fae56584a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:32.490903 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4084/8140] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:32.495770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.558821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617fa87-adf1-4727-b924-d67ba66e37f7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.570211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.571815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.572098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.572442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.573371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.576188 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.606039 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4057/8141] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:32 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:32.607762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f8a0-42d3-4ba5-9a16-b94fae56584a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.619764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f8a0-42d3-4ba5-9a16-b94fae56584a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.685098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.685794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.686077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.686353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.687092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.689028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.726023 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4085/8142] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:32 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:32.727211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.740926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33627df-899f-4a58-9767-4d04e41ce8c4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.752178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.752968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.753319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.753662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.754514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.756398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.770797 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4058/8143] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:32.774649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.789381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f71b9-2b17-4b61-aed0-05983ca2be9d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.795842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.796952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.797337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.797718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] PATH_INFO: `/v3/projects/2890b253d7b24b808aa76bd9a0e4201d/users/6964efbae8b34d0595841f26950b8dc7/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.816535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2890b253d7b24b808aa76bd9a0e4201d, user_id=6964efbae8b34d0595841f26950b8dc7, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.819829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.834333 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4086/8144] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:32 2022] PUT /identity/v3/projects/2890b253d7b24b808aa76bd9a0e4201d/users/6964efbae8b34d0595841f26950b8dc7/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:32.839672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.853692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc2b83-a0d2-438e-863b-0f1baf11c82f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.935859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01515ee2-89f3-46ca-b7e2-f33cf2e3c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.937307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01515ee2-89f3-46ca-b7e2-f33cf2e3c9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.937590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01515ee2-89f3-46ca-b7e2-f33cf2e3c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.937868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01515ee2-89f3-46ca-b7e2-f33cf2e3c9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.938689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01515ee2-89f3-46ca-b7e2-f33cf2e3c9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.940806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01515ee2-89f3-46ca-b7e2-f33cf2e3c9a5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:32.954809 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4059/8145] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:32.958010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:32.969956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755b91d-95dd-4140-b4f6-919d3ccdfb3e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:32.984157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:32.985437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:32.985802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:32.986363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] PATH_INFO: `/v3/projects/2890b253d7b24b808aa76bd9a0e4201d/users/6964efbae8b34d0595841f26950b8dc7/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:32.989001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2890b253d7b24b808aa76bd9a0e4201d, user_id=6964efbae8b34d0595841f26950b8dc7, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:32.991963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:33.005402 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4087/8146] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:32 2022] PUT /identity/v3/projects/2890b253d7b24b808aa76bd9a0e4201d/users/6964efbae8b34d0595841f26950b8dc7/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:33.015980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c2e0a-1d4a-42e5-8889-8d1a9f32cb63 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:33.023342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c2e0a-1d4a-42e5-8889-8d1a9f32cb63 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:33.023637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c2e0a-1d4a-42e5-8889-8d1a9f32cb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:33.063021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fb4c2e0a-1d4a-42e5-8889-8d1a9f32cb63 None None] MFA Rules not processed for user `6964efbae8b34d0595841f26950b8dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:33.065177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fb4c2e0a-1d4a-42e5-8889-8d1a9f32cb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:33.229247 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4060/8147] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:33.243315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:33.245871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:33.379212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d0c37-3183-4436-8afb-1439263bf4d8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:33.385870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159f6a6-6498-410f-acef-2ed5ab7badbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:33.386595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f6a6-6498-410f-acef-2ed5ab7badbd service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:33.386927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f6a6-6498-410f-acef-2ed5ab7badbd service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:33.395797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f6a6-6498-410f-acef-2ed5ab7badbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:33.414419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159f6a6-6498-410f-acef-2ed5ab7badbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:33.416196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159f6a6-6498-410f-acef-2ed5ab7badbd service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:33.437532 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4088/8148] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:33 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:33.619689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c2e0a-1d4a-42e5-8889-8d1a9f32cb63 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:33.724313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c2e0a-1d4a-42e5-8889-8d1a9f32cb63 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:33.732834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:33.734709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:33.735084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:33.735365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] PATH_INFO: `/v3/users/da39a0b6bd00485182ab185bf507e578` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:33.738181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da39a0b6bd00485182ab185bf507e578)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:33.742426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:33.813320 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da39a0b6bd00485182ab185bf507e578'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:33.821276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da39a0b6bd00485182ab185bf507e578'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:33.822011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da39a0b6bd00485182ab185bf507e578'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:33.822634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da39a0b6bd00485182ab185bf507e578'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:33.832530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da39a0b6bd00485182ab185bf507e578'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:33.855657 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4061/8149] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:33 2022] DELETE /identity/v3/users/da39a0b6bd00485182ab185bf507e578 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:33.860406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:33.860700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:33.860986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:33.898734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:33.900428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:33.995047 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4089/8150] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:34.006067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:34.008426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:34.085864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc70d1-4737-481e-81a4-ef1ff5930490 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:34.089620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:34.090299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:34.090688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:34.090926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:34.100056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:34.101574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:34.111717 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4062/8151] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:34.484543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:34.487879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:34.508579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e9779-e70d-45f2-8f11-679df228f66d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:34.514750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:34.515755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:34.516036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:34.516361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] PATH_INFO: `/v3/projects/a6f87f9ee72e49739157cfec7fc06706` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:34.517897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f87f9ee72e49739157cfec7fc06706)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:34.527898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:34.628829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f87f9ee72e49739157cfec7fc06706', 'request_id': 'req-f2032c67-b7c0-48df-9c1b-58d191517591'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.644193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f87f9ee72e49739157cfec7fc06706', 'request_id': 'req-f2032c67-b7c0-48df-9c1b-58d191517591'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.661934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f87f9ee72e49739157cfec7fc06706', 'request_id': 'req-f2032c67-b7c0-48df-9c1b-58d191517591'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.694273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] The token cache is being invalidate because project a6f87f9ee72e49739157cfec7fc06706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:34.694273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.696171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.702821 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4090/8152] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:34 2022] DELETE /identity/v3/projects/a6f87f9ee72e49739157cfec7fc06706 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:34.706255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:34.722252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad02f9c-f48f-4fef-99f7-c0012fed7eab service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:34.842660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:34.845334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:34.845919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:34.847298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] PATH_INFO: `/v3/users/6964efbae8b34d0595841f26950b8dc7` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:34.850590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6964efbae8b34d0595841f26950b8dc7)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:34.852842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:34.951212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6964efbae8b34d0595841f26950b8dc7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.961835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6964efbae8b34d0595841f26950b8dc7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.964082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6964efbae8b34d0595841f26950b8dc7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.979708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6964efbae8b34d0595841f26950b8dc7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:34.991647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6964efbae8b34d0595841f26950b8dc7'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:35.027606 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4063/8153] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:34 2022] DELETE /identity/v3/users/6964efbae8b34d0595841f26950b8dc7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:35.145882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:35.147866 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:35.257541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2032c67-b7c0-48df-9c1b-58d191517591 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:35.322473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67dc20-dfc5-498e-83c8-b80606fdf273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:35.323056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67dc20-dfc5-498e-83c8-b80606fdf273 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:35.323343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67dc20-dfc5-498e-83c8-b80606fdf273 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:35.323650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67dc20-dfc5-498e-83c8-b80606fdf273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:35.326378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5d67dc20-dfc5-498e-83c8-b80606fdf273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:35.374953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:35.376574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:35.401608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67dc20-dfc5-498e-83c8-b80606fdf273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:35.403089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67dc20-dfc5-498e-83c8-b80606fdf273 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:35.415154 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4091/8154] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:35.479114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ee3d4-a3b3-48cc-98da-afed74985c93 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:35.484849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:35.485824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:35.486109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:35.486424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] PATH_INFO: `/v3/projects/2890b253d7b24b808aa76bd9a0e4201d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:35.487964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2890b253d7b24b808aa76bd9a0e4201d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:35.490177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:35.566108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2890b253d7b24b808aa76bd9a0e4201d', 'request_id': 'req-00379cd4-0f58-4c99-b14e-ea182c51151a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:35.575555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2890b253d7b24b808aa76bd9a0e4201d', 'request_id': 'req-00379cd4-0f58-4c99-b14e-ea182c51151a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:35.584011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2890b253d7b24b808aa76bd9a0e4201d', 'request_id': 'req-00379cd4-0f58-4c99-b14e-ea182c51151a'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:35.597959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] The token cache is being invalidate because project 2890b253d7b24b808aa76bd9a0e4201d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:35.598337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:35.598982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-00379cd4-0f58-4c99-b14e-ea182c51151a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:35.601093 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4064/8155] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:35 2022] DELETE /identity/v3/projects/2890b253d7b24b808aa76bd9a0e4201d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:35.607045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864249ad-9b2c-4074-9153-ee327e3fc634 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:35.607568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864249ad-9b2c-4074-9153-ee327e3fc634 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:35.607797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864249ad-9b2c-4074-9153-ee327e3fc634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:35.627721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-864249ad-9b2c-4074-9153-ee327e3fc634 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:35.628945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-864249ad-9b2c-4074-9153-ee327e3fc634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:35.714980 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4092/8156] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:35.720730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f114ac-9f39-46e9-96b1-14e859168d04 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:35.721107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f114ac-9f39-46e9-96b1-14e859168d04 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:35.721394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f114ac-9f39-46e9-96b1-14e859168d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:35.756373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-19f114ac-9f39-46e9-96b1-14e859168d04 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:35.757688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-19f114ac-9f39-46e9-96b1-14e859168d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:35.781920 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4065/8157] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:35.783364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864249ad-9b2c-4074-9153-ee327e3fc634 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:35.803089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864249ad-9b2c-4074-9153-ee327e3fc634 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:35.812775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:35.813679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:35.814036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:35.814382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:35.815246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:35.815639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:35.817704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:35.843326 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4093/8158] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:35.844355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f114ac-9f39-46e9-96b1-14e859168d04 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:35.858297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f114ac-9f39-46e9-96b1-14e859168d04 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:35.866409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:35.867613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:35.868616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:35.869132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:35.870247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:35.873284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:35.915872 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4066/8159] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:35 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:35.918421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:35.938551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f7f57-2a9e-450d-9750-526ddbf92735 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.025431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.026118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.026401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.026857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.027553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.031913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.058818 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4094/8160] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:35 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:36.063104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.079730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4065d-7226-4095-9ad3-b1c7852209ce admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.088872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.089564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.089846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.090316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.091270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.093072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.115204 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4067/8161] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:36.120719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.147930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf84af2-99fe-4429-ad0d-106faa8718ad admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.162596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2d6e9-1cd0-49b1-9c59-53fab58643c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.163924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d6e9-1cd0-49b1-9c59-53fab58643c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.164980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d6e9-1cd0-49b1-9c59-53fab58643c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.165259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2d6e9-1cd0-49b1-9c59-53fab58643c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.167352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2d6e9-1cd0-49b1-9c59-53fab58643c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.172219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2d6e9-1cd0-49b1-9c59-53fab58643c7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.203335 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4095/8162] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:36.208687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.225184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f740-2ce3-41ce-a125-ab5110328c4a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.239020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.242720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.242999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.243298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] PATH_INFO: `/v3/projects/41244813d03044bd9a5e0be8651fa413/users/afca4a012f67432ebabb3cf4f3470c28/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.283405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41244813d03044bd9a5e0be8651fa413, user_id=afca4a012f67432ebabb3cf4f3470c28, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.287741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.338735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4068/8163] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:36 2022] PUT /identity/v3/projects/41244813d03044bd9a5e0be8651fa413/users/afca4a012f67432ebabb3cf4f3470c28/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:36.341454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208018f6-c233-479d-a48d-2f4b544c2042 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.341888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208018f6-c233-479d-a48d-2f4b544c2042 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.342437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208018f6-c233-479d-a48d-2f4b544c2042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.389717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-208018f6-c233-479d-a48d-2f4b544c2042 None None] MFA Rules not processed for user `afca4a012f67432ebabb3cf4f3470c28`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:36.391230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-208018f6-c233-479d-a48d-2f4b544c2042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:36.474749 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4096/8164] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:36.479794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.582197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40378a-0569-44f7-8ee7-c673e7b56727 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.593365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.594478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.596416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.596752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.599698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.604000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.646457 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4069/8165] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:36 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:36.652018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208018f6-c233-479d-a48d-2f4b544c2042 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.666631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208018f6-c233-479d-a48d-2f4b544c2042 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.733207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.733899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.734181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.734457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.735169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.737181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.763133 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4097/8166] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:36 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:36.766559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.781743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae110f6-6f93-47fe-8672-fa86c4f7ed18 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.803351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.805173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.805487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.806356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.806538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.808561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.830875 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4070/8167] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:36.831780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.844446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60866d-fd43-4ae2-8e83-f95348ee3607 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:36.851345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:36.852221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:36.852547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:36.852859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] PATH_INFO: `/v3/projects/060a8986d0cc4fcc83bbb79b4dce0b10/users/d7dd185478e24f5e89cf8e0411b6035b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:36.872609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060a8986d0cc4fcc83bbb79b4dce0b10, user_id=d7dd185478e24f5e89cf8e0411b6035b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:36.876578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:36.898595 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4098/8168] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:36 2022] PUT /identity/v3/projects/060a8986d0cc4fcc83bbb79b4dce0b10/users/d7dd185478e24f5e89cf8e0411b6035b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:36.902317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:36.915015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afebe7a-69fb-45e2-862f-b64a18e79989 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:37.082887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd33f8-f3b9-46fb-8c1d-c19e7ab21740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:37.085252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd33f8-f3b9-46fb-8c1d-c19e7ab21740 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:37.085552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd33f8-f3b9-46fb-8c1d-c19e7ab21740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:37.087377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd33f8-f3b9-46fb-8c1d-c19e7ab21740 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:37.089042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd33f8-f3b9-46fb-8c1d-c19e7ab21740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:37.097362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd33f8-f3b9-46fb-8c1d-c19e7ab21740 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:37.123246 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4071/8169] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:37.124443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:37.139232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0290eb-18cf-4291-804d-e6d7e4fcafb8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:37.167483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:37.168656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:37.171869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:37.172384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] PATH_INFO: `/v3/projects/060a8986d0cc4fcc83bbb79b4dce0b10/users/d7dd185478e24f5e89cf8e0411b6035b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:37.186182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060a8986d0cc4fcc83bbb79b4dce0b10, user_id=d7dd185478e24f5e89cf8e0411b6035b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:37.195195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:37.236349 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4099/8170] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:37 2022] PUT /identity/v3/projects/060a8986d0cc4fcc83bbb79b4dce0b10/users/d7dd185478e24f5e89cf8e0411b6035b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:37.238790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:37.239700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:37.239990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:37.328726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] MFA Rules not processed for user `d7dd185478e24f5e89cf8e0411b6035b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:37.329957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:37.426010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:37.428357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:37.505783 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4072/8171] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:37.523715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:37.525866 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:37.554348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a45e5-0357-47af-aff8-51bdc2615638 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:37.560501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:37.561405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:37.561688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:37.561964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] PATH_INFO: `/v3/users/3f124f0e42464680adc1e3bc4c4b12ef` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:37.563316 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f124f0e42464680adc1e3bc4c4b12ef)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:37.566219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:37.647218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f124f0e42464680adc1e3bc4c4b12ef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:37.648549 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f124f0e42464680adc1e3bc4c4b12ef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:37.656828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d333c3-292f-4596-a0b6-dc31473e1ee3 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:37.658617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f124f0e42464680adc1e3bc4c4b12ef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:37.659748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f124f0e42464680adc1e3bc4c4b12ef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:37.673775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d74a2f0b-45f9-4261-89ba-0184c9e46c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f124f0e42464680adc1e3bc4c4b12ef'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:37.696626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:37.697447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:37.697664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:37.697958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:37.701526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:37.707805 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4100/8172] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:37 2022] DELETE /identity/v3/users/3f124f0e42464680adc1e3bc4c4b12ef => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:37.710138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:37.710536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:37.711003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:37.727855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:37.729622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:37.744787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:37.746016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:37.753237 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4073/8173] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:37.824884 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4101/8174] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:37.837657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:37.839533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:37.938253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaa291-23f9-4278-a2d4-69ffca0762e0 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:38.000767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:38.001488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.001775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.002052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.014495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:38.016277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:38.030881 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4074/8175] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:38.276861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:38.280077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:38.295567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3e9d5-534d-48f8-912c-28b99e94b257 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:38.304467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:38.305289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.305585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.305911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] PATH_INFO: `/v3/users/afca4a012f67432ebabb3cf4f3470c28` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.310426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afca4a012f67432ebabb3cf4f3470c28)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:38.315252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:38.378689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:38.380246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:38.403862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7fcd8-1f36-4e48-a6af-84111efb5290 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:38.410891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:38.411309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.411582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.412710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] PATH_INFO: `/v3/projects/d8cb50bdf4a84c5b86d53ceb0021a81d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.414185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cb50bdf4a84c5b86d53ceb0021a81d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:38.416058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:38.418978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afca4a012f67432ebabb3cf4f3470c28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.421263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afca4a012f67432ebabb3cf4f3470c28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.435245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afca4a012f67432ebabb3cf4f3470c28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.435996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afca4a012f67432ebabb3cf4f3470c28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.449342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2b677400-3726-49b5-8382-34776ff4134d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afca4a012f67432ebabb3cf4f3470c28'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.485303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cb50bdf4a84c5b86d53ceb0021a81d', 'request_id': 'req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.494870 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4102/8176] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:38 2022] DELETE /identity/v3/users/afca4a012f67432ebabb3cf4f3470c28 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:38.497734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.498094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.498331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.500664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cb50bdf4a84c5b86d53ceb0021a81d', 'request_id': 'req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.517391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cb50bdf4a84c5b86d53ceb0021a81d', 'request_id': 'req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.522015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:38.530304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:38.534315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] The token cache is being invalidate because project d8cb50bdf4a84c5b86d53ceb0021a81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:38.534848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.535758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2dc88fc5-8bbd-4ab5-b0df-48ba55a95022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:38.538259 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4075/8177] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:38 2022] DELETE /identity/v3/projects/d8cb50bdf4a84c5b86d53ceb0021a81d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:38.545742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054aeba-a2f2-4347-a533-93dc08949b19 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.547053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054aeba-a2f2-4347-a533-93dc08949b19 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.548159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054aeba-a2f2-4347-a533-93dc08949b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.574243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5054aeba-a2f2-4347-a533-93dc08949b19 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:38.577307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5054aeba-a2f2-4347-a533-93dc08949b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:38.700131 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4103/8178] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:38.728520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:38.731072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:38.767861 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4076/8179] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:38.773454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409c7f-412a-461c-8a08-dd8b9e441ec6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.773944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409c7f-412a-461c-8a08-dd8b9e441ec6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.774437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409c7f-412a-461c-8a08-dd8b9e441ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.813553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a3409c7f-412a-461c-8a08-dd8b9e441ec6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:38.815095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a3409c7f-412a-461c-8a08-dd8b9e441ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:38.828215 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4077/8180] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:38.831740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3409c7f-412a-461c-8a08-dd8b9e441ec6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:38.849279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3409c7f-412a-461c-8a08-dd8b9e441ec6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:38.854743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb0a49-7cda-42be-af6d-ca718118adbe None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:38.855886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:38.857137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.857419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.857690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.858663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:38.858995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:38.861737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:38.865842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:38.866564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.866892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.867244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.882318 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4078/8181] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:38.883039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:38.884970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:38.886829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:38.898387 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4104/8182] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:38.899933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7467eb3-3fd6-4450-9756-a1b3ce17478a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:38.907934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:38.908615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:38.908906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:38.909304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:38.910279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:38.912317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:38.944969 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4079/8183] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:38 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:38.951324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:38.951564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:38.957311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:38.972041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a840-f7f3-4c0e-bc85-afb9b084a3a9 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.084186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.084891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.085184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.085466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.086165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.093423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.095719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f743c94-fe82-4836-8195-8e46ef21868e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.102677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.104801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.105253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.105727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] PATH_INFO: `/v3/users/7a1a72aff0004d55aec865834645bedf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.110348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1a72aff0004d55aec865834645bedf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.114418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.134906 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4105/8184] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:38 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:39.139682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.159747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4310-f5ba-4ddc-af22-9c2be22fabce admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.171104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.171806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.171998 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.172280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.173013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.176050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.189537 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4106/8185] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:39.193416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.222110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438cd671-a340-4a24-82dd-072e1b565d2c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.224064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1a72aff0004d55aec865834645bedf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.228983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.229790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.230351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.230739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.232219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.233966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.234360 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1a72aff0004d55aec865834645bedf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.235544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1a72aff0004d55aec865834645bedf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.236192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1a72aff0004d55aec865834645bedf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.250437 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4107/8186] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:39.251540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8d7cf42f-1f35-44d3-8aad-3338acf05df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1a72aff0004d55aec865834645bedf'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.253813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.256169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.272203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fb703-b483-45ac-8814-7400b1db2ca9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.277713 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4080/8187] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:38 2022] DELETE /identity/v3/users/7a1a72aff0004d55aec865834645bedf => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:39.282310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ef91a-bad4-4f02-a95f-f9c3e46a23c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.282852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.283325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef91a-bad4-4f02-a95f-f9c3e46a23c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.283655 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef91a-bad4-4f02-a95f-f9c3e46a23c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.283850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef91a-bad4-4f02-a95f-f9c3e46a23c8 admin admin] PATH_INFO: `/v3/projects/1ec5e7d0966f4df9bb2eee27fc19cc78/users/36e57e71413c40e482c1f8969817a528/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.284432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.285467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.303989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef91a-bad4-4f02-a95f-f9c3e46a23c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec5e7d0966f4df9bb2eee27fc19cc78, user_id=36e57e71413c40e482c1f8969817a528, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.308540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef91a-bad4-4f02-a95f-f9c3e46a23c8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.320619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:39.322469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.326657 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4108/8188] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:39 2022] PUT /identity/v3/projects/1ec5e7d0966f4df9bb2eee27fc19cc78/users/36e57e71413c40e482c1f8969817a528/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:39.342373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.343025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.343620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.389230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] MFA Rules not processed for user `36e57e71413c40e482c1f8969817a528`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:39.390919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.411688 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4081/8189] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:39.412532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.413845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.436582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50175d-1233-40db-a3b1-7eb49b6f41de None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.443747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.444816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.445118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.445416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] PATH_INFO: `/v3/projects/41244813d03044bd9a5e0be8651fa413` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.447400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41244813d03044bd9a5e0be8651fa413)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.449786 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.468720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4109/8190] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:39.469622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.471106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.522356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41244813d03044bd9a5e0be8651fa413', 'request_id': 'req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.532377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41244813d03044bd9a5e0be8651fa413', 'request_id': 'req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.541687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e486128-9b57-4a53-89ec-3cc6fd79be3c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.542255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41244813d03044bd9a5e0be8651fa413', 'request_id': 'req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.559278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] The token cache is being invalidate because project 41244813d03044bd9a5e0be8651fa413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:39.559278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.560823 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.563527 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4082/8191] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:39 2022] DELETE /identity/v3/projects/41244813d03044bd9a5e0be8651fa413 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:39.564221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.565724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.600715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.601682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.602129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.602711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.605687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.664784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e8fff-2f4e-422c-baf9-3db96a1df31c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.672100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.673006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.673779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.674179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.675091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.677448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.679613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.681649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.696044 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4110/8192] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:39.696630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.698159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.710169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39aed30-2024-4aec-9d85-c8b3fd1892ac service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.715921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.717144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.717432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.717763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] PATH_INFO: `/v3/users/d7dd185478e24f5e89cf8e0411b6035b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.719772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dd185478e24f5e89cf8e0411b6035b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.722128 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.727482 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4083/8193] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:39 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:39.732756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.788152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dd185478e24f5e89cf8e0411b6035b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.789594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dd185478e24f5e89cf8e0411b6035b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.804358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dd185478e24f5e89cf8e0411b6035b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.805596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dd185478e24f5e89cf8e0411b6035b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.813054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76820a3b-0f9d-430a-a5d5-00a4411ba0c2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.819580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.820389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.820694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.820991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.821364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dd185478e24f5e89cf8e0411b6035b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:39.821687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.824490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.852363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4084/8195] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:39 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:39.852570 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4111/8195] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:39 2022] DELETE /identity/v3/users/d7dd185478e24f5e89cf8e0411b6035b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:39.855889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:39.857917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:39.876472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dff816-b07c-46fd-9023-a01e6b839f73 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:39.972653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:39.974334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:39.974880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:39.975298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:39.976483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:39.978807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:39.998373 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4085/8196] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:40.000421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.020411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62037e0-f5e2-4c7e-a5a2-3adc9e8c623f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.027176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.028077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.028757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.029118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.030098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.032588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.046560 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4112/8197] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:40.052127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.061441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.066130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c1b4d-4955-46cd-9099-f7b393faed03 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.072984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.073630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439e4f0-f0df-4d7a-b274-9457246afd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.074675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439e4f0-f0df-4d7a-b274-9457246afd1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.075644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439e4f0-f0df-4d7a-b274-9457246afd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.076000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439e4f0-f0df-4d7a-b274-9457246afd1a admin admin] PATH_INFO: `/v3/projects/0551b03273614443a453b57742f88f79/users/f139b93416074f66a1addb12e788609f/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.109704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439e4f0-f0df-4d7a-b274-9457246afd1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0551b03273614443a453b57742f88f79, user_id=f139b93416074f66a1addb12e788609f, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.113604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439e4f0-f0df-4d7a-b274-9457246afd1a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.124494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ff853-8790-4b3a-a6d3-351629a19f56 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.139543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.140487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.140777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.143347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] PATH_INFO: `/v3/projects/c97cc2eddd154160b778a3336d71bc1a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.146502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97cc2eddd154160b778a3336d71bc1a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.148655 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4086/8198] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:40 2022] PUT /identity/v3/projects/0551b03273614443a453b57742f88f79/users/f139b93416074f66a1addb12e788609f/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:40.151283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.163464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.164516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.164785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.215826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] MFA Rules not processed for user `f139b93416074f66a1addb12e788609f`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:40.217884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.240444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97cc2eddd154160b778a3336d71bc1a', 'request_id': 'req-2569eacf-9b9f-4f09-b424-d1a5e80bba12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.251606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97cc2eddd154160b778a3336d71bc1a', 'request_id': 'req-2569eacf-9b9f-4f09-b424-d1a5e80bba12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.273006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97cc2eddd154160b778a3336d71bc1a', 'request_id': 'req-2569eacf-9b9f-4f09-b424-d1a5e80bba12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.297814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] The token cache is being invalidate because project c97cc2eddd154160b778a3336d71bc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:40.298146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.299077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.301963 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4113/8199] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:40 2022] DELETE /identity/v3/projects/c97cc2eddd154160b778a3336d71bc1a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:40.306124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.307841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.341969 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4087/8200] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:40.346579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.347979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.388257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569eacf-9b9f-4f09-b424-d1a5e80bba12 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.394417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.396071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.396782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.396913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] PATH_INFO: `/v3/projects/060a8986d0cc4fcc83bbb79b4dce0b10` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.398602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060a8986d0cc4fcc83bbb79b4dce0b10)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.400271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.438015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af987fd5-bbc2-4a07-8668-62c0cf8fdc11 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.444191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.445199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.445609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.446403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] PATH_INFO: `/v3/users/fa644c83a97a43d4a275e06137514946` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.447490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa644c83a97a43d4a275e06137514946)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.449596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.466020 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060a8986d0cc4fcc83bbb79b4dce0b10', 'request_id': 'req-a2405bda-cb67-44a5-b8cc-21537be22c23'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.474495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060a8986d0cc4fcc83bbb79b4dce0b10', 'request_id': 'req-a2405bda-cb67-44a5-b8cc-21537be22c23'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.487691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060a8986d0cc4fcc83bbb79b4dce0b10', 'request_id': 'req-a2405bda-cb67-44a5-b8cc-21537be22c23'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.503336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] The token cache is being invalidate because project 060a8986d0cc4fcc83bbb79b4dce0b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:40.503770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.504937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.507611 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4114/8201] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:40 2022] DELETE /identity/v3/projects/060a8986d0cc4fcc83bbb79b4dce0b10 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:40.508370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.511221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.524497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa644c83a97a43d4a275e06137514946'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.536605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa644c83a97a43d4a275e06137514946'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.537458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa644c83a97a43d4a275e06137514946'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.538257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa644c83a97a43d4a275e06137514946'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.550604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-8537c768-479b-4314-95c8-6ee23db90e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa644c83a97a43d4a275e06137514946'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:40.569329 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4088/8202] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:40 2022] DELETE /identity/v3/users/fa644c83a97a43d4a275e06137514946 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:40.570809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8e1b-cee4-488a-8523-7c53d52eb5d2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.571261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8e1b-cee4-488a-8523-7c53d52eb5d2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.571633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8e1b-cee4-488a-8523-7c53d52eb5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.592727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f95e8e1b-cee4-488a-8523-7c53d52eb5d2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:40.594254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f95e8e1b-cee4-488a-8523-7c53d52eb5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.610791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2405bda-cb67-44a5-b8cc-21537be22c23 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.678858 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4089/8203] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:40.686315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47427a-e9fa-410d-bc81-05c234131190 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.686611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47427a-e9fa-410d-bc81-05c234131190 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.687100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47427a-e9fa-410d-bc81-05c234131190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.690180 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.691203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.691455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.692181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.693066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.695951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.713526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dd47427a-e9fa-410d-bc81-05c234131190 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:40.716606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dd47427a-e9fa-410d-bc81-05c234131190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.730851 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4090/8204] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:40.736179 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4115/8205] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:40 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:40.738517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47427a-e9fa-410d-bc81-05c234131190 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.740538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.743026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:40.767406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47427a-e9fa-410d-bc81-05c234131190 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.860225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e0cb2-3d3f-4faf-bfd4-030b542bd7f3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.860745 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.861556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.862085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.862420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.863394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:40.863775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.865986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.866144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.866980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.867393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.867740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.868635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.870663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.882562 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4091/8206] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:40.888965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.902616 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4116/8207] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:40 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:40.908548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.909492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de50d51-b701-4848-80e1-23a35f6e94e0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.923762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.924442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.924727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.925005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.925709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.927449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf913996-21c1-4e76-9637-8167e1974c9f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:40.929403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.933689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:40.934390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:40.934681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:40.935060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:40.935795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:40.937457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:40.953641 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4117/8208] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:40.954561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:40.997027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7481c-809a-40cd-8da7-fd1415ba1d4b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.000477 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4092/8209] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:40 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:41.007709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.116391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03360fca-8ded-4043-b6bf-603d5f7c986b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.122328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.123189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.123636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.123954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.124767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.125178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.126349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.126721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.127011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.127472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] PATH_INFO: `/v3/projects/d1b984894ab54466ae94346b3cabf484/users/4f9e4c97735542f7bb58c4577ca565d6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.147386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b984894ab54466ae94346b3cabf484, user_id=4f9e4c97735542f7bb58c4577ca565d6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.151796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.162794 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4093/8210] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:41 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:41.162794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.166407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.185751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ef820-97b5-4073-a38d-205c89b8ff02 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.189103 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4118/8211] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:40 2022] PUT /identity/v3/projects/d1b984894ab54466ae94346b3cabf484/users/4f9e4c97735542f7bb58c4577ca565d6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:41.190527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.288393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62bdd9a-30f2-4200-b7be-5bdbeedcdc4b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.294789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.295485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.295777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.296171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.296320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.296951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.297684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.298181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.298994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] PATH_INFO: `/v3/projects/d68cfabc02644e5899316723493712e1` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.299563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.301472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68cfabc02644e5899316723493712e1)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.304004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.315016 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4119/8212] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:41.315016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.328890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375fb59-2cdb-44b5-a352-fa0732d23b5b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.335754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.336508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.336798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.337318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.338469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.340208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.353871 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4120/8213] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:41.358370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.372134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a07e-a5d6-46d0-a769-5b6f3a611556 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.391852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68cfabc02644e5899316723493712e1', 'request_id': 'req-54b28044-b39e-48f0-a44b-cb689ec51822'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:41.400558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68cfabc02644e5899316723493712e1', 'request_id': 'req-54b28044-b39e-48f0-a44b-cb689ec51822'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:41.415226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68cfabc02644e5899316723493712e1', 'request_id': 'req-54b28044-b39e-48f0-a44b-cb689ec51822'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:41.435017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] The token cache is being invalidate because project d68cfabc02644e5899316723493712e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:41.435581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:41.436678 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:41.438476 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4094/8214] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:41 2022] DELETE /identity/v3/projects/d68cfabc02644e5899316723493712e1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:41.440429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.440751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.457202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228f421-27fc-4f3d-bcba-ec948d8cfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.457991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228f421-27fc-4f3d-bcba-ec948d8cfcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.458681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228f421-27fc-4f3d-bcba-ec948d8cfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.458681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228f421-27fc-4f3d-bcba-ec948d8cfcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.459414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228f421-27fc-4f3d-bcba-ec948d8cfcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.461077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228f421-27fc-4f3d-bcba-ec948d8cfcf7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.480058 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4121/8215] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:41.481817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.482355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.483798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.508952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:41.510300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.522966 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4122/8216] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:41.524069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.526139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.541422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76d8c1-7895-4f72-8b5f-2d01cbd7aff7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.547537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a915d-f56f-4b6c-b0a4-7d1871669a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.549487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a915d-f56f-4b6c-b0a4-7d1871669a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.549815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a915d-f56f-4b6c-b0a4-7d1871669a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.550109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a915d-f56f-4b6c-b0a4-7d1871669a05 admin admin] PATH_INFO: `/v3/projects/965e6b62b0234b898946b3219a6974bf/users/bddf8ca0755040dbbd106f85311c21c8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.554541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b28044-b39e-48f0-a44b-cb689ec51822 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.563283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c999961-691d-470e-b36d-634f346bdc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.564898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c999961-691d-470e-b36d-634f346bdc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.565356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c999961-691d-470e-b36d-634f346bdc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.566350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c999961-691d-470e-b36d-634f346bdc97 admin admin] PATH_INFO: `/v3/projects/d1b984894ab54466ae94346b3cabf484/users/4f9e4c97735542f7bb58c4577ca565d6/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.569087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c999961-691d-470e-b36d-634f346bdc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b984894ab54466ae94346b3cabf484, user_id=4f9e4c97735542f7bb58c4577ca565d6, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.572202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c999961-691d-470e-b36d-634f346bdc97 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.576296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a915d-f56f-4b6c-b0a4-7d1871669a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965e6b62b0234b898946b3219a6974bf, user_id=bddf8ca0755040dbbd106f85311c21c8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.579953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a915d-f56f-4b6c-b0a4-7d1871669a05 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.588911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4095/8217] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:41 2022] PUT /identity/v3/projects/d1b984894ab54466ae94346b3cabf484/users/4f9e4c97735542f7bb58c4577ca565d6/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:41.591217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6948e-7e1c-4e7a-9117-8024d6d41218 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.591782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6948e-7e1c-4e7a-9117-8024d6d41218 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.593089 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6948e-7e1c-4e7a-9117-8024d6d41218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.608157 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4123/8218] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:41 2022] PUT /identity/v3/projects/965e6b62b0234b898946b3219a6974bf/users/bddf8ca0755040dbbd106f85311c21c8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:41.610435 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710b70-7b28-4b7b-a555-0375aca6732c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.611046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710b70-7b28-4b7b-a555-0375aca6732c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.611434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710b70-7b28-4b7b-a555-0375aca6732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.625877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-78a6948e-7e1c-4e7a-9117-8024d6d41218 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:41.630351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-78a6948e-7e1c-4e7a-9117-8024d6d41218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.658413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-36710b70-7b28-4b7b-a555-0375aca6732c None None] MFA Rules not processed for user `4f9e4c97735542f7bb58c4577ca565d6`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:41.660166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-36710b70-7b28-4b7b-a555-0375aca6732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.716015 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4096/8219] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:41.717467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aace23b-113a-41f9-b3d9-a01c6165bec1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.717826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aace23b-113a-41f9-b3d9-a01c6165bec1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.718213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aace23b-113a-41f9-b3d9-a01c6165bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.755948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0aace23b-113a-41f9-b3d9-a01c6165bec1 None None] MFA Rules not processed for user `bddf8ca0755040dbbd106f85311c21c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:41.757354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0aace23b-113a-41f9-b3d9-a01c6165bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.764989 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4124/8220] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:41.767882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36710b70-7b28-4b7b-a555-0375aca6732c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.787312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36710b70-7b28-4b7b-a555-0375aca6732c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.795507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.796190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.796667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.796976 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.797710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:41.798022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.800289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.813903 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4125/8221] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:41.816292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.819070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:41.845228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4097/8222] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:41.849892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aace23b-113a-41f9-b3d9-a01c6165bec1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.864099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aace23b-113a-41f9-b3d9-a01c6165bec1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.869790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.870673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.871001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.871292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.872710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:41.875698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:41.904556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e042cee-0191-4216-a429-cd192d6dd1bd admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:41.908944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:41.909670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:41.909958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:41.910387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:41.914003 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4098/8223] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:41 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:41.914003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:41.916268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:42.010041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fd5a1-e496-4361-bd56-29ed07233922 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.010923 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.014108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.018082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.018968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.019496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.019886 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.020701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.023219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.026859 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4126/8224] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:42.029346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.051650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5b1bb-8947-42de-82f9-d9c14ef1c3fc service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.061648 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4099/8225] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:41 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:42.064300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.065819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.066623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.067656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.067656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.067917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.075131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.125923 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4127/8226] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:42.129585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.143086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ef458-2ee6-416c-adf3-8c2682588d5b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.159330 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e9c0b-9ed0-4280-b94e-96682106385c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.166731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.167750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.168221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.168805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.170649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.173904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.207396 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4100/8227] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:42.212200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.230273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af6479-ee98-4f78-a76e-0ddf9aae2437 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.230484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.231890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.232428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.232792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.234091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.237241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.239514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.240617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.240903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.241244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.242366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.244339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.254408 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4128/8228] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:42.257825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.262944 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4101/8229] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:42.265319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.278691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088c1ce-5824-49fa-8abc-e7be07d2bcab admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.280187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d31d3d-3843-4dcc-af4f-373dc343290b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.285708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.286400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.286713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.287082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.287909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.288044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.288778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.289242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.289591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.289943 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.290418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.295108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.307262 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4102/8230] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:42.308881 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4129/8231] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:42.310282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.313418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.326747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467cad2-db9a-444c-b28f-e18e5a1ff1df admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.340227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93c261-4bb3-4f63-8da1-051f1d27fa08 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.344689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c33e3b-41cb-4778-80dd-b56b1b6fd45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.347242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c33e3b-41cb-4778-80dd-b56b1b6fd45d admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.349013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c33e3b-41cb-4778-80dd-b56b1b6fd45d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.349613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c33e3b-41cb-4778-80dd-b56b1b6fd45d admin admin] PATH_INFO: `/v3/projects/2c1eac63a55b4dffb48460f6684eae60/users/fea3eb1dea90431e85bfbbf1afbd9474/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.358731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75acc22-39cc-4d2b-a457-85d8faba70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.359593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75acc22-39cc-4d2b-a457-85d8faba70d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.359789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75acc22-39cc-4d2b-a457-85d8faba70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.360040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75acc22-39cc-4d2b-a457-85d8faba70d1 admin admin] PATH_INFO: `/v3/projects/aa7a542cb9da4117a10f879cc11b2a4a/users/473c88eba536479ebbdbfbb416080bf5/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.392973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75acc22-39cc-4d2b-a457-85d8faba70d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7a542cb9da4117a10f879cc11b2a4a, user_id=473c88eba536479ebbdbfbb416080bf5, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.396314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75acc22-39cc-4d2b-a457-85d8faba70d1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.410927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c33e3b-41cb-4778-80dd-b56b1b6fd45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1eac63a55b4dffb48460f6684eae60, user_id=fea3eb1dea90431e85bfbbf1afbd9474, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.413652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c33e3b-41cb-4778-80dd-b56b1b6fd45d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.424486 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4130/8232] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:42 2022] PUT /identity/v3/projects/aa7a542cb9da4117a10f879cc11b2a4a/users/473c88eba536479ebbdbfbb416080bf5/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:42.437075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00066b30-bd64-4a08-a86d-df295fc9266c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.437394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00066b30-bd64-4a08-a86d-df295fc9266c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.437673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00066b30-bd64-4a08-a86d-df295fc9266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.477939 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4103/8233] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:42 2022] PUT /identity/v3/projects/2c1eac63a55b4dffb48460f6684eae60/users/fea3eb1dea90431e85bfbbf1afbd9474/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:42.480340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5a4a5-6f42-4d40-a65d-5f74d0af5bb4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.480853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5a4a5-6f42-4d40-a65d-5f74d0af5bb4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.481919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5a4a5-6f42-4d40-a65d-5f74d0af5bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.488850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-00066b30-bd64-4a08-a86d-df295fc9266c None None] MFA Rules not processed for user `473c88eba536479ebbdbfbb416080bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:42.491047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00066b30-bd64-4a08-a86d-df295fc9266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:42.561395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-dce5a4a5-6f42-4d40-a65d-5f74d0af5bb4 None None] MFA Rules not processed for user `fea3eb1dea90431e85bfbbf1afbd9474`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:42.564293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dce5a4a5-6f42-4d40-a65d-5f74d0af5bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:42.655732 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4131/8234] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:42.656870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00066b30-bd64-4a08-a86d-df295fc9266c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.793428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00066b30-bd64-4a08-a86d-df295fc9266c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.810459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.811233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.811523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.811800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.812817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.815473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.826752 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4104/8235] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:42.831488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5a4a5-6f42-4d40-a65d-5f74d0af5bb4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.853880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5a4a5-6f42-4d40-a65d-5f74d0af5bb4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:42.866044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:42.867009 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:42.867457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:42.868140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:42.869357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:42.874805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:42.878151 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4132/8236] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/projects => generated 365 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:42.885464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.976366 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4105/8237] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:42.976768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:42.989810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c401c-c91e-48ae-b635-efeed62a0590 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.117952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.118645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.119146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.119301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.120027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.122684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.142210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39895b-ec14-45f8-9f85-492a205e84b6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.163053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4133/8238] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:43.164290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.166973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.167369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.167679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.168058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.169802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.173672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.196030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934aa1f-1d01-43a6-b6a0-c806021557d7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.203942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.205215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.205624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.206088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.207236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.209055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.210862 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4106/8239] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:42 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:15:43.218424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.228795 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4134/8240] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:15:43.232999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.245224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e1df0-2474-4f1e-852f-0b5f12fa9630 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.246703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80eb0b-4815-40a8-b5ec-94b75d1c6b55 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.251562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.252438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.252784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.253134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] PATH_INFO: `/v3/projects/535e83ff134648ec92493f724d951613/users/989c926b44384d4e882dce6552146145/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.265809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.265970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.266329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.266740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.268224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.270004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.281722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535e83ff134648ec92493f724d951613, user_id=989c926b44384d4e882dce6552146145, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.283443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.285762 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4107/8241] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:43.289832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.303994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9efa9d-383a-464d-9608-6fcd119de97d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.305730 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4135/8242] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:43 2022] PUT /identity/v3/projects/535e83ff134648ec92493f724d951613/users/989c926b44384d4e882dce6552146145/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:43.310056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.379774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.380688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.380978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.381652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] PATH_INFO: `/v3/projects/b0a9f5b4466b409ea547bb0f2d1d5b40/users/d9e00a58b75b4716903b5bcbf4550558/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.395257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280124-5593-4b7f-a205-496d3ce85516 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.400804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a9f5b4466b409ea547bb0f2d1d5b40, user_id=d9e00a58b75b4716903b5bcbf4550558, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.402028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.402831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.403750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.404162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.404290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.404959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.407028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.418492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4136/8243] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:43.422598 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4108/8244] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:43 2022] PUT /identity/v3/projects/b0a9f5b4466b409ea547bb0f2d1d5b40/users/d9e00a58b75b4716903b5bcbf4550558/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:43.423114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.423986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.434063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d366e-518a-4679-8d03-b47df5a7dbc9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.509093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a696cd-7d40-41ff-a272-2c0c68f6e609 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.516973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.517774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.518065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.519065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.520040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.521871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.541057 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4109/8245] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:43.549049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.567508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0afa57-20bd-42c7-8818-fad053f6b18f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.573488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92007d5-ed68-4a14-9ef6-c927556e6b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.574518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92007d5-ed68-4a14-9ef6-c927556e6b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.574831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92007d5-ed68-4a14-9ef6-c927556e6b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.575220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92007d5-ed68-4a14-9ef6-c927556e6b08 admin admin] PATH_INFO: `/v3/projects/b0a9f5b4466b409ea547bb0f2d1d5b40/users/d9e00a58b75b4716903b5bcbf4550558/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.578458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92007d5-ed68-4a14-9ef6-c927556e6b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a9f5b4466b409ea547bb0f2d1d5b40, user_id=d9e00a58b75b4716903b5bcbf4550558, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.583659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92007d5-ed68-4a14-9ef6-c927556e6b08 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.607824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4110/8246] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:43 2022] PUT /identity/v3/projects/b0a9f5b4466b409ea547bb0f2d1d5b40/users/d9e00a58b75b4716903b5bcbf4550558/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:43.609679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e5da-c7a3-4691-ac9a-a64df6254db4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.610074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e5da-c7a3-4691-ac9a-a64df6254db4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.610474 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3e5da-c7a3-4691-ac9a-a64df6254db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.661323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7dd3e5da-c7a3-4691-ac9a-a64df6254db4 None None] MFA Rules not processed for user `d9e00a58b75b4716903b5bcbf4550558`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:43.663302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7dd3e5da-c7a3-4691-ac9a-a64df6254db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:43.673869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af6cc4-08be-485e-b4a9-dd2ace44e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.675386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af6cc4-08be-485e-b4a9-dd2ace44e391 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.675674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af6cc4-08be-485e-b4a9-dd2ace44e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.675933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af6cc4-08be-485e-b4a9-dd2ace44e391 admin admin] PATH_INFO: `/v3/projects/535e83ff134648ec92493f724d951613/users/989c926b44384d4e882dce6552146145/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.678456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af6cc4-08be-485e-b4a9-dd2ace44e391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535e83ff134648ec92493f724d951613, user_id=989c926b44384d4e882dce6552146145, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:43.682296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af6cc4-08be-485e-b4a9-dd2ace44e391 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:43.699299 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4137/8247] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:43 2022] PUT /identity/v3/projects/535e83ff134648ec92493f724d951613/users/989c926b44384d4e882dce6552146145/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:43.710487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.710614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.710932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.740656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] MFA Rules not processed for user `989c926b44384d4e882dce6552146145`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:43.742056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:43.776029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4111/8248] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:43.790556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e5da-c7a3-4691-ac9a-a64df6254db4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.852700 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4138/8249] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:43.854191 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:43.855596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:43.890455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3e5da-c7a3-4691-ac9a-a64df6254db4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.947624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee111a-f59f-4735-96df-6fccaaa6f349 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:43.951995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.952649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.952934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.953220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.953715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:43.954569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:43.954967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:43.955318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:43.957480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:44.040774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:44.041244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:44.042182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:44.042919 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:44.056650 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4112/8250] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:15:44.057586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:44.059172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:44.064286 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4139/8251] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:44.140336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:44.156838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cc509-29db-47ae-9446-d81f53fc3e03 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:44.162519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:44.163512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:44.163927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:44.164213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:44.168879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519e789-00eb-41c9-bfa6-21dbb98c394e service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:44.174872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:44.176428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:44.176695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:44.176982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:44.195530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:44.198871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:44.223838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4113/8252] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:44.252871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:44.256471 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:44.275259 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4140/8253] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:44.875769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:44.895152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346e42-6c4b-472e-9e01-47947a0bd43b service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:44.900077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92822a16-f39a-4006-910e-85723513126a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:44.900932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92822a16-f39a-4006-910e-85723513126a service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:44.901139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92822a16-f39a-4006-910e-85723513126a service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:44.901419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92822a16-f39a-4006-910e-85723513126a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:44.996314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92822a16-f39a-4006-910e-85723513126a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:44.998621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92822a16-f39a-4006-910e-85723513126a service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:45.015695 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4114/8254] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:47.191190 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:47.234702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc311e8-1657-4fc0-95b0-1e76da2945a7 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:47.240485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24955051-1acd-484e-be73-d92e08db1f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:47.241162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955051-1acd-484e-be73-d92e08db1f50 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:47.241902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955051-1acd-484e-be73-d92e08db1f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:47.242590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24955051-1acd-484e-be73-d92e08db1f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:47.332059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24955051-1acd-484e-be73-d92e08db1f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:47.333518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24955051-1acd-484e-be73-d92e08db1f50 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:47.359008 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4141/8255] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:47.481688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92822a16-f39a-4006-910e-85723513126a service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:47.549431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92822a16-f39a-4006-910e-85723513126a service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:47.554153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:47.555185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:47.555758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:47.556216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] PATH_INFO: `/v3/users/bddf8ca0755040dbbd106f85311c21c8` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:47.557756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bddf8ca0755040dbbd106f85311c21c8)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:47.560814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:47.615006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bddf8ca0755040dbbd106f85311c21c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:47.630894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bddf8ca0755040dbbd106f85311c21c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:47.632439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bddf8ca0755040dbbd106f85311c21c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:47.633235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bddf8ca0755040dbbd106f85311c21c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:47.651340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bddf8ca0755040dbbd106f85311c21c8'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:47.674650 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4115/8256] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:47 2022] DELETE /identity/v3/users/bddf8ca0755040dbbd106f85311c21c8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:47.679079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:47.680274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:47.680892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:47.705355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:47.707145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:47.869674 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4142/8257] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:47.875538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:47.876975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:47.980299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3b44e-63aa-4961-b98a-41aed541da06 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:47.987879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:47.988640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:47.988972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:47.989227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:48.006514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:48.009180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:48.030620 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4116/8258] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:48.579807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:48.581489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:48.597666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee4413-896b-493f-87b2-7b1b85fa342e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:48.605726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:48.607724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:48.608448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:48.608784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] PATH_INFO: `/v3/users/2c4d46ef99794532b7de756b929e6d17` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:48.610320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4d46ef99794532b7de756b929e6d17)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:48.612561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:48.669890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4d46ef99794532b7de756b929e6d17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:48.670656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4d46ef99794532b7de756b929e6d17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:48.679627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4d46ef99794532b7de756b929e6d17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:48.680431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4d46ef99794532b7de756b929e6d17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:48.689729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4d46ef99794532b7de756b929e6d17'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:48.713279 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4143/8259] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:48 2022] DELETE /identity/v3/users/2c4d46ef99794532b7de756b929e6d17 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:48.960083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:48.979411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573ab2-c707-41f0-a645-fc49466d3e80 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:49.061427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:49.062935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.064379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.064736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] PATH_INFO: `/v3/projects/de8505b33dbf41ffb3f14bfddea6c103` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.066363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8505b33dbf41ffb3f14bfddea6c103)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:49.073776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:49.099081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:49.100567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.148869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7819dc5-75ff-4afa-a116-1b2f28858922 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:49.149738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8505b33dbf41ffb3f14bfddea6c103', 'request_id': 'req-cc7177d6-98b6-4871-bb00-e86eb5b1a191'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.162297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8505b33dbf41ffb3f14bfddea6c103', 'request_id': 'req-cc7177d6-98b6-4871-bb00-e86eb5b1a191'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.179725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8505b33dbf41ffb3f14bfddea6c103', 'request_id': 'req-cc7177d6-98b6-4871-bb00-e86eb5b1a191'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.202442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] The token cache is being invalidate because project de8505b33dbf41ffb3f14bfddea6c103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:49.202740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.203929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.206112 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4117/8260] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:48 2022] DELETE /identity/v3/projects/de8505b33dbf41ffb3f14bfddea6c103 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:49.207304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:49.218682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.226401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:49.227464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.227858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.228378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] PATH_INFO: `/v3/users/473c88eba536479ebbdbfbb416080bf5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.230093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473c88eba536479ebbdbfbb416080bf5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:49.232932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:49.300781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7177d6-98b6-4871-bb00-e86eb5b1a191 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:49.304749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:49.304968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473c88eba536479ebbdbfbb416080bf5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.305730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473c88eba536479ebbdbfbb416080bf5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.306405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.306955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.307506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] PATH_INFO: `/v3/projects/965e6b62b0234b898946b3219a6974bf` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.309973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965e6b62b0234b898946b3219a6974bf)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:49.314552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:49.317759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473c88eba536479ebbdbfbb416080bf5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.319602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473c88eba536479ebbdbfbb416080bf5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.334336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473c88eba536479ebbdbfbb416080bf5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.366997 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4144/8261] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:49 2022] DELETE /identity/v3/users/473c88eba536479ebbdbfbb416080bf5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:49.366997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:49.369302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.399319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965e6b62b0234b898946b3219a6974bf', 'request_id': 'req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.407878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965e6b62b0234b898946b3219a6974bf', 'request_id': 'req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.419197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965e6b62b0234b898946b3219a6974bf', 'request_id': 'req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.434961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] The token cache is being invalidate because project 965e6b62b0234b898946b3219a6974bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:49.435250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.435982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a7e03c00-baf9-40b6-9ebb-7ad84f8b6648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.438061 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4118/8262] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:49 2022] DELETE /identity/v3/projects/965e6b62b0234b898946b3219a6974bf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:49.439372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.439659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.439936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.461294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:49.462902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.467751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3ea0-f5a0-449a-8147-7e5b115bc687 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:49.529619 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4119/8263] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:49.530235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:49.530658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:49.531249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.531537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.531811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] PATH_INFO: `/v3/users/8cddd0e679bc49369c57f5679f8226ee` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.532282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.534236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cddd0e679bc49369c57f5679f8226ee)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:49.536240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:49.545014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f95a1d-ad4e-4eda-b922-b81e6cdc4db4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:49.551184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:49.552349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.552673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.552956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] PATH_INFO: `/v3/users/36e57e71413c40e482c1f8969817a528` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.554483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e57e71413c40e482c1f8969817a528)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:49.556671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:49.589009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cddd0e679bc49369c57f5679f8226ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.591108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cddd0e679bc49369c57f5679f8226ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.601604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cddd0e679bc49369c57f5679f8226ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.602397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cddd0e679bc49369c57f5679f8226ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.609424 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cddd0e679bc49369c57f5679f8226ee'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.626203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e57e71413c40e482c1f8969817a528'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.634617 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4145/8264] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:49 2022] DELETE /identity/v3/users/8cddd0e679bc49369c57f5679f8226ee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:49.635557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:49.637791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.638249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e57e71413c40e482c1f8969817a528'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.639378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e57e71413c40e482c1f8969817a528'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.640485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e57e71413c40e482c1f8969817a528'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.655894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e57e71413c40e482c1f8969817a528'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.680036 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4120/8265] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:49 2022] DELETE /identity/v3/users/36e57e71413c40e482c1f8969817a528 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:49.683904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:49.687695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.725319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6e455-7048-4e69-90de-eac2c49d6535 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:49.767903 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9ece3-18b0-41c7-ad3f-d4784358cd6b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:49.771972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3764d4c-ec31-4b1b-b271-17f45c0de11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:49.772540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764d4c-ec31-4b1b-b271-17f45c0de11d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.772993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764d4c-ec31-4b1b-b271-17f45c0de11d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.773165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764d4c-ec31-4b1b-b271-17f45c0de11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.775354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f3764d4c-ec31-4b1b-b271-17f45c0de11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.785464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:49.786464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.786845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.787198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] PATH_INFO: `/v3/users/fea3eb1dea90431e85bfbbf1afbd9474` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.788576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea3eb1dea90431e85bfbbf1afbd9474)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:49.790600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:49.849092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea3eb1dea90431e85bfbbf1afbd9474'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.849902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea3eb1dea90431e85bfbbf1afbd9474'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.859181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea3eb1dea90431e85bfbbf1afbd9474'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.860100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea3eb1dea90431e85bfbbf1afbd9474'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.863339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3764d4c-ec31-4b1b-b271-17f45c0de11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:49.865619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3764d4c-ec31-4b1b-b271-17f45c0de11d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:49.873177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea3eb1dea90431e85bfbbf1afbd9474'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:49.880247 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4121/8266] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:49.881632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:49.881983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:49.882272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:49.905922 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4146/8267] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:49 2022] DELETE /identity/v3/users/fea3eb1dea90431e85bfbbf1afbd9474 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:49.906701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:49.908496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:49.913347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:49.914582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.001459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7af56-7e3a-4caf-a2cf-e2886d5f813c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:50.007338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:50.008805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:50.008959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:50.009377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] PATH_INFO: `/v3/projects/7258ee48454a4985a79b7f26d184493f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:50.010912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7258ee48454a4985a79b7f26d184493f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:50.013478 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:50.017140 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4122/8268] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:50.040150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:50.041832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.091260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7258ee48454a4985a79b7f26d184493f', 'request_id': 'req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.099271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7258ee48454a4985a79b7f26d184493f', 'request_id': 'req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.110229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7258ee48454a4985a79b7f26d184493f', 'request_id': 'req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.128052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae303ea-9b77-46fe-8399-c333c80abd97 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:50.140870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] The token cache is being invalidate because project 7258ee48454a4985a79b7f26d184493f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:50.144441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.147514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.152016 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4147/8269] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:49 2022] DELETE /identity/v3/projects/7258ee48454a4985a79b7f26d184493f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:50.203595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:50.205822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:50.206419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:50.207240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:50.215458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.311686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:50.315504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:50.316843 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.317407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:50.332770 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4123/8270] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:50.347937 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9fd0c-ae31-45d3-a668-7ef9de3d6a12 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:50.358880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:50.360777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:50.361365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:50.361922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] PATH_INFO: `/v3/projects/aa7a542cb9da4117a10f879cc11b2a4a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:50.364397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7a542cb9da4117a10f879cc11b2a4a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:50.367355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:50.367799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:50.375464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.396887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad69ff-be05-47ba-a267-224c284dad7b service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:50.406218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:50.407382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:50.407655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:50.407932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] PATH_INFO: `/v3/projects/2c1eac63a55b4dffb48460f6684eae60` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:50.409515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1eac63a55b4dffb48460f6684eae60)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:50.413050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:50.474037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7a542cb9da4117a10f879cc11b2a4a', 'request_id': 'req-0caffbe5-07bd-4521-90c6-6dba54e6ad56'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.481988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7a542cb9da4117a10f879cc11b2a4a', 'request_id': 'req-0caffbe5-07bd-4521-90c6-6dba54e6ad56'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.494908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7a542cb9da4117a10f879cc11b2a4a', 'request_id': 'req-0caffbe5-07bd-4521-90c6-6dba54e6ad56'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.513779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1eac63a55b4dffb48460f6684eae60', 'request_id': 'req-4a0aec67-4378-4fc7-8a62-f153362976a2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.516055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] The token cache is being invalidate because project aa7a542cb9da4117a10f879cc11b2a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:50.516772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.517451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.520716 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4148/8271] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:50 2022] DELETE /identity/v3/projects/aa7a542cb9da4117a10f879cc11b2a4a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:50.525838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:50.527716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1eac63a55b4dffb48460f6684eae60', 'request_id': 'req-4a0aec67-4378-4fc7-8a62-f153362976a2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.528666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.544819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1eac63a55b4dffb48460f6684eae60', 'request_id': 'req-4a0aec67-4378-4fc7-8a62-f153362976a2'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.569710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] The token cache is being invalidate because project 2c1eac63a55b4dffb48460f6684eae60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:50.570057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.572339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.579203 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4124/8272] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:50 2022] DELETE /identity/v3/projects/2c1eac63a55b4dffb48460f6684eae60 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:50.580577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:50.585806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.638159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caffbe5-07bd-4521-90c6-6dba54e6ad56 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:50.685965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0aec67-4378-4fc7-8a62-f153362976a2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:50.692468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:50.694020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:50.694458 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:50.694744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] PATH_INFO: `/v3/users/d9e00a58b75b4716903b5bcbf4550558` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:50.696696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e00a58b75b4716903b5bcbf4550558)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:50.699622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:50.724526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:50.725419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:50.725706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:50.725984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] PATH_INFO: `/v3/users/989c926b44384d4e882dce6552146145` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:50.727799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] RBAC: Authorizing `identity:delete_user(user_id=989c926b44384d4e882dce6552146145)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:50.729305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:50.768112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e00a58b75b4716903b5bcbf4550558'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.776333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e00a58b75b4716903b5bcbf4550558'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.777090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e00a58b75b4716903b5bcbf4550558'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.777794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e00a58b75b4716903b5bcbf4550558'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.787069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989c926b44384d4e882dce6552146145'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.787809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989c926b44384d4e882dce6552146145'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.789181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e00a58b75b4716903b5bcbf4550558'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.796900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989c926b44384d4e882dce6552146145'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.797781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989c926b44384d4e882dce6552146145'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.807205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989c926b44384d4e882dce6552146145'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:50.813828 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4125/8273] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:50 2022] DELETE /identity/v3/users/d9e00a58b75b4716903b5bcbf4550558 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:50.831267 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4149/8274] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:50 2022] DELETE /identity/v3/users/989c926b44384d4e882dce6552146145 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:50.875896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:50.879064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:50.974688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5312-a368-4056-833b-8296809934bd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.069807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.070904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.071303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.071542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] PATH_INFO: `/v3/projects/1ec5e7d0966f4df9bb2eee27fc19cc78` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.073892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec5e7d0966f4df9bb2eee27fc19cc78)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.076911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.142719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec5e7d0966f4df9bb2eee27fc19cc78', 'request_id': 'req-5bd1c6ee-bb61-49b8-a81e-8102df63e669'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.151156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec5e7d0966f4df9bb2eee27fc19cc78', 'request_id': 'req-5bd1c6ee-bb61-49b8-a81e-8102df63e669'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.164101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec5e7d0966f4df9bb2eee27fc19cc78', 'request_id': 'req-5bd1c6ee-bb61-49b8-a81e-8102df63e669'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.167329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.169537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.178446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] The token cache is being invalidate because project 1ec5e7d0966f4df9bb2eee27fc19cc78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:51.178862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.179680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.181657 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4126/8275] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:50 2022] DELETE /identity/v3/projects/1ec5e7d0966f4df9bb2eee27fc19cc78 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:51.186594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2215-bbc4-418a-80aa-e273c3a0f89f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.193590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.196602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.266562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.267839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.267963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.268222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] PATH_INFO: `/v3/projects/b0a9f5b4466b409ea547bb0f2d1d5b40` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.269571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a9f5b4466b409ea547bb0f2d1d5b40)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.271795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.291683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1c6ee-bb61-49b8-a81e-8102df63e669 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.297849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.299148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.299504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.299817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] PATH_INFO: `/v3/users/f139b93416074f66a1addb12e788609f` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.301503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f139b93416074f66a1addb12e788609f)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.304050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.325905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a9f5b4466b409ea547bb0f2d1d5b40', 'request_id': 'req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.332630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a9f5b4466b409ea547bb0f2d1d5b40', 'request_id': 'req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.340586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a9f5b4466b409ea547bb0f2d1d5b40', 'request_id': 'req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.352584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] The token cache is being invalidate because project b0a9f5b4466b409ea547bb0f2d1d5b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:51.352904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.353522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.355903 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4150/8276] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:51 2022] DELETE /identity/v3/projects/b0a9f5b4466b409ea547bb0f2d1d5b40 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:51.356693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.358538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.361146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f139b93416074f66a1addb12e788609f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.369102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f139b93416074f66a1addb12e788609f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.370057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f139b93416074f66a1addb12e788609f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.372487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f139b93416074f66a1addb12e788609f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.380722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-bcb9171d-5c2e-432b-be47-112858201125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f139b93416074f66a1addb12e788609f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.405164 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4127/8277] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:51 2022] DELETE /identity/v3/users/f139b93416074f66a1addb12e788609f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:51.409152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cdc7e-e9e7-4f9c-80ec-61ed3eb35474 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.409438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cdc7e-e9e7-4f9c-80ec-61ed3eb35474 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.409728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cdc7e-e9e7-4f9c-80ec-61ed3eb35474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.431764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ea9cdc7e-e9e7-4f9c-80ec-61ed3eb35474 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:51.433294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ea9cdc7e-e9e7-4f9c-80ec-61ed3eb35474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.435348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55d67a-85a3-490b-b9ea-2e9cd2ff2569 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.506701 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4128/8278] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:51.506974 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.508076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.508262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.508544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] PATH_INFO: `/v3/projects/535e83ff134648ec92493f724d951613` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.509823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535e83ff134648ec92493f724d951613)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.511965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.516174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c191b1-3ca3-4f9e-8a7b-8a47539b22de None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.516746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c191b1-3ca3-4f9e-8a7b-8a47539b22de None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.517037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c191b1-3ca3-4f9e-8a7b-8a47539b22de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.538038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-24c191b1-3ca3-4f9e-8a7b-8a47539b22de None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:51.539391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-24c191b1-3ca3-4f9e-8a7b-8a47539b22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.553927 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4129/8279] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:51.555913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c191b1-3ca3-4f9e-8a7b-8a47539b22de None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.566742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c191b1-3ca3-4f9e-8a7b-8a47539b22de None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.573363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535e83ff134648ec92493f724d951613', 'request_id': 'req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.580886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535e83ff134648ec92493f724d951613', 'request_id': 'req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.591074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535e83ff134648ec92493f724d951613', 'request_id': 'req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.605451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] The token cache is being invalidate because project 535e83ff134648ec92493f724d951613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:51.605755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.607621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a2d5c8ac-8457-4076-9ff0-69d05bbadfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.609872 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4151/8280] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:51 2022] DELETE /identity/v3/projects/535e83ff134648ec92493f724d951613 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:51.614265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9e61-2db6-430a-b114-f37c14ad2290 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.614608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9e61-2db6-430a-b114-f37c14ad2290 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.615075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c9e61-2db6-430a-b114-f37c14ad2290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.637714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-211c9e61-2db6-430a-b114-f37c14ad2290 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:51.638808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-211c9e61-2db6-430a-b114-f37c14ad2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.643835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.644790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.645847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.646526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.647948 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4152/8281] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:51.648515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:51.648999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.651067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.657290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fbe56-7d59-4d1a-b33d-d88b40cc8af4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.657290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fbe56-7d59-4d1a-b33d-d88b40cc8af4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.657290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fbe56-7d59-4d1a-b33d-d88b40cc8af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.669006 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4130/8282] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:51.670481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.672457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.680443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-910fbe56-7d59-4d1a-b33d-d88b40cc8af4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:51.681940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-910fbe56-7d59-4d1a-b33d-d88b40cc8af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.687389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20346178-dd64-484e-ad2c-440c065a1440 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.692886 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4153/8283] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:51.696714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.697400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.697689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.697973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.698335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fbe56-7d59-4d1a-b33d-d88b40cc8af4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.698720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.700849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.717044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fbe56-7d59-4d1a-b33d-d88b40cc8af4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.724105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.725032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.725392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.725685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.728736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:51.728736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.734823 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4131/8284] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:51.737261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.739533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.754041 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4154/8285] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:51.755184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.757207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.774880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff2033-9693-4a13-af29-f400717bfdf2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.822709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c0ae0-595b-4ad3-b8b8-e0ca7ab07711 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.827992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.828725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.829040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.829315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.830079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.832272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.839781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.840904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.841257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.841548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] PATH_INFO: `/v3/projects/0551b03273614443a453b57742f88f79` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.842925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0551b03273614443a453b57742f88f79)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.844899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.859270 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4132/8286] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:51.859270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.869498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee911-d6b0-4fba-a547-f9f6fa79fb3f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.876136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.876870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.877201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.877459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.879235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:51.880776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:51.904739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0551b03273614443a453b57742f88f79', 'request_id': 'req-4ef6d99f-3cee-4495-9459-415b9cf8591f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.911541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0551b03273614443a453b57742f88f79', 'request_id': 'req-4ef6d99f-3cee-4495-9459-415b9cf8591f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.911701 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4133/8287] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:51.915740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.920897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0551b03273614443a453b57742f88f79', 'request_id': 'req-4ef6d99f-3cee-4495-9459-415b9cf8591f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.934997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] The token cache is being invalidate because project 0551b03273614443a453b57742f88f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:51.935353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.936224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:51.938083 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4155/8288] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:51 2022] DELETE /identity/v3/projects/0551b03273614443a453b57742f88f79 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:51.940506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:51.945593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:51.991549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92652208-77a6-4653-ac4b-2c1ed7431043 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:51.996747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:51.997590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:51.997839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:51.998187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:51.999013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.000813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.014372 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4134/8289] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:52.014372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.014372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.019084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6d99f-3cee-4495-9459-415b9cf8591f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.024509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.025580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.026022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.026417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.027360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.028996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994b87b-cc4c-4e24-829b-d38721ec6ecc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.030418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.034987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.036214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.036567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.036895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] PATH_INFO: `/v3/users/4f9e4c97735542f7bb58c4577ca565d6` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.038376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9e4c97735542f7bb58c4577ca565d6)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.040822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.055338 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4156/8290] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:51 2022] POST /identity/v3/users => generated 281 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:52.056784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.059070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.073232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815441f-da30-49d0-be2b-c85f644eaec4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.078761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.079480 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.080043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.080043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.080833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.082640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.092124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9e4c97735542f7bb58c4577ca565d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.095417 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4157/8291] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:52.096195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.103148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9e4c97735542f7bb58c4577ca565d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.103915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9e4c97735542f7bb58c4577ca565d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.104580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9e4c97735542f7bb58c4577ca565d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.107387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ab408-d6a3-4236-853e-64f04a7fa24b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.112556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.113213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.113531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9e4c97735542f7bb58c4577ca565d6'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.113720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.113831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.114814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.116203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.129007 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4158/8292] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:52.129913 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.131604 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.134851 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4135/8293] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:15:52 2022] DELETE /identity/v3/users/4f9e4c97735542f7bb58c4577ca565d6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:52.135740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.140297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.147530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345a4e7-5ad1-41b1-bfdd-ed7a793c65e9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.233411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3c89e-23fa-429a-bf13-5b7a5d5608f7 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.237196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab8ce4-cad2-4f18-94f6-86260c843c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.238439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8ce4-cad2-4f18-94f6-86260c843c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.238860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8ce4-cad2-4f18-94f6-86260c843c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.239065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab8ce4-cad2-4f18-94f6-86260c843c9b admin admin] PATH_INFO: `/v3/projects/c82534ba00c049e6bfa7421398228fff/users/af105dbc34cb4e4191e14314d88df4c4/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.241947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.241947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.242200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.242526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.243266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.245323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.256313 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4136/8294] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:52.259198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab8ce4-cad2-4f18-94f6-86260c843c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82534ba00c049e6bfa7421398228fff, user_id=af105dbc34cb4e4191e14314d88df4c4, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.262614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab8ce4-cad2-4f18-94f6-86260c843c9b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.264042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.276450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b030a-073b-4c79-94f0-05f3d1a88bc0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.284653 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54631905-afe1-4ec8-b04f-61f3d084eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.285565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631905-afe1-4ec8-b04f-61f3d084eec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.286099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631905-afe1-4ec8-b04f-61f3d084eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.286392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54631905-afe1-4ec8-b04f-61f3d084eec9 admin admin] PATH_INFO: `/v3/projects/61f7747618f6437fb151a86eb8762d19/users/8353db7a23914173b7fb3ac2f01ede5a/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.301367 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4159/8295] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:52 2022] PUT /identity/v3/projects/c82534ba00c049e6bfa7421398228fff/users/af105dbc34cb4e4191e14314d88df4c4/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:52.303798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.304231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.304707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.310526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54631905-afe1-4ec8-b04f-61f3d084eec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f7747618f6437fb151a86eb8762d19, user_id=8353db7a23914173b7fb3ac2f01ede5a, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.314021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54631905-afe1-4ec8-b04f-61f3d084eec9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.329423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:52.330754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.333435 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4137/8296] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:52 2022] PUT /identity/v3/projects/61f7747618f6437fb151a86eb8762d19/users/8353db7a23914173b7fb3ac2f01ede5a/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:15:52.343917 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.344204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.344512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.374331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] MFA Rules not processed for user `8353db7a23914173b7fb3ac2f01ede5a`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:52.375713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.414075 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4160/8297] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:15:52.421426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.422984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.455115 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4138/8298] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:52.465577 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.467986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.502345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91fc3c-1bea-4f90-a6fd-a06a9db15025 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.514051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.514723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.515042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.515318 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.530603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.532142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.545713 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4161/8299] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:15:52.546385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.549073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.556462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f4f35-b795-45c6-a0b7-8dbdd9564922 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.561074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fce4f2-20e7-4b12-8467-5ffa98f7c621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.561735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce4f2-20e7-4b12-8467-5ffa98f7c621 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.562022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce4f2-20e7-4b12-8467-5ffa98f7c621 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.562836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fce4f2-20e7-4b12-8467-5ffa98f7c621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.567194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bed57-51f5-4636-92df-9e06d325ae18 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.573837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.574018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fce4f2-20e7-4b12-8467-5ffa98f7c621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.575707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.576120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.576235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fce4f2-20e7-4b12-8467-5ffa98f7c621 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.576579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] PATH_INFO: `/v3/projects/d1b984894ab54466ae94346b3cabf484` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.578037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b984894ab54466ae94346b3cabf484)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.581492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.593461 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4139/8300] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:52.644691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b984894ab54466ae94346b3cabf484', 'request_id': 'req-3285f242-81cb-4847-b454-7aca61820b4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.652023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b984894ab54466ae94346b3cabf484', 'request_id': 'req-3285f242-81cb-4847-b454-7aca61820b4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.661583 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b984894ab54466ae94346b3cabf484', 'request_id': 'req-3285f242-81cb-4847-b454-7aca61820b4e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.672945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] The token cache is being invalidate because project d1b984894ab54466ae94346b3cabf484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:15:52.673232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.674371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-3285f242-81cb-4847-b454-7aca61820b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:15:52.676579 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4162/8301] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:15:52 2022] DELETE /identity/v3/projects/d1b984894ab54466ae94346b3cabf484 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:52.685694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f3a9-390a-4f7b-aff6-94d21c2a88af None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.685926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f3a9-390a-4f7b-aff6-94d21c2a88af None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.686343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f3a9-390a-4f7b-aff6-94d21c2a88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.707001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fb76f3a9-390a-4f7b-aff6-94d21c2a88af None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:52.708216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fb76f3a9-390a-4f7b-aff6-94d21c2a88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.778430 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4140/8302] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:52.786616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa4c2-93c8-4451-b629-2829f50ad102 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.786948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa4c2-93c8-4451-b629-2829f50ad102 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.787251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa4c2-93c8-4451-b629-2829f50ad102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.808496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1d0aa4c2-93c8-4451-b629-2829f50ad102 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:52.810489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1d0aa4c2-93c8-4451-b629-2829f50ad102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:52.824806 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4163/8303] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:52.826075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f3a9-390a-4f7b-aff6-94d21c2a88af None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.836911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f3a9-390a-4f7b-aff6-94d21c2a88af None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.842561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.843374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.843851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.843978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.844650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:15:52.844959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.846593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.862961 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4141/8304] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:15:52.866188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aa4c2-93c8-4451-b629-2829f50ad102 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.880759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aa4c2-93c8-4451-b629-2829f50ad102 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:52.887009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:52.887852 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:52.888135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:52.888409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:52.889494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:52.892001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:52.921202 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4164/8305] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:15:52 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:52.926457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:52.940323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945b87f-8abf-4054-9427-d2789ba31f14 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:53.018390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:53.019062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.019336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.019615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.020309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:53.022257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:53.044615 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4142/8306] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:15:52 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:15:53.047280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:53.059764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582d9c8-4c21-43aa-86da-bfa4d3dcc06d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:53.064596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:53.065306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.065592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.065930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.066675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:53.068375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:53.080234 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4165/8307] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:53.084094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:53.096093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75e051-8f81-4c75-9a2e-5e61b6f0633d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:53.103205 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af6ada-d2e9-493b-b477-6b5f6502fc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:53.103942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6ada-d2e9-493b-b477-6b5f6502fc8e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.104289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6ada-d2e9-493b-b477-6b5f6502fc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.104574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6ada-d2e9-493b-b477-6b5f6502fc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.105302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af6ada-d2e9-493b-b477-6b5f6502fc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:53.109198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af6ada-d2e9-493b-b477-6b5f6502fc8e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:53.120191 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4143/8308] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:15:53.126441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:53.142301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51bb8e-9fc9-4d91-9906-12f55e841687 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:53.147352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:53.148402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.148666 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.148945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] PATH_INFO: `/v3/projects/646717cca3f1470693a47f4d8d56dd1b/users/3743c0c0605b45d0bc8946a5f6f5d2b7/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.168160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] RBAC: Authorizing `identity:create_grant(project_id=646717cca3f1470693a47f4d8d56dd1b, user_id=3743c0c0605b45d0bc8946a5f6f5d2b7, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:53.171882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:53.190902 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4166/8309] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:15:53 2022] PUT /identity/v3/projects/646717cca3f1470693a47f4d8d56dd1b/users/3743c0c0605b45d0bc8946a5f6f5d2b7/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:15:53.205004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307263-6ea4-4441-8b17-b065f3f41f5a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.205297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307263-6ea4-4441-8b17-b065f3f41f5a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.205584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50307263-6ea4-4441-8b17-b065f3f41f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.247064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-50307263-6ea4-4441-8b17-b065f3f41f5a None None] MFA Rules not processed for user `3743c0c0605b45d0bc8946a5f6f5d2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:53.248468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-50307263-6ea4-4441-8b17-b065f3f41f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:53.340822 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4144/8310] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:53.349842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:53.352484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:53.428078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b917018-324e-4f0c-b0ed-c342a937389f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:53.432019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:53.432674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.432960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.433243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.443119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:53.445183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:53.464746 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4167/8311] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:53.572923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d8d-fc3c-422b-92b1-7268985a7e54 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.573283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d8d-fc3c-422b-92b1-7268985a7e54 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.574006 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6d8d-fc3c-422b-92b1-7268985a7e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.644346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-96cb6d8d-fc3c-422b-92b1-7268985a7e54 None None] MFA Rules not processed for user `af105dbc34cb4e4191e14314d88df4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:53.645499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-96cb6d8d-fc3c-422b-92b1-7268985a7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:53.772930 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4145/8312] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:53.786574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:53.789673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:53.883210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe2dd6-4394-4ad0-92ca-9f4574dfc8ea service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:53.888639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:53.889451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:53.889904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:53.890897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:53.902700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:53.904311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:53.921751 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4168/8313] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:55.402506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:55.404024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:55.404024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:55.425343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] MFA Rules not processed for user `af105dbc34cb4e4191e14314d88df4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:15:55.426141 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:55.435175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4146/8314] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:15:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:15:55.482273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:55.495894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe55ea-6ad4-4b51-944d-320fd8e30140 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:55.500964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:55.501580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:55.502046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:55.502348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:55.505628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:55.609601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:55.611154 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:55.635986 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4169/8315] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:15:56.646319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:15:56.650663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:56.768346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d2d6d-e769-4578-a976-f0bafde67f8e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:15:56.774015 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a2c05-0e9b-4f29-b4ab-ec048946ade5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:15:56.775060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2c05-0e9b-4f29-b4ab-ec048946ade5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:15:56.775662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2c05-0e9b-4f29-b4ab-ec048946ade5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:15:56.776839 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2c05-0e9b-4f29-b4ab-ec048946ade5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:15:56.781895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-250a2c05-0e9b-4f29-b4ab-ec048946ade5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:15:56.807637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a2c05-0e9b-4f29-b4ab-ec048946ade5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:15:56.810454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a2c05-0e9b-4f29-b4ab-ec048946ade5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:15:56.834793 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4147/8316] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:15:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:02.150008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:02.151472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:02.244873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30254ff1-8da3-4dc9-97be-5fb85b10272e service glance] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:02.249984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:02.250864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:02.251146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:02.251417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] PATH_INFO: `/v3/users/8353db7a23914173b7fb3ac2f01ede5a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:02.252603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8353db7a23914173b7fb3ac2f01ede5a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:02.254506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:02.301956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8353db7a23914173b7fb3ac2f01ede5a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.302945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8353db7a23914173b7fb3ac2f01ede5a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.310022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8353db7a23914173b7fb3ac2f01ede5a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.310676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8353db7a23914173b7fb3ac2f01ede5a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.318912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8353db7a23914173b7fb3ac2f01ede5a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.335355 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4170/8317] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:02 2022] DELETE /identity/v3/users/8353db7a23914173b7fb3ac2f01ede5a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:02.340090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:02.341075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:02.341402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:02.398633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:02.399845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:02.464704 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4148/8318] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:02.476757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:02.478355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:02.556238 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7975-0927-40ec-a8ae-2edd81734852 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:02.560314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a409058-884f-4dbb-a58a-7c72a83a01f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:02.560969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409058-884f-4dbb-a58a-7c72a83a01f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:02.561255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409058-884f-4dbb-a58a-7c72a83a01f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:02.561533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a409058-884f-4dbb-a58a-7c72a83a01f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:02.572311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a409058-884f-4dbb-a58a-7c72a83a01f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:02.574418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a409058-884f-4dbb-a58a-7c72a83a01f9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:02.588493 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4171/8319] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:02.775441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:02.776908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:02.790747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e0bcf-5392-466d-85ae-ddc67f321a86 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:02.795701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:02.796690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:02.797040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:02.797325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] PATH_INFO: `/v3/projects/61f7747618f6437fb151a86eb8762d19` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:02.798983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f7747618f6437fb151a86eb8762d19)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:02.800935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:02.858501 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f7747618f6437fb151a86eb8762d19', 'request_id': 'req-7aa281e2-524f-485c-a115-00ffd4452306'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.868420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f7747618f6437fb151a86eb8762d19', 'request_id': 'req-7aa281e2-524f-485c-a115-00ffd4452306'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.877433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f7747618f6437fb151a86eb8762d19', 'request_id': 'req-7aa281e2-524f-485c-a115-00ffd4452306'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.888873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] The token cache is being invalidate because project 61f7747618f6437fb151a86eb8762d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:02.889170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.889911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-7aa281e2-524f-485c-a115-00ffd4452306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:02.891995 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4149/8320] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:02 2022] DELETE /identity/v3/projects/61f7747618f6437fb151a86eb8762d19 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:02.896909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2557ec-5c1d-4867-8844-cfab634622ec None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:02.897204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2557ec-5c1d-4867-8844-cfab634622ec None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:02.897511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2557ec-5c1d-4867-8844-cfab634622ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:02.916475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ed2557ec-5c1d-4867-8844-cfab634622ec None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:02.917704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed2557ec-5c1d-4867-8844-cfab634622ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:02.981457 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4172/8321] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:02.989303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcb79-291e-43dd-af2a-c1268e6c8ff9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:02.989687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcb79-291e-43dd-af2a-c1268e6c8ff9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:02.989978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcb79-291e-43dd-af2a-c1268e6c8ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.010624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bb5dcb79-291e-43dd-af2a-c1268e6c8ff9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:03.012490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bb5dcb79-291e-43dd-af2a-c1268e6c8ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:03.020703 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4150/8322] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:03.025013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2557ec-5c1d-4867-8844-cfab634622ec None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.037711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2557ec-5c1d-4867-8844-cfab634622ec None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.042313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.043049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.043341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.043619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.044651 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:03.044958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.046571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.061310 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4173/8323] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:16:03.065620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcb79-291e-43dd-af2a-c1268e6c8ff9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.075949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcb79-291e-43dd-af2a-c1268e6c8ff9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.081688 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.082424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.082714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.083028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.083752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.085684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.116682 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4151/8324] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:03 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:03.120739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.131395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a24f51-fcfd-4c39-a145-41d371a570e6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.197652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.198335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.198627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.198951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.200283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.202388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.232003 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4174/8325] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:03 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:03.237789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.249336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef74166-0be5-4e9a-b1ae-4648eadef05d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.255431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.256112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.256422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.256665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.257470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.259276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.272353 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4152/8326] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:03.278254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.291377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a40c8-fa77-4500-add9-8439e0d6366f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.301889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08394d-0f83-45f1-988e-acbcfcda677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.302554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08394d-0f83-45f1-988e-acbcfcda677f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.302992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08394d-0f83-45f1-988e-acbcfcda677f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.303198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08394d-0f83-45f1-988e-acbcfcda677f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.303921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08394d-0f83-45f1-988e-acbcfcda677f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.305880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08394d-0f83-45f1-988e-acbcfcda677f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.318210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4175/8327] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:03.322463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.335929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e682b-ede3-46d1-8a5d-7f81264abdf0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.342054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.343668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.344128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.344691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] PATH_INFO: `/v3/projects/54a6d5ac8242481b9bc8d715450d84c9/users/d7a222ef36b94d988d01be8630d2b7f2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.360692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a6d5ac8242481b9bc8d715450d84c9, user_id=d7a222ef36b94d988d01be8630d2b7f2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.363661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.378032 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4153/8328] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:03 2022] PUT /identity/v3/projects/54a6d5ac8242481b9bc8d715450d84c9/users/d7a222ef36b94d988d01be8630d2b7f2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:03.388407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c38ed-7ec7-4626-b9be-cc64e383b575 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.388700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c38ed-7ec7-4626-b9be-cc64e383b575 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.388980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c38ed-7ec7-4626-b9be-cc64e383b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.420605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4d7c38ed-7ec7-4626-b9be-cc64e383b575 None None] MFA Rules not processed for user `d7a222ef36b94d988d01be8630d2b7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:03.421822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4d7c38ed-7ec7-4626-b9be-cc64e383b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:03.490864 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4176/8329] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:03.507961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.509779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:03.596444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4d23-53ad-4093-8ded-8235bfcc1a09 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.600213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72807e95-7964-4cd9-b602-412a6183e800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.600863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807e95-7964-4cd9-b602-412a6183e800 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.601278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807e95-7964-4cd9-b602-412a6183e800 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.601564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72807e95-7964-4cd9-b602-412a6183e800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.610151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72807e95-7964-4cd9-b602-412a6183e800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.611657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72807e95-7964-4cd9-b602-412a6183e800 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.620943 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4154/8330] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:03.635201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c38ed-7ec7-4626-b9be-cc64e383b575 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.698065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c38ed-7ec7-4626-b9be-cc64e383b575 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.703280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.704157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.704444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.704725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] PATH_INFO: `/v3/users/d7a222ef36b94d988d01be8630d2b7f2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.705947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a222ef36b94d988d01be8630d2b7f2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.707924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.755028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a222ef36b94d988d01be8630d2b7f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:03.755605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a222ef36b94d988d01be8630d2b7f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:03.763336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a222ef36b94d988d01be8630d2b7f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:03.764001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a222ef36b94d988d01be8630d2b7f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:03.771343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a222ef36b94d988d01be8630d2b7f2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:03.789289 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4177/8331] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:03 2022] DELETE /identity/v3/users/d7a222ef36b94d988d01be8630d2b7f2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:03.793916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.794212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.794489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.822879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:03.824103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:03.884936 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4155/8332] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:03.895720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:03.897250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:03.959414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1087c1-26cd-44ae-a62a-97842119a890 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:03.963144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178681-92f2-4939-b6fd-bbf6b613ac05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:03.963787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178681-92f2-4939-b6fd-bbf6b613ac05 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:03.964075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178681-92f2-4939-b6fd-bbf6b613ac05 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:03.964355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178681-92f2-4939-b6fd-bbf6b613ac05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:03.973361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178681-92f2-4939-b6fd-bbf6b613ac05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:03.974838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178681-92f2-4939-b6fd-bbf6b613ac05 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:03.984826 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4178/8333] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:04.266499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:04.268315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:04.281054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d537b7-f476-4a51-aa93-f70eaf11e9fb None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:04.287473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:04.288748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.289045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.289325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] PATH_INFO: `/v3/projects/54a6d5ac8242481b9bc8d715450d84c9` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.291516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a6d5ac8242481b9bc8d715450d84c9)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:04.294422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:04.351155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a6d5ac8242481b9bc8d715450d84c9', 'request_id': 'req-6633d436-7c47-4a8a-91ab-3adda676a448'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:04.359837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a6d5ac8242481b9bc8d715450d84c9', 'request_id': 'req-6633d436-7c47-4a8a-91ab-3adda676a448'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:04.372532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a6d5ac8242481b9bc8d715450d84c9', 'request_id': 'req-6633d436-7c47-4a8a-91ab-3adda676a448'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:04.388364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] The token cache is being invalidate because project 54a6d5ac8242481b9bc8d715450d84c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:04.388664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:04.389537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6633d436-7c47-4a8a-91ab-3adda676a448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:04.395118 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4156/8334] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:04 2022] DELETE /identity/v3/projects/54a6d5ac8242481b9bc8d715450d84c9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:04.397062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c935-44d4-433d-93f0-5e6cf788a2cb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.397550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c935-44d4-433d-93f0-5e6cf788a2cb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.397983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c935-44d4-433d-93f0-5e6cf788a2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.417477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9281c935-44d4-433d-93f0-5e6cf788a2cb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:04.419322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9281c935-44d4-433d-93f0-5e6cf788a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:04.479018 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4179/8335] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:04.566039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705400-4b36-44e1-b069-0f05922e50c0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.566384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705400-4b36-44e1-b069-0f05922e50c0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.566671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705400-4b36-44e1-b069-0f05922e50c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.603267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a5705400-4b36-44e1-b069-0f05922e50c0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:04.604726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a5705400-4b36-44e1-b069-0f05922e50c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:04.613380 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4157/8336] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:04.617695 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281c935-44d4-433d-93f0-5e6cf788a2cb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:04.633800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281c935-44d4-433d-93f0-5e6cf788a2cb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:04.639108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:04.639772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.640055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.640329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.641054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:04.641359 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:04.643100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:04.655030 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4180/8337] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:16:04.659392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5705400-4b36-44e1-b069-0f05922e50c0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:04.669292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5705400-4b36-44e1-b069-0f05922e50c0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:04.674583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:04.675276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.675563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.675838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.676526 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:04.678447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:04.702397 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4158/8338] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:04 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:04.706627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:04.717250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855e36b-c880-418f-ae93-aa39eef98db5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:04.776995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:04.778105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.778395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.778670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.779404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:04.781578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:04.802172 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4181/8339] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:04 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:04.806437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:04.816630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92299d1-a94b-46fd-83cd-c58b6c4a5f89 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:04.821163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:04.821816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.822099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.822374 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.823133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:04.824757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:04.835080 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4159/8340] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:04.838908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:04.849617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaec514-a894-4925-8b99-973e4c01786c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:04.854342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d6ed1-331e-4ffe-84ee-c0b3b27ca035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:04.855120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6ed1-331e-4ffe-84ee-c0b3b27ca035 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.855410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6ed1-331e-4ffe-84ee-c0b3b27ca035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.856355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d6ed1-331e-4ffe-84ee-c0b3b27ca035 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.857076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d6ed1-331e-4ffe-84ee-c0b3b27ca035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:04.858715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d6ed1-331e-4ffe-84ee-c0b3b27ca035 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:04.868296 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4182/8341] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:04.872303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:04.881975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde470d-c203-42b0-a6ee-f09a8d30f2be admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:04.886538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:04.887479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.887749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.888025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] PATH_INFO: `/v3/projects/9c97c10be6f04abe88bae3fed114e3eb/users/8d7d1e4d45af4c66adbfd4ce9fb95457/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.901871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c97c10be6f04abe88bae3fed114e3eb, user_id=8d7d1e4d45af4c66adbfd4ce9fb95457, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:04.905101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:04.917898 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4160/8342] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:04 2022] PUT /identity/v3/projects/9c97c10be6f04abe88bae3fed114e3eb/users/8d7d1e4d45af4c66adbfd4ce9fb95457/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:04.928719 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463f971-0f8b-4e91-b80e-698d27a361ff None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:04.929018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463f971-0f8b-4e91-b80e-698d27a361ff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:04.929302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463f971-0f8b-4e91-b80e-698d27a361ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:04.955253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8463f971-0f8b-4e91-b80e-698d27a361ff None None] MFA Rules not processed for user `8d7d1e4d45af4c66adbfd4ce9fb95457`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:04.956577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8463f971-0f8b-4e91-b80e-698d27a361ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:05.020387 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4183/8343] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:05.025014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.084867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6429607-0497-4e29-a307-16093e782854 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.089685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.090950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.091239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.091523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.092497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.094439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.128491 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4161/8344] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:05 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:05.132752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463f971-0f8b-4e91-b80e-698d27a361ff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.143921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463f971-0f8b-4e91-b80e-698d27a361ff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.204287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.204992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.205273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.205692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.206411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.208368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.229863 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4184/8345] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:05 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:05.236366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.246899 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223358e1-8fc5-437b-b850-1fb1e5f3170c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.251666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.252406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.252692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.252966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.253679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.255315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.267137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4162/8346] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:05.271320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.282118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c7158-e987-4d7c-bf7c-1e6924f71875 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.287121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.288009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.288300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.288577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] PATH_INFO: `/v3/projects/73fb7cdcaae24a95b2cc1ac30d22aa45/users/062df33bf21d4f3881fc4fff357c7a8b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.309074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fb7cdcaae24a95b2cc1ac30d22aa45, user_id=062df33bf21d4f3881fc4fff357c7a8b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.311893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.325680 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4185/8347] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:05 2022] PUT /identity/v3/projects/73fb7cdcaae24a95b2cc1ac30d22aa45/users/062df33bf21d4f3881fc4fff357c7a8b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:05.330845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.342827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a811-6d07-4915-a565-204b813ccab5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.397941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f3942-578c-4013-bdca-861e8032d42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.398632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3942-578c-4013-bdca-861e8032d42a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.398929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3942-578c-4013-bdca-861e8032d42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.399260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f3942-578c-4013-bdca-861e8032d42a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.400017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f3942-578c-4013-bdca-861e8032d42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.401615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f3942-578c-4013-bdca-861e8032d42a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.414729 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4163/8348] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:05.415804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.426389 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc986-4aae-4798-9017-0682c1938c25 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.431084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.431955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.432258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.432499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] PATH_INFO: `/v3/projects/73fb7cdcaae24a95b2cc1ac30d22aa45/users/062df33bf21d4f3881fc4fff357c7a8b/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.435021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fb7cdcaae24a95b2cc1ac30d22aa45, user_id=062df33bf21d4f3881fc4fff357c7a8b, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.437671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.448749 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4186/8349] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:05 2022] PUT /identity/v3/projects/73fb7cdcaae24a95b2cc1ac30d22aa45/users/062df33bf21d4f3881fc4fff357c7a8b/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:05.460130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0691-145e-4b70-8c86-47f80a78e92e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.460419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0691-145e-4b70-8c86-47f80a78e92e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.460856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd0691-145e-4b70-8c86-47f80a78e92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.488879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-69bd0691-145e-4b70-8c86-47f80a78e92e None None] MFA Rules not processed for user `062df33bf21d4f3881fc4fff357c7a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:05.490103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-69bd0691-145e-4b70-8c86-47f80a78e92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:05.579362 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4164/8350] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:05.591340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.593749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:05.657835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99709611-c734-4770-83f0-1da5cdae37ff admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.662144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.662824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.663114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.663439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.673917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.675545 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.686567 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4187/8351] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:05.772318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd0691-145e-4b70-8c86-47f80a78e92e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:05.786937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd0691-145e-4b70-8c86-47f80a78e92e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:05.791637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376aa9b-c418-4ebf-95d4-aa0568189194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:05.792311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376aa9b-c418-4ebf-95d4-aa0568189194 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:05.792600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376aa9b-c418-4ebf-95d4-aa0568189194 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:05.793439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376aa9b-c418-4ebf-95d4-aa0568189194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:05.857532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376aa9b-c418-4ebf-95d4-aa0568189194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:05.858780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376aa9b-c418-4ebf-95d4-aa0568189194 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:05.869883 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4165/8352] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:08.855210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:08.856839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:08.943453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477052-5baf-4490-b928-1ac07d5bdf7e service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:08.950062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:08.951283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:08.951598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:08.954864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] PATH_INFO: `/v3/users/3743c0c0605b45d0bc8946a5f6f5d2b7` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:08.956305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3743c0c0605b45d0bc8946a5f6f5d2b7)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:08.959714 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:09.032324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3743c0c0605b45d0bc8946a5f6f5d2b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.033317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3743c0c0605b45d0bc8946a5f6f5d2b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.050111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3743c0c0605b45d0bc8946a5f6f5d2b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.051079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3743c0c0605b45d0bc8946a5f6f5d2b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.061739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3743c0c0605b45d0bc8946a5f6f5d2b7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.082974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4188/8353] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:08 2022] DELETE /identity/v3/users/3743c0c0605b45d0bc8946a5f6f5d2b7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:09.088191 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:09.088698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:09.089180 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:09.109716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:09.111104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:09.177697 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4166/8354] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:09.188490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:09.189919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:09.254411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c07b7-7ea1-4920-b21a-d679a8e51b45 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:09.258532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842266e-dad5-4036-88a2-d0bc5f8e9c5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:09.259294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842266e-dad5-4036-88a2-d0bc5f8e9c5b service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:09.259654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842266e-dad5-4036-88a2-d0bc5f8e9c5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:09.259967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842266e-dad5-4036-88a2-d0bc5f8e9c5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:09.271682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842266e-dad5-4036-88a2-d0bc5f8e9c5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:09.273365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842266e-dad5-4036-88a2-d0bc5f8e9c5b service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:09.285448 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4189/8355] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:09.588694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:09.591013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:09.629813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19788f-39c5-4cf6-a9ac-26c9d713db21 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:09.639674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:09.640783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:09.641107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:09.641398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] PATH_INFO: `/v3/projects/646717cca3f1470693a47f4d8d56dd1b` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:09.643252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=646717cca3f1470693a47f4d8d56dd1b)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:09.645305 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:09.700857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646717cca3f1470693a47f4d8d56dd1b', 'request_id': 'req-b4926784-f804-4d2c-90eb-a246b0d9f5fb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.707908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646717cca3f1470693a47f4d8d56dd1b', 'request_id': 'req-b4926784-f804-4d2c-90eb-a246b0d9f5fb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.717952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646717cca3f1470693a47f4d8d56dd1b', 'request_id': 'req-b4926784-f804-4d2c-90eb-a246b0d9f5fb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.729422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] The token cache is being invalidate because project 646717cca3f1470693a47f4d8d56dd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:09.729762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.731023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b4926784-f804-4d2c-90eb-a246b0d9f5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:09.732848 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4167/8356] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:09 2022] DELETE /identity/v3/projects/646717cca3f1470693a47f4d8d56dd1b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:09.737877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560db782-08e6-4a5d-9db9-c04e70f422cb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:09.738167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560db782-08e6-4a5d-9db9-c04e70f422cb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:09.738457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560db782-08e6-4a5d-9db9-c04e70f422cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:09.757189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-560db782-08e6-4a5d-9db9-c04e70f422cb None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:09.758504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-560db782-08e6-4a5d-9db9-c04e70f422cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:09.828961 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4190/8357] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:09.838734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebc2c-841d-47a8-a294-9e651d327f84 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:09.839208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebc2c-841d-47a8-a294-9e651d327f84 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:09.839657 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebc2c-841d-47a8-a294-9e651d327f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:09.860977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-35eebc2c-841d-47a8-a294-9e651d327f84 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:09.862190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-35eebc2c-841d-47a8-a294-9e651d327f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:09.874658 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4168/8358] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:09.875873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560db782-08e6-4a5d-9db9-c04e70f422cb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:09.887167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560db782-08e6-4a5d-9db9-c04e70f422cb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:09.892902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:09.893603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:09.894015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:09.894271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:09.895118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:09.895428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:09.897024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:09.910840 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4191/8359] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:16:09.915389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eebc2c-841d-47a8-a294-9e651d327f84 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:09.926649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eebc2c-841d-47a8-a294-9e651d327f84 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:09.932445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:09.933113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:09.933431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:09.933705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:09.934433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:09.936432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:09.967839 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4169/8360] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:09 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:09.973221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:09.986231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74352e5-400a-4f29-8260-d27ee6ebfe58 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.054916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.055829 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.056118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.056525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.057340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.059946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.083825 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4192/8361] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:09 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:10.088865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.102581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21186-fd79-49cb-8284-48544c758dfb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.109001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.109762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.109968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.110223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.111121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.112981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.127829 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4170/8362] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:10.132028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.146809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751541b1-54e4-4c07-9f25-278c4e767f79 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.154219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c98b9-c99d-40f3-b1bd-2e5dc7c0279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.154983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c98b9-c99d-40f3-b1bd-2e5dc7c0279d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.155511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c98b9-c99d-40f3-b1bd-2e5dc7c0279d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.155805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c98b9-c99d-40f3-b1bd-2e5dc7c0279d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.156684 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c98b9-c99d-40f3-b1bd-2e5dc7c0279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.158691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c98b9-c99d-40f3-b1bd-2e5dc7c0279d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.176362 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4193/8363] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:10.178185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.203742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc0522-5ebc-4980-995b-f57198e8175d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.211941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.213064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.213498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.214245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] PATH_INFO: `/v3/projects/16812b38c4514406886f0ab13cabe8ad/users/aeee01bf990e46bfa331c1cd93528cab/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.233367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16812b38c4514406886f0ab13cabe8ad, user_id=aeee01bf990e46bfa331c1cd93528cab, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.236597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.257332 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4171/8364] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:10 2022] PUT /identity/v3/projects/16812b38c4514406886f0ab13cabe8ad/users/aeee01bf990e46bfa331c1cd93528cab/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:10.268278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aac9-615a-4067-b28a-f47c94c77f12 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.268716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aac9-615a-4067-b28a-f47c94c77f12 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.268979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7aac9-615a-4067-b28a-f47c94c77f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.306167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-70b7aac9-615a-4067-b28a-f47c94c77f12 None None] MFA Rules not processed for user `aeee01bf990e46bfa331c1cd93528cab`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:10.307958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-70b7aac9-615a-4067-b28a-f47c94c77f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:10.406744 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4194/8365] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:10.411261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.508494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03aa58-5c19-42c8-8a6b-396ec887ad4a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.516393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.517586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.518210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.518632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.519600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.522216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.588404 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4172/8366] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:10 2022] POST /identity/v3/projects => generated 391 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:10.593733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aac9-615a-4067-b28a-f47c94c77f12 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.606364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7aac9-615a-4067-b28a-f47c94c77f12 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.700710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.701617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.701911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.703188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.704227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.706306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.737329 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4195/8367] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:10 2022] POST /identity/v3/users => generated 302 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:10.742068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.758460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61423ac7-421b-4164-8e63-fc2ea9a18585 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.765230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.765942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.766459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.766675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.767835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.770037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.784363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4173/8368] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:10.789672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.803685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e2d4d-d285-493e-ad23-45a094f61def admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.810140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.811155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.811493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.811777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] PATH_INFO: `/v3/projects/5eeb6b6f47ee48bb9910c2053c218c5f/users/89531afef5cb418ba1f03c733b07816d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.830249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eeb6b6f47ee48bb9910c2053c218c5f, user_id=89531afef5cb418ba1f03c733b07816d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.833632 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.850298 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4196/8369] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:10 2022] PUT /identity/v3/projects/5eeb6b6f47ee48bb9910c2053c218c5f/users/89531afef5cb418ba1f03c733b07816d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:10.854718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.868558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15296e79-ce93-41e5-b64e-6eebbf2fd10e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.934543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9204c-4cbe-454f-bade-8a16e9441e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.935237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9204c-4cbe-454f-bade-8a16e9441e21 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.935519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9204c-4cbe-454f-bade-8a16e9441e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.935792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9204c-4cbe-454f-bade-8a16e9441e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.936584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9204c-4cbe-454f-bade-8a16e9441e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.938301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9204c-4cbe-454f-bade-8a16e9441e21 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.950123 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4174/8370] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:10.954608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:10.966427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7887f6b-8d59-4033-bdce-4fd263ad1f1a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:10.971718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:10.972650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:10.972934 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:10.973498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] PATH_INFO: `/v3/projects/5eeb6b6f47ee48bb9910c2053c218c5f/users/89531afef5cb418ba1f03c733b07816d/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:10.976216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eeb6b6f47ee48bb9910c2053c218c5f, user_id=89531afef5cb418ba1f03c733b07816d, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:10.979749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:10.994351 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4197/8371] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:10 2022] PUT /identity/v3/projects/5eeb6b6f47ee48bb9910c2053c218c5f/users/89531afef5cb418ba1f03c733b07816d/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:11.006867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438ea32-5445-4730-8f8f-998e20c0042f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:11.007189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438ea32-5445-4730-8f8f-998e20c0042f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:11.007441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438ea32-5445-4730-8f8f-998e20c0042f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:11.041850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6438ea32-5445-4730-8f8f-998e20c0042f None None] MFA Rules not processed for user `89531afef5cb418ba1f03c733b07816d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:11.044056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6438ea32-5445-4730-8f8f-998e20c0042f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:11.130688 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4175/8372] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:11.145411 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:11.147911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:11.238575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666ae9a-8df9-4880-a0c7-f365d150312d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:11.250245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:11.250245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:11.250245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:11.250245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:11.254548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd0bb-c6f7-4f97-9b9f-28dc2b7ce081 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:11.254976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd0bb-c6f7-4f97-9b9f-28dc2b7ce081 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:11.255407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd0bb-c6f7-4f97-9b9f-28dc2b7ce081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:11.283597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5c5dd0bb-c6f7-4f97-9b9f-28dc2b7ce081 None None] MFA Rules not processed for user `af105dbc34cb4e4191e14314d88df4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:11.285285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5c5dd0bb-c6f7-4f97-9b9f-28dc2b7ce081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:11.318669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:11.320338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:11.331456 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4198/8373] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:11.358169 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4176/8374] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:13.239200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:13.241279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:13.335963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200700a-9ebe-494d-a53c-638c0166ff3f service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:13.340701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:13.341570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:13.341845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:13.342379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] PATH_INFO: `/v3/users/8d7d1e4d45af4c66adbfd4ce9fb95457` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:13.343629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7d1e4d45af4c66adbfd4ce9fb95457)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:13.346353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:13.395706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7d1e4d45af4c66adbfd4ce9fb95457'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:13.396911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7d1e4d45af4c66adbfd4ce9fb95457'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:13.404646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7d1e4d45af4c66adbfd4ce9fb95457'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:13.405431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7d1e4d45af4c66adbfd4ce9fb95457'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:13.415888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7d1e4d45af4c66adbfd4ce9fb95457'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:13.434454 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4199/8375] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:13 2022] DELETE /identity/v3/users/8d7d1e4d45af4c66adbfd4ce9fb95457 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:13.439106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:13.439630 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:13.439742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:13.457725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:13.459008 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:13.518636 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4177/8376] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:13.528591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:13.530013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:13.591187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8120-0c5f-45a7-ace0-0a15f632b60e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:13.594918 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:13.595560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:13.595841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:13.596149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:13.605801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:13.607313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:13.617482 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4200/8377] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:14.190494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:14.192035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:14.205321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89d4db-1309-4f21-8b01-0f0205fd9fa6 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:14.212728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:14.213924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:14.214296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:14.215257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] PATH_INFO: `/v3/projects/9c97c10be6f04abe88bae3fed114e3eb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:14.216884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c97c10be6f04abe88bae3fed114e3eb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:14.219747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:14.270922 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c97c10be6f04abe88bae3fed114e3eb', 'request_id': 'req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.278062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c97c10be6f04abe88bae3fed114e3eb', 'request_id': 'req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.287247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c97c10be6f04abe88bae3fed114e3eb', 'request_id': 'req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.297388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] The token cache is being invalidate because project 9c97c10be6f04abe88bae3fed114e3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:14.297679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.298677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.300363 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4178/8378] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:14 2022] DELETE /identity/v3/projects/9c97c10be6f04abe88bae3fed114e3eb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:14.304953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:14.314927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977e824-ebf7-4ffe-b0a6-c7ca15f8d894 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:14.381455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:14.382343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:14.382908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:14.383510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] PATH_INFO: `/v3/users/062df33bf21d4f3881fc4fff357c7a8b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:14.384916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062df33bf21d4f3881fc4fff357c7a8b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:14.388235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:14.439848 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062df33bf21d4f3881fc4fff357c7a8b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.440552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062df33bf21d4f3881fc4fff357c7a8b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.447619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062df33bf21d4f3881fc4fff357c7a8b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.448367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062df33bf21d4f3881fc4fff357c7a8b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.455771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-f74b28de-0ee5-4c0c-8d78-4bb5e21aa828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062df33bf21d4f3881fc4fff357c7a8b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.478592 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4201/8379] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:14 2022] DELETE /identity/v3/users/062df33bf21d4f3881fc4fff357c7a8b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:14.763735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:14.766273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:14.800425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418e17a-6e76-4f21-8fbb-0c80a37e64c4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:14.863954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:14.864822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:14.865131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:14.865402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] PATH_INFO: `/v3/projects/73fb7cdcaae24a95b2cc1ac30d22aa45` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:14.866591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fb7cdcaae24a95b2cc1ac30d22aa45)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:14.868574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:14.915553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fb7cdcaae24a95b2cc1ac30d22aa45', 'request_id': 'req-16800ea6-ff90-464e-be19-1d0c5f2f9f12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.922801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fb7cdcaae24a95b2cc1ac30d22aa45', 'request_id': 'req-16800ea6-ff90-464e-be19-1d0c5f2f9f12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.931108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fb7cdcaae24a95b2cc1ac30d22aa45', 'request_id': 'req-16800ea6-ff90-464e-be19-1d0c5f2f9f12'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.943011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] The token cache is being invalidate because project 73fb7cdcaae24a95b2cc1ac30d22aa45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:14.943315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.943964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-16800ea6-ff90-464e-be19-1d0c5f2f9f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:14.945625 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4179/8380] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:14 2022] DELETE /identity/v3/projects/73fb7cdcaae24a95b2cc1ac30d22aa45 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:14.951537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62752-bbf9-49c8-93d0-dcb19a0cf517 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:14.951828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62752-bbf9-49c8-93d0-dcb19a0cf517 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:14.952092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e62752-bbf9-49c8-93d0-dcb19a0cf517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:14.969277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-86e62752-bbf9-49c8-93d0-dcb19a0cf517 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:14.970421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-86e62752-bbf9-49c8-93d0-dcb19a0cf517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:15.030114 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4202/8381] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:15.037979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0e63-daca-4220-83b9-0a03a4556860 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.038376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0e63-daca-4220-83b9-0a03a4556860 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.038737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b0e63-daca-4220-83b9-0a03a4556860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.059754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-007b0e63-daca-4220-83b9-0a03a4556860 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:15.060974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-007b0e63-daca-4220-83b9-0a03a4556860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:15.069325 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4180/8382] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:15.073463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e62752-bbf9-49c8-93d0-dcb19a0cf517 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.083628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e62752-bbf9-49c8-93d0-dcb19a0cf517 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.088434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.089208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.089596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.089960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.090763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:15.091172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.092867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.106288 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4203/8383] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:16:15.110880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0e63-daca-4220-83b9-0a03a4556860 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.120658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b0e63-daca-4220-83b9-0a03a4556860 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.126363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.127106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.127392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.127667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.128398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.130390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.161440 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4181/8384] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:15 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:15.163036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.174729 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4750cc-63b5-45f8-b6ad-d678ed63ad68 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.245433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.246112 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.246398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.246682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.247412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.249383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.268742 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4204/8385] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:15 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:15.273433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.284555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc56cf7-b9ac-48f3-b891-726e547e99bf admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.289651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.290370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.290656 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.290981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.291717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.294109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.305662 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4182/8386] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:15.310078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.321421 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923148d7-257e-441c-9282-4010c5d92ef1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.326592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d391545-0ee2-4f7d-aa36-6254913ddd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.327297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d391545-0ee2-4f7d-aa36-6254913ddd0d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.327588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d391545-0ee2-4f7d-aa36-6254913ddd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.327870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d391545-0ee2-4f7d-aa36-6254913ddd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.328696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d391545-0ee2-4f7d-aa36-6254913ddd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.330333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d391545-0ee2-4f7d-aa36-6254913ddd0d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.341010 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4205/8387] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:15.345414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.356625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c6f-6007-4de3-89dd-b7a061d754b8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.361569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.362560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.362948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.363292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] PATH_INFO: `/v3/projects/dc8c7e7f20654d47a53f6788abfe6290/users/1fee969eedf442c4b6ebeccf993565ac/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.377470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8c7e7f20654d47a53f6788abfe6290, user_id=1fee969eedf442c4b6ebeccf993565ac, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.380283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.394397 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4183/8388] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:15 2022] PUT /identity/v3/projects/dc8c7e7f20654d47a53f6788abfe6290/users/1fee969eedf442c4b6ebeccf993565ac/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:15.406256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06f4d-1bfa-4911-8f0e-f5a3d529a3f2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.406699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06f4d-1bfa-4911-8f0e-f5a3d529a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.407248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06f4d-1bfa-4911-8f0e-f5a3d529a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.439027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d1f06f4d-1bfa-4911-8f0e-f5a3d529a3f2 None None] MFA Rules not processed for user `1fee969eedf442c4b6ebeccf993565ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:15.440273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d1f06f4d-1bfa-4911-8f0e-f5a3d529a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:15.505684 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4206/8389] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:15.510326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.593724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7ebf6-df0b-459a-8174-e4cb5d1c68fa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.598614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.599327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.599634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.599914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.600609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.602544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.631771 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4184/8390] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:15 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:15.634178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06f4d-1bfa-4911-8f0e-f5a3d529a3f2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.651398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06f4d-1bfa-4911-8f0e-f5a3d529a3f2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.711773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.712602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.713018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.713400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.714331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.717062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.736652 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4207/8391] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:15 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:15.740825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.751314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15dd02-1c4f-4845-a963-916e89b6e0c4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.756145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.756819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.757115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.757371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.758328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.759949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.771181 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4185/8392] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:15.775789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.787018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb35b42-d1a5-41ee-a017-cfedece94c90 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.793027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.793907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.794207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.794474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] PATH_INFO: `/v3/projects/f908d3179c36445bae83f910af155867/users/d900ccf5fb31483da748c3aa99d88841/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.809687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f908d3179c36445bae83f910af155867, user_id=d900ccf5fb31483da748c3aa99d88841, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.812587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.828386 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4208/8393] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:15 2022] PUT /identity/v3/projects/f908d3179c36445bae83f910af155867/users/d900ccf5fb31483da748c3aa99d88841/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:15.832278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.842643 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c6e6d-95f8-407f-891d-8e50020814e4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.901195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d513b-7ffe-4860-a07d-4fa2a524a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.901868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d513b-7ffe-4860-a07d-4fa2a524a276 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.902708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d513b-7ffe-4860-a07d-4fa2a524a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.903012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d513b-7ffe-4860-a07d-4fa2a524a276 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.903728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d513b-7ffe-4860-a07d-4fa2a524a276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.905350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d513b-7ffe-4860-a07d-4fa2a524a276 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.915955 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4186/8394] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:15.920110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:15.931066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940e77d-0cd4-47b6-8962-be464b5576e9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:15.936720 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:15.937620 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.937901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.938178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] PATH_INFO: `/v3/projects/f908d3179c36445bae83f910af155867/users/d900ccf5fb31483da748c3aa99d88841/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.941554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f908d3179c36445bae83f910af155867, user_id=d900ccf5fb31483da748c3aa99d88841, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:15.946328 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:15.957398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4209/8395] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:15 2022] PUT /identity/v3/projects/f908d3179c36445bae83f910af155867/users/d900ccf5fb31483da748c3aa99d88841/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:15.968562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:15.968853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:15.969140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:15.995365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] MFA Rules not processed for user `d900ccf5fb31483da748c3aa99d88841`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:15.997209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:16.069736 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4187/8396] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:16.084167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:16.086126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:16.098949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:16.100506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:16.180626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa973d-4156-477a-ab25-126e266a8549 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:16.186486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9c652-df41-42ae-bb91-16fb42795af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:16.187436 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c652-df41-42ae-bb91-16fb42795af5 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:16.187847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c652-df41-42ae-bb91-16fb42795af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:16.188318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9c652-df41-42ae-bb91-16fb42795af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:16.191359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0ed9c652-df41-42ae-bb91-16fb42795af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:16.196057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d4c24-c6a6-4543-a257-e8c6e5e342ce admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:16.207863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:16.208964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:16.214813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:16.214813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:16.240751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:16.242382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:16.256702 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4210/8397] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:16:16.295816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9c652-df41-42ae-bb91-16fb42795af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:16.298253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9c652-df41-42ae-bb91-16fb42795af5 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:16.332934 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4188/8398] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:16:18.284658 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:18.409015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309f543-c4f5-4b74-830f-3b73f82cf410 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:18.418804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:18.420731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:18.421518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:18.421981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] PATH_INFO: `/v3/users/1fee969eedf442c4b6ebeccf993565ac` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:18.424108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fee969eedf442c4b6ebeccf993565ac)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:18.426538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:18.498135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fee969eedf442c4b6ebeccf993565ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:18.499224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fee969eedf442c4b6ebeccf993565ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:18.508362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fee969eedf442c4b6ebeccf993565ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:18.510476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fee969eedf442c4b6ebeccf993565ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:18.525127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fee969eedf442c4b6ebeccf993565ac'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:18.555196 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4211/8399] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:18 2022] DELETE /identity/v3/users/1fee969eedf442c4b6ebeccf993565ac => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:18.557307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:18.557808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:18.558045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:18.586471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:18.587860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:18.668769 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4189/8400] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:18.678941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:18.680413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:18.802200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386324-0901-40c4-b884-24fbfdfd3815 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:18.813660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:18.814441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:18.814880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:18.815236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:18.826878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:18.828375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:18.847032 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4212/8401] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:19.192390 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:19.194001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:19.212124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402991e-3d77-49d8-abe2-bb2c01353764 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:19.221560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:19.222217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:19.222592 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:19.223028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] PATH_INFO: `/v3/projects/dc8c7e7f20654d47a53f6788abfe6290` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:19.224364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8c7e7f20654d47a53f6788abfe6290)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:19.226429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:19.331446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8c7e7f20654d47a53f6788abfe6290', 'request_id': 'req-0e041d2a-73c1-4898-a117-aeaea48eb1f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.345742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8c7e7f20654d47a53f6788abfe6290', 'request_id': 'req-0e041d2a-73c1-4898-a117-aeaea48eb1f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.359393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8c7e7f20654d47a53f6788abfe6290', 'request_id': 'req-0e041d2a-73c1-4898-a117-aeaea48eb1f9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.389976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] The token cache is being invalidate because project dc8c7e7f20654d47a53f6788abfe6290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:19.390652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.392587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.395824 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4190/8402] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:19 2022] DELETE /identity/v3/projects/dc8c7e7f20654d47a53f6788abfe6290 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:19.400004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:19.421096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628019a-fb8c-46a7-b518-ce9bfb94046b service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:19.505550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:19.506704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:19.507193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:19.507664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] PATH_INFO: `/v3/users/d900ccf5fb31483da748c3aa99d88841` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:19.509141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d900ccf5fb31483da748c3aa99d88841)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:19.512347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:19.584267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd900ccf5fb31483da748c3aa99d88841'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.585104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd900ccf5fb31483da748c3aa99d88841'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.593272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd900ccf5fb31483da748c3aa99d88841'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.594200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd900ccf5fb31483da748c3aa99d88841'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.603331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-176e23c4-b4ad-477d-b715-05b0a76bef21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd900ccf5fb31483da748c3aa99d88841'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:19.627467 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4213/8403] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:19 2022] DELETE /identity/v3/users/d900ccf5fb31483da748c3aa99d88841 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:20.030499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:20.033094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:20.068690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e041d2a-73c1-4898-a117-aeaea48eb1f9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:20.165578 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:20.166941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.167368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.167988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] PATH_INFO: `/v3/projects/f908d3179c36445bae83f910af155867` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.169502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f908d3179c36445bae83f910af155867)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:20.172444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:20.250192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f908d3179c36445bae83f910af155867', 'request_id': 'req-12e09b8f-b2b9-404d-a71a-be2c7bec3122'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:20.258805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f908d3179c36445bae83f910af155867', 'request_id': 'req-12e09b8f-b2b9-404d-a71a-be2c7bec3122'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:20.268514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f908d3179c36445bae83f910af155867', 'request_id': 'req-12e09b8f-b2b9-404d-a71a-be2c7bec3122'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:20.286783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] The token cache is being invalidate because project f908d3179c36445bae83f910af155867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:20.288267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:20.289414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-12e09b8f-b2b9-404d-a71a-be2c7bec3122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:20.294819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4191/8404] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:20 2022] DELETE /identity/v3/projects/f908d3179c36445bae83f910af155867 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:20.297269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb8cae-d6ee-4d2c-8662-1ad4981e1898 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.297562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb8cae-d6ee-4d2c-8662-1ad4981e1898 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.298108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb8cae-d6ee-4d2c-8662-1ad4981e1898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.343015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-41eb8cae-d6ee-4d2c-8662-1ad4981e1898 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:20.344285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-41eb8cae-d6ee-4d2c-8662-1ad4981e1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:20.427827 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4214/8405] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:20.436184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a09d-a0e0-4175-bd0d-24ebba7fbac1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.436465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a09d-a0e0-4175-bd0d-24ebba7fbac1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.436664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a09d-a0e0-4175-bd0d-24ebba7fbac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.476947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d167a09d-a0e0-4175-bd0d-24ebba7fbac1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:20.478420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d167a09d-a0e0-4175-bd0d-24ebba7fbac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:20.491430 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4192/8406] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:20.492634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb8cae-d6ee-4d2c-8662-1ad4981e1898 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:20.503261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb8cae-d6ee-4d2c-8662-1ad4981e1898 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:20.512795 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:20.514141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.514593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.515060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.515948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:20.516691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:20.518708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:20.536761 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4215/8407] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:16:20.541411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a09d-a0e0-4175-bd0d-24ebba7fbac1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:20.552238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a09d-a0e0-4175-bd0d-24ebba7fbac1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:20.559667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851dd4a-c161-4495-9ae6-7d1d5cb342f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:20.560399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851dd4a-c161-4495-9ae6-7d1d5cb342f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.560683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851dd4a-c161-4495-9ae6-7d1d5cb342f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.560969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851dd4a-c161-4495-9ae6-7d1d5cb342f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.562182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851dd4a-c161-4495-9ae6-7d1d5cb342f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:20.565170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851dd4a-c161-4495-9ae6-7d1d5cb342f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:20.624446 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4193/8408] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:20 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:20.632488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:20.654493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa80486-c601-4d5e-8e2a-a667107807ab admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:20.703473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd8ee6-42db-4cc6-bf39-38e65bc120d0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.703769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd8ee6-42db-4cc6-bf39-38e65bc120d0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.704055 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd8ee6-42db-4cc6-bf39-38e65bc120d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.735048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-26bd8ee6-42db-4cc6-bf39-38e65bc120d0 None None] MFA Rules not processed for user `aeee01bf990e46bfa331c1cd93528cab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:20.736315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-26bd8ee6-42db-4cc6-bf39-38e65bc120d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:20.772853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:20.774038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.774038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.774466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.776141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:20.779470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:20.808773 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4216/8409] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:20 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:20.814397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:20.825930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf67b2-541c-462c-a3c3-a09e702c0d78 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:20.830754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:20.831460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.831749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.832019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.832911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:20.834702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:20.840888 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4194/8410] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:20.849754 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4217/8411] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:20.853791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd8ee6-42db-4cc6-bf39-38e65bc120d0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:20.867424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd8ee6-42db-4cc6-bf39-38e65bc120d0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:20.884700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aacc4-4f59-490c-bf1b-090b0fc8fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:20.885537 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aacc4-4f59-490c-bf1b-090b0fc8fa88 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.885881 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aacc4-4f59-490c-bf1b-090b0fc8fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.886243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aacc4-4f59-490c-bf1b-090b0fc8fa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.886980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7aacc4-4f59-490c-bf1b-090b0fc8fa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:20.889605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7aacc4-4f59-490c-bf1b-090b0fc8fa88 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:20.907819 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4195/8412] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:20.911839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:20.923360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f1a9-e77b-497f-81cd-ce666b2814ee admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:20.943724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:20.944648 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:20.944939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:20.945221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] PATH_INFO: `/v3/projects/f1b40dcfd2984f6e970681073445c904/users/bd164563a7524038aac7dd703d2e5b99/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:20.967735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b40dcfd2984f6e970681073445c904, user_id=bd164563a7524038aac7dd703d2e5b99, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:20.970953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:21.000275 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4218/8413] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:20 2022] PUT /identity/v3/projects/f1b40dcfd2984f6e970681073445c904/users/bd164563a7524038aac7dd703d2e5b99/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:21.012275 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97e46-a58f-4377-ab59-9af280b21c56 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:21.012569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97e46-a58f-4377-ab59-9af280b21c56 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:21.013422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd97e46-a58f-4377-ab59-9af280b21c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:21.056949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2bd97e46-a58f-4377-ab59-9af280b21c56 None None] MFA Rules not processed for user `bd164563a7524038aac7dd703d2e5b99`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:21.061076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2bd97e46-a58f-4377-ab59-9af280b21c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:21.146246 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4196/8414] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:21.147406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:21.235899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccea38-dffa-4409-ab70-a2b6c6da6b55 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:21.241508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:21.241508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:21.241775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:21.241871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:21.242854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:21.245078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:21.283587 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4219/8415] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:21 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:21.283802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97e46-a58f-4377-ab59-9af280b21c56 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:21.305336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd97e46-a58f-4377-ab59-9af280b21c56 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:21.408880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:21.409621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:21.409938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:21.410217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:21.412513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:21.417401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:21.458211 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4197/8416] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:21 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:21.462324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:21.482048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48b2c4-8938-48df-8097-2da978cb7c15 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:21.487288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:21.488220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:21.488688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:21.489132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:21.490094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:21.491916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:21.503750 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4220/8417] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:21.508340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:21.522195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07d3b5-9a73-406a-81b3-00a2b7ff20f5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:21.529972 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd9f2-1f2c-4e06-990b-2535773b34e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:21.530658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd9f2-1f2c-4e06-990b-2535773b34e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:21.531056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd9f2-1f2c-4e06-990b-2535773b34e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:21.531400 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd9f2-1f2c-4e06-990b-2535773b34e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:21.532102 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bd9f2-1f2c-4e06-990b-2535773b34e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:21.533827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bd9f2-1f2c-4e06-990b-2535773b34e9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:21.548414 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4198/8418] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:21.553168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:21.566649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2916c8-7ac1-437d-8dc9-0f82968593d8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:21.579779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:21.582348 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:21.582879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:21.583352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] PATH_INFO: `/v3/projects/6ef7aa422a8d4f7fb0bba17628f0ac22/users/dfe0dab527ba4985a3292fae5672e0ac/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:21.604890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef7aa422a8d4f7fb0bba17628f0ac22, user_id=dfe0dab527ba4985a3292fae5672e0ac, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:21.607701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:21.629888 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4221/8419] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:21 2022] PUT /identity/v3/projects/6ef7aa422a8d4f7fb0bba17628f0ac22/users/dfe0dab527ba4985a3292fae5672e0ac/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:21.642571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5e21-a460-45d0-9a05-706cad4063a1 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:21.644384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5e21-a460-45d0-9a05-706cad4063a1 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:21.644859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a5e21-a460-45d0-9a05-706cad4063a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:21.690445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5d1a5e21-a460-45d0-9a05-706cad4063a1 None None] MFA Rules not processed for user `dfe0dab527ba4985a3292fae5672e0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:21.691953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5d1a5e21-a460-45d0-9a05-706cad4063a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:21.807640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:21.821661 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4199/8420] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:22.007680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548331b-b34e-46d6-bad6-ebe8b8c9371d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:22.015285 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:22.016164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.016463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.016774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.022472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:22.024594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:22.099259 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4222/8421] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:21 2022] POST /identity/v3/projects => generated 385 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:22.103253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5e21-a460-45d0-9a05-706cad4063a1 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:22.120083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a5e21-a460-45d0-9a05-706cad4063a1 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:22.231874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:22.232739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.233023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.233304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.234779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:22.237794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:22.270725 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4200/8422] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:22 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:22.274569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:22.287688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6dce-0eb9-4138-8f29-f018b8622ca0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:22.302183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:22.303050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.303951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.304210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.305155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:22.306875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:22.324054 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4223/8423] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:22.328353 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:22.350308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b93d85-51b8-4aa7-ae2f-fec2bb7bc6de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:22.357243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:22.370096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.371645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.372086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] PATH_INFO: `/v3/projects/93fad29629ba425da889a3c3956ad59c/users/30177945667949909c16cec02eb96680/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.394153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fad29629ba425da889a3c3956ad59c, user_id=30177945667949909c16cec02eb96680, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:22.397413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:22.430129 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4201/8424] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:22 2022] PUT /identity/v3/projects/93fad29629ba425da889a3c3956ad59c/users/30177945667949909c16cec02eb96680/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:22.436032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:22.469412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367f5d4-5671-4cee-935d-1bc1e57ba5df admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:22.639749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bf1e9-036c-4c20-9c97-e3e10a499ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:22.640482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf1e9-036c-4c20-9c97-e3e10a499ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.640769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf1e9-036c-4c20-9c97-e3e10a499ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.641050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bf1e9-036c-4c20-9c97-e3e10a499ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.643442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf1e9-036c-4c20-9c97-e3e10a499ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:22.645126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bf1e9-036c-4c20-9c97-e3e10a499ee8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:22.670096 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4224/8425] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:22.675314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:22.694505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67c860-ba8d-4f51-b206-71fcab9bd31b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:22.701314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:22.702546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.703624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.704085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] PATH_INFO: `/v3/projects/93fad29629ba425da889a3c3956ad59c/users/30177945667949909c16cec02eb96680/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.706426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fad29629ba425da889a3c3956ad59c, user_id=30177945667949909c16cec02eb96680, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:22.709428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:22.721462 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4202/8426] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:22 2022] PUT /identity/v3/projects/93fad29629ba425da889a3c3956ad59c/users/30177945667949909c16cec02eb96680/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:22.732200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.732533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.732757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.772896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] MFA Rules not processed for user `30177945667949909c16cec02eb96680`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:22.774136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:22.852247 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4225/8427] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:22.864086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:22.866105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:22.928872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42ca3-fdc2-47c3-914a-cd9aa27f35ee admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:22.932584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:22.933530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:22.933952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:22.934237 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:22.944777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:22.946244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:22.956793 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4203/8428] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:23.624075 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:23.625562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:23.641647 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077abe-b9d8-4b43-8d63-e7b9065091db None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:23.646361 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:23.647057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:23.647342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:23.647778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:23.718121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:23.719623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:23.729680 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4226/8429] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:24.244681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:24.246181 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:24.321072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966d5fb-93f4-4314-9112-ee69cbdb40e3 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:24.325895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3858c19-f06f-4c4c-bad9-9bfbc5d957c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:24.326761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858c19-f06f-4c4c-bad9-9bfbc5d957c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:24.327175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858c19-f06f-4c4c-bad9-9bfbc5d957c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:24.327603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3858c19-f06f-4c4c-bad9-9bfbc5d957c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:24.329628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b3858c19-f06f-4c4c-bad9-9bfbc5d957c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:24.345709 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3858c19-f06f-4c4c-bad9-9bfbc5d957c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:24.347485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3858c19-f06f-4c4c-bad9-9bfbc5d957c2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:24.367023 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4204/8430] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:27.962907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:27.978234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca5325-4326-46a5-90d3-59e3a9005051 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:27.984061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:27.985174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:27.985637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:27.986073 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:28.050251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:28.051821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:28.061100 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4227/8431] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:28.792262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e50b9-a7cd-4fdf-91d1-afca2668a0a9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:28.793659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e50b9-a7cd-4fdf-91d1-afca2668a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:28.793937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e50b9-a7cd-4fdf-91d1-afca2668a0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:28.820289 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c98e50b9-a7cd-4fdf-91d1-afca2668a0a9 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:28.821519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c98e50b9-a7cd-4fdf-91d1-afca2668a0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:28.887969 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4205/8432] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:28.934066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:28.935888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:29.023944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170503d-8f02-47be-a867-330c9617a8aa service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:29.031046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf6cda-6dd3-4490-bfed-50ba59b0598f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:29.031778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6cda-6dd3-4490-bfed-50ba59b0598f service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:29.032095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6cda-6dd3-4490-bfed-50ba59b0598f service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:29.032356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf6cda-6dd3-4490-bfed-50ba59b0598f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:29.042373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6cda-6dd3-4490-bfed-50ba59b0598f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:29.044205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf6cda-6dd3-4490-bfed-50ba59b0598f service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:29.054511 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4228/8433] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:16:30.485088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e50b9-a7cd-4fdf-91d1-afca2668a0a9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:30.582032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e50b9-a7cd-4fdf-91d1-afca2668a0a9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:30.587718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:30.588803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:30.590247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:30.590711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] PATH_INFO: `/v3/users/bd164563a7524038aac7dd703d2e5b99` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:30.592146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd164563a7524038aac7dd703d2e5b99)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:30.594271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:30.664120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd164563a7524038aac7dd703d2e5b99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:30.678303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd164563a7524038aac7dd703d2e5b99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:30.679915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd164563a7524038aac7dd703d2e5b99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:30.682431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd164563a7524038aac7dd703d2e5b99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:30.699103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd164563a7524038aac7dd703d2e5b99'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:30.736171 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4206/8434] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:30 2022] DELETE /identity/v3/users/bd164563a7524038aac7dd703d2e5b99 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:30.740437 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:30.741008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:30.741234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:30.773721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:30.775072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:30.884851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4229/8435] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:30.895566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:30.897767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:30.988711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ad745-0340-4ffe-b5cc-ff1f86015a7c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:30.993284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:30.994134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:30.994480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:30.994853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:31.006491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:31.008112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:31.020923 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4207/8436] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:31.383909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:31.385701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:31.400940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf49cdf-386b-4bce-a804-ffd6004929e5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:31.407024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:31.409674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:31.410118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:31.410463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] PATH_INFO: `/v3/projects/f1b40dcfd2984f6e970681073445c904` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:31.411922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b40dcfd2984f6e970681073445c904)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:31.414274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:31.476856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b40dcfd2984f6e970681073445c904', 'request_id': 'req-e4bc899e-047d-4e02-ab04-382cbd926c8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.486119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b40dcfd2984f6e970681073445c904', 'request_id': 'req-e4bc899e-047d-4e02-ab04-382cbd926c8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.498349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b40dcfd2984f6e970681073445c904', 'request_id': 'req-e4bc899e-047d-4e02-ab04-382cbd926c8c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.510950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] The token cache is being invalidate because project f1b40dcfd2984f6e970681073445c904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:31.511465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.512259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.514708 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4230/8437] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:31 2022] DELETE /identity/v3/projects/f1b40dcfd2984f6e970681073445c904 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:31.521408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:31.536000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819edccb-720c-4893-b7df-93823a111bd1 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:31.650145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:31.651071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:31.651892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:31.654742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] PATH_INFO: `/v3/users/dfe0dab527ba4985a3292fae5672e0ac` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:31.658550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe0dab527ba4985a3292fae5672e0ac)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:31.662623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:31.744609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe0dab527ba4985a3292fae5672e0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.755354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe0dab527ba4985a3292fae5672e0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.756416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe0dab527ba4985a3292fae5672e0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.757364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe0dab527ba4985a3292fae5672e0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.770533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe0dab527ba4985a3292fae5672e0ac'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:31.802038 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4208/8438] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:31 2022] DELETE /identity/v3/users/dfe0dab527ba4985a3292fae5672e0ac => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:32.387790 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:32.390084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:32.412721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc899e-047d-4e02-ab04-382cbd926c8c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:32.585586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:32.587845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:32.588038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:32.588301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] PATH_INFO: `/v3/projects/6ef7aa422a8d4f7fb0bba17628f0ac22` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:32.593484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef7aa422a8d4f7fb0bba17628f0ac22)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:32.595551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:32.706241 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef7aa422a8d4f7fb0bba17628f0ac22', 'request_id': 'req-87c7150c-cebc-4005-b0e7-953eaa824ac9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.713567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef7aa422a8d4f7fb0bba17628f0ac22', 'request_id': 'req-87c7150c-cebc-4005-b0e7-953eaa824ac9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.726722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef7aa422a8d4f7fb0bba17628f0ac22', 'request_id': 'req-87c7150c-cebc-4005-b0e7-953eaa824ac9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.749654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] The token cache is being invalidate because project 6ef7aa422a8d4f7fb0bba17628f0ac22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:32.750029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.752141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.755050 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4231/8439] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:32 2022] DELETE /identity/v3/projects/6ef7aa422a8d4f7fb0bba17628f0ac22 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:32.758936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:32.760593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:32.774920 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84809d81-d5d5-4cce-b656-724ef3204a81 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:32.861959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:32.863197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:32.863478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:32.863755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] PATH_INFO: `/v3/users/30177945667949909c16cec02eb96680` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:32.865056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30177945667949909c16cec02eb96680)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:32.867159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:32.945645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30177945667949909c16cec02eb96680'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.960318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30177945667949909c16cec02eb96680'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.961571 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30177945667949909c16cec02eb96680'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.962677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30177945667949909c16cec02eb96680'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:32.975388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-81e75a5a-0b79-4f50-a4ed-757e14dca78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30177945667949909c16cec02eb96680'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:33.018197 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4209/8440] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:32 2022] DELETE /identity/v3/users/30177945667949909c16cec02eb96680 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:33.469566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:33.472265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:33.493731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7150c-cebc-4005-b0e7-953eaa824ac9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:33.583273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:33.585243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:33.586805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:33.586805 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] PATH_INFO: `/v3/projects/93fad29629ba425da889a3c3956ad59c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:33.588995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fad29629ba425da889a3c3956ad59c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:33.591231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:33.669696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fad29629ba425da889a3c3956ad59c', 'request_id': 'req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:33.679006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fad29629ba425da889a3c3956ad59c', 'request_id': 'req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:33.696611 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fad29629ba425da889a3c3956ad59c', 'request_id': 'req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:33.723250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] The token cache is being invalidate because project 93fad29629ba425da889a3c3956ad59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:33.723956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:33.725084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-9a0ba975-6f1c-41bd-9c20-02b5d0c85e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:33.730825 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4232/8441] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:33 2022] DELETE /identity/v3/projects/93fad29629ba425da889a3c3956ad59c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:33.733984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e27d3-fc82-4504-bedb-4f80fff10f10 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:33.733984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e27d3-fc82-4504-bedb-4f80fff10f10 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:33.734455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e27d3-fc82-4504-bedb-4f80fff10f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:33.758991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-742e27d3-fc82-4504-bedb-4f80fff10f10 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:33.760513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-742e27d3-fc82-4504-bedb-4f80fff10f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:33.831763 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4210/8442] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:33.840922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fbacc-25ba-4d21-a06a-7ac77038fa1a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:33.841260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fbacc-25ba-4d21-a06a-7ac77038fa1a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:33.841489 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fbacc-25ba-4d21-a06a-7ac77038fa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:33.862894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b16fbacc-25ba-4d21-a06a-7ac77038fa1a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:33.863994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b16fbacc-25ba-4d21-a06a-7ac77038fa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:33.875696 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4233/8443] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:33.877260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e27d3-fc82-4504-bedb-4f80fff10f10 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:33.888150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e27d3-fc82-4504-bedb-4f80fff10f10 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:33.893902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:33.894870 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:33.895216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:33.895684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:33.896585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:33.897056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:33.898947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:33.918917 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4211/8444] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:16:33.919178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fbacc-25ba-4d21-a06a-7ac77038fa1a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:33.934627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fbacc-25ba-4d21-a06a-7ac77038fa1a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:33.963309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:33.963574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:33.964681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:33.964966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:33.965679 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:33.967667 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.020690 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4234/8445] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:33 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:34.023649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.036826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391c9ea-1684-42a6-b356-245e5a900220 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.129521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.130479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.131106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.131579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.132590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.140930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.168011 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4212/8446] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:34 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:34.172206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.187804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb46fb-20f5-4603-a891-2af8dddf695d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.194610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.195525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.195994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.196553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.197558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.200124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.229598 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4235/8447] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:34.232760 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.248901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d06f494-beb9-4778-be08-f45302d50295 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.263063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a304-7669-4689-8849-7e960d481af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.263757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a304-7669-4689-8849-7e960d481af5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.264042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a304-7669-4689-8849-7e960d481af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.264332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a304-7669-4689-8849-7e960d481af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.265050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2a304-7669-4689-8849-7e960d481af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.271318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2a304-7669-4689-8849-7e960d481af5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.299245 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4213/8448] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:34.301016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.317785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751075ab-aaf4-4bcb-bc3f-5bee51d994d4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.324707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.325610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.325900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.326259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] PATH_INFO: `/v3/projects/06190b642cf044dd9a9981c59a6424c4/users/1697ee0473a14b99a70474fe07bdefff/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.352459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06190b642cf044dd9a9981c59a6424c4, user_id=1697ee0473a14b99a70474fe07bdefff, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.355744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.378835 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4236/8449] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:34 2022] PUT /identity/v3/projects/06190b642cf044dd9a9981c59a6424c4/users/1697ee0473a14b99a70474fe07bdefff/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:34.389728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d1662-27f7-4ab8-b0c4-4511dcc5637c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.390025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d1662-27f7-4ab8-b0c4-4511dcc5637c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.390302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d1662-27f7-4ab8-b0c4-4511dcc5637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.436640 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0f9d1662-27f7-4ab8-b0c4-4511dcc5637c None None] MFA Rules not processed for user `1697ee0473a14b99a70474fe07bdefff`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:34.437877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0f9d1662-27f7-4ab8-b0c4-4511dcc5637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:34.551976 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4214/8450] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:34.553499 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.640825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61137478-c009-46ee-99ff-70bbb713506b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.646094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.646764 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.647427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.647713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.648432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.652772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.682483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4237/8451] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:34 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:34.687283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d1662-27f7-4ab8-b0c4-4511dcc5637c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.701131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d1662-27f7-4ab8-b0c4-4511dcc5637c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.789895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.791236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.791524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.791808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.793101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.795140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.824327 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4215/8452] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:34 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:34.827979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.845120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7beb87-8f25-4bb3-a059-255c5cdd17d0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.857382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.858166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.859034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.859383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.860185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.861885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:34.882817 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4238/8453] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:34.890499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:34.902912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c73c9-a6de-4b8e-9ba8-211cf21f8467 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:34.925771 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:34.926706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:34.927026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:34.927300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] PATH_INFO: `/v3/projects/daaa5ad645dc4cc786a16bd998f44cc4/users/c86cb0cf7c3c4c03b57021fbe429e43f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:34.963424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daaa5ad645dc4cc786a16bd998f44cc4, user_id=c86cb0cf7c3c4c03b57021fbe429e43f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:34.970322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:35.020083 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4216/8454] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:34 2022] PUT /identity/v3/projects/daaa5ad645dc4cc786a16bd998f44cc4/users/c86cb0cf7c3c4c03b57021fbe429e43f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:35.022237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:35.040188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a4e2-50db-4b3d-b436-2d3920fb8a9a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:35.155786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db4f6b-2df2-4068-a409-060e2905457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:35.156431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4f6b-2df2-4068-a409-060e2905457c admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:35.156775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4f6b-2df2-4068-a409-060e2905457c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:35.157045 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db4f6b-2df2-4068-a409-060e2905457c admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:35.157782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db4f6b-2df2-4068-a409-060e2905457c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:35.159469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db4f6b-2df2-4068-a409-060e2905457c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:35.186413 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4239/8455] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:35.193739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:35.210266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1716f-93fd-4b34-8fee-d7b01b182128 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:35.223469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:35.227048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:35.227048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:35.229282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] PATH_INFO: `/v3/projects/daaa5ad645dc4cc786a16bd998f44cc4/users/c86cb0cf7c3c4c03b57021fbe429e43f/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:35.231767 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daaa5ad645dc4cc786a16bd998f44cc4, user_id=c86cb0cf7c3c4c03b57021fbe429e43f, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:35.234482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:35.246368 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4217/8456] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:35 2022] PUT /identity/v3/projects/daaa5ad645dc4cc786a16bd998f44cc4/users/c86cb0cf7c3c4c03b57021fbe429e43f/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:35.256735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ef4e8-b83d-4018-bb6d-cfad026bd194 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:35.257236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ef4e8-b83d-4018-bb6d-cfad026bd194 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:35.257371 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ef4e8-b83d-4018-bb6d-cfad026bd194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:35.300842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e21ef4e8-b83d-4018-bb6d-cfad026bd194 None None] MFA Rules not processed for user `c86cb0cf7c3c4c03b57021fbe429e43f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:35.302090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e21ef4e8-b83d-4018-bb6d-cfad026bd194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:35.473233 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4240/8457] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:35.486234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:35.488005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:35.618918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574eb84-383f-4bcf-a635-e70039315490 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:35.631645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df8e7-c1a3-4327-b105-da508e7c16b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:35.632514 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df8e7-c1a3-4327-b105-da508e7c16b3 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:35.633351 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df8e7-c1a3-4327-b105-da508e7c16b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:35.633665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df8e7-c1a3-4327-b105-da508e7c16b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:35.656895 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df8e7-c1a3-4327-b105-da508e7c16b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:35.659045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df8e7-c1a3-4327-b105-da508e7c16b3 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:35.681885 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4218/8458] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:36.280900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ef4e8-b83d-4018-bb6d-cfad026bd194 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:36.472187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ef4e8-b83d-4018-bb6d-cfad026bd194 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:36.482504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:36.483986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:36.484484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:36.484953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] PATH_INFO: `/v3/users/1697ee0473a14b99a70474fe07bdefff` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:36.486442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1697ee0473a14b99a70474fe07bdefff)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:36.489397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:36.589820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1697ee0473a14b99a70474fe07bdefff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:36.590576 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1697ee0473a14b99a70474fe07bdefff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:36.600770 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1697ee0473a14b99a70474fe07bdefff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:36.601525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1697ee0473a14b99a70474fe07bdefff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:36.612135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1697ee0473a14b99a70474fe07bdefff'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:36.663650 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4241/8459] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:36 2022] DELETE /identity/v3/users/1697ee0473a14b99a70474fe07bdefff => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:36.668236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:36.668784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:36.668918 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:36.692028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:36.693608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:36.833328 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4219/8460] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:36.842530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:36.844076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:36.937428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dfbff-289c-41f2-bf2b-b673512fac96 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:36.942541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:36.943476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:36.943776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:36.944222 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:36.957758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:36.959288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:36.975874 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4242/8461] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:37.320764 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:37.322377 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:37.336550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5aac5-54c9-4d6b-8f3f-21b202dc9480 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:37.341359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:37.343326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:37.343602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:37.343927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] PATH_INFO: `/v3/projects/06190b642cf044dd9a9981c59a6424c4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:37.345212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=06190b642cf044dd9a9981c59a6424c4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:37.348756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:37.461626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06190b642cf044dd9a9981c59a6424c4', 'request_id': 'req-3b84b564-1118-4ef0-be89-9b6afba4de7d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.469778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06190b642cf044dd9a9981c59a6424c4', 'request_id': 'req-3b84b564-1118-4ef0-be89-9b6afba4de7d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.482283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06190b642cf044dd9a9981c59a6424c4', 'request_id': 'req-3b84b564-1118-4ef0-be89-9b6afba4de7d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.494461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] The token cache is being invalidate because project 06190b642cf044dd9a9981c59a6424c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:37.494759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.496258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.498152 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4220/8462] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:37 2022] DELETE /identity/v3/projects/06190b642cf044dd9a9981c59a6424c4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:37.502033 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:37.512956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e05cb4-2098-49c0-ad52-8186a8e5fa7b service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:37.579574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:37.581044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:37.581527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:37.582018 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] PATH_INFO: `/v3/users/c86cb0cf7c3c4c03b57021fbe429e43f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:37.583954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86cb0cf7c3c4c03b57021fbe429e43f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:37.586394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:37.643608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86cb0cf7c3c4c03b57021fbe429e43f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.644319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86cb0cf7c3c4c03b57021fbe429e43f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.652903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86cb0cf7c3c4c03b57021fbe429e43f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.653728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86cb0cf7c3c4c03b57021fbe429e43f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.663717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4f2ab48b-529c-406c-aca1-6cf74ccbc7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86cb0cf7c3c4c03b57021fbe429e43f'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:37.690565 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4243/8463] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:37 2022] DELETE /identity/v3/users/c86cb0cf7c3c4c03b57021fbe429e43f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:38.039563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:38.041228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:38.068974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84b564-1118-4ef0-be89-9b6afba4de7d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:38.152277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:38.153717 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.154162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.154747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] PATH_INFO: `/v3/projects/daaa5ad645dc4cc786a16bd998f44cc4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.156204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daaa5ad645dc4cc786a16bd998f44cc4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:38.158438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:38.227894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daaa5ad645dc4cc786a16bd998f44cc4', 'request_id': 'req-99375234-5b71-4a86-a435-3603051c3326'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:38.234683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daaa5ad645dc4cc786a16bd998f44cc4', 'request_id': 'req-99375234-5b71-4a86-a435-3603051c3326'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:38.243763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daaa5ad645dc4cc786a16bd998f44cc4', 'request_id': 'req-99375234-5b71-4a86-a435-3603051c3326'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:38.257615 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] The token cache is being invalidate because project daaa5ad645dc4cc786a16bd998f44cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:38.258155 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:38.258947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-99375234-5b71-4a86-a435-3603051c3326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:38.264790 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4221/8464] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:38 2022] DELETE /identity/v3/projects/daaa5ad645dc4cc786a16bd998f44cc4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:38.266807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e523d-bd94-4e29-aed4-e95a3a37aadf None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.267124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e523d-bd94-4e29-aed4-e95a3a37aadf None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.267410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e523d-bd94-4e29-aed4-e95a3a37aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.294251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-654e523d-bd94-4e29-aed4-e95a3a37aadf None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:38.296715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-654e523d-bd94-4e29-aed4-e95a3a37aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:38.372503 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4244/8465] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:38.377014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1f7ed-9713-4070-8c5e-10a2b9ec5874 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.377608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1f7ed-9713-4070-8c5e-10a2b9ec5874 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.377959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1f7ed-9713-4070-8c5e-10a2b9ec5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.409841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-91a1f7ed-9713-4070-8c5e-10a2b9ec5874 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:38.411651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-91a1f7ed-9713-4070-8c5e-10a2b9ec5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:38.428406 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4222/8466] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:38.429781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e523d-bd94-4e29-aed4-e95a3a37aadf None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:38.440956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e523d-bd94-4e29-aed4-e95a3a37aadf None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:38.446184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:38.446894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.447182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.447457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.448382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:38.448811 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:38.450951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:38.471341 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4245/8467] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:16:38.472691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1f7ed-9713-4070-8c5e-10a2b9ec5874 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:38.485946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1f7ed-9713-4070-8c5e-10a2b9ec5874 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:38.495468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:38.496271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.496658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.497048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.497838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:38.499950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:38.531816 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4223/8468] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:38 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:38.536132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:38.549364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d0bb2-8234-48f5-8293-2434d3f3c409 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:38.639522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:38.640646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.640940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.641270 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.642299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:38.644400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:38.672923 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4246/8469] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:38 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:38.677200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:38.692463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b758-1eba-4ed5-a945-3354796be975 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:38.699073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:38.699861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.700147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.700416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.701153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:38.706019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:38.722366 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4224/8470] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:38.726148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:38.739067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4643e-a472-4e4e-931f-514ecf186e1e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:38.746550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851dbad-1d91-49ae-8aad-b90e5d5525e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:38.747353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851dbad-1d91-49ae-8aad-b90e5d5525e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.747840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851dbad-1d91-49ae-8aad-b90e5d5525e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.748192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851dbad-1d91-49ae-8aad-b90e5d5525e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.749131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851dbad-1d91-49ae-8aad-b90e5d5525e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:38.751063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851dbad-1d91-49ae-8aad-b90e5d5525e4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:38.766906 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4247/8471] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:38.769672 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:38.781167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea7ac7-186f-4c99-9735-15f531c887ae admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:38.786299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:38.787462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.787751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.788030 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] PATH_INFO: `/v3/projects/7b5bfe60f6c2490680249eec45e092fe/users/1d971abb2ec9431891d4530f35448f1b/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.809260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5bfe60f6c2490680249eec45e092fe, user_id=1d971abb2ec9431891d4530f35448f1b, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:38.812172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:38.828601 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4225/8472] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:38 2022] PUT /identity/v3/projects/7b5bfe60f6c2490680249eec45e092fe/users/1d971abb2ec9431891d4530f35448f1b/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:38.839775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011251-c971-43f2-931b-e4209b4dffbb None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:38.840358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011251-c971-43f2-931b-e4209b4dffbb None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:38.840905 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011251-c971-43f2-931b-e4209b4dffbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:38.877177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-65011251-c971-43f2-931b-e4209b4dffbb None None] MFA Rules not processed for user `1d971abb2ec9431891d4530f35448f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:38.878868 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-65011251-c971-43f2-931b-e4209b4dffbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:39.013899 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4248/8473] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:39.022171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.124816 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e37552-557d-44ab-b8a8-3789e3b253a6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.133213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.133887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.134175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.134454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.135187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:39.137742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:39.169473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4226/8474] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:39 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:39.173738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011251-c971-43f2-931b-e4209b4dffbb None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.186447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011251-c971-43f2-931b-e4209b4dffbb None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.281837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.284002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.284518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.285579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.287460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:39.292214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:39.321844 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4249/8475] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:39 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:39.326651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.342220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee51624-f19b-4731-8c9f-f42aa0924270 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.347873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.348624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.348982 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.349337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.350134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:39.351951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:39.366618 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4227/8476] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:39.371022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.383121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d12f6-db53-4e32-b45d-55ada30739ac admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.389026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.390178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.390619 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.391012 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] PATH_INFO: `/v3/projects/1eb344eef6fd4945aa324730116cec27/users/c0f25e9cc6ff4534914c6a2f3e6dc0e2/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.411523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb344eef6fd4945aa324730116cec27, user_id=c0f25e9cc6ff4534914c6a2f3e6dc0e2, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:39.414395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:39.432916 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4250/8477] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:39 2022] PUT /identity/v3/projects/1eb344eef6fd4945aa324730116cec27/users/c0f25e9cc6ff4534914c6a2f3e6dc0e2/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:39.436996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.447541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56474e10-871f-43ad-b74b-914a28faf2ef admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.526801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd03434-874d-4dd9-95f3-bb40913a87af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.527502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03434-874d-4dd9-95f3-bb40913a87af admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.527790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03434-874d-4dd9-95f3-bb40913a87af admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.528081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd03434-874d-4dd9-95f3-bb40913a87af admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.528800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd03434-874d-4dd9-95f3-bb40913a87af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:39.530628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd03434-874d-4dd9-95f3-bb40913a87af admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:39.542928 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4228/8478] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:39.545757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.568815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c852739-5b0f-4b72-a764-2ee5649fdb00 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.574806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.575701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.575983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.576260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] PATH_INFO: `/v3/projects/1eb344eef6fd4945aa324730116cec27/users/c0f25e9cc6ff4534914c6a2f3e6dc0e2/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.578291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb344eef6fd4945aa324730116cec27, user_id=c0f25e9cc6ff4534914c6a2f3e6dc0e2, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:39.581271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:39.598049 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4251/8479] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:39 2022] PUT /identity/v3/projects/1eb344eef6fd4945aa324730116cec27/users/c0f25e9cc6ff4534914c6a2f3e6dc0e2/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:39.611111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9410ed-c8b7-4fad-ad8c-d7c5ead9e9c8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.611547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9410ed-c8b7-4fad-ad8c-d7c5ead9e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.611935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9410ed-c8b7-4fad-ad8c-d7c5ead9e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.648171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ad9410ed-c8b7-4fad-ad8c-d7c5ead9e9c8 None None] MFA Rules not processed for user `c0f25e9cc6ff4534914c6a2f3e6dc0e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:39.649759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ad9410ed-c8b7-4fad-ad8c-d7c5ead9e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:39.745720 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4229/8480] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:39.759355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.761863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:39.835938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30c58e-ea25-4154-af85-f44d5aed1c19 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.843308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.843975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.844264 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.844543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:39.862031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:39.863548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:39.878184 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4252/8481] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:16:39.965480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9410ed-c8b7-4fad-ad8c-d7c5ead9e9c8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:39.980029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9410ed-c8b7-4fad-ad8c-d7c5ead9e9c8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:39.983847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd31bfb-548c-4325-a278-c2ce6abfec99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:39.984498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31bfb-548c-4325-a278-c2ce6abfec99 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:39.984784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31bfb-548c-4325-a278-c2ce6abfec99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:39.985053 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd31bfb-548c-4325-a278-c2ce6abfec99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:40.085591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31bfb-548c-4325-a278-c2ce6abfec99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:40.088269 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd31bfb-548c-4325-a278-c2ce6abfec99 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:40.107743 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4230/8482] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:40.440256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:40.509614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd45616-4b12-4a62-912f-e5335336bae6 service cinder] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:40.515130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:40.516068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:40.517705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:40.517705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] PATH_INFO: `/v3/users/1d971abb2ec9431891d4530f35448f1b` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:40.519591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d971abb2ec9431891d4530f35448f1b)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:40.521124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:40.581681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d971abb2ec9431891d4530f35448f1b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:40.582440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d971abb2ec9431891d4530f35448f1b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:40.592051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d971abb2ec9431891d4530f35448f1b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:40.593234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d971abb2ec9431891d4530f35448f1b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:40.603884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d971abb2ec9431891d4530f35448f1b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:40.626720 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4253/8483] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:40 2022] DELETE /identity/v3/users/1d971abb2ec9431891d4530f35448f1b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:40.631844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:40.632716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:40.633225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:40.659818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:40.662292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:40.740340 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4231/8484] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:40.750698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:40.752473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:40.840230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c41017-26b6-4b46-b026-1828ffdd7505 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:40.844711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:40.845310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:40.845594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:40.845872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:40.857380 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:40.858885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:40.877066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4254/8485] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:41.213147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:41.219617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:41.233243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7b728-17a8-4255-8d8a-a196567c3766 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:41.240905 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:41.242023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:41.242411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:41.242830 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] PATH_INFO: `/v3/projects/7b5bfe60f6c2490680249eec45e092fe` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:41.245687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5bfe60f6c2490680249eec45e092fe)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:41.258349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:41.320381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5bfe60f6c2490680249eec45e092fe', 'request_id': 'req-e7477e74-df61-4295-9a93-6c5f532f69d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.328734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5bfe60f6c2490680249eec45e092fe', 'request_id': 'req-e7477e74-df61-4295-9a93-6c5f532f69d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.339713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5bfe60f6c2490680249eec45e092fe', 'request_id': 'req-e7477e74-df61-4295-9a93-6c5f532f69d9'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.352988 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] The token cache is being invalidate because project 7b5bfe60f6c2490680249eec45e092fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:41.353483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.355335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.357260 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4232/8486] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:41 2022] DELETE /identity/v3/projects/7b5bfe60f6c2490680249eec45e092fe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:41.363122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:41.374958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17923966-fb8c-4451-9984-1f72f54c9f55 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:41.443143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:41.444039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:41.444345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:41.444597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] PATH_INFO: `/v3/users/c0f25e9cc6ff4534914c6a2f3e6dc0e2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:41.445828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f25e9cc6ff4534914c6a2f3e6dc0e2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:41.447903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:41.511023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f25e9cc6ff4534914c6a2f3e6dc0e2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.511697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f25e9cc6ff4534914c6a2f3e6dc0e2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.520188 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f25e9cc6ff4534914c6a2f3e6dc0e2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.521208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f25e9cc6ff4534914c6a2f3e6dc0e2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.532202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-30d32e82-2ce7-4f45-84b6-6c10722b42ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f25e9cc6ff4534914c6a2f3e6dc0e2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:41.551723 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4255/8487] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:41 2022] DELETE /identity/v3/users/c0f25e9cc6ff4534914c6a2f3e6dc0e2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:41.930128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:41.931583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:41.948893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477e74-df61-4295-9a93-6c5f532f69d9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.020453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.021506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.022131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.022511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] PATH_INFO: `/v3/projects/1eb344eef6fd4945aa324730116cec27` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.023860 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb344eef6fd4945aa324730116cec27)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.025897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.091310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb344eef6fd4945aa324730116cec27', 'request_id': 'req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:42.098635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb344eef6fd4945aa324730116cec27', 'request_id': 'req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:42.106742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb344eef6fd4945aa324730116cec27', 'request_id': 'req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:42.118153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] The token cache is being invalidate because project 1eb344eef6fd4945aa324730116cec27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:42.118591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:42.119278 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-9ee4cce0-a879-4c7d-b235-5773d5dd4b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:42.124779 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4233/8488] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:41 2022] DELETE /identity/v3/projects/1eb344eef6fd4945aa324730116cec27 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:42.126114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa021a59-fc91-437f-9622-2096dd49f412 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.126637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa021a59-fc91-437f-9622-2096dd49f412 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.126637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa021a59-fc91-437f-9622-2096dd49f412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.149096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fa021a59-fc91-437f-9622-2096dd49f412 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:42.150748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fa021a59-fc91-437f-9622-2096dd49f412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:42.246311 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4256/8489] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:42.251538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c394b-db88-488a-af8b-1fcd20d9258b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.251908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c394b-db88-488a-af8b-1fcd20d9258b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.252262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c394b-db88-488a-af8b-1fcd20d9258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.274280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7b1c394b-db88-488a-af8b-1fcd20d9258b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:42.275759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b1c394b-db88-488a-af8b-1fcd20d9258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:42.284281 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4234/8490] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:42.288782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa021a59-fc91-437f-9622-2096dd49f412 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:42.304925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa021a59-fc91-437f-9622-2096dd49f412 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.325744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.326450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.326922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.327212 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.327978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:42.328311 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.329971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.350822 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4257/8491] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:16:42.354234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c394b-db88-488a-af8b-1fcd20d9258b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:42.366716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c394b-db88-488a-af8b-1fcd20d9258b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.372729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.373494 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.373850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.374203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.375014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.377044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.409756 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4235/8492] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:42 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:42.413776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:42.424839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fe36c-770f-4483-89ed-633e52734408 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.513111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.513785 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.514342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.514835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.515822 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.518369 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.549187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4258/8493] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:42 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:42.550372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:42.575270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178973de-912d-4956-9fda-19012b6a98fe admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.581624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.582967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.583349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.583692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.585007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.586910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.603252 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4236/8494] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:42.605065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:42.615777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358362e-95eb-43b8-a6c5-27bd72b15f3d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.622441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529decf5-a4d7-4f08-9cd9-fe00f8dab625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.623234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529decf5-a4d7-4f08-9cd9-fe00f8dab625 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.623596 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529decf5-a4d7-4f08-9cd9-fe00f8dab625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.623950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529decf5-a4d7-4f08-9cd9-fe00f8dab625 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.624746 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529decf5-a4d7-4f08-9cd9-fe00f8dab625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.626753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529decf5-a4d7-4f08-9cd9-fe00f8dab625 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.638796 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4259/8495] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:42.643177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:42.656508 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37adc-8849-47e9-94c6-b1879c41233a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.661445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.662428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.662803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.663187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] PATH_INFO: `/v3/projects/da2cd9f873674463a0d54570586512c5/users/5b004d5e8c6743dda2f9983b1679ee9e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.694250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2cd9f873674463a0d54570586512c5, user_id=5b004d5e8c6743dda2f9983b1679ee9e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.697296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.713983 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4237/8496] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:42 2022] PUT /identity/v3/projects/da2cd9f873674463a0d54570586512c5/users/5b004d5e8c6743dda2f9983b1679ee9e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:42.724349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca258630-a6b9-4dc4-a621-e24027fec5dd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.724902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca258630-a6b9-4dc4-a621-e24027fec5dd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.725617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca258630-a6b9-4dc4-a621-e24027fec5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.758599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ca258630-a6b9-4dc4-a621-e24027fec5dd None None] MFA Rules not processed for user `5b004d5e8c6743dda2f9983b1679ee9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:42.760344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ca258630-a6b9-4dc4-a621-e24027fec5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:42.837339 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4260/8497] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:42.848312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:42.850133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:42.935124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9538d8b-57de-4021-b9ae-0ead4f07d55c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:42.941137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:42.941968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:42.942255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:42.942534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:42.952992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:42.954736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:42.974432 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4238/8498] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:47.824877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b74a6a-511b-468a-81be-a1286b29a956 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:47.825416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b74a6a-511b-468a-81be-a1286b29a956 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:47.825416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b74a6a-511b-468a-81be-a1286b29a956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:47.844559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-04b74a6a-511b-468a-81be-a1286b29a956 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:47.845787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-04b74a6a-511b-468a-81be-a1286b29a956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:47.907277 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4261/8499] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:47.919496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:47.920993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:47.989815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb187b9b-89c8-4f69-97ec-d99797912f77 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:47.994937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ecde3-abad-456c-b0b5-5392e8ee8b82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:47.995586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ecde3-abad-456c-b0b5-5392e8ee8b82 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:47.995868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ecde3-abad-456c-b0b5-5392e8ee8b82 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:47.996146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ecde3-abad-456c-b0b5-5392e8ee8b82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:48.004179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ecde3-abad-456c-b0b5-5392e8ee8b82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:48.005775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ecde3-abad-456c-b0b5-5392e8ee8b82 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:48.014197 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4239/8500] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:16:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:16:49.622063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b74a6a-511b-468a-81be-a1286b29a956 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:49.687580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b74a6a-511b-468a-81be-a1286b29a956 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:49.692133 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:49.692996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:49.693284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:49.693566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] PATH_INFO: `/v3/users/5b004d5e8c6743dda2f9983b1679ee9e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:49.694791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b004d5e8c6743dda2f9983b1679ee9e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:49.696842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:49.741289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b004d5e8c6743dda2f9983b1679ee9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:49.742086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b004d5e8c6743dda2f9983b1679ee9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:49.749513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b004d5e8c6743dda2f9983b1679ee9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:49.750313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b004d5e8c6743dda2f9983b1679ee9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:49.759762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b004d5e8c6743dda2f9983b1679ee9e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:49.777551 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4262/8501] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:49 2022] DELETE /identity/v3/users/5b004d5e8c6743dda2f9983b1679ee9e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:49.782010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:49.782487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:49.782618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:49.801073 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:49.802581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:49.865072 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4240/8502] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:49.875473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:49.876907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:49.925761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:49.927343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:49.941174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6b568-2094-4e94-ad82-f202b72a8781 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:49.943940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe40c8-04c8-4b81-bd32-99249b9ab69f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:49.945958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:49.946850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:49.947137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:49.947408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] PATH_INFO: `/v3/users/af105dbc34cb4e4191e14314d88df4c4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:49.947718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:49.948364 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:49.948628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af105dbc34cb4e4191e14314d88df4c4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:49.948748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:49.949574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:49.951184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:49.959022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:49.960397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:49.970325 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4263/8503] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:16:49.997276 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af105dbc34cb4e4191e14314d88df4c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.004848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af105dbc34cb4e4191e14314d88df4c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.005762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af105dbc34cb4e4191e14314d88df4c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.006544 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af105dbc34cb4e4191e14314d88df4c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.015014 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af105dbc34cb4e4191e14314d88df4c4'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.033710 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4241/8504] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:49 2022] DELETE /identity/v3/users/af105dbc34cb4e4191e14314d88df4c4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:50.566195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:50.583069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5db8e-6dea-4651-8ef2-776c4e990da4 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:50.606375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:50.608545 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:50.662963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:50.663821 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.664097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.664562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] PATH_INFO: `/v3/projects/c82534ba00c049e6bfa7421398228fff` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.665748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82534ba00c049e6bfa7421398228fff)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:50.668278 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:50.683584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959b5f-30e8-4378-bcc8-dbeecdaf9a5b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:50.688189 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:50.689035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.689311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.689579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] PATH_INFO: `/v3/projects/da2cd9f873674463a0d54570586512c5` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.690747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2cd9f873674463a0d54570586512c5)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:50.692680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:50.713488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82534ba00c049e6bfa7421398228fff', 'request_id': 'req-5bba48cd-5225-4c79-b9a5-5b9708b28169'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.720700 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82534ba00c049e6bfa7421398228fff', 'request_id': 'req-5bba48cd-5225-4c79-b9a5-5b9708b28169'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.727917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82534ba00c049e6bfa7421398228fff', 'request_id': 'req-5bba48cd-5225-4c79-b9a5-5b9708b28169'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.738326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2cd9f873674463a0d54570586512c5', 'request_id': 'req-3a050202-7b92-4b69-898d-cb46339b461c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.738889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] The token cache is being invalidate because project c82534ba00c049e6bfa7421398228fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:50.739182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.739814 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5bba48cd-5225-4c79-b9a5-5b9708b28169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.741361 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4264/8505] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:50 2022] DELETE /identity/v3/projects/c82534ba00c049e6bfa7421398228fff => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:50.744835 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2cd9f873674463a0d54570586512c5', 'request_id': 'req-3a050202-7b92-4b69-898d-cb46339b461c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.745986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481dea9-91ea-4f63-9044-a7e3a83fed7a None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.746302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481dea9-91ea-4f63-9044-a7e3a83fed7a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.746603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481dea9-91ea-4f63-9044-a7e3a83fed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.752001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2cd9f873674463a0d54570586512c5', 'request_id': 'req-3a050202-7b92-4b69-898d-cb46339b461c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.763387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] The token cache is being invalidate because project da2cd9f873674463a0d54570586512c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:50.763681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.764338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3a050202-7b92-4b69-898d-cb46339b461c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:50.765904 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4242/8506] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:50 2022] DELETE /identity/v3/projects/da2cd9f873674463a0d54570586512c5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:50.769374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8481dea9-91ea-4f63-9044-a7e3a83fed7a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:50.769517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8481dea9-91ea-4f63-9044-a7e3a83fed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:50.770681 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb375-5c34-4fdb-86a3-5471d6f3164d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.771020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb375-5c34-4fdb-86a3-5471d6f3164d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.771337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1eb375-5c34-4fdb-86a3-5471d6f3164d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.789878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7b1eb375-5c34-4fdb-86a3-5471d6f3164d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:50.791159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7b1eb375-5c34-4fdb-86a3-5471d6f3164d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:50.832036 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4265/8507] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:50.839496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794667c-4685-4173-8cf8-832c484c4119 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.840402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794667c-4685-4173-8cf8-832c484c4119 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.840686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794667c-4685-4173-8cf8-832c484c4119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.849756 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4243/8508] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:50.857175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876c88-8765-46c5-a66a-d63889409970 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.857581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876c88-8765-46c5-a66a-d63889409970 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.857985 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876c88-8765-46c5-a66a-d63889409970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.861286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5794667c-4685-4173-8cf8-832c484c4119 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:50.862512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5794667c-4685-4173-8cf8-832c484c4119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:50.870763 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4266/8509] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:50.874654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794667c-4685-4173-8cf8-832c484c4119 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:50.875913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-07876c88-8765-46c5-a66a-d63889409970 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:50.877080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-07876c88-8765-46c5-a66a-d63889409970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:50.883578 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794667c-4685-4173-8cf8-832c484c4119 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:50.885253 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4244/8510] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:50.888932 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:50.889563 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.889755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876c88-8765-46c5-a66a-d63889409970 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:50.889876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.890109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.890864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:50.891169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:50.892772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:50.898954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876c88-8765-46c5-a66a-d63889409970 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:50.904525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:50.905081 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4267/8511] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:16:50.905199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.905531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.905879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.906617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:50.906961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:50.908769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:50.909335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:50.919297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6a68f-3a63-4ff0-95c8-e248b3c9282e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:50.928880 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4245/8512] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:16:50.929077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:50.929077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.929077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.929077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.929473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:50.929574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:50.929923 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:50.939707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5f41e-05e1-4091-9ca8-57f4bf843e48 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:50.945029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:50.945665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:50.945912 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:50.946245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:50.946968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:50.949364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:50.956120 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4268/8513] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:50.960031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:50.976416 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4246/8514] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:50.980406 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.022451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0628-0535-4e18-9977-1a5530be28d3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.040743 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014187bd-dad5-4f2b-9193-68048d1d5379 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.045428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.046082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.046362 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.046633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.047606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.049520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.072696 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4247/8515] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:51.073744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.078925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.079592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.079877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.080704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.080883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.082899 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.085381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8db5a0-55a3-437c-aa9f-2a431c93d47d admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.091123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.091790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.092074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.092354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.093736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.095768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.105813 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4269/8516] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:50 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:16:51.109364 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4248/8517] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:51.109990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.113376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.120003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880b12e-436f-4973-ac99-b59ed43ab5c4 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.123894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ab28-cce8-436c-8686-534671e90fa6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.125260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.125911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.126198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.126475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.127247 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.128620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.128835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.129253 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.129532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.129806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.130509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.132133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.142104 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4270/8518] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:51.143113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.145663 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4249/8519] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:51.149540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.153051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64545f50-0770-43bf-9fc9-e49f5b29f1d0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.158289 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.158981 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.159262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.159535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.159636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a707c-6ca5-4dac-a44a-c4fabfabf356 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.160243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.161823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.164562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0bf7d9-65e6-4d0a-abf2-24765bbd7c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.165426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bf7d9-65e6-4d0a-abf2-24765bbd7c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.165715 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bf7d9-65e6-4d0a-abf2-24765bbd7c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.165992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0bf7d9-65e6-4d0a-abf2-24765bbd7c23 admin admin] PATH_INFO: `/v3/projects/3a3f46c126714930aca88fe9624bfe80/users/9eb6ede5766f4a6cad923de222ac01ae/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.172502 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4271/8520] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:16:51.176538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.180854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bf7d9-65e6-4d0a-abf2-24765bbd7c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3f46c126714930aca88fe9624bfe80, user_id=9eb6ede5766f4a6cad923de222ac01ae, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.184490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0bf7d9-65e6-4d0a-abf2-24765bbd7c23 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.186810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fa22b-b054-4701-b1f8-ca6ded23c876 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.192477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9d192-cd85-467a-bf14-defbb4d07262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.193377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d192-cd85-467a-bf14-defbb4d07262 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.193661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d192-cd85-467a-bf14-defbb4d07262 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.194445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9d192-cd85-467a-bf14-defbb4d07262 admin admin] PATH_INFO: `/v3/projects/117ff6231e96434ab97d7e6405af2765/users/1e52fc614b774d13a38bbcbbe94a419d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.202403 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4250/8521] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:51 2022] PUT /identity/v3/projects/3a3f46c126714930aca88fe9624bfe80/users/9eb6ede5766f4a6cad923de222ac01ae/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:51.210434 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9d192-cd85-467a-bf14-defbb4d07262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=117ff6231e96434ab97d7e6405af2765, user_id=1e52fc614b774d13a38bbcbbe94a419d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.212720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.213017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.213322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.213505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9d192-cd85-467a-bf14-defbb4d07262 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.226906 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4272/8522] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:51 2022] PUT /identity/v3/projects/117ff6231e96434ab97d7e6405af2765/users/1e52fc614b774d13a38bbcbbe94a419d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:16:51.236625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.236946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.237200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.240719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] MFA Rules not processed for user `9eb6ede5766f4a6cad923de222ac01ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:51.241926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:51.263775 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] MFA Rules not processed for user `1e52fc614b774d13a38bbcbbe94a419d`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:51.264975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:51.304202 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4251/8523] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:51.316622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.318255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:51.332125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4273/8524] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:16:51.343626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:51.345274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:51.378143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed45ac-fdb2-40c2-979b-4398538a63ac None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.382076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.382731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.383049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.383329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.392803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.393992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.404076 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4252/8525] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:16:51.406109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe51de3-9525-499c-b315-346cbd022ed5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:51.409880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8cce-df5b-4da0-9f15-a851d43b4724 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:51.410527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8cce-df5b-4da0-9f15-a851d43b4724 service glance] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:51.411088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8cce-df5b-4da0-9f15-a851d43b4724 service glance] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:51.411253 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8cce-df5b-4da0-9f15-a851d43b4724 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:51.419898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8cce-df5b-4da0-9f15-a851d43b4724 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:51.421375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8cce-df5b-4da0-9f15-a851d43b4724 service glance] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:51.430445 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4274/8526] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:16:54.431892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:54.491724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181caa4-dc2a-4067-bd87-5ba351c71824 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:54.496236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:54.497091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:54.497371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:54.497645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] PATH_INFO: `/v3/users/9eb6ede5766f4a6cad923de222ac01ae` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:54.498858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb6ede5766f4a6cad923de222ac01ae)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:54.500782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:54.544450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb6ede5766f4a6cad923de222ac01ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:54.551487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb6ede5766f4a6cad923de222ac01ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:54.552130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb6ede5766f4a6cad923de222ac01ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:54.552741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb6ede5766f4a6cad923de222ac01ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:54.561120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb6ede5766f4a6cad923de222ac01ae'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:54.578737 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4253/8527] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:16:54 2022] DELETE /identity/v3/users/9eb6ede5766f4a6cad923de222ac01ae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:54.583228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f8db5-f035-4adc-a545-c025017612cc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:54.583704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f8db5-f035-4adc-a545-c025017612cc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:54.583826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f8db5-f035-4adc-a545-c025017612cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:54.600803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-907f8db5-f035-4adc-a545-c025017612cc None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:54.602009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-907f8db5-f035-4adc-a545-c025017612cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:54.660548 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4275/8528] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:54.670429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:54.672510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:54.730382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cbe54-9d67-4fa3-81df-6934ffacfd5f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:54.734059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217d9e3-9079-4b5d-8b3c-7594acedceae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:54.734699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217d9e3-9079-4b5d-8b3c-7594acedceae service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:54.735013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217d9e3-9079-4b5d-8b3c-7594acedceae service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:54.735286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217d9e3-9079-4b5d-8b3c-7594acedceae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:54.744179 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217d9e3-9079-4b5d-8b3c-7594acedceae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:54.745551 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217d9e3-9079-4b5d-8b3c-7594acedceae service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:54.755323 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4254/8529] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:16:55.021978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f8db5-f035-4adc-a545-c025017612cc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.023474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-907f8db5-f035-4adc-a545-c025017612cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:55.035553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f8db5-f035-4adc-a545-c025017612cc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.040257 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.041124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.041404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.041687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] PATH_INFO: `/v3/projects/3a3f46c126714930aca88fe9624bfe80` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.043546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3f46c126714930aca88fe9624bfe80)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.045488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.090502 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3f46c126714930aca88fe9624bfe80', 'request_id': 'req-a098f7f0-c858-426e-8a4a-e30d963372aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:55.096427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3f46c126714930aca88fe9624bfe80', 'request_id': 'req-a098f7f0-c858-426e-8a4a-e30d963372aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:55.103149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3f46c126714930aca88fe9624bfe80', 'request_id': 'req-a098f7f0-c858-426e-8a4a-e30d963372aa'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:55.113936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] The token cache is being invalidate because project 3a3f46c126714930aca88fe9624bfe80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:16:55.114243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:55.114901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-a098f7f0-c858-426e-8a4a-e30d963372aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:16:55.116452 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4276/8530] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:16:55 2022] DELETE /identity/v3/projects/3a3f46c126714930aca88fe9624bfe80 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:55.122004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86174-a295-4fd9-9411-9c8d44a9aa4d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.122292 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86174-a295-4fd9-9411-9c8d44a9aa4d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.122591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f86174-a295-4fd9-9411-9c8d44a9aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.140192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-30f86174-a295-4fd9-9411-9c8d44a9aa4d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:55.141373 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-30f86174-a295-4fd9-9411-9c8d44a9aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:55.200146 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4255/8531] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:55.208903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605e3d3-3208-4d46-bdbe-b3328c71cd00 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.209198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605e3d3-3208-4d46-bdbe-b3328c71cd00 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.209473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605e3d3-3208-4d46-bdbe-b3328c71cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.228757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d605e3d3-3208-4d46-bdbe-b3328c71cd00 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:55.230532 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d605e3d3-3208-4d46-bdbe-b3328c71cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:55.241066 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4277/8532] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:55.243038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f86174-a295-4fd9-9411-9c8d44a9aa4d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.253963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f86174-a295-4fd9-9411-9c8d44a9aa4d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.258850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.259510 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.259802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.260077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.260794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:16:55.261101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.262730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.274214 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4256/8533] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:16:55.279169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605e3d3-3208-4d46-bdbe-b3328c71cd00 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.288378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605e3d3-3208-4d46-bdbe-b3328c71cd00 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.293782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.294554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.294873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.295147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.295861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.298200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.324630 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4278/8534] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:16:55 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:55.328560 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.341112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2168a-07ff-44ba-8465-b90274bb0a86 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.404990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.405724 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.406077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.406409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.407197 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.409224 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.429784 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4257/8535] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:16:55 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:16:55.433712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.444121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989eaae-fa4f-422d-9146-35cd5adacfe8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.449041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.449706 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.449993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.450269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.451030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.452894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.464096 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4279/8536] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:55.470158 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.480759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b9173-f579-4155-a4c7-07cbf020e5d8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.486065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3a0c2-5717-4599-9278-89cd50fe11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.486865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3a0c2-5717-4599-9278-89cd50fe11ce admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.487228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3a0c2-5717-4599-9278-89cd50fe11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.487569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3a0c2-5717-4599-9278-89cd50fe11ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.488354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3a0c2-5717-4599-9278-89cd50fe11ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.490100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3a0c2-5717-4599-9278-89cd50fe11ce admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.504925 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4258/8537] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:16:55.508548 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.518672 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a102-0401-43f2-ab12-e67a87525203 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.523566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.524347 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.524628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.524910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] PATH_INFO: `/v3/projects/162642dda04647e3ba9064594cfad423/users/8dffc3e4bcad4a6b8ec9b1faf27c8bc2/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.539643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162642dda04647e3ba9064594cfad423, user_id=8dffc3e4bcad4a6b8ec9b1faf27c8bc2, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.542339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.556853 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4280/8538] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:16:55 2022] PUT /identity/v3/projects/162642dda04647e3ba9064594cfad423/users/8dffc3e4bcad4a6b8ec9b1faf27c8bc2/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:16:55.567385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.567680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.567967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.595783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] MFA Rules not processed for user `8dffc3e4bcad4a6b8ec9b1faf27c8bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:16:55.596978 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:55.663156 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4259/8539] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:16:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:16:55.675315 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:16:55.677052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:16:55.739186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960eab2-1a38-4d20-bf48-444331380038 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:16:55.742968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea006b-b7da-491a-8de0-c1f87d7612d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:16:55.743615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea006b-b7da-491a-8de0-c1f87d7612d6 service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:16:55.744060 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea006b-b7da-491a-8de0-c1f87d7612d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:16:55.744274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea006b-b7da-491a-8de0-c1f87d7612d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:16:55.752828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea006b-b7da-491a-8de0-c1f87d7612d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:16:55.755079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea006b-b7da-491a-8de0-c1f87d7612d6 service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:16:55.764757 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4281/8540] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:16:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:04.439777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:04.441177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:04.503793 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c36b72-9dc3-4ab2-b379-559c3505899b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:04.508331 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:04.509194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:04.509477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:04.509754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] PATH_INFO: `/v3/users/1e52fc614b774d13a38bbcbbe94a419d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:04.510955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e52fc614b774d13a38bbcbbe94a419d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:04.512935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:04.558299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e52fc614b774d13a38bbcbbe94a419d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:04.565777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e52fc614b774d13a38bbcbbe94a419d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:04.566591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e52fc614b774d13a38bbcbbe94a419d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:04.567227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e52fc614b774d13a38bbcbbe94a419d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:04.575206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e52fc614b774d13a38bbcbbe94a419d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:04.599346 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4260/8541] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:17:04 2022] DELETE /identity/v3/users/1e52fc614b774d13a38bbcbbe94a419d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:04.599468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:04.599468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:04.599468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:04.617201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:04.618415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:04.692927 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4282/8542] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:04.704182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:04.705617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:04.766460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e59f8-45ed-45ab-9fa5-4173093f9597 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:04.770138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782e76d-01bb-4fc8-a549-31f1d5f375c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:04.771051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782e76d-01bb-4fc8-a549-31f1d5f375c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:04.771341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782e76d-01bb-4fc8-a549-31f1d5f375c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:04.771614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782e76d-01bb-4fc8-a549-31f1d5f375c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:04.782661 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782e76d-01bb-4fc8-a549-31f1d5f375c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:04.784255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782e76d-01bb-4fc8-a549-31f1d5f375c6 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:04.795271 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4261/8543] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:05.079656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.081498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:05.095370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2fc85-f3fb-421c-b991-eaf999b7aef8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.101239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.102259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.102610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.103029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] PATH_INFO: `/v3/projects/117ff6231e96434ab97d7e6405af2765` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.104587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=117ff6231e96434ab97d7e6405af2765)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.107500 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.157368 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117ff6231e96434ab97d7e6405af2765', 'request_id': 'req-cf6f98f2-259d-4c9d-b895-980655deefa5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:05.166962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117ff6231e96434ab97d7e6405af2765', 'request_id': 'req-cf6f98f2-259d-4c9d-b895-980655deefa5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:05.176542 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117ff6231e96434ab97d7e6405af2765', 'request_id': 'req-cf6f98f2-259d-4c9d-b895-980655deefa5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:05.187323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] The token cache is being invalidate because project 117ff6231e96434ab97d7e6405af2765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:17:05.187711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:05.188419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-cf6f98f2-259d-4c9d-b895-980655deefa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:05.190147 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4283/8544] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:17:05 2022] DELETE /identity/v3/projects/117ff6231e96434ab97d7e6405af2765 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:05.194984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d661d-9ad8-43ea-9cd5-27e48d211634 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.195327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d661d-9ad8-43ea-9cd5-27e48d211634 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.195611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d661d-9ad8-43ea-9cd5-27e48d211634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.215809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-5f6d661d-9ad8-43ea-9cd5-27e48d211634 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:05.217270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-5f6d661d-9ad8-43ea-9cd5-27e48d211634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:05.286726 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4262/8545] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:05.296232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b62a-5866-4c19-97d7-df3a38835c73 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.296839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b62a-5866-4c19-97d7-df3a38835c73 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.297908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2b62a-5866-4c19-97d7-df3a38835c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.324336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d3d2b62a-5866-4c19-97d7-df3a38835c73 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:05.325581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d3d2b62a-5866-4c19-97d7-df3a38835c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:05.333947 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4284/8546] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:05.338149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d661d-9ad8-43ea-9cd5-27e48d211634 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.348342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d661d-9ad8-43ea-9cd5-27e48d211634 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.355536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.357442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.357948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.358449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.359878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:17:05.360441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.363558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.380863 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4263/8547] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:17:05.384996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b62a-5866-4c19-97d7-df3a38835c73 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.394908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2b62a-5866-4c19-97d7-df3a38835c73 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.400059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.400781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.401070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.401374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.402044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.404573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.432305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4285/8548] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:17:05 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:17:05.436405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.446375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec28b-f0e3-48f5-b366-63d0002a198a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.505585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.506257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.506549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.506832 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.507524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.509437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.532707 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4264/8549] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:17:05 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:17:05.534184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.545374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5ced-250d-4ff9-a544-d67dc448e932 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.551688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.552393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.552747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.553095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.553890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.555606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.569529 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4286/8550] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:17:05.570670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.581171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2dd15-dc9f-48ef-bd2a-b1879407302b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.585951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34daf079-9d64-427d-b042-6d2d8aa69e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.586613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf079-9d64-427d-b042-6d2d8aa69e75 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.586936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf079-9d64-427d-b042-6d2d8aa69e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.587214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34daf079-9d64-427d-b042-6d2d8aa69e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.587926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34daf079-9d64-427d-b042-6d2d8aa69e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.589530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34daf079-9d64-427d-b042-6d2d8aa69e75 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.600116 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4265/8551] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:17:05.604317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.614267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640168c9-0f65-491a-8325-23c8f88b558d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.619387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.620350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.620633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.620908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] PATH_INFO: `/v3/projects/3374eeb3bca84f37988c8d4ce2c03f87/users/321a3223fd9d462a8d956c1e6ca5ce55/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.635911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3374eeb3bca84f37988c8d4ce2c03f87, user_id=321a3223fd9d462a8d956c1e6ca5ce55, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.639192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.652087 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4287/8552] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:17:05 2022] PUT /identity/v3/projects/3374eeb3bca84f37988c8d4ce2c03f87/users/321a3223fd9d462a8d956c1e6ca5ce55/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:05.663034 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81fa9-b699-458e-9263-186b3586a624 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.663477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81fa9-b699-458e-9263-186b3586a624 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.663768 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af81fa9-b699-458e-9263-186b3586a624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.691753 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8af81fa9-b699-458e-9263-186b3586a624 None None] MFA Rules not processed for user `321a3223fd9d462a8d956c1e6ca5ce55`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:05.692976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8af81fa9-b699-458e-9263-186b3586a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:05.757555 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4266/8553] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:05.770122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.771857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:05.831302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a21de-c8f6-433c-b40c-b47b349e8295 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.834906 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9d7f3-d2f7-4abb-b3f9-2931ae8a285d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.835575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d7f3-d2f7-4abb-b3f9-2931ae8a285d service cinder] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.835858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d7f3-d2f7-4abb-b3f9-2931ae8a285d service cinder] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.836137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d7f3-d2f7-4abb-b3f9-2931ae8a285d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.844448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9d7f3-d2f7-4abb-b3f9-2931ae8a285d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.845890 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9d7f3-d2f7-4abb-b3f9-2931ae8a285d service cinder] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:05.855043 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4288/8554] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:05.880410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af81fa9-b699-458e-9263-186b3586a624 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:05.942805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af81fa9-b699-458e-9263-186b3586a624 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:05.947636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:05.948505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:05.948789 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:05.949068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] PATH_INFO: `/v3/users/321a3223fd9d462a8d956c1e6ca5ce55` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:05.951021 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321a3223fd9d462a8d956c1e6ca5ce55)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:05.952959 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:06.007599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321a3223fd9d462a8d956c1e6ca5ce55'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.014898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321a3223fd9d462a8d956c1e6ca5ce55'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.015580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321a3223fd9d462a8d956c1e6ca5ce55'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.016203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321a3223fd9d462a8d956c1e6ca5ce55'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.023194 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321a3223fd9d462a8d956c1e6ca5ce55'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.039952 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4267/8555] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:17:05 2022] DELETE /identity/v3/users/321a3223fd9d462a8d956c1e6ca5ce55 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:06.044506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67851-fab8-4eaf-b449-c4790bea27d7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.044794 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67851-fab8-4eaf-b449-c4790bea27d7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.045072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e67851-fab8-4eaf-b449-c4790bea27d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.062736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-63e67851-fab8-4eaf-b449-c4790bea27d7 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:06.063956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-63e67851-fab8-4eaf-b449-c4790bea27d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.122499 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4289/8556] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:06.134066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:06.135604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.198323 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7873d-bbd4-4257-95fb-91ae4f865139 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:06.202357 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bb43e-9107-429a-896a-d37235ad9237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:06.203037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb43e-9107-429a-896a-d37235ad9237 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.203446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb43e-9107-429a-896a-d37235ad9237 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.203729 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb43e-9107-429a-896a-d37235ad9237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.213582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bb43e-9107-429a-896a-d37235ad9237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:06.215115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bb43e-9107-429a-896a-d37235ad9237 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:06.225413 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4268/8557] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:06.320857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4489-c32d-4bb6-8ad7-c708782a9744 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.321156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4489-c32d-4bb6-8ad7-c708782a9744 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.321535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed4489-c32d-4bb6-8ad7-c708782a9744 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.323577 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4290/8558] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:17:06.330849 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.331076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.331417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.394946 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:06.396502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.484850 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4269/8559] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:17:06.513076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed4489-c32d-4bb6-8ad7-c708782a9744 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:06.515374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9aed4489-c32d-4bb6-8ad7-c708782a9744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.544494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed4489-c32d-4bb6-8ad7-c708782a9744 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:06.550892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ee18a-1235-46d9-ab07-c7583407c83d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:06.551765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee18a-1235-46d9-ab07-c7583407c83d service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.552165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee18a-1235-46d9-ab07-c7583407c83d service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.552623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee18a-1235-46d9-ab07-c7583407c83d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.564179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ee18a-1235-46d9-ab07-c7583407c83d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:06.566391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ee18a-1235-46d9-ab07-c7583407c83d service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:06.578378 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4291/8560] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:06.604655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:06.606727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.626757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35279c-66d3-4d8c-b26e-e5dfc6fdc933 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:06.632026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:06.633496 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.633888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.634347 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] PATH_INFO: `/v3/projects/3374eeb3bca84f37988c8d4ce2c03f87` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.635773 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3374eeb3bca84f37988c8d4ce2c03f87)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:06.640304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:06.697394 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3374eeb3bca84f37988c8d4ce2c03f87', 'request_id': 'req-80c79736-0878-424a-98f8-628766b834bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.703877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3374eeb3bca84f37988c8d4ce2c03f87', 'request_id': 'req-80c79736-0878-424a-98f8-628766b834bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.711906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3374eeb3bca84f37988c8d4ce2c03f87', 'request_id': 'req-80c79736-0878-424a-98f8-628766b834bc'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.733483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] The token cache is being invalidate because project 3374eeb3bca84f37988c8d4ce2c03f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:17:06.733778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.734524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:06.736569 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4270/8561] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:17:06 2022] DELETE /identity/v3/projects/3374eeb3bca84f37988c8d4ce2c03f87 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:06.741553 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d019-f39e-455b-afa8-eb4871454278 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.742054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d019-f39e-455b-afa8-eb4871454278 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.742165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d019-f39e-455b-afa8-eb4871454278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.763099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6fe6d019-f39e-455b-afa8-eb4871454278 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:06.764268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6fe6d019-f39e-455b-afa8-eb4871454278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.823270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:06.824864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.836483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4292/8562] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:17:06.844900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786fa13-1125-4cc5-97a5-193962f8ad5c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.845201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786fa13-1125-4cc5-97a5-193962f8ad5c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.845481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786fa13-1125-4cc5-97a5-193962f8ad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.864977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2786fa13-1125-4cc5-97a5-193962f8ad5c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:06.866210 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2786fa13-1125-4cc5-97a5-193962f8ad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.874717 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4293/8563] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:06.878881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786fa13-1125-4cc5-97a5-193962f8ad5c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:06.889056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786fa13-1125-4cc5-97a5-193962f8ad5c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:06.894172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c79736-0878-424a-98f8-628766b834bc admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:06.896351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:06.897111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.897403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.897687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.898429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:17:06.898821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:06.898970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:06.899486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.899769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.900046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.900511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:06.901971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:06.913837 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4294/8564] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:17:06.918279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:06.918858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:06.920334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:06.931891 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4271/8565] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:17:06.934513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726cc0f-2267-4f0c-9a00-d92a90b56760 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:06.939268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2856fe0-2cb1-4a1f-aa80-6c5fc376d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:06.939929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856fe0-2cb1-4a1f-aa80-6c5fc376d625 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:06.940245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856fe0-2cb1-4a1f-aa80-6c5fc376d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:06.940526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856fe0-2cb1-4a1f-aa80-6c5fc376d625 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:06.941206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2856fe0-2cb1-4a1f-aa80-6c5fc376d625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:06.943200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2856fe0-2cb1-4a1f-aa80-6c5fc376d625 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:06.974807 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4295/8566] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:17:06 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:17:06.978319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:06.990067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd00da3-a3b1-4c42-8ba7-90d47266ce7d service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.024330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894bab-e894-4fd7-ad95-55c2b8435763 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.024699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894bab-e894-4fd7-ad95-55c2b8435763 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.025072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894bab-e894-4fd7-ad95-55c2b8435763 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.026563 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4296/8567] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 22:17:07.031798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.032159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.032506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.046118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.046809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.047371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.047626 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.048295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.050209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.051515 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:07.052732 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:07.070005 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4272/8568] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:17:06 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:17:07.073817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:07.083810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38e4b9-0dc0-4f0b-8611-6ce5ba577d55 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.089095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.090664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.090986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.091270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.091992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.093599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.106244 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4273/8569] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:17:07.107332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:07.116028 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4297/8570] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:17:07.116618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c807d-e6fa-4be0-94ad-4495719a16ee admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.121361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.122005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.122291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.122574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.123322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.125072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.139811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4274/8571] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:17:07.139996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:07.139996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:07.140820 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:07.150984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefcddd-11a9-4c06-9afd-c8534e129fc6 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.156648 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.157565 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.157846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.158016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be0454-cae8-4e77-beb4-8fc268e9a089 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.158146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] PATH_INFO: `/v3/projects/5bac0f87a16b47fd834d24945cc0ca92/users/be2a0c581a934ebd9d694a3b7a411c4e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.163300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe3d90-a2e1-4dc0-9d77-d4f29502a275 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.163945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3d90-a2e1-4dc0-9d77-d4f29502a275 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.164235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3d90-a2e1-4dc0-9d77-d4f29502a275 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.164517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3d90-a2e1-4dc0-9d77-d4f29502a275 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.173265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bac0f87a16b47fd834d24945cc0ca92, user_id=be2a0c581a934ebd9d694a3b7a411c4e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.173535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe3d90-a2e1-4dc0-9d77-d4f29502a275 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.175177 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe3d90-a2e1-4dc0-9d77-d4f29502a275 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.175983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.185613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4298/8572] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:17:07.188896 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4275/8573] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:17:07 2022] PUT /identity/v3/projects/5bac0f87a16b47fd834d24945cc0ca92/users/be2a0c581a934ebd9d694a3b7a411c4e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:07.200670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.201031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.201290 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.228292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] MFA Rules not processed for user `be2a0c581a934ebd9d694a3b7a411c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:07.229955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:07.293356 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4299/8574] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:07.305663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:07.307236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:07.370816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:07.373138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:07.398958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306c4ca-8f8b-45a8-ba83-2cb9504accab admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.405166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.406740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.407111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.407388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.419250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.421604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.440051 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4276/8575] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:07.453280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608fbf3-27ed-49f6-8c39-d9d043e4ba1f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.457513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.458160 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.458446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.458722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.460540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:07.553769 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.555498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.575374 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4300/8576] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:07.638865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:07.749455 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555492-2bec-44c7-810e-54ab3614a848 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:07.756499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2115-283f-41dc-805b-e37cb9ff1ca2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:07.757249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2115-283f-41dc-805b-e37cb9ff1ca2 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:07.757440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2115-283f-41dc-805b-e37cb9ff1ca2 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:07.757736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2115-283f-41dc-805b-e37cb9ff1ca2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:07.759686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-641d2115-283f-41dc-805b-e37cb9ff1ca2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:07.775044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2115-283f-41dc-805b-e37cb9ff1ca2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:07.776738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2115-283f-41dc-805b-e37cb9ff1ca2 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:07.794882 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4277/8577] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:15.912393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:15.913912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:15.986106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836beca-65bb-4e1a-905a-c091beecbee1 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:15.991163 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:15.992007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:15.992292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:15.992644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] PATH_INFO: `/v3/users/8dffc3e4bcad4a6b8ec9b1faf27c8bc2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:15.993840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dffc3e4bcad4a6b8ec9b1faf27c8bc2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:15.995985 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:16.045877 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dffc3e4bcad4a6b8ec9b1faf27c8bc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.046640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dffc3e4bcad4a6b8ec9b1faf27c8bc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.054427 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dffc3e4bcad4a6b8ec9b1faf27c8bc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.055397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dffc3e4bcad4a6b8ec9b1faf27c8bc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.064015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dffc3e4bcad4a6b8ec9b1faf27c8bc2'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.081492 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4301/8578] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:17:15 2022] DELETE /identity/v3/users/8dffc3e4bcad4a6b8ec9b1faf27c8bc2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:16.086175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:16.086705 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:16.086921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:16.104621 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:16.106499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:16.168155 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4278/8579] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:16.179127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:16.180741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:16.253058 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51cf7-00c4-48b4-b93e-35850eda55a5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:16.256883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c6225-38b5-4e16-b5ff-9b192b0441b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:16.257817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c6225-38b5-4e16-b5ff-9b192b0441b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:16.258109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c6225-38b5-4e16-b5ff-9b192b0441b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:16.258504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c6225-38b5-4e16-b5ff-9b192b0441b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:16.270473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c6225-38b5-4e16-b5ff-9b192b0441b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:16.272768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c6225-38b5-4e16-b5ff-9b192b0441b3 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:16.286477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4302/8580] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:17:16.649068 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:16.650642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:16.664071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad9797-3492-4737-9f3c-2e0e46c1847a None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:16.669896 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:16.672095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:16.672848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:16.673220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] PATH_INFO: `/v3/projects/162642dda04647e3ba9064594cfad423` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:16.674680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162642dda04647e3ba9064594cfad423)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:16.676680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:16.728497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162642dda04647e3ba9064594cfad423', 'request_id': 'req-a0359204-91de-4dba-937a-bc7850ef1480'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.735242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162642dda04647e3ba9064594cfad423', 'request_id': 'req-a0359204-91de-4dba-937a-bc7850ef1480'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.743145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162642dda04647e3ba9064594cfad423', 'request_id': 'req-a0359204-91de-4dba-937a-bc7850ef1480'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.754572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] The token cache is being invalidate because project 162642dda04647e3ba9064594cfad423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:17:16.754871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.755509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-a0359204-91de-4dba-937a-bc7850ef1480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:16.757086 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4279/8581] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:17:16 2022] DELETE /identity/v3/projects/162642dda04647e3ba9064594cfad423 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:16.763076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d122fd-2b79-4a38-a1b3-1396fcce761b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:16.763336 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d122fd-2b79-4a38-a1b3-1396fcce761b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:16.763607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d122fd-2b79-4a38-a1b3-1396fcce761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:16.783358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e0d122fd-2b79-4a38-a1b3-1396fcce761b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:16.784595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e0d122fd-2b79-4a38-a1b3-1396fcce761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:16.850971 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4303/8582] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:16.859149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73035ca-98e4-4048-b797-040e079be5e9 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:16.859456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73035ca-98e4-4048-b797-040e079be5e9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:16.859723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73035ca-98e4-4048-b797-040e079be5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:16.880128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d73035ca-98e4-4048-b797-040e079be5e9 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:16.881585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d73035ca-98e4-4048-b797-040e079be5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:16.891385 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4280/8583] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:16.895645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d122fd-2b79-4a38-a1b3-1396fcce761b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:16.906422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d122fd-2b79-4a38-a1b3-1396fcce761b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:16.911407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:16.912104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:16.912365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:16.912652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:16.913379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:17:16.913683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:16.915345 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:16.927860 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4304/8584] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:17:16.932203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73035ca-98e4-4048-b797-040e079be5e9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:16.941942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73035ca-98e4-4048-b797-040e079be5e9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:16.947168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:16.947825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:16.948111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:16.948386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:16.949085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:16.951722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:16.981922 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4281/8585] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:17:16 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:17:16.983445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:16.994652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396fc0e-6323-4b77-b6ca-2ccd7f70ecc3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.058728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.060106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.060430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.060825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.061521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.063588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.086352 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4305/8586] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:17:16 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:17:17.091105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.103157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0298beb-51b6-47bb-9581-567fd116aad4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.108646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.109319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.109607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.109882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.110605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.112260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.123782 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4282/8587] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:17:17.128119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.139543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d1492-496c-4489-84d9-96f52a3f1fb3 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.144862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5a642-508a-4db3-b623-d44e05db7aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.145558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a642-508a-4db3-b623-d44e05db7aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.145850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a642-508a-4db3-b623-d44e05db7aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.146131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a642-508a-4db3-b623-d44e05db7aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.146977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5a642-508a-4db3-b623-d44e05db7aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.148707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5a642-508a-4db3-b623-d44e05db7aa9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.159133 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4306/8588] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:17:17.163355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.174389 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03544509-ffe1-4acd-8644-c575aa794507 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.179419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.180996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.181735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.182025 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] PATH_INFO: `/v3/projects/2340a9d9fc794801961cf33ab1ea3355/users/60d48c501ee647e98f09eaafd83e7f5e/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.198124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2340a9d9fc794801961cf33ab1ea3355, user_id=60d48c501ee647e98f09eaafd83e7f5e, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.201532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.217763 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4283/8589] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:17:17 2022] PUT /identity/v3/projects/2340a9d9fc794801961cf33ab1ea3355/users/60d48c501ee647e98f09eaafd83e7f5e/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:17.231858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b335140-0e09-4b90-a077-97d1f126434f None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.232396 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b335140-0e09-4b90-a077-97d1f126434f None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.232692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b335140-0e09-4b90-a077-97d1f126434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.260867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2b335140-0e09-4b90-a077-97d1f126434f None None] MFA Rules not processed for user `60d48c501ee647e98f09eaafd83e7f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:17.262061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2b335140-0e09-4b90-a077-97d1f126434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:17.331227 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4307/8590] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:17:17.336282 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.407589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad48f-712e-45e6-9463-a59bdc2f4366 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.413294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.414231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.414644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.414966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.415722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.417887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.444273 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4284/8591] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:17:17 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:17:17.448539 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b335140-0e09-4b90-a077-97d1f126434f None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.460791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b335140-0e09-4b90-a077-97d1f126434f None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.524511 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.525660 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.525930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.526215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.526954 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.529696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.556947 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4308/8592] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:17:17 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:17:17.560966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.571825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff57bd-dfb2-4d7d-afdc-ab855c04724a admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.577847 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d72b7-f787-4c18-a2ad-169370610b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.588872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d72b7-f787-4c18-a2ad-169370610b07 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.589187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d72b7-f787-4c18-a2ad-169370610b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.589464 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d72b7-f787-4c18-a2ad-169370610b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.590213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d72b7-f787-4c18-a2ad-169370610b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.592495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d72b7-f787-4c18-a2ad-169370610b07 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.605956 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4285/8593] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:17:17.610102 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.620183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a950ce8-1919-45ec-ac21-8fbadba9047b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.624872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.625739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.626025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.626362 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] PATH_INFO: `/v3/projects/2837e6fe54044226b5f521d78ef70ac9/users/ed860a1048744429b906c0e263045dfb/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.641863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2837e6fe54044226b5f521d78ef70ac9, user_id=ed860a1048744429b906c0e263045dfb, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.644585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.658623 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4309/8594] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:17:17 2022] PUT /identity/v3/projects/2837e6fe54044226b5f521d78ef70ac9/users/ed860a1048744429b906c0e263045dfb/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:17.669017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d4fc-c433-440e-9919-94cf76a5e867 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.669340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d4fc-c433-440e-9919-94cf76a5e867 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.669618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d4fc-c433-440e-9919-94cf76a5e867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.709105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-9ea4d4fc-c433-440e-9919-94cf76a5e867 None None] MFA Rules not processed for user `ed860a1048744429b906c0e263045dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:17.710722 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9ea4d4fc-c433-440e-9919-94cf76a5e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:17.789321 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4286/8595] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:17 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:17.820626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:17.822372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:17.892663 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db984df-6d60-4cea-935f-7f0293a09219 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:17.897757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d7410-e7b3-47e2-bbe8-37d8af6b0ff0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:17.898399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7410-e7b3-47e2-bbe8-37d8af6b0ff0 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:17.898685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7410-e7b3-47e2-bbe8-37d8af6b0ff0 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:17.898996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7410-e7b3-47e2-bbe8-37d8af6b0ff0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:17.906683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7410-e7b3-47e2-bbe8-37d8af6b0ff0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:17.908309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7410-e7b3-47e2-bbe8-37d8af6b0ff0 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:17.916510 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4310/8596] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:17:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:17:18.516235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d4fc-c433-440e-9919-94cf76a5e867 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:18.584405 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d4fc-c433-440e-9919-94cf76a5e867 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:18.589364 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:18.590251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:18.590554 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:18.590891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] PATH_INFO: `/v3/users/60d48c501ee647e98f09eaafd83e7f5e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:18.592093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d48c501ee647e98f09eaafd83e7f5e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:18.594138 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:18.645613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d48c501ee647e98f09eaafd83e7f5e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:18.653432 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d48c501ee647e98f09eaafd83e7f5e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:18.654153 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d48c501ee647e98f09eaafd83e7f5e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:18.654871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d48c501ee647e98f09eaafd83e7f5e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:18.662644 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d48c501ee647e98f09eaafd83e7f5e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:18.681841 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4287/8597] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:17:18 2022] DELETE /identity/v3/users/60d48c501ee647e98f09eaafd83e7f5e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:18.687574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:18.687940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:18.688255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:18.706882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:18.708310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:18.771873 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4311/8598] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:18.782108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:18.784165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:18.855425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0da36-909a-48c7-b3c0-4e1c28dab808 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:18.860005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:18.861204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:18.861523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:18.862865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:18.873417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:18.875371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:18.888105 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4288/8599] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:17:19.169050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:19.170552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:19.188153 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f190e-1cb1-4d93-b9f5-2d127c756cb2 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:19.194202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:19.195182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:19.195379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:19.195654 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] PATH_INFO: `/v3/projects/2340a9d9fc794801961cf33ab1ea3355` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:19.196888 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2340a9d9fc794801961cf33ab1ea3355)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:19.198858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:19.252550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2340a9d9fc794801961cf33ab1ea3355', 'request_id': 'req-c91d7fe6-32df-47e5-a029-4374c700c5f9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.258857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2340a9d9fc794801961cf33ab1ea3355', 'request_id': 'req-c91d7fe6-32df-47e5-a029-4374c700c5f9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.266878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2340a9d9fc794801961cf33ab1ea3355', 'request_id': 'req-c91d7fe6-32df-47e5-a029-4374c700c5f9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.277070 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] The token cache is being invalidate because project 2340a9d9fc794801961cf33ab1ea3355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:17:19.277374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.278580 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.280737 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4312/8600] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:17:19 2022] DELETE /identity/v3/projects/2340a9d9fc794801961cf33ab1ea3355 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:19.285387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:19.296723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0f071-8330-47ea-b809-a5ade7c3228c service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:19.358725 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:19.359619 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:19.359897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:19.360172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] PATH_INFO: `/v3/users/ed860a1048744429b906c0e263045dfb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:19.361448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed860a1048744429b906c0e263045dfb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:19.363363 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:19.407796 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed860a1048744429b906c0e263045dfb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.414327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed860a1048744429b906c0e263045dfb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.415018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed860a1048744429b906c0e263045dfb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.415731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed860a1048744429b906c0e263045dfb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.427297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed860a1048744429b906c0e263045dfb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.448468 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4289/8601] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:17:19 2022] DELETE /identity/v3/users/ed860a1048744429b906c0e263045dfb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:17:19.776733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:19.778921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:19.795750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d7fe6-32df-47e5-a029-4374c700c5f9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:19.858446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:19.859357 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:19.859638 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:19.859915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] PATH_INFO: `/v3/projects/2837e6fe54044226b5f521d78ef70ac9` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:19.861121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2837e6fe54044226b5f521d78ef70ac9)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:19.863168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:19.911450 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2837e6fe54044226b5f521d78ef70ac9', 'request_id': 'req-249157b8-b8d7-4291-a46a-a2c00a448336'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.919156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2837e6fe54044226b5f521d78ef70ac9', 'request_id': 'req-249157b8-b8d7-4291-a46a-a2c00a448336'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.932741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2837e6fe54044226b5f521d78ef70ac9', 'request_id': 'req-249157b8-b8d7-4291-a46a-a2c00a448336'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.945484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] The token cache is being invalidate because project 2837e6fe54044226b5f521d78ef70ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:17:19.945865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.946550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-249157b8-b8d7-4291-a46a-a2c00a448336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:19.948381 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4313/8602] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:17:19 2022] DELETE /identity/v3/projects/2837e6fe54044226b5f521d78ef70ac9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:21.630129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:21.631633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:21.644694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c13888-ccb3-49bf-97ae-1aaacf848bb8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:21.697862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:21.698719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:21.699040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:21.699314 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] PATH_INFO: `/v3/users/be2a0c581a934ebd9d694a3b7a411c4e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:21.701143 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2a0c581a934ebd9d694a3b7a411c4e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:21.703079 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:21.745161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2a0c581a934ebd9d694a3b7a411c4e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:21.752307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2a0c581a934ebd9d694a3b7a411c4e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:21.752968 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2a0c581a934ebd9d694a3b7a411c4e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:21.753572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2a0c581a934ebd9d694a3b7a411c4e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:21.760825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2a0c581a934ebd9d694a3b7a411c4e'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:21.778209 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4290/8603] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:17:21 2022] DELETE /identity/v3/users/be2a0c581a934ebd9d694a3b7a411c4e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:21.782628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:21.783148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:21.783255 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:21.801681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:21.802957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:21.859667 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4314/8604] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:21.869711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:21.871147 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:21.929763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835528dd-2fa2-4dbd-9c01-181e35f8b3de admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:21.933427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:21.934662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:21.934976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:21.935257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:21.944650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:21.946123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:21.955602 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4291/8605] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:22.211744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:22.213192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:22.228124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd9657-2e16-491f-b7af-89dabe660002 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:22.233914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:22.235207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:22.235501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:22.236206 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] PATH_INFO: `/v3/projects/5bac0f87a16b47fd834d24945cc0ca92` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:22.237517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bac0f87a16b47fd834d24945cc0ca92)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:22.239793 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:22.286090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bac0f87a16b47fd834d24945cc0ca92', 'request_id': 'req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:22.292227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bac0f87a16b47fd834d24945cc0ca92', 'request_id': 'req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:22.299569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bac0f87a16b47fd834d24945cc0ca92', 'request_id': 'req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:22.310452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] The token cache is being invalidate because project 5bac0f87a16b47fd834d24945cc0ca92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:17:22.310894 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:22.311518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:17:22.313061 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4315/8606] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:17:22 2022] DELETE /identity/v3/projects/5bac0f87a16b47fd834d24945cc0ca92 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:17:25.907974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:25.919865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910c7ac-b2fa-41e9-85e0-05050ce4ba4e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:25.968265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:25.968936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:25.969215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:25.969488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:25.971295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:25.984018 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:25.985450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:25.995923 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4292/8607] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:26.453673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:26.455273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:26.537412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fc4e5-2aef-4391-b8eb-bd02767c0800 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:26.545291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:26.546115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:26.546403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:26.546977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:26.548972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:26.565079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:26.566710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:26.581757 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4316/8608] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:33.624277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:33.640702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352450-51be-4a22-ab55-a00564156b48 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:33.646087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:33.646720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:33.647028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:33.647299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:33.649114 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:33.705867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:33.707521 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:33.725382 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4293/8609] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:34.422802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:34.436712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247e0f-5388-4b98-95d6-6dec71bcf225 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:34.442485 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb9073-b860-45bf-bb7b-60cb585731bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:34.443166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9073-b860-45bf-bb7b-60cb585731bc service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:34.443452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9073-b860-45bf-bb7b-60cb585731bc service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:34.443728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9073-b860-45bf-bb7b-60cb585731bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:34.445528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-15bb9073-b860-45bf-bb7b-60cb585731bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:34.460816 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb9073-b860-45bf-bb7b-60cb585731bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:34.462344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb9073-b860-45bf-bb7b-60cb585731bc service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:34.476053 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4317/8610] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:36.217893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:36.219642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:36.238187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873b6c-cd15-4e7e-b27f-9560f90bcc45 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:36.251443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:36.252687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:36.253260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:36.253863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:36.256170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:36.280116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:36.282503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:36.332495 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4294/8611] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:17:37.677752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513099-ad00-4639-aa09-dfd2e1dc1757 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:37.678229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513099-ad00-4639-aa09-dfd2e1dc1757 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:37.678337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513099-ad00-4639-aa09-dfd2e1dc1757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:37.695492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-26513099-ad00-4639-aa09-dfd2e1dc1757 None None] MFA Rules not processed for user `9b4988836610494ab48a138bd43d5b52`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:17:37.696689 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-26513099-ad00-4639-aa09-dfd2e1dc1757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:37.704109 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4318/8612] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:17:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:17:38.027589 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:17:38.029029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:38.042964 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da727437-13a9-4a5a-ba5e-3b5d29510951 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:17:38.046894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:17:38.047531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:17:38.047815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:17:38.048091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:17:38.049780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:17:38.061858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:17:38.063332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:17:38.073659 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4295/8613] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:17:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:18:14.364165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff857-9916-4541-b9f0-f15ad589dd04 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:18:14.365027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff857-9916-4541-b9f0-f15ad589dd04 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:18:14.365488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ff857-9916-4541-b9f0-f15ad589dd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:18:14.393947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4a2ff857-9916-4541-b9f0-f15ad589dd04 None None] MFA Rules not processed for user `aeee01bf990e46bfa331c1cd93528cab`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:18:14.395274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a2ff857-9916-4541-b9f0-f15ad589dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:14.464638 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4319/8614] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:18:57.989242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:18:57.991007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:58.004485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892e80-cd5f-419a-97cb-c577071c707c service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:18:58.008749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b393-4805-4839-9826-c225e6e252ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:18:58.009434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b393-4805-4839-9826-c225e6e252ec service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:18:58.009766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b393-4805-4839-9826-c225e6e252ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:18:58.010045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b393-4805-4839-9826-c225e6e252ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:18:58.011983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ffd4b393-4805-4839-9826-c225e6e252ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:58.026200 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b393-4805-4839-9826-c225e6e252ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:18:58.027869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4b393-4805-4839-9826-c225e6e252ec service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:18:58.040860 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4296/8615] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:18:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:18:58.163626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4855-d3f2-44e2-86fb-cf09190916b8 None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:18:58.164150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4855-d3f2-44e2-86fb-cf09190916b8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:18:58.164263 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4855-d3f2-44e2-86fb-cf09190916b8 None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:18:58.165598 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4320/8616] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:18:58.171523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:18:58.171819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:18:58.172096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:18:58.201412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:18:58.202338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:58.270456 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4297/8617] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:18:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:18:58.294265 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad4855-d3f2-44e2-86fb-cf09190916b8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:18:58.296226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-35ad4855-d3f2-44e2-86fb-cf09190916b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:58.318828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad4855-d3f2-44e2-86fb-cf09190916b8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:18:58.325733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:18:58.326607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:18:58.327155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:18:58.327444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:18:58.338943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:18:58.340740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:18:58.350338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:18:58.351975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:58.353686 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4321/8618] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:18:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:18:58.369862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb021bf7-5b5b-45ac-a9ea-01b7fa7a87b0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:18:58.375654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:18:58.376348 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:18:58.376658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:18:58.376976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:18:58.378980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:58.394690 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:18:58.396668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:18:58.412620 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4298/8619] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:18:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:18:58.536059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:18:58.549849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aeb94-1668-49ea-95c4-5338ddab3b85 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:18:58.553853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115af10d-ec0f-4739-8334-0fde96e45f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:18:58.554566 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af10d-ec0f-4739-8334-0fde96e45f9f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:18:58.554916 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af10d-ec0f-4739-8334-0fde96e45f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:18:58.555202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af10d-ec0f-4739-8334-0fde96e45f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:18:58.557118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-115af10d-ec0f-4739-8334-0fde96e45f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:18:58.574831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115af10d-ec0f-4739-8334-0fde96e45f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:18:58.576413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115af10d-ec0f-4739-8334-0fde96e45f9f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:18:58.591094 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4322/8620] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:18:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:19:18.373519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:19:18.386838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4103f8-2148-4136-ad1d-82e5bb7b0af3 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:19:18.392223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac5e0c-f10b-4192-9697-aba2993a931f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:19:18.393133 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5e0c-f10b-4192-9697-aba2993a931f service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:19:18.393890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5e0c-f10b-4192-9697-aba2993a931f service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:19:18.393890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac5e0c-f10b-4192-9697-aba2993a931f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:19:18.395468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0bac5e0c-f10b-4192-9697-aba2993a931f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:19:18.411113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5e0c-f10b-4192-9697-aba2993a931f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:19:18.412718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac5e0c-f10b-4192-9697-aba2993a931f service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:19:18.426596 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4299/8621] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:19:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:19:44.919902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695af56-13a1-4928-ae33-dd1e327e8228 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:19:44.920447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695af56-13a1-4928-ae33-dd1e327e8228 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:19:44.920447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695af56-13a1-4928-ae33-dd1e327e8228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:19:44.937940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-2695af56-13a1-4928-ae33-dd1e327e8228 None None] MFA Rules not processed for user `9b4988836610494ab48a138bd43d5b52`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:19:44.939151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2695af56-13a1-4928-ae33-dd1e327e8228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:19:44.946528 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4323/8622] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:20:06.980599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ddd3a-5829-4b0b-894c-3612b9a3da68 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:20:06.981198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ddd3a-5829-4b0b-894c-3612b9a3da68 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:20:06.981198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ddd3a-5829-4b0b-894c-3612b9a3da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:20:07.002247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-eb5ddd3a-5829-4b0b-894c-3612b9a3da68 None None] MFA Rules not processed for user `aeee01bf990e46bfa331c1cd93528cab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:20:07.003604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eb5ddd3a-5829-4b0b-894c-3612b9a3da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:20:07.011576 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4300/8623] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:20:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:20:07.397358 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695af56-13a1-4928-ae33-dd1e327e8228 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:20:07.412557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695af56-13a1-4928-ae33-dd1e327e8228 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:20:07.420449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10f86e-5594-46bd-83a9-3ba384518b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:20:07.421524 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f86e-5594-46bd-83a9-3ba384518b32 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:20:07.421907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f86e-5594-46bd-83a9-3ba384518b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:20:07.422254 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10f86e-5594-46bd-83a9-3ba384518b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:20:07.430817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5a10f86e-5594-46bd-83a9-3ba384518b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:20:07.441944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f86e-5594-46bd-83a9-3ba384518b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:20:07.443465 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10f86e-5594-46bd-83a9-3ba384518b32 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:20:07.461553 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4324/8624] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:20:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:20:54.463934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb08bd-14de-4ac1-9c4b-6ade59ae125f None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:20:54.464525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb08bd-14de-4ac1-9c4b-6ade59ae125f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:20:54.464525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb08bd-14de-4ac1-9c4b-6ade59ae125f None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:20:54.465936 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4301/8625] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:20:54.471115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b1f08-fc5b-4e6f-98ac-847d3074802d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:20:54.471575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b1f08-fc5b-4e6f-98ac-847d3074802d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:20:54.472077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b1f08-fc5b-4e6f-98ac-847d3074802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:20:54.492613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-531b1f08-fc5b-4e6f-98ac-847d3074802d None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:20:54.494159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-531b1f08-fc5b-4e6f-98ac-847d3074802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:20:54.505242 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4325/8626] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:20:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:20:54.525779 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb08bd-14de-4ac1-9c4b-6ade59ae125f None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:20:54.542164 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb08bd-14de-4ac1-9c4b-6ade59ae125f None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:20:54.548268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:20:54.548925 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:20:54.549193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:20:54.549504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:20:54.558637 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:20:54.560343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:20:54.571694 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4302/8627] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:20:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:20:57.024568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b1f08-fc5b-4e6f-98ac-847d3074802d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:20:57.038799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b1f08-fc5b-4e6f-98ac-847d3074802d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:20:57.042457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:20:57.043462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:20:57.043747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:20:57.044025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:20:57.046564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:20:57.064409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:20:57.065902 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:20:57.081691 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4326/8628] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:20:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:20:58.218397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:20:58.230915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8f3ea-236e-4f45-bc13-91fb3477bd86 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:20:58.235057 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c134290-0405-42c2-a37c-b883b8f7714a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:20:58.235695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134290-0405-42c2-a37c-b883b8f7714a service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:20:58.235980 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134290-0405-42c2-a37c-b883b8f7714a service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:20:58.236260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134290-0405-42c2-a37c-b883b8f7714a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:20:58.238135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7c134290-0405-42c2-a37c-b883b8f7714a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:20:58.254555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c134290-0405-42c2-a37c-b883b8f7714a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:20:58.256024 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c134290-0405-42c2-a37c-b883b8f7714a service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:20:58.274997 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4303/8629] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:20:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:21:11.082116 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:21:11.095391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037d134-5aea-4113-aec7-65cf343b9090 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:21:11.100826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:21:11.101927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:21:11.102416 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:21:11.102948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:21:11.105881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:21:11.118307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:21:11.119797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:21:11.129680 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4327/8630] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:21:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:21:16.635407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac56c-6cbd-4c36-9e7a-38c171981394 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:21:16.635974 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac56c-6cbd-4c36-9e7a-38c171981394 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:21:16.636099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac56c-6cbd-4c36-9e7a-38c171981394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:21:16.655758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1f1ac56c-6cbd-4c36-9e7a-38c171981394 None None] MFA Rules not processed for user `aeee01bf990e46bfa331c1cd93528cab`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:21:16.657165 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1f1ac56c-6cbd-4c36-9e7a-38c171981394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:21:16.665182 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4304/8631] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:21:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:21:26.991512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:21:27.002568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055a38-2b6b-40f8-b291-0ed4d4092cdf service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:21:27.006227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:21:27.006896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:21:27.007181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:21:27.007458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:21:27.009171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:21:27.069940 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:21:27.071353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:21:27.081378 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4328/8632] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:21:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:21:35.665040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac56c-6cbd-4c36-9e7a-38c171981394 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:21:35.678083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac56c-6cbd-4c36-9e7a-38c171981394 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:21:35.681822 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:21:35.682670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:21:35.682992 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:21:35.683270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:21:35.685599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:21:35.699263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:21:35.700910 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:21:35.712555 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4305/8633] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:21:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:22:18.789950 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:18.801507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000f17d-62eb-4f92-a408-e11db05b2dfd service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:18.805078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:18.805712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:18.806022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:18.806299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:18.808096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:18.869748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:18.871165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:18.881261 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4329/8634] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:22:25.544827 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:25.546403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:25.567206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c278a-e677-4695-84c5-18f2255b9029 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:25.571813 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:25.572685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:25.572994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:25.573270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] PATH_INFO: `/v3/users/9b4988836610494ab48a138bd43d5b52` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:25.589334 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4988836610494ab48a138bd43d5b52)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:25.591532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:25.642970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4988836610494ab48a138bd43d5b52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.649694 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4988836610494ab48a138bd43d5b52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.650356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4988836610494ab48a138bd43d5b52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.650976 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4988836610494ab48a138bd43d5b52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.658462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4988836610494ab48a138bd43d5b52'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.675589 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4306/8635] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:22:25 2022] DELETE /identity/v3/users/9b4988836610494ab48a138bd43d5b52 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:22:25.848046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:25.860562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94c846-c080-43bc-abc2-2f649b7560c8 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:25.916123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:25.917259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:25.917540 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:25.917907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] PATH_INFO: `/v3/projects/f3657e8df46a4252b9eb1eb159306a66` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:25.928456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3657e8df46a4252b9eb1eb159306a66)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:25.930397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:25.973779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3657e8df46a4252b9eb1eb159306a66', 'request_id': 'req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.979995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3657e8df46a4252b9eb1eb159306a66', 'request_id': 'req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.987378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3657e8df46a4252b9eb1eb159306a66', 'request_id': 'req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.998108 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] The token cache is being invalidate because project f3657e8df46a4252b9eb1eb159306a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:22:25.998386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:25.999027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.000549 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4330/8636] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:22:25 2022] DELETE /identity/v3/projects/f3657e8df46a4252b9eb1eb159306a66 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:22:26.004485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:26.005891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:26.019609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d4d85-c59c-42cd-a555-5be1b976a267 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:26.079177 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:26.080042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:26.080329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:26.080602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] PATH_INFO: `/v3/users/2d22cd748692410bb1d4219aaa4c093c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:26.092902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d22cd748692410bb1d4219aaa4c093c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:26.094906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:26.137913 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d22cd748692410bb1d4219aaa4c093c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.144692 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d22cd748692410bb1d4219aaa4c093c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.145335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d22cd748692410bb1d4219aaa4c093c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.145938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d22cd748692410bb1d4219aaa4c093c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.153104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d22cd748692410bb1d4219aaa4c093c'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.170482 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4307/8637] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:22:26 2022] DELETE /identity/v3/users/2d22cd748692410bb1d4219aaa4c093c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:22:26.340057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:26.342144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:26.357099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaa1ba-9730-42b7-aa8f-dc9365a3d076 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:26.412967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:26.413819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:26.414104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:26.414379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] PATH_INFO: `/v3/projects/4e3a459b2e514b998bffd4275d7bb847` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:26.425306 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3a459b2e514b998bffd4275d7bb847)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:26.427282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:26.471039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3a459b2e514b998bffd4275d7bb847', 'request_id': 'req-03854759-b03f-467d-bfa2-1b0d596ca5f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.477282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3a459b2e514b998bffd4275d7bb847', 'request_id': 'req-03854759-b03f-467d-bfa2-1b0d596ca5f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.484591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3a459b2e514b998bffd4275d7bb847', 'request_id': 'req-03854759-b03f-467d-bfa2-1b0d596ca5f5'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.494513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] The token cache is being invalidate because project 4e3a459b2e514b998bffd4275d7bb847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:22:26.494831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.495473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:26.497062 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4331/8638] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:22:26 2022] DELETE /identity/v3/projects/4e3a459b2e514b998bffd4275d7bb847 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:22:51.899718 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:51.901169 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:51.986467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341c834-f4b3-4841-a207-f902c5453cd5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:52.058909 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:52.059620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:52.059904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:52.060183 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:52.062254 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:52.078559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:52.080382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:52.098547 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4308/8639] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:22:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:22:53.022390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:53.023864 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:53.085157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03854759-b03f-467d-bfa2-1b0d596ca5f5 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:53.088750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e861b-d05b-4f8d-89c1-1a058e9e02c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:53.090064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e861b-d05b-4f8d-89c1-1a058e9e02c0 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:53.090520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e861b-d05b-4f8d-89c1-1a058e9e02c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:53.090820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e861b-d05b-4f8d-89c1-1a058e9e02c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:53.092685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a2e861b-d05b-4f8d-89c1-1a058e9e02c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:53.105122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e861b-d05b-4f8d-89c1-1a058e9e02c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:53.107530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e861b-d05b-4f8d-89c1-1a058e9e02c0 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:53.120003 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4332/8640] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:22:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:22:58.965887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:58.967391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:59.041324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542d50bc-bf64-4fed-822b-9234851d6759 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:59.045984 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:59.046880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:59.047166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:59.047440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] PATH_INFO: `/v3/users/aeee01bf990e46bfa331c1cd93528cab` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:59.048711 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeee01bf990e46bfa331c1cd93528cab)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:59.050652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:59.104470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeee01bf990e46bfa331c1cd93528cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.111268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeee01bf990e46bfa331c1cd93528cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.111937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeee01bf990e46bfa331c1cd93528cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.112538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeee01bf990e46bfa331c1cd93528cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.119440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeee01bf990e46bfa331c1cd93528cab'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.135724 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4309/8641] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:22:58 2022] DELETE /identity/v3/users/aeee01bf990e46bfa331c1cd93528cab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:22:59.140791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:59.141279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:59.141391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:59.158635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:22:59.159865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:59.220767 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4333/8642] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:22:59.230438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:59.231989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:59.292207 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251b48b-98b8-429b-88d0-2f976835d98f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:59.295952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:59.296668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:59.297083 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:59.297367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:59.307043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:59.309078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:59.319012 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4310/8643] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:22:59.497460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:59.498912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:59.510831 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c555d51-3c5d-45b3-ae71-9c6e667f961d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:59.519126 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:59.520011 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:59.520282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:59.520558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] PATH_INFO: `/v3/projects/16812b38c4514406886f0ab13cabe8ad` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:59.521754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=16812b38c4514406886f0ab13cabe8ad)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:59.523882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:59.570722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16812b38c4514406886f0ab13cabe8ad', 'request_id': 'req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.577433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16812b38c4514406886f0ab13cabe8ad', 'request_id': 'req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.584374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16812b38c4514406886f0ab13cabe8ad', 'request_id': 'req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.594341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] The token cache is being invalidate because project 16812b38c4514406886f0ab13cabe8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:22:59.594683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.595292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.596865 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4334/8644] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:22:59 2022] DELETE /identity/v3/projects/16812b38c4514406886f0ab13cabe8ad => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:22:59.600929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:59.611317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6ba75-b5af-486b-aae2-30c40601a481 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:22:59.671412 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:22:59.672220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:22:59.672507 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:22:59.672785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] PATH_INFO: `/v3/users/89531afef5cb418ba1f03c733b07816d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:22:59.674393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89531afef5cb418ba1f03c733b07816d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:22:59.679381 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:22:59.723249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89531afef5cb418ba1f03c733b07816d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.730417 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89531afef5cb418ba1f03c733b07816d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.731097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89531afef5cb418ba1f03c733b07816d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.731713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89531afef5cb418ba1f03c733b07816d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.738316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-3fbb8d7d-e3fd-44c4-9621-933fc74e75e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89531afef5cb418ba1f03c733b07816d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:22:59.755981 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4311/8645] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:22:59 2022] DELETE /identity/v3/users/89531afef5cb418ba1f03c733b07816d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:22:59.931091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:22:59.932579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:22:59.946106 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477d3a7-b1fc-46ae-bde2-e60d984bd20c admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:00.009381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:00.010924 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:00.012048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:00.012547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] PATH_INFO: `/v3/projects/5eeb6b6f47ee48bb9910c2053c218c5f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:00.014132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eeb6b6f47ee48bb9910c2053c218c5f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:00.017243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:00.063861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eeb6b6f47ee48bb9910c2053c218c5f', 'request_id': 'req-51d117d3-3692-461d-b747-9406a9f0d9a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:00.070021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eeb6b6f47ee48bb9910c2053c218c5f', 'request_id': 'req-51d117d3-3692-461d-b747-9406a9f0d9a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:00.078189 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eeb6b6f47ee48bb9910c2053c218c5f', 'request_id': 'req-51d117d3-3692-461d-b747-9406a9f0d9a9'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:00.088624 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] The token cache is being invalidate because project 5eeb6b6f47ee48bb9910c2053c218c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:23:00.088943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:00.089579 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-51d117d3-3692-461d-b747-9406a9f0d9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:00.091207 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4335/8646] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:22:59 2022] DELETE /identity/v3/projects/5eeb6b6f47ee48bb9910c2053c218c5f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:09.954533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e0853-67aa-4b20-8b51-7734fa3bf758 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:09.955121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e0853-67aa-4b20-8b51-7734fa3bf758 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:09.955121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e0853-67aa-4b20-8b51-7734fa3bf758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:09.973523 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-262e0853-67aa-4b20-8b51-7734fa3bf758 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:09.974700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-262e0853-67aa-4b20-8b51-7734fa3bf758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:10.030616 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4312/8647] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:10.041431 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb427a-37ba-4f5a-b452-22fd4bd19b05 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.042025 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb427a-37ba-4f5a-b452-22fd4bd19b05 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.042144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb427a-37ba-4f5a-b452-22fd4bd19b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.061601 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-43eb427a-37ba-4f5a-b452-22fd4bd19b05 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:10.062804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-43eb427a-37ba-4f5a-b452-22fd4bd19b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:10.070963 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4336/8648] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:10.076159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e0853-67aa-4b20-8b51-7734fa3bf758 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.085609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e0853-67aa-4b20-8b51-7734fa3bf758 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.090249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.091485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.091769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.092046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.092762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:23:10.093067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.094671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.105916 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4313/8649] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:23:10.114158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb427a-37ba-4f5a-b452-22fd4bd19b05 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.123351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb427a-37ba-4f5a-b452-22fd4bd19b05 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.128069 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.128718 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.129001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.129276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.129952 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.131889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.169573 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4337/8650] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:23:10 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:23:10.173751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.183530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e199-7171-40b6-9da2-ea90bc8ebaff admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.239883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.240562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.240848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.241157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.241838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.243841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.263249 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4314/8651] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:23:10 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:23:10.267297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.277394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f79b-a362-42ef-a1c2-81c5a99e33e2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.282711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.283397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.283691 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.283969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.284687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.286287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.296236 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4338/8652] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:23:10.299997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.309667 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f092c-efb0-49e0-9431-b1c6d4021f0c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.314192 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff87e3e-df40-4412-b1f5-1f9e92fe4d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.314864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87e3e-df40-4412-b1f5-1f9e92fe4d76 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.315144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87e3e-df40-4412-b1f5-1f9e92fe4d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.315421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff87e3e-df40-4412-b1f5-1f9e92fe4d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.316125 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff87e3e-df40-4412-b1f5-1f9e92fe4d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.317702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff87e3e-df40-4412-b1f5-1f9e92fe4d76 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.327725 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4315/8653] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:23:10.331677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.342068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36838a-b8eb-4d33-8827-63d96bb7f0d6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.346686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.347594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.347875 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.348149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] PATH_INFO: `/v3/projects/b72b3d9fbb75435bbea655f49329ad94/users/30f6e56e1b944bf7affeeecf22b39218/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.362491 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72b3d9fbb75435bbea655f49329ad94, user_id=30f6e56e1b944bf7affeeecf22b39218, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.365203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.377695 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4339/8654] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:23:10 2022] PUT /identity/v3/projects/b72b3d9fbb75435bbea655f49329ad94/users/30f6e56e1b944bf7affeeecf22b39218/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:10.389447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbcf73-a147-41a4-a834-3af3d6c1bdf7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.389742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbcf73-a147-41a4-a834-3af3d6c1bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.390020 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbcf73-a147-41a4-a834-3af3d6c1bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.416585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ccfbcf73-a147-41a4-a834-3af3d6c1bdf7 None None] MFA Rules not processed for user `30f6e56e1b944bf7affeeecf22b39218`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:10.417790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ccfbcf73-a147-41a4-a834-3af3d6c1bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:10.486619 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4316/8655] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:10.491211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.550422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30449ac-1dbe-41a1-8832-a8de4fe57959 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.555168 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.555817 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.556101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.556375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.557055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.559514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.589553 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4340/8656] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:23:10 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:23:10.593726 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbcf73-a147-41a4-a834-3af3d6c1bdf7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.605495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbcf73-a147-41a4-a834-3af3d6c1bdf7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.663418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.663834 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.664113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.664384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.665072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.667293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.688621 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4317/8657] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:23:10 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:23:10.692662 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.703527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5debfe-c1a8-4645-9682-8c5934c0eb6b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.711787 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.712455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.712744 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.713029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.713751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.715463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.726831 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4341/8658] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:23:10.731022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.741317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dd0d9-13a4-4d89-8654-9a385d7b1973 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.747618 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.748487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.748763 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.749028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] PATH_INFO: `/v3/projects/0a46c3500bad44c4ba2f968f1ea14486/users/ed3fb8431bc54bdda8acf0d19c6407da/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.765453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a46c3500bad44c4ba2f968f1ea14486, user_id=ed3fb8431bc54bdda8acf0d19c6407da, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.768244 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.781062 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4318/8659] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:23:10 2022] PUT /identity/v3/projects/0a46c3500bad44c4ba2f968f1ea14486/users/ed3fb8431bc54bdda8acf0d19c6407da/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:10.786208 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.797469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66d170-d300-4923-9b6d-9178adfd0cd6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.857569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45467e-3f25-41be-89a0-325fa62d4876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.858279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45467e-3f25-41be-89a0-325fa62d4876 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.858560 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45467e-3f25-41be-89a0-325fa62d4876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.858863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45467e-3f25-41be-89a0-325fa62d4876 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.859575 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45467e-3f25-41be-89a0-325fa62d4876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.861167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45467e-3f25-41be-89a0-325fa62d4876 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.872594 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4342/8660] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:23:10.876941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:10.888427 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab6193-295a-425c-a840-be00aa963b1c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:10.893288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770970da-8ecc-4aec-9d6e-f4372d6e2986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:10.894157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770970da-8ecc-4aec-9d6e-f4372d6e2986 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.894438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770970da-8ecc-4aec-9d6e-f4372d6e2986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.894824 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770970da-8ecc-4aec-9d6e-f4372d6e2986 admin admin] PATH_INFO: `/v3/projects/0a46c3500bad44c4ba2f968f1ea14486/users/ed3fb8431bc54bdda8acf0d19c6407da/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.896983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770970da-8ecc-4aec-9d6e-f4372d6e2986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a46c3500bad44c4ba2f968f1ea14486, user_id=ed3fb8431bc54bdda8acf0d19c6407da, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:10.899805 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770970da-8ecc-4aec-9d6e-f4372d6e2986 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:10.910474 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4319/8661] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:23:10 2022] PUT /identity/v3/projects/0a46c3500bad44c4ba2f968f1ea14486/users/ed3fb8431bc54bdda8acf0d19c6407da/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:23:10.922513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:10.922839 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:10.923130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:10.954799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] MFA Rules not processed for user `ed3fb8431bc54bdda8acf0d19c6407da`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:10.956044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:11.033769 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4343/8662] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:11.048202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:11.048733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:11.048733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:11.066308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] MFA Rules not processed for user `30f6e56e1b944bf7affeeecf22b39218`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:11.067662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:11.126020 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4320/8663] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:11.139675 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:11.141136 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:11.224220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a05411-ec26-4e68-99fc-7049d72046a8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:11.230628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:11.231309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:11.231600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:11.231881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:11.239910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:11.241516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:11.251512 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4344/8664] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:11.722332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:11.723877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:11.799126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce35d3-9662-4f07-accd-bde01da56116 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:11.804352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:11.805038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:11.805324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:11.805603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:11.807492 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:11.822185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:11.823852 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:11.836600 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4321/8665] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:19.961030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:19.975591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb1a8e-646e-4acd-9905-fc66fc4e0582 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:19.981159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c4844-b9cd-4eef-a998-e616ff99c9e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:19.981802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4844-b9cd-4eef-a998-e616ff99c9e2 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:19.982085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4844-b9cd-4eef-a998-e616ff99c9e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:19.982360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c4844-b9cd-4eef-a998-e616ff99c9e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:19.984232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de2c4844-b9cd-4eef-a998-e616ff99c9e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:19.999006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c4844-b9cd-4eef-a998-e616ff99c9e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:20.000528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c4844-b9cd-4eef-a998-e616ff99c9e2 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:20.013743 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4345/8666] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:22.238862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:22.240352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:22.258287 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66d4c6-2457-4aec-b4c8-f382d1854369 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:22.263701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:22.264341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:22.264880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:22.265173 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:22.273195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:22.274817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:22.284259 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4322/8667] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:22.298641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384af89-2886-4ee0-a1ac-922a0b9c7a0d None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:22.299109 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384af89-2886-4ee0-a1ac-922a0b9c7a0d None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:22.299243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384af89-2886-4ee0-a1ac-922a0b9c7a0d None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:22.300637 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4346/8668] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:23:22.306300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] Authenticating service token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 22:23:22.320532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:22.328498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932ad1a-365e-43d6-8fc6-76f634fb4ec2 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:22.333038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb0d3-6466-4e4c-8bc3-bea9040a1ac4 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3fb8431bc54bdda8acf0d19c6407da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a46c3500bad44c4ba2f968f1ea14486', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:22.333875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb0d3-6466-4e4c-8bc3-bea9040a1ac4 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:22.334157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb0d3-6466-4e4c-8bc3-bea9040a1ac4 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:22.334430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb0d3-6466-4e4c-8bc3-bea9040a1ac4 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] PATH_INFO: `/v3/projects/0a46c3500bad44c4ba2f968f1ea14486` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:22.335634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeb0d3-6466-4e4c-8bc3-bea9040a1ac4 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a46c3500bad44c4ba2f968f1ea14486)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:22.337409 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeb0d3-6466-4e4c-8bc3-bea9040a1ac4 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:22.339105 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4323/8669] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 22:23:22 2022] GET /identity/v3/projects/0a46c3500bad44c4ba2f968f1ea14486 => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:23:22.488853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384af89-2886-4ee0-a1ac-922a0b9c7a0d None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:22.490541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d384af89-2886-4ee0-a1ac-922a0b9c7a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:22.549449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384af89-2886-4ee0-a1ac-922a0b9c7a0d None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:22.552938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:22.553590 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:22.553878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:22.554159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:22.555931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:22.567630 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:22.569064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:22.579308 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4347/8670] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:22.724713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7f88-1f5e-475f-bef4-69567d5a0429 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:22.725001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7f88-1f5e-475f-bef4-69567d5a0429 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:22.725280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d7f88-1f5e-475f-bef4-69567d5a0429 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:22.726856 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4324/8671] 10.222.0.32 () {54 vars in 912 bytes} [Sat May 7 22:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:23:22.731299 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] Authenticating service token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} May 07 22:23:22.747482 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:22.756699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575e67f-5752-4a64-a6c6-1e9b8b71ca8d service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:22.761333 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4d07b-3f13-4224-89dc-18393b6b34f1 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3fb8431bc54bdda8acf0d19c6407da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a46c3500bad44c4ba2f968f1ea14486', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:22.762179 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d07b-3f13-4224-89dc-18393b6b34f1 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:22.762470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d07b-3f13-4224-89dc-18393b6b34f1 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:22.762752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d07b-3f13-4224-89dc-18393b6b34f1 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] PATH_INFO: `/v3/projects/0a46c3500bad44c4ba2f968f1ea14486` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:22.764488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4d07b-3f13-4224-89dc-18393b6b34f1 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a46c3500bad44c4ba2f968f1ea14486)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:22.766287 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4d07b-3f13-4224-89dc-18393b6b34f1 tempest-ServersAdminNegativeTestJSON-1809507495 tempest-ServersAdminNegativeTestJSON-1809507495-project-admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:22.768006 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4348/8672] 10.222.0.32 () {58 vars in 1443 bytes} [Sat May 7 22:23:22 2022] GET /identity/v3/projects/0a46c3500bad44c4ba2f968f1ea14486 => generated 393 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:23:25.537520 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d7f88-1f5e-475f-bef4-69567d5a0429 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:25.600481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d7f88-1f5e-475f-bef4-69567d5a0429 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:25.605029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:25.605890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:25.606175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:25.606459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] PATH_INFO: `/v3/users/30f6e56e1b944bf7affeeecf22b39218` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:25.607687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f6e56e1b944bf7affeeecf22b39218)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:25.609628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:25.652219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f6e56e1b944bf7affeeecf22b39218'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:25.658843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f6e56e1b944bf7affeeecf22b39218'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:25.659513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f6e56e1b944bf7affeeecf22b39218'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:25.660139 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f6e56e1b944bf7affeeecf22b39218'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:25.666645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f6e56e1b944bf7affeeecf22b39218'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:25.683060 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4325/8673] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:23:25 2022] DELETE /identity/v3/users/30f6e56e1b944bf7affeeecf22b39218 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:25.688021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:25.688490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:25.688618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:25.706159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:25.707391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:25.762947 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4349/8674] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:25.773056 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:25.774479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:25.832916 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef791c9c-5f2f-481e-bf48-7ea8626275f0 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:25.836548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:25.837187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:25.837467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:25.837741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:25.846561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:25.848026 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:25.858562 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4326/8675] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:26.023688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:26.025280 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:26.037460 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f340abe-54dc-4153-835b-62e498246b48 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:26.042506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:26.043399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.043682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.043964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] PATH_INFO: `/v3/projects/b72b3d9fbb75435bbea655f49329ad94` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.045669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72b3d9fbb75435bbea655f49329ad94)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:26.047636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:26.093854 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72b3d9fbb75435bbea655f49329ad94', 'request_id': 'req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.099738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72b3d9fbb75435bbea655f49329ad94', 'request_id': 'req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.106887 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72b3d9fbb75435bbea655f49329ad94', 'request_id': 'req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.117217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] The token cache is being invalidate because project b72b3d9fbb75435bbea655f49329ad94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:23:26.117506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.118137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.119760 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4350/8676] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:23:26 2022] DELETE /identity/v3/projects/b72b3d9fbb75435bbea655f49329ad94 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:26.124402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:26.133962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406d0c-c0c7-4c65-87e8-f9fd511e9d82 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:26.188337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:26.189206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.189491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.189770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] PATH_INFO: `/v3/users/ed3fb8431bc54bdda8acf0d19c6407da` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.190983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3fb8431bc54bdda8acf0d19c6407da)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:26.192927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:26.238140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3fb8431bc54bdda8acf0d19c6407da'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.244636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3fb8431bc54bdda8acf0d19c6407da'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.245296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3fb8431bc54bdda8acf0d19c6407da'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.245901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3fb8431bc54bdda8acf0d19c6407da'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.256202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-43cd3260-4bd8-46e7-88f5-8d659b300f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3fb8431bc54bdda8acf0d19c6407da'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.272855 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4327/8677] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:23:26 2022] DELETE /identity/v3/users/ed3fb8431bc54bdda8acf0d19c6407da => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:26.544423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:26.547092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:26.560721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f0c9d-ae08-4203-b4e1-ab6b473d8ff0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:26.616859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:26.617716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.617999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.618268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] PATH_INFO: `/v3/projects/0a46c3500bad44c4ba2f968f1ea14486` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.619462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a46c3500bad44c4ba2f968f1ea14486)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:26.621391 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:26.666956 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a46c3500bad44c4ba2f968f1ea14486', 'request_id': 'req-379d2fa3-d266-472f-932a-df43e7ae1c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.673528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a46c3500bad44c4ba2f968f1ea14486', 'request_id': 'req-379d2fa3-d266-472f-932a-df43e7ae1c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.680652 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a46c3500bad44c4ba2f968f1ea14486', 'request_id': 'req-379d2fa3-d266-472f-932a-df43e7ae1c84'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.691308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] The token cache is being invalidate because project 0a46c3500bad44c4ba2f968f1ea14486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:23:26.691872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.692269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-379d2fa3-d266-472f-932a-df43e7ae1c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:23:26.693811 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4351/8678] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:23:26 2022] DELETE /identity/v3/projects/0a46c3500bad44c4ba2f968f1ea14486 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:26.699846 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154039b-3e0b-4a21-a90f-cdf9fd8a519e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.700318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154039b-3e0b-4a21-a90f-cdf9fd8a519e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.700449 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154039b-3e0b-4a21-a90f-cdf9fd8a519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.718476 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8154039b-3e0b-4a21-a90f-cdf9fd8a519e None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:26.719698 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8154039b-3e0b-4a21-a90f-cdf9fd8a519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:26.775621 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4328/8679] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:26.784026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5050-e191-4ba8-b1a3-e20807a1aeb0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.784313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5050-e191-4ba8-b1a3-e20807a1aeb0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.784588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5050-e191-4ba8-b1a3-e20807a1aeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.803258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6bfd5050-e191-4ba8-b1a3-e20807a1aeb0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:26.804388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6bfd5050-e191-4ba8-b1a3-e20807a1aeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:26.812919 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4352/8680] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:26.817115 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154039b-3e0b-4a21-a90f-cdf9fd8a519e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:26.826932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154039b-3e0b-4a21-a90f-cdf9fd8a519e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:26.831540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:26.832221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.832512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.832803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.833504 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:23:26.833810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:26.835465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:26.846759 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4329/8681] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:23:26.850911 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5050-e191-4ba8-b1a3-e20807a1aeb0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:26.861187 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5050-e191-4ba8-b1a3-e20807a1aeb0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:26.866086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:26.866739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.867055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.867334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.868046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:26.869999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:26.894693 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4353/8682] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:23:26 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:23:26.898749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:26.909097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b333cc-ae62-4170-b203-e4515a9d351b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:26.961854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:26.962513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:26.962819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:26.963101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:26.963783 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:26.965704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:26.985180 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4330/8683] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:23:26 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:23:26.989273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:26.999464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a4a8a-46e1-46b5-a194-9f96aea6abf9 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:27.004143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:27.004806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:27.005091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:27.005372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:27.006091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:27.007752 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:27.017876 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4354/8684] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:23:27.022017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:27.032542 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d647db5-98d0-4b64-abda-4c2181b286e2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:27.037175 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d746a-3db8-45ac-96a7-fe6e45e1b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:27.037821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d746a-3db8-45ac-96a7-fe6e45e1b34d admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:27.038100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d746a-3db8-45ac-96a7-fe6e45e1b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:27.038369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d746a-3db8-45ac-96a7-fe6e45e1b34d admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:27.039132 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d746a-3db8-45ac-96a7-fe6e45e1b34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:27.041007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d746a-3db8-45ac-96a7-fe6e45e1b34d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:27.051212 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4331/8685] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:23:27.055269 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:27.065005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651008e9-33ff-48fb-9e07-da38428756bb admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:27.069685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:27.070547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:27.070861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:27.071144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] PATH_INFO: `/v3/projects/55ed75dcd4ce4cb3a25250247e45159c/users/7c787a6b43bf4218a444fd63f4b706b1/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:27.085130 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ed75dcd4ce4cb3a25250247e45159c, user_id=7c787a6b43bf4218a444fd63f4b706b1, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:27.087857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:27.100768 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4355/8686] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:23:27 2022] PUT /identity/v3/projects/55ed75dcd4ce4cb3a25250247e45159c/users/7c787a6b43bf4218a444fd63f4b706b1/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:23:27.105750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb581a-17ad-4340-a0ce-4b72636bff16 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:27.106040 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb581a-17ad-4340-a0ce-4b72636bff16 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:27.106321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb581a-17ad-4340-a0ce-4b72636bff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:27.124239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-89eb581a-17ad-4340-a0ce-4b72636bff16 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:27.125410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-89eb581a-17ad-4340-a0ce-4b72636bff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:27.180578 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4332/8687] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:23:27.190173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:27.191942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:27.250543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de056a-4f3b-4905-9e56-ca337422f423 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:27.254186 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead4a3-0f23-4f28-8d9f-a48931af6614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:27.254861 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead4a3-0f23-4f28-8d9f-a48931af6614 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:27.255149 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead4a3-0f23-4f28-8d9f-a48931af6614 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:27.255428 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead4a3-0f23-4f28-8d9f-a48931af6614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:27.265169 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead4a3-0f23-4f28-8d9f-a48931af6614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:27.266856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead4a3-0f23-4f28-8d9f-a48931af6614 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:27.276381 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4356/8688] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:23:27.887255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:27.887732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:27.887861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:27.914218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] MFA Rules not processed for user `7c787a6b43bf4218a444fd63f4b706b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:27.915926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:27.981858 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4333/8689] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:27.993533 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93a7ec-2fb6-4d7d-94e9-2ddd4d39dd28 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:27.994087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93a7ec-2fb6-4d7d-94e9-2ddd4d39dd28 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:27.994087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93a7ec-2fb6-4d7d-94e9-2ddd4d39dd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:28.010953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-9d93a7ec-2fb6-4d7d-94e9-2ddd4d39dd28 None None] MFA Rules not processed for user `7c787a6b43bf4218a444fd63f4b706b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:28.012150 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9d93a7ec-2fb6-4d7d-94e9-2ddd4d39dd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:28.019600 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4357/8690] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:23:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:23:28.031686 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:28.033074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:28.108235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaefda-b25e-43e6-b3d9-dcce6b05aa72 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:28.113704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8075d-724a-42a6-8729-78875b85327c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:28.114346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8075d-724a-42a6-8729-78875b85327c service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:28.114628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8075d-724a-42a6-8729-78875b85327c service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:28.114940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8075d-724a-42a6-8729-78875b85327c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:28.122487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8075d-724a-42a6-8729-78875b85327c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:28.124136 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8075d-724a-42a6-8729-78875b85327c service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:28.132697 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4334/8691] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:38.656558 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf83e-87b5-48da-8d01-b42606a81e2a None None] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:38.657164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf83e-87b5-48da-8d01-b42606a81e2a None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:38.657337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf83e-87b5-48da-8d01-b42606a81e2a None None] PATH_INFO: `/` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:38.659117 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4358/8692] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:23:38.667145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:38.667679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:38.667791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:38.685735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:23:38.686997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:38.749433 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4335/8693] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:23:38.769863 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf83e-87b5-48da-8d01-b42606a81e2a None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:38.771559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3fcf83e-87b5-48da-8d01-b42606a81e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:38.791567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf83e-87b5-48da-8d01-b42606a81e2a None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:38.796704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:38.797340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:38.797626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:38.797912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:38.806373 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:38.808006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:38.817889 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4359/8694] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:23:38.972202 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:23:38.973622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:38.987311 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e02e9-bbce-4302-88d3-736cd694ddcd None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:23:38.990851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:23:38.991481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:23:38.991765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:23:38.992038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:23:38.993682 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:23:39.009337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:23:39.010695 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:23:39.025017 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4336/8695] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:23:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:24:02.334268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:02.347095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce23e4-1a8a-423b-98b5-ead3a75ba5e4 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:02.352026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:02.352677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:02.352961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:02.353231 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:02.354978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:02.373233 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:02.375354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:02.387530 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4360/8696] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:24:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:24:07.548333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:07.563511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d88eef-2118-410e-a906-11d675078ca4 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:07.569145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:07.569825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:07.570110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:07.570387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:07.572193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:07.587029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:07.588633 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:07.602042 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4337/8697] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:24:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:24:14.940203 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:14.951835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff53b8-98ea-4b2c-8518-efbff1d9fdd8 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:14.957204 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:14.958125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:14.958541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:14.958872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] PATH_INFO: `/v3/users/7c787a6b43bf4218a444fd63f4b706b1` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:14.960094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c787a6b43bf4218a444fd63f4b706b1)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:14.962036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.008656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c787a6b43bf4218a444fd63f4b706b1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.009229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c787a6b43bf4218a444fd63f4b706b1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.015837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c787a6b43bf4218a444fd63f4b706b1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.016474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c787a6b43bf4218a444fd63f4b706b1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.023810 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-d60fac1a-3f65-4aa0-afb6-796356a7e355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c787a6b43bf4218a444fd63f4b706b1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.040509 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4361/8698] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:24:14 2022] DELETE /identity/v3/users/7c787a6b43bf4218a444fd63f4b706b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:24:15.211845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.223945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b7502-ea0d-4ca8-9292-47288accf860 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.278716 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.279538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.279819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.280088 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] PATH_INFO: `/v3/projects/55ed75dcd4ce4cb3a25250247e45159c` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.281297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ed75dcd4ce4cb3a25250247e45159c)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.283264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.331308 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ed75dcd4ce4cb3a25250247e45159c', 'request_id': 'req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.339310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ed75dcd4ce4cb3a25250247e45159c', 'request_id': 'req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.350435 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ed75dcd4ce4cb3a25250247e45159c', 'request_id': 'req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.360856 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] The token cache is being invalidate because project 55ed75dcd4ce4cb3a25250247e45159c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:24:15.361134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.361756 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-eb08f54e-9b0c-411e-a73b-1533a78c8a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:24:15.363453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4338/8699] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:24:15 2022] DELETE /identity/v3/projects/55ed75dcd4ce4cb3a25250247e45159c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:24:15.368448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5b81-c879-49d5-932a-985163a6f91b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.368835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5b81-c879-49d5-932a-985163a6f91b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.369114 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5b81-c879-49d5-932a-985163a6f91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.387218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-badd5b81-c879-49d5-932a-985163a6f91b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:24:15.388422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-badd5b81-c879-49d5-932a-985163a6f91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:15.447507 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4362/8700] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:24:15.456948 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96d20-7266-4da6-9eb3-051015bc9e5d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.457239 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96d20-7266-4da6-9eb3-051015bc9e5d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.457548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96d20-7266-4da6-9eb3-051015bc9e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.475750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-41f96d20-7266-4da6-9eb3-051015bc9e5d None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:24:15.476947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-41f96d20-7266-4da6-9eb3-051015bc9e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:15.484793 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4339/8701] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:24:15.488959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd5b81-c879-49d5-932a-985163a6f91b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.498534 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd5b81-c879-49d5-932a-985163a6f91b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.503840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.504494 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.504779 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.505056 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.505776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:24:15.506082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.507784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.519604 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4363/8702] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:24:15.523713 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f96d20-7266-4da6-9eb3-051015bc9e5d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.532668 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f96d20-7266-4da6-9eb3-051015bc9e5d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.537227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.537869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.538151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.538423 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.539146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.541325 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.565182 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4340/8703] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:24:15 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:24:15.569317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.579609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57b703-8a5a-498d-9e3a-d5ba14219f1e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.637402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.638071 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.638352 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.638627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.639350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.641329 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.664084 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4364/8704] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:24:15 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:24:15.665583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.676384 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10162a-7a67-430a-b4b7-3c37bbe921b2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.681038 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.681693 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.681979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.682258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.683243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.684685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.695512 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4341/8705] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:24:15.699573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.709799 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228b3a-076e-4090-816b-ebbbd408f653 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.714455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bca2c5-2de0-4ae4-8247-28bc8ef40fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.715134 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bca2c5-2de0-4ae4-8247-28bc8ef40fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.715420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bca2c5-2de0-4ae4-8247-28bc8ef40fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.715697 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bca2c5-2de0-4ae4-8247-28bc8ef40fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.716508 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bca2c5-2de0-4ae4-8247-28bc8ef40fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.718828 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bca2c5-2de0-4ae4-8247-28bc8ef40fa2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.728508 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4365/8706] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:24:15.732495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.742211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51072786-3978-4e1d-bd1b-b791c0b738c5 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.746855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.747747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.748028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.748299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] PATH_INFO: `/v3/projects/ce6f4e2c33bb4c6d98d8b89b302d2b2a/users/b49d5a27410a4d1cb7c0f63db60a9036/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.762062 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce6f4e2c33bb4c6d98d8b89b302d2b2a, user_id=b49d5a27410a4d1cb7c0f63db60a9036, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.764754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.778079 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4342/8707] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:24:15 2022] PUT /identity/v3/projects/ce6f4e2c33bb4c6d98d8b89b302d2b2a/users/b49d5a27410a4d1cb7c0f63db60a9036/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:24:15.783741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85521-e8fc-4e9c-aadd-cbfb903bbce1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.783986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85521-e8fc-4e9c-aadd-cbfb903bbce1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.784267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85521-e8fc-4e9c-aadd-cbfb903bbce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.801871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-00b85521-e8fc-4e9c-aadd-cbfb903bbce1 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:24:15.803084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-00b85521-e8fc-4e9c-aadd-cbfb903bbce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:15.860032 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4366/8708] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:24:15.869714 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:15.871450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:15.929600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb572c-5e20-4f19-ac42-fa2dc46d7d64 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:15.933313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42562992-01ed-4a87-97ec-568e3bfc9602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:15.933951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562992-01ed-4a87-97ec-568e3bfc9602 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:15.934236 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562992-01ed-4a87-97ec-568e3bfc9602 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:15.934513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42562992-01ed-4a87-97ec-568e3bfc9602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:15.943398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562992-01ed-4a87-97ec-568e3bfc9602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:15.944826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42562992-01ed-4a87-97ec-568e3bfc9602 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:15.954561 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4343/8709] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:24:16.595712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:16.596496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:16.596496 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:16.632074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] MFA Rules not processed for user `b49d5a27410a4d1cb7c0f63db60a9036`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:24:16.633307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:16.712377 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4367/8710] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:24:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:24:16.723090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:16.723654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:16.723654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:16.740927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] MFA Rules not processed for user `b49d5a27410a4d1cb7c0f63db60a9036`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:24:16.742388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:16.749800 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4344/8711] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:24:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:24:16.761833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:16.763300 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:16.838656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b9626-c87e-4f00-99cf-a5667ef3b43c None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:16.844173 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:16.844819 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:16.845100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:16.845374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:16.853101 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:16.854629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:16.863371 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4368/8712] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:24:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:24:17.846828 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:17.848256 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:17.919229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eb5e4-0075-4179-aa04-f08af378009e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:17.924777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3d432-6832-4f8c-8e7b-e0965dadb70e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:17.925433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d432-6832-4f8c-8e7b-e0965dadb70e service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:17.925720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d432-6832-4f8c-8e7b-e0965dadb70e service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:17.926003 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d432-6832-4f8c-8e7b-e0965dadb70e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:17.927780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-86f3d432-6832-4f8c-8e7b-e0965dadb70e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:17.942146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d432-6832-4f8c-8e7b-e0965dadb70e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:17.943697 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d432-6832-4f8c-8e7b-e0965dadb70e service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:17.956823 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4345/8713] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:24:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:24:26.650334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:26.651824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:26.666820 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f99e-c011-498b-997e-b0ef5a5f9162 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:26.670495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc6237-e21b-4e1b-a1bc-e4d8e6d62964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:26.671151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6237-e21b-4e1b-a1bc-e4d8e6d62964 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:26.671629 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6237-e21b-4e1b-a1bc-e4d8e6d62964 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:26.671870 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6237-e21b-4e1b-a1bc-e4d8e6d62964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:26.673809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-74fc6237-e21b-4e1b-a1bc-e4d8e6d62964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:26.689377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc6237-e21b-4e1b-a1bc-e4d8e6d62964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:26.691080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc6237-e21b-4e1b-a1bc-e4d8e6d62964 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:26.702162 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4369/8714] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:24:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:24:26.777872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784813-c9d4-49f9-ac41-a48d71569b44 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:26.778398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784813-c9d4-49f9-ac41-a48d71569b44 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:26.778512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784813-c9d4-49f9-ac41-a48d71569b44 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:26.779919 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4346/8715] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:24:26.784514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a790601-8d6d-44fd-9b1e-e26871a02fdc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:26.784892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a790601-8d6d-44fd-9b1e-e26871a02fdc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:26.785181 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a790601-8d6d-44fd-9b1e-e26871a02fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:26.803946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-4a790601-8d6d-44fd-9b1e-e26871a02fdc None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:24:26.805061 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a790601-8d6d-44fd-9b1e-e26871a02fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:24:26.814058 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4370/8716] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:24:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:24:26.834211 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8784813-c9d4-49f9-ac41-a48d71569b44 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:24:26.850199 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8784813-c9d4-49f9-ac41-a48d71569b44 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:24:26.855172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444d34b-5b45-4143-a837-dd9d4ffba677 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:24:26.855809 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444d34b-5b45-4143-a837-dd9d4ffba677 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:24:26.856096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444d34b-5b45-4143-a837-dd9d4ffba677 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:24:26.856376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444d34b-5b45-4143-a837-dd9d4ffba677 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:24:26.866042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444d34b-5b45-4143-a837-dd9d4ffba677 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:24:26.867654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444d34b-5b45-4143-a837-dd9d4ffba677 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:24:26.877970 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4347/8717] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:24:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:25:00.778182 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9c99-c580-43e7-a2f5-e6bda5c52fe5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:00.778741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9c99-c580-43e7-a2f5-e6bda5c52fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:00.778741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9c99-c580-43e7-a2f5-e6bda5c52fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:00.799897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-d9bc9c99-c580-43e7-a2f5-e6bda5c52fe5 None None] MFA Rules not processed for user `b49d5a27410a4d1cb7c0f63db60a9036`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:25:00.799897 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-d9bc9c99-c580-43e7-a2f5-e6bda5c52fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:00.806477 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4371/8718] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:25:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:25:12.389159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541adec-08a0-455a-a90e-af50970ddef0 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:12.389751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541adec-08a0-455a-a90e-af50970ddef0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:12.389751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541adec-08a0-455a-a90e-af50970ddef0 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:12.391168 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4348/8719] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:25:12.396704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade44a-e477-4efa-b2e0-6e4dd88c8f28 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:12.397184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade44a-e477-4efa-b2e0-6e4dd88c8f28 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:12.397407 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade44a-e477-4efa-b2e0-6e4dd88c8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:12.417789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-f5ade44a-e477-4efa-b2e0-6e4dd88c8f28 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:25:12.419055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f5ade44a-e477-4efa-b2e0-6e4dd88c8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:12.429532 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4372/8720] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:25:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:25:12.453502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541adec-08a0-455a-a90e-af50970ddef0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:12.455243 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b541adec-08a0-455a-a90e-af50970ddef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:12.475324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541adec-08a0-455a-a90e-af50970ddef0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:12.480306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:12.480944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:12.481225 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:12.481499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:12.489731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:12.491352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:12.500838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4349/8721] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:25:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:25:49.228074 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ade44a-e477-4efa-b2e0-6e4dd88c8f28 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:49.248893 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ade44a-e477-4efa-b2e0-6e4dd88c8f28 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:49.253945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:49.254867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.255175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.255445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] PATH_INFO: `/v3/users/b49d5a27410a4d1cb7c0f63db60a9036` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.257148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49d5a27410a4d1cb7c0f63db60a9036)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:49.259125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:49.304951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49d5a27410a4d1cb7c0f63db60a9036'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.305693 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49d5a27410a4d1cb7c0f63db60a9036'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.312304 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49d5a27410a4d1cb7c0f63db60a9036'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.312936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49d5a27410a4d1cb7c0f63db60a9036'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.320441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-fa48f3e1-69b4-4b96-ba93-671db488d5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49d5a27410a4d1cb7c0f63db60a9036'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.338006 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4373/8722] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:25:49 2022] DELETE /identity/v3/users/b49d5a27410a4d1cb7c0f63db60a9036 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:25:49.510902 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:49.521662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4414f9a-be8b-4c6c-b255-f2aad685a9da service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:49.577599 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:49.578454 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.578738 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.579049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] PATH_INFO: `/v3/projects/ce6f4e2c33bb4c6d98d8b89b302d2b2a` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.580227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce6f4e2c33bb4c6d98d8b89b302d2b2a)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:49.582140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:49.626391 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'request_id': 'req-be46dc9f-9699-4906-8cfd-27cca4da064d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.632864 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'request_id': 'req-be46dc9f-9699-4906-8cfd-27cca4da064d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.639949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce6f4e2c33bb4c6d98d8b89b302d2b2a', 'request_id': 'req-be46dc9f-9699-4906-8cfd-27cca4da064d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.650310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] The token cache is being invalidate because project ce6f4e2c33bb4c6d98d8b89b302d2b2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:25:49.650598 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.651265 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-be46dc9f-9699-4906-8cfd-27cca4da064d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:25:49.652801 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4350/8723] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:25:49 2022] DELETE /identity/v3/projects/ce6f4e2c33bb4c6d98d8b89b302d2b2a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:25:49.657980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d2ea7-33ac-488c-bb69-57ca38a87eed None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.658273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d2ea7-33ac-488c-bb69-57ca38a87eed None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.658569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d2ea7-33ac-488c-bb69-57ca38a87eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.676849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e63d2ea7-33ac-488c-bb69-57ca38a87eed None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:25:49.678547 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e63d2ea7-33ac-488c-bb69-57ca38a87eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:49.733771 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4374/8724] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:25:49.742098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b19c-e48c-4b82-bf0e-debc6fec70de None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.742388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b19c-e48c-4b82-bf0e-debc6fec70de None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.742665 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b19c-e48c-4b82-bf0e-debc6fec70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.761022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-6923b19c-e48c-4b82-bf0e-debc6fec70de None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:25:49.762075 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6923b19c-e48c-4b82-bf0e-debc6fec70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:49.769911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4351/8725] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:25:49.773957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d2ea7-33ac-488c-bb69-57ca38a87eed None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:49.783634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d2ea7-33ac-488c-bb69-57ca38a87eed None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:49.788202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:49.788845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.789131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.789408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.790155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:25:49.790461 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:49.792377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:49.804047 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4375/8726] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:25:49.808609 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923b19c-e48c-4b82-bf0e-debc6fec70de None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:49.817924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923b19c-e48c-4b82-bf0e-debc6fec70de None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:49.823302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:49.823950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.824238 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.824517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.825210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:49.827279 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:49.855743 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4352/8727] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:25:49 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:25:49.856858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:49.867469 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50993434-08e0-44b6-a226-fac92edfb622 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:49.922132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:49.922883 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.923175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.923457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.924141 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:49.926080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:49.945739 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4376/8728] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:25:49 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:25:49.949727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:49.960120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e2b04-0174-485a-bc7f-7eb4c25686df admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:49.964744 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:49.965397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.965680 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.965956 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:49.966671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:49.968298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:49.979138 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4353/8729] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:25:49.982992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:49.993628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dcb73-ce63-49a4-b840-c2b28fdee50a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:49.998335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f167e-f2f4-4c55-91cc-0831280d0972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:49.999028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f167e-f2f4-4c55-91cc-0831280d0972 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:49.999312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f167e-f2f4-4c55-91cc-0831280d0972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:49.999702 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f167e-f2f4-4c55-91cc-0831280d0972 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:50.000425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f167e-f2f4-4c55-91cc-0831280d0972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:50.002023 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f167e-f2f4-4c55-91cc-0831280d0972 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:50.012758 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4377/8730] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:25:50.016689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:50.026358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44beb90-2451-4630-b7bb-c6130d0ae431 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:50.031043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:50.031906 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:50.032187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:50.032461 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] PATH_INFO: `/v3/projects/697345bef14f49b0a7ffff78f8f90913/users/29f04b492fa34ec79228aeb116b422e0/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:50.047441 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] RBAC: Authorizing `identity:create_grant(project_id=697345bef14f49b0a7ffff78f8f90913, user_id=29f04b492fa34ec79228aeb116b422e0, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:50.050109 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:50.063343 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4354/8731] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:25:50 2022] PUT /identity/v3/projects/697345bef14f49b0a7ffff78f8f90913/users/29f04b492fa34ec79228aeb116b422e0/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:25:50.068570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa23a-d369-46c3-a970-5853cf9b7343 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:50.068874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa23a-d369-46c3-a970-5853cf9b7343 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:50.069152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6fa23a-d369-46c3-a970-5853cf9b7343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:50.085733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0a6fa23a-d369-46c3-a970-5853cf9b7343 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:25:50.086948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0a6fa23a-d369-46c3-a970-5853cf9b7343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:50.143564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4378/8732] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:25:50.153754 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:50.155500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:50.224469 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f934844-c371-4f6a-9537-13890346206b admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:50.228707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:50.229352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:50.229638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:50.229914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:50.239002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:50.240534 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:50.250683 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4355/8733] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:25:54.399077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaec4c-69f4-418d-ad82-2cfe78491725 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:54.399570 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaec4c-69f4-418d-ad82-2cfe78491725 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:54.399694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaec4c-69f4-418d-ad82-2cfe78491725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:54.430037 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-e3eaec4c-69f4-418d-ad82-2cfe78491725 None None] MFA Rules not processed for user `29f04b492fa34ec79228aeb116b422e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:25:54.431291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3eaec4c-69f4-418d-ad82-2cfe78491725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:54.514346 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4379/8734] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:25:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:25:54.526477 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:54.528063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:54.609733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3fc98-607f-4770-9224-165ffb634817 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:54.615108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:54.616326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:54.616606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:54.616884 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:54.625525 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:54.627221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:54.636723 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4356/8735] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:25:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:25:56.113235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:56.113777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:56.113777 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:56.132765 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] MFA Rules not processed for user `29f04b492fa34ec79228aeb116b422e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:25:56.133951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:56.141187 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4380/8736] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:25:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:25:59.066677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:25:59.079444 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6357f1-fd6b-42ab-91ca-b911c97a1a43 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:25:59.083145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3d2c3-55d5-49e4-83cb-5dd3f51f18a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:25:59.083838 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d2c3-55d5-49e4-83cb-5dd3f51f18a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:25:59.084212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d2c3-55d5-49e4-83cb-5dd3f51f18a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:25:59.084991 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3d2c3-55d5-49e4-83cb-5dd3f51f18a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:25:59.086833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-05c3d2c3-55d5-49e4-83cb-5dd3f51f18a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:25:59.102854 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3d2c3-55d5-49e4-83cb-5dd3f51f18a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:25:59.104288 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3d2c3-55d5-49e4-83cb-5dd3f51f18a2 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:25:59.126615 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4357/8737] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:25:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:26:01.545960 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:26:01.547512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:26:01.562555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffab52-e9ec-4527-aa48-b85b19f7d9f0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:26:01.566400 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e781e64-f810-4f32-a1e4-c068506d8760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:26:01.567080 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e781e64-f810-4f32-a1e4-c068506d8760 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:26:01.567363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e781e64-f810-4f32-a1e4-c068506d8760 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:26:01.567635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e781e64-f810-4f32-a1e4-c068506d8760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:26:01.569901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6e781e64-f810-4f32-a1e4-c068506d8760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:26:01.586144 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e781e64-f810-4f32-a1e4-c068506d8760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:26:01.587622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e781e64-f810-4f32-a1e4-c068506d8760 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:26:01.600930 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4381/8738] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:26:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:26:09.457168 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587d8a-f7b1-4a53-b8e0-bff85f2d43ea None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:26:09.457792 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587d8a-f7b1-4a53-b8e0-bff85f2d43ea None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:26:09.458516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67587d8a-f7b1-4a53-b8e0-bff85f2d43ea None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:26:09.460595 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4358/8739] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:26:09.465627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb1934-3a60-4aa8-9e6f-1cbfdbaac591 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:26:09.466115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb1934-3a60-4aa8-9e6f-1cbfdbaac591 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:26:09.466325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb1934-3a60-4aa8-9e6f-1cbfdbaac591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:26:09.494889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-14cb1934-3a60-4aa8-9e6f-1cbfdbaac591 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:26:09.495725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-14cb1934-3a60-4aa8-9e6f-1cbfdbaac591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:26:09.595261 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4382/8740] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:26:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:26:09.617216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67587d8a-f7b1-4a53-b8e0-bff85f2d43ea None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:26:09.619649 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-67587d8a-f7b1-4a53-b8e0-bff85f2d43ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:26:09.643343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67587d8a-f7b1-4a53-b8e0-bff85f2d43ea None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:26:09.649048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a0875-44eb-481b-9f0c-f4fd551b0e8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:26:09.649700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0875-44eb-481b-9f0c-f4fd551b0e8e service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:26:09.649986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0875-44eb-481b-9f0c-f4fd551b0e8e service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:26:09.650264 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a0875-44eb-481b-9f0c-f4fd551b0e8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:26:09.658929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a0875-44eb-481b-9f0c-f4fd551b0e8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:26:09.660515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a0875-44eb-481b-9f0c-f4fd551b0e8e service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:26:09.671285 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4359/8741] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:26:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:26:38.820980 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567d94-513f-4404-8655-7acf12912c4c None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:26:38.821512 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567d94-513f-4404-8655-7acf12912c4c None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:26:38.821625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58567d94-513f-4404-8655-7acf12912c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:26:38.839360 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-58567d94-513f-4404-8655-7acf12912c4c None None] MFA Rules not processed for user `29f04b492fa34ec79228aeb116b422e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:26:38.840585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-58567d94-513f-4404-8655-7acf12912c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:26:38.847493 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4383/8742] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:26:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:27:16.594299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c203-b52c-4d3b-93f5-edac3fd1851e None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:16.595050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c203-b52c-4d3b-93f5-edac3fd1851e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:16.595050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c203-b52c-4d3b-93f5-edac3fd1851e None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:16.596345 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4360/8743] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:27:16.601761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635262c3-361c-4601-8487-75b66f241806 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:16.602267 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635262c3-361c-4601-8487-75b66f241806 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:16.602458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635262c3-361c-4601-8487-75b66f241806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:16.662823 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-635262c3-361c-4601-8487-75b66f241806 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:27:16.664050 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-635262c3-361c-4601-8487-75b66f241806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:27:16.683105 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4384/8744] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:27:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:27:16.707559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0c203-b52c-4d3b-93f5-edac3fd1851e None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:27:16.709299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-46b0c203-b52c-4d3b-93f5-edac3fd1851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:27:16.732617 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0c203-b52c-4d3b-93f5-edac3fd1851e None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:27:16.738456 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880fcc8-b196-421d-bfdf-6ebb6400cd67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:27:16.739144 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880fcc8-b196-421d-bfdf-6ebb6400cd67 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:16.739430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880fcc8-b196-421d-bfdf-6ebb6400cd67 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:16.739707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880fcc8-b196-421d-bfdf-6ebb6400cd67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:16.748921 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880fcc8-b196-421d-bfdf-6ebb6400cd67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:27:16.750518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880fcc8-b196-421d-bfdf-6ebb6400cd67 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:27:16.760977 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4361/8745] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:27:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:27:20.183761 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635262c3-361c-4601-8487-75b66f241806 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:27:20.195725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635262c3-361c-4601-8487-75b66f241806 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:27:20.200041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:27:20.200737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:20.201473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:20.201473 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:20.203111 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:27:20.228592 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:27:20.230047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:27:20.240637 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4385/8746] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:27:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:27:30.446365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942493-1128-4d60-8ef1-897843ba499e None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:30.448023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942493-1128-4d60-8ef1-897843ba499e None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:30.448382 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3942493-1128-4d60-8ef1-897843ba499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:30.468987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a3942493-1128-4d60-8ef1-897843ba499e None None] MFA Rules not processed for user `29f04b492fa34ec79228aeb116b422e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:27:30.470210 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a3942493-1128-4d60-8ef1-897843ba499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:27:30.478484 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4362/8747] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:27:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:27:30.780448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:27:30.791871 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de3316-69fa-48b0-a91e-170bdc225806 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:27:30.795390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de50c63-8b8f-4243-bfc0-3004ca4ad3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:27:30.796014 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50c63-8b8f-4243-bfc0-3004ca4ad3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:30.796308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50c63-8b8f-4243-bfc0-3004ca4ad3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:30.796568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50c63-8b8f-4243-bfc0-3004ca4ad3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:30.798325 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-3de50c63-8b8f-4243-bfc0-3004ca4ad3a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:27:30.810498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de50c63-8b8f-4243-bfc0-3004ca4ad3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:27:30.812225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de50c63-8b8f-4243-bfc0-3004ca4ad3a8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:27:30.823625 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4386/8748] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:27:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:27:42.073603 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b9b17-109c-4766-aef8-a8e9dc65abd9 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:42.074245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b9b17-109c-4766-aef8-a8e9dc65abd9 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:42.074245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b9b17-109c-4766-aef8-a8e9dc65abd9 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:42.076486 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4363/8749] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:27:42.084479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282350-cec9-4888-9a24-568cf27d7854 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:42.085059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282350-cec9-4888-9a24-568cf27d7854 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:42.085059 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba282350-cec9-4888-9a24-568cf27d7854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:42.110613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ba282350-cec9-4888-9a24-568cf27d7854 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:27:42.112162 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ba282350-cec9-4888-9a24-568cf27d7854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:27:42.124819 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4387/8750] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:27:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:27:42.147658 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b9b17-109c-4766-aef8-a8e9dc65abd9 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:27:42.168481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b9b17-109c-4766-aef8-a8e9dc65abd9 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:27:42.173953 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:27:42.174677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:27:42.175166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:27:42.175531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:27:42.185344 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:27:42.187041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:27:42.198409 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4364/8751] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:27:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:28:13.450490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba282350-cec9-4888-9a24-568cf27d7854 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:28:13.462453 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba282350-cec9-4888-9a24-568cf27d7854 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:28:13.465895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a386d4e-bac4-4b99-96c4-391f7862335c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:28:13.466564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a386d4e-bac4-4b99-96c4-391f7862335c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:13.466879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a386d4e-bac4-4b99-96c4-391f7862335c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:13.467156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a386d4e-bac4-4b99-96c4-391f7862335c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:13.468904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a386d4e-bac4-4b99-96c4-391f7862335c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:13.480477 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a386d4e-bac4-4b99-96c4-391f7862335c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:28:13.481892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a386d4e-bac4-4b99-96c4-391f7862335c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:28:13.492435 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4388/8752] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:28:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:28:23.193826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:28:23.197116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:23.244358 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a714580-dcd9-40bf-bffc-66b599835729 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:28:23.250446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:28:23.251159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:23.251452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:23.251736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:23.253532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:23.274431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:28:23.276140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:28:23.307265 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4365/8753] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:28:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:28:29.916625 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc065d-4267-4c0d-85ae-08252c7a2405 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:29.917178 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc065d-4267-4c0d-85ae-08252c7a2405 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:29.917294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc065d-4267-4c0d-85ae-08252c7a2405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:29.939010 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ddcc065d-4267-4c0d-85ae-08252c7a2405 None None] MFA Rules not processed for user `29f04b492fa34ec79228aeb116b422e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:28:29.940217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ddcc065d-4267-4c0d-85ae-08252c7a2405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:29.947484 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4389/8754] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:28:30.557721 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:28:30.571907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a40af-8b58-4902-8c2d-33f4678be69a service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:28:30.577567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fde4ae-7e0d-49af-8c5c-e0d073521099 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:28:30.578222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fde4ae-7e0d-49af-8c5c-e0d073521099 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:30.578506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fde4ae-7e0d-49af-8c5c-e0d073521099 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:30.578791 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fde4ae-7e0d-49af-8c5c-e0d073521099 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:30.580583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-74fde4ae-7e0d-49af-8c5c-e0d073521099 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:30.595825 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fde4ae-7e0d-49af-8c5c-e0d073521099 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:28:30.597620 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fde4ae-7e0d-49af-8c5c-e0d073521099 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:28:30.610413 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4366/8755] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:28:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:28:38.865869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc065d-4267-4c0d-85ae-08252c7a2405 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:28:38.884463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc065d-4267-4c0d-85ae-08252c7a2405 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:28:38.890730 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dccc1-6a7c-45c7-856c-06472e35bf97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:28:38.891441 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dccc1-6a7c-45c7-856c-06472e35bf97 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:38.891723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dccc1-6a7c-45c7-856c-06472e35bf97 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:38.892021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dccc1-6a7c-45c7-856c-06472e35bf97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:38.894538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-905dccc1-6a7c-45c7-856c-06472e35bf97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:38.909802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dccc1-6a7c-45c7-856c-06472e35bf97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:28:38.911444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905dccc1-6a7c-45c7-856c-06472e35bf97 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:28:38.925709 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4390/8756] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:28:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:28:46.829414 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5153-22a5-4955-8a8a-33a948d58353 None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:46.830017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5153-22a5-4955-8a8a-33a948d58353 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:46.830017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f5153-22a5-4955-8a8a-33a948d58353 None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:46.831623 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4367/8757] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 07 22:28:46.836972 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e113c-b39f-4ab4-a03f-385b6fe844e7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:46.837445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e113c-b39f-4ab4-a03f-385b6fe844e7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:46.837600 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e113c-b39f-4ab4-a03f-385b6fe844e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:46.855381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-491e113c-b39f-4ab4-a03f-385b6fe844e7 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:28:46.856614 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-491e113c-b39f-4ab4-a03f-385b6fe844e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:46.869437 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4391/8758] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:28:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:28:46.893154 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f5153-22a5-4955-8a8a-33a948d58353 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:28:46.909315 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f5153-22a5-4955-8a8a-33a948d58353 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:28:46.914313 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:28:46.914975 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:46.915262 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:46.915536 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:46.924516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:28:46.926126 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:28:46.935605 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4368/8759] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:28:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:28:47.092183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e113c-b39f-4ab4-a03f-385b6fe844e7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:28:47.104510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e113c-b39f-4ab4-a03f-385b6fe844e7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:28:47.108105 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:28:47.109301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:28:47.109584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:28:47.109856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:28:47.111637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:28:47.127224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:28:47.128656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:28:47.141860 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4392/8760] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:28:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:29:10.558701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:10.571746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b2ae0-48cd-4d16-87b6-d9a42a320082 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:10.577490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:10.578124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:10.578401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:10.578691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:10.580416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:10.594818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:10.596393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:10.609041 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4369/8761] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:29:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:29:21.145882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:21.165447 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496096-e9f4-4458-aeb9-c056eb4715d4 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:21.171514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:21.172670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:21.172955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:21.173239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:21.175039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:21.201656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:21.204898 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:21.232593 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4393/8762] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:29:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:29:35.537047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:35.555833 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0becc5-1507-4821-bd68-b20dca50db1e service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:35.566561 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:35.567529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:35.567812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:35.568095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] PATH_INFO: `/v3/users/29f04b492fa34ec79228aeb116b422e0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:35.569407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f04b492fa34ec79228aeb116b422e0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:35.571445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:35.633516 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f04b492fa34ec79228aeb116b422e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:35.640624 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f04b492fa34ec79228aeb116b422e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:35.641365 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f04b492fa34ec79228aeb116b422e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:35.641994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f04b492fa34ec79228aeb116b422e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:35.649961 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f818e564-106e-4a49-9a21-1288f8d850b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f04b492fa34ec79228aeb116b422e0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:35.667886 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4370/8763] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:29:35 2022] DELETE /identity/v3/users/29f04b492fa34ec79228aeb116b422e0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:29:35.845090 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:35.855507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664b74e-dcb7-4eab-a2b7-7c6f08d5a16a service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:35.922751 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:35.923645 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:35.923928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:35.924200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] PATH_INFO: `/v3/projects/697345bef14f49b0a7ffff78f8f90913` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:35.925397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=697345bef14f49b0a7ffff78f8f90913)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:35.927363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:35.971762 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697345bef14f49b0a7ffff78f8f90913', 'request_id': 'req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:35.977635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697345bef14f49b0a7ffff78f8f90913', 'request_id': 'req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:35.984988 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697345bef14f49b0a7ffff78f8f90913', 'request_id': 'req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:36.006568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] The token cache is being invalidate because project 697345bef14f49b0a7ffff78f8f90913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:29:36.006891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:36.007521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-bb95c7fe-67c7-4f40-96e7-ba5669e1d8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:29:36.009049 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4394/8764] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:29:35 2022] DELETE /identity/v3/projects/697345bef14f49b0a7ffff78f8f90913 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:29:36.014116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc26c-1818-47cb-9eb6-c6abb405f6a8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.014407 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc26c-1818-47cb-9eb6-c6abb405f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.014685 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc26c-1818-47cb-9eb6-c6abb405f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.060533 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-2a2fc26c-1818-47cb-9eb6-c6abb405f6a8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:29:36.061737 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-2a2fc26c-1818-47cb-9eb6-c6abb405f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:36.117453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4371/8765] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:29:36.125320 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b9d00-8636-4688-a27f-b0c031fccdff None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.125608 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b9d00-8636-4688-a27f-b0c031fccdff None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.125886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b9d00-8636-4688-a27f-b0c031fccdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.143698 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-8e8b9d00-8636-4688-a27f-b0c031fccdff None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:29:36.144968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8e8b9d00-8636-4688-a27f-b0c031fccdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:36.153092 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4395/8766] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:29:36.157775 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fc26c-1818-47cb-9eb6-c6abb405f6a8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:36.167495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fc26c-1818-47cb-9eb6-c6abb405f6a8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:36.172007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:36.172655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.172938 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.173213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.173927 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:29:36.174230 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:36.175862 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:36.186911 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4372/8767] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:29:36.190907 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b9d00-8636-4688-a27f-b0c031fccdff None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:36.199953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b9d00-8636-4688-a27f-b0c031fccdff None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:36.205119 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:36.205771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.206053 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.206331 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.207127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:36.209039 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:36.234416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4396/8768] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:29:36 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:29:36.238607 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:36.248563 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8f50e-891c-4319-a057-731c85d20adb admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:36.305007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:36.305675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.305960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.306266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.307000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:36.308966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:36.328553 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4373/8769] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:29:36 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:29:36.332668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:36.342967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99983bc4-3d53-427a-8035-fade28b469e1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:36.348157 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:36.348809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.349096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.349377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.350099 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:36.351743 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:36.361390 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4397/8770] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:29:36.365248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:36.375272 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec90ef-33e8-4f84-8188-cb6439b5d38e admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:36.379941 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8154-170f-4b27-8d12-9f2ebee90008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:36.380602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8154-170f-4b27-8d12-9f2ebee90008 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.380888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8154-170f-4b27-8d12-9f2ebee90008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.381167 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8154-170f-4b27-8d12-9f2ebee90008 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.381898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8154-170f-4b27-8d12-9f2ebee90008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:36.383532 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8154-170f-4b27-8d12-9f2ebee90008 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:36.394801 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4374/8771] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:29:36.398964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:36.409446 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900641d-a5b2-457b-9c16-d0d36694d991 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:36.414031 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:36.414939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.415227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.415506 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] PATH_INFO: `/v3/projects/513bc8fe3df847c2914e5d3e465e864f/users/1bc01d9efcd942f7b17489817b1c6af0/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.429842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513bc8fe3df847c2914e5d3e465e864f, user_id=1bc01d9efcd942f7b17489817b1c6af0, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:36.432591 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:36.445020 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4398/8772] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:29:36 2022] PUT /identity/v3/projects/513bc8fe3df847c2914e5d3e465e864f/users/1bc01d9efcd942f7b17489817b1c6af0/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:29:36.450012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44634740-1d31-454b-bf97-d085adac735f None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.450310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44634740-1d31-454b-bf97-d085adac735f None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.450596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44634740-1d31-454b-bf97-d085adac735f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.469591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-44634740-1d31-454b-bf97-d085adac735f None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:29:36.470819 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-44634740-1d31-454b-bf97-d085adac735f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:36.526670 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4375/8773] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:29:36.536223 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:36.537953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:36.596051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39304b6b-5443-47c4-86b2-49ddbde38c03 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:36.599781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb5355-160d-4458-b798-cc9e7206eb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:36.600419 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5355-160d-4458-b798-cc9e7206eb05 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:36.600707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5355-160d-4458-b798-cc9e7206eb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:36.600986 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5355-160d-4458-b798-cc9e7206eb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:36.610656 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb5355-160d-4458-b798-cc9e7206eb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:36.612351 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb5355-160d-4458-b798-cc9e7206eb05 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:36.622150 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4399/8774] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:29:37.234708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:37.235297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:37.235447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:37.262712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] MFA Rules not processed for user `1bc01d9efcd942f7b17489817b1c6af0`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:29:37.263970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:37.331585 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4376/8775] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:29:37.341544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:37.342088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:37.342088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:37.358403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] MFA Rules not processed for user `1bc01d9efcd942f7b17489817b1c6af0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:29:37.359626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:37.366409 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4400/8776] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:29:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:29:37.378166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:37.379625 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:37.454424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c30b-38f2-4ef2-8b0f-8e46628f7201 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:37.460397 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:37.461146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:37.461437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:37.461720 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:37.469425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:37.471050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:37.479801 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4377/8777] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:29:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:29:37.707669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:37.709051 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:37.723260 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4404e-cdd4-401a-8f28-e09cebb4eacc None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:37.726798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca1708-2187-4e54-8810-a84340a020fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:37.727430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1708-2187-4e54-8810-a84340a020fd service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:37.727712 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1708-2187-4e54-8810-a84340a020fd service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:37.727993 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1708-2187-4e54-8810-a84340a020fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:37.729650 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-afca1708-2187-4e54-8810-a84340a020fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:37.741694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca1708-2187-4e54-8810-a84340a020fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:37.743259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca1708-2187-4e54-8810-a84340a020fd service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:37.754216 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4401/8778] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:29:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:29:38.542420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:29:38.543858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:38.612491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb7a40-75cc-4396-91a1-964faa0414a6 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:29:38.617466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:29:38.618108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:38.618387 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:38.618659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:38.620422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:38.634097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:29:38.635704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:29:38.648291 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4378/8779] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:29:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:29:47.688448 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab9c8-6f47-4ad8-b8c1-855845406042 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:29:47.689013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab9c8-6f47-4ad8-b8c1-855845406042 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:29:47.689013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab9c8-6f47-4ad8-b8c1-855845406042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:29:47.706024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-265ab9c8-6f47-4ad8-b8c1-855845406042 None None] MFA Rules not processed for user `1bc01d9efcd942f7b17489817b1c6af0`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:29:47.707258 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-265ab9c8-6f47-4ad8-b8c1-855845406042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:29:47.714001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4402/8780] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:29:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:04.376096 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:04.387547 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5d47d-a22b-4d23-8f44-11fdf3207991 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:04.393100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:04.394538 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:04.395092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:04.395562 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] PATH_INFO: `/v3/users/1bc01d9efcd942f7b17489817b1c6af0` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:04.397605 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc01d9efcd942f7b17489817b1c6af0)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:04.401258 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:04.448945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc01d9efcd942f7b17489817b1c6af0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.456345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc01d9efcd942f7b17489817b1c6af0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.456999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc01d9efcd942f7b17489817b1c6af0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.457632 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc01d9efcd942f7b17489817b1c6af0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.464778 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-ca219278-074b-4233-8734-fb5a2fb9d934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc01d9efcd942f7b17489817b1c6af0'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.481838 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4379/8781] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:30:04 2022] DELETE /identity/v3/users/1bc01d9efcd942f7b17489817b1c6af0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:04.695739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ab9c8-6f47-4ad8-b8c1-855845406042 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:04.707455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ab9c8-6f47-4ad8-b8c1-855845406042 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:04.763944 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:04.764726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:04.765513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:04.765791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] PATH_INFO: `/v3/projects/513bc8fe3df847c2914e5d3e465e864f` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:04.767021 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513bc8fe3df847c2914e5d3e465e864f)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:04.768958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:04.812990 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513bc8fe3df847c2914e5d3e465e864f', 'request_id': 'req-6748efa9-bd3d-4a34-86bd-b19a1bb84329'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.818858 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513bc8fe3df847c2914e5d3e465e864f', 'request_id': 'req-6748efa9-bd3d-4a34-86bd-b19a1bb84329'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.825633 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513bc8fe3df847c2914e5d3e465e864f', 'request_id': 'req-6748efa9-bd3d-4a34-86bd-b19a1bb84329'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.836028 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] The token cache is being invalidate because project 513bc8fe3df847c2914e5d3e465e864f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:30:04.836314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.836936 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-6748efa9-bd3d-4a34-86bd-b19a1bb84329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:04.838457 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4403/8782] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:30:04 2022] DELETE /identity/v3/projects/513bc8fe3df847c2914e5d3e465e864f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:04.844047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73156-47d7-4d4f-973f-bb9b6d65f7a2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:04.844335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73156-47d7-4d4f-973f-bb9b6d65f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:04.844613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73156-47d7-4d4f-973f-bb9b6d65f7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:04.867935 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d5d73156-47d7-4d4f-973f-bb9b6d65f7a2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:04.869634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d5d73156-47d7-4d4f-973f-bb9b6d65f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:04.934653 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4380/8783] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:04.942627 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feefd6-2a75-4b8d-b1a2-3f2f50c1a917 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:04.942969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feefd6-2a75-4b8d-b1a2-3f2f50c1a917 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:04.943250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feefd6-2a75-4b8d-b1a2-3f2f50c1a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:04.963281 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-31feefd6-2a75-4b8d-b1a2-3f2f50c1a917 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:04.964479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-31feefd6-2a75-4b8d-b1a2-3f2f50c1a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:04.973024 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4404/8784] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:04.977216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73156-47d7-4d4f-973f-bb9b6d65f7a2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:04.987058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73156-47d7-4d4f-973f-bb9b6d65f7a2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:04.991645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:04.992303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:04.992590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:04.992868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:04.993584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:30:04.993892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:04.995555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:05.007193 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4381/8785] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:30:05.011468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feefd6-2a75-4b8d-b1a2-3f2f50c1a917 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:05.021525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feefd6-2a75-4b8d-b1a2-3f2f50c1a917 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:05.026308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:05.026964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:05.027249 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:05.027525 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:05.028226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:05.030151 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:05.055001 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4405/8786] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:30:05 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:30:05.059135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:05.069480 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80ee4f-6630-4859-aa32-3c1954c08cb2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:05.123466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:05.124157 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:05.124942 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:05.125218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:05.125893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:05.127880 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:05.146807 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4382/8787] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:30:05 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:30:05.150748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:05.160851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fbb00-4912-48a0-8eef-3ae997783fd8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:05.165377 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:05.166022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:05.166593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:05.166876 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:05.167612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:05.169218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:05.179472 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4406/8788] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:30:05.183463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:05.194039 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05712d3-19bd-4be4-96bb-c8a90df8bba2 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:05.198802 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0873d7d-16c6-4453-9af4-0ac8b773437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:05.199462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0873d7d-16c6-4453-9af4-0ac8b773437c admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:05.199750 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0873d7d-16c6-4453-9af4-0ac8b773437c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:05.200029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0873d7d-16c6-4453-9af4-0ac8b773437c admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:05.200752 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0873d7d-16c6-4453-9af4-0ac8b773437c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:05.202386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0873d7d-16c6-4453-9af4-0ac8b773437c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:05.213400 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4383/8789] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:30:05.217132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:05.227509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fb6b2-e0d2-4dfd-aff5-dcdf06ff7c69 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:05.232146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:05.233013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:05.233295 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:05.233567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] PATH_INFO: `/v3/projects/248c06fe1bea439ba920ff4b093f0491/users/24e0788326264abfabaf34e11c2b4e75/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:05.247531 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248c06fe1bea439ba920ff4b093f0491, user_id=24e0788326264abfabaf34e11c2b4e75, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:05.250715 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:05.262752 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4407/8790] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:30:05 2022] PUT /identity/v3/projects/248c06fe1bea439ba920ff4b093f0491/users/24e0788326264abfabaf34e11c2b4e75/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:05.323145 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef910ab-dbe6-49e5-9234-2eb9ed9e9c54 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:05.323371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef910ab-dbe6-49e5-9234-2eb9ed9e9c54 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:05.323627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef910ab-dbe6-49e5-9234-2eb9ed9e9c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:05.349541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7ef910ab-dbe6-49e5-9234-2eb9ed9e9c54 None None] MFA Rules not processed for user `24e0788326264abfabaf34e11c2b4e75`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:05.350730 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7ef910ab-dbe6-49e5-9234-2eb9ed9e9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:05.411877 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4384/8791] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:05.422903 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:05.424606 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:05.484561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9eb2-ffc3-405f-b116-ca76ff6bc401 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:05.488350 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fbac1-fbb5-4150-878b-2f2e3e264467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:05.488958 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fbac1-fbb5-4150-878b-2f2e3e264467 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:05.489242 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fbac1-fbb5-4150-878b-2f2e3e264467 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:05.489521 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fbac1-fbb5-4150-878b-2f2e3e264467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:05.497800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fbac1-fbb5-4150-878b-2f2e3e264467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:05.499283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fbac1-fbb5-4150-878b-2f2e3e264467 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:05.508649 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4408/8792] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:30:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:30:15.815252 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef910ab-dbe6-49e5-9234-2eb9ed9e9c54 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:15.881195 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef910ab-dbe6-49e5-9234-2eb9ed9e9c54 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:15.885777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:15.886642 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:15.886977 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:15.887247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] PATH_INFO: `/v3/users/24e0788326264abfabaf34e11c2b4e75` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:15.888466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e0788326264abfabaf34e11c2b4e75)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:15.890979 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:15.934638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e0788326264abfabaf34e11c2b4e75'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:15.941349 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e0788326264abfabaf34e11c2b4e75'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:15.942011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e0788326264abfabaf34e11c2b4e75'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:15.942629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e0788326264abfabaf34e11c2b4e75'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:15.951851 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e0788326264abfabaf34e11c2b4e75'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:15.969526 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4385/8793] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:30:15 2022] DELETE /identity/v3/users/24e0788326264abfabaf34e11c2b4e75 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:15.974049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:15.974559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:15.974669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:15.991038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:15.992301 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:16.048320 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4409/8794] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:16.057861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.059304 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:16.118074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5480-c136-466b-b6c3-2fb63bc2f39f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.121777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943150e-4ce4-4dee-87a6-1010d8a69886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.122418 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943150e-4ce4-4dee-87a6-1010d8a69886 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.122703 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943150e-4ce4-4dee-87a6-1010d8a69886 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.123022 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943150e-4ce4-4dee-87a6-1010d8a69886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.131932 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943150e-4ce4-4dee-87a6-1010d8a69886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.133372 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943150e-4ce4-4dee-87a6-1010d8a69886 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.143230 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4386/8795] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:30:16.311183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.313276 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:16.325349 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a900b14-c11f-4b26-9b37-5394ccba82a0 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.330669 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.331569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.331856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.332135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] PATH_INFO: `/v3/projects/248c06fe1bea439ba920ff4b093f0491` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.333501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] RBAC: Authorizing `identity:delete_project(project_id=248c06fe1bea439ba920ff4b093f0491)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.335340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.382013 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248c06fe1bea439ba920ff4b093f0491', 'request_id': 'req-4e793fff-522e-432f-8a89-3ce50a60157e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:16.388170 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248c06fe1bea439ba920ff4b093f0491', 'request_id': 'req-4e793fff-522e-432f-8a89-3ce50a60157e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:16.394686 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248c06fe1bea439ba920ff4b093f0491', 'request_id': 'req-4e793fff-522e-432f-8a89-3ce50a60157e'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:16.404739 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] The token cache is being invalidate because project 248c06fe1bea439ba920ff4b093f0491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:30:16.405029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:16.406251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-4e793fff-522e-432f-8a89-3ce50a60157e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:16.407923 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4410/8796] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:30:16 2022] DELETE /identity/v3/projects/248c06fe1bea439ba920ff4b093f0491 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:30:16.413078 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b1ae-cbca-4be8-92af-320f88e85508 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.413367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b1ae-cbca-4be8-92af-320f88e85508 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.413647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b1ae-cbca-4be8-92af-320f88e85508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.432221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1547b1ae-cbca-4be8-92af-320f88e85508 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:16.433429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1547b1ae-cbca-4be8-92af-320f88e85508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:16.491026 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4387/8797] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:16.499219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3d20-8940-44a4-aecf-76612d308696 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.499517 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3d20-8940-44a4-aecf-76612d308696 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.499798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3d20-8940-44a4-aecf-76612d308696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.517951 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-409c3d20-8940-44a4-aecf-76612d308696 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:16.519194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-409c3d20-8940-44a4-aecf-76612d308696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:16.527240 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4411/8798] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:16.531873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b1ae-cbca-4be8-92af-320f88e85508 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.541590 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b1ae-cbca-4be8-92af-320f88e85508 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.546973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.547622 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.547908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.548184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.548893 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:30:16.549198 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.550829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.561913 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4388/8799] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:30:16.566125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c3d20-8940-44a4-aecf-76612d308696 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.575813 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c3d20-8940-44a4-aecf-76612d308696 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.580755 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.581408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.581692 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.581992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.582664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.584636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.610140 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4412/8800] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:30:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:30:16.614352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.624245 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056455d8-0bb6-483b-80b9-b0bbdf67b4f9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.678240 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.678937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.679227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.679506 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.680185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.682128 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.700855 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4389/8801] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:30:16 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:30:16.705470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.715724 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dde5d9-835e-4937-8535-7275007a0fc0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.721228 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.721880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.722166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.722442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.723200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.724804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.735060 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4413/8802] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:30:16.738949 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.748710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ba9f9-be98-4c69-9053-80882cd0d6b3 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.753411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5f991-468b-4132-946b-429d0303c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.754066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f991-468b-4132-946b-429d0303c989 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.754354 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f991-468b-4132-946b-429d0303c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.754635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f991-468b-4132-946b-429d0303c989 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.755392 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5f991-468b-4132-946b-429d0303c989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.757002 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5f991-468b-4132-946b-429d0303c989 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.767701 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4390/8803] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:30:16.771797 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.782286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a1694-8767-41a4-b5d1-a3a976691d1f admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.787104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.787973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.788309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.788586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] PATH_INFO: `/v3/projects/eca2ce95995d47c4b836f5eeccc23a35/users/c64c1ad6e5bc4f5a98286c4ac6db1126/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.803089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca2ce95995d47c4b836f5eeccc23a35, user_id=c64c1ad6e5bc4f5a98286c4ac6db1126, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:16.805802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:16.818374 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4414/8804] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:30:16 2022] PUT /identity/v3/projects/eca2ce95995d47c4b836f5eeccc23a35/users/c64c1ad6e5bc4f5a98286c4ac6db1126/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:16.828872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6ce19-9b7a-47f3-8e90-334cae5f7588 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.829359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6ce19-9b7a-47f3-8e90-334cae5f7588 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.829495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6ce19-9b7a-47f3-8e90-334cae5f7588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:16.855736 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7bc6ce19-9b7a-47f3-8e90-334cae5f7588 None None] MFA Rules not processed for user `c64c1ad6e5bc4f5a98286c4ac6db1126`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:16.856933 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7bc6ce19-9b7a-47f3-8e90-334cae5f7588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:16.918329 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4391/8805] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:30:16.928274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:16.930036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:16.989467 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3824-3692-4eb2-a5ed-35757046516a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:16.993275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1e90c-a2df-449d-aa35-6855fec3bf79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:16.993914 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e90c-a2df-449d-aa35-6855fec3bf79 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:16.994205 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e90c-a2df-449d-aa35-6855fec3bf79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:16.994483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1e90c-a2df-449d-aa35-6855fec3bf79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:17.003363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e90c-a2df-449d-aa35-6855fec3bf79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:17.004796 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1e90c-a2df-449d-aa35-6855fec3bf79 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:17.013481 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4415/8806] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:30:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:30:21.438190 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6ce19-9b7a-47f3-8e90-334cae5f7588 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:21.498638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6ce19-9b7a-47f3-8e90-334cae5f7588 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:21.504074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:21.504761 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:21.505041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:21.505342 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] PATH_INFO: `/v3/users/c64c1ad6e5bc4f5a98286c4ac6db1126` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:21.506583 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64c1ad6e5bc4f5a98286c4ac6db1126)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:21.508608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:21.555065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64c1ad6e5bc4f5a98286c4ac6db1126'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:21.562335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64c1ad6e5bc4f5a98286c4ac6db1126'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:21.563042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64c1ad6e5bc4f5a98286c4ac6db1126'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:21.563660 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64c1ad6e5bc4f5a98286c4ac6db1126'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:21.571037 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64c1ad6e5bc4f5a98286c4ac6db1126'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:21.589633 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4392/8807] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:30:21 2022] DELETE /identity/v3/users/c64c1ad6e5bc4f5a98286c4ac6db1126 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:21.594237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:21.594847 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:21.594959 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:21.616032 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:21.617250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:21.675368 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4416/8808] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:21.684869 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:21.686251 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:21.743808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39f895-57b6-40e3-87d5-8027c4a958c4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:21.747471 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576dc54-10a0-436e-9c3a-1ac211c4c84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:21.748111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576dc54-10a0-436e-9c3a-1ac211c4c84d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:21.748393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576dc54-10a0-436e-9c3a-1ac211c4c84d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:21.748696 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576dc54-10a0-436e-9c3a-1ac211c4c84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:21.758059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576dc54-10a0-436e-9c3a-1ac211c4c84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:21.759530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576dc54-10a0-436e-9c3a-1ac211c4c84d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:21.769570 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4393/8809] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:30:21.945036 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:21.946594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:21.968901 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7d2bb-2af5-478a-8034-bf5b288314f8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:21.973860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:21.974800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:21.975089 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:21.975363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] PATH_INFO: `/v3/projects/eca2ce95995d47c4b836f5eeccc23a35` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:21.976555 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca2ce95995d47c4b836f5eeccc23a35)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:21.978516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.025034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca2ce95995d47c4b836f5eeccc23a35', 'request_id': 'req-1f0cedda-680e-463a-bfa9-25574eac2183'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:22.031132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca2ce95995d47c4b836f5eeccc23a35', 'request_id': 'req-1f0cedda-680e-463a-bfa9-25574eac2183'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:22.037996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca2ce95995d47c4b836f5eeccc23a35', 'request_id': 'req-1f0cedda-680e-463a-bfa9-25574eac2183'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:22.048792 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] The token cache is being invalidate because project eca2ce95995d47c4b836f5eeccc23a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:30:22.049078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:22.049726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-1f0cedda-680e-463a-bfa9-25574eac2183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:30:22.051332 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4417/8810] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:30:21 2022] DELETE /identity/v3/projects/eca2ce95995d47c4b836f5eeccc23a35 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:22.057223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314f25-a7e8-45d7-ad6a-202d4213497c None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.057512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314f25-a7e8-45d7-ad6a-202d4213497c None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.057817 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8314f25-a7e8-45d7-ad6a-202d4213497c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.075877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f8314f25-a7e8-45d7-ad6a-202d4213497c None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:22.077054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f8314f25-a7e8-45d7-ad6a-202d4213497c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:22.135478 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4394/8811] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:22.143288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec646f1-c238-4c2b-a16e-c01a017c12b4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.143582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec646f1-c238-4c2b-a16e-c01a017c12b4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.143865 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec646f1-c238-4c2b-a16e-c01a017c12b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.161802 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fec646f1-c238-4c2b-a16e-c01a017c12b4 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:22.163042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fec646f1-c238-4c2b-a16e-c01a017c12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:22.171885 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4418/8812] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:22.175944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314f25-a7e8-45d7-ad6a-202d4213497c None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:22.185437 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8314f25-a7e8-45d7-ad6a-202d4213497c None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:22.190655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:22.191281 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.191566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.191844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.192559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:30:22.192863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:22.194468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.205776 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4395/8813] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:30:22.210009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec646f1-c238-4c2b-a16e-c01a017c12b4 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:22.219768 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec646f1-c238-4c2b-a16e-c01a017c12b4 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:22.224457 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:22.225127 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.225409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.225681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.226367 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:22.228296 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.253774 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4419/8814] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:30:22 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:30:22.257872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:22.267677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6db8cd-cc60-4de2-a5c7-b64d9eeb8ea4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:22.321066 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:22.321766 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.322047 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.322318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.323051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:22.325226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.344779 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4396/8815] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:30:22 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:30:22.348942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:22.359773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b5f29-8cd0-48a8-af42-6f08fbb45885 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:22.364324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:22.364970 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.365250 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.365522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.366235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:22.367862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.377845 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4420/8816] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:30:22.381638 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:22.391369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d45e11-47db-4e35-9451-47974aaaabcd admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:22.395994 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e7c47-bef9-497f-adfa-c8c81d2b2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:22.396645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7c47-bef9-497f-adfa-c8c81d2b2e6f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.396934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7c47-bef9-497f-adfa-c8c81d2b2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.397212 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e7c47-bef9-497f-adfa-c8c81d2b2e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.397931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e7c47-bef9-497f-adfa-c8c81d2b2e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:22.399564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e7c47-bef9-497f-adfa-c8c81d2b2e6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.409690 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4397/8817] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:30:22.413536 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:22.424312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18425323-af14-4ad0-bab1-352d693c63c7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:22.428915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:22.429778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.430063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.430399 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] PATH_INFO: `/v3/projects/42b928f3be814de2bf73bded06b23fd4/users/96de17f60f6047f2a1886aa8e80354c8/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.444774 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b928f3be814de2bf73bded06b23fd4, user_id=96de17f60f6047f2a1886aa8e80354c8, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:22.447454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.460275 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4421/8818] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:30:22 2022] PUT /identity/v3/projects/42b928f3be814de2bf73bded06b23fd4/users/96de17f60f6047f2a1886aa8e80354c8/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:30:22.465879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da973ccd-2b1d-4506-8fb7-8453a2289e5a None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.466472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da973ccd-2b1d-4506-8fb7-8453a2289e5a None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.466604 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da973ccd-2b1d-4506-8fb7-8453a2289e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.486433 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-da973ccd-2b1d-4506-8fb7-8453a2289e5a None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:22.487654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-da973ccd-2b1d-4506-8fb7-8453a2289e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:22.542609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4398/8819] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:22.552824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:22.554495 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:22.613488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba3cd5-88da-450f-8ed5-c476fed51c15 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:22.617379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:22.618024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:22.618308 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:22.618582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:22.627628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:22.629067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:22.638406 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4422/8820] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:30:26.838246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38992-7bd6-4882-92bc-f686ff413d6d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:26.838844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38992-7bd6-4882-92bc-f686ff413d6d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:26.838844 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb38992-7bd6-4882-92bc-f686ff413d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:26.878804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bbb38992-7bd6-4882-92bc-f686ff413d6d None None] MFA Rules not processed for user `96de17f60f6047f2a1886aa8e80354c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:26.880286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bbb38992-7bd6-4882-92bc-f686ff413d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:26.946337 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4399/8821] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:26.951066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:26.961554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccd88d-05e9-42e8-9a94-de98a7ba417e service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:26.967052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:26.967772 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:26.968152 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:26.968344 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:26.969063 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:26.971917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:27.002810 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4423/8822] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:30:26 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:30:27.004759 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb38992-7bd6-4882-92bc-f686ff413d6d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:27.016587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb38992-7bd6-4882-92bc-f686ff413d6d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:27.073989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:27.074662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:27.075048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:27.075328 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:27.076016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:27.078574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:27.098751 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4400/8823] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:30:27 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:30:27.102701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:27.113452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a471c05-1db5-4445-a4b6-69b23b4e51db admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:27.118426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:27.119156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:27.119445 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:27.119728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:27.120456 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:27.122172 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:27.133432 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4424/8824] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:30:27.137368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:27.147505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edd5bf-8402-4182-878a-624ca34efd09 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:27.152216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:27.153087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:27.153367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:27.153641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] PATH_INFO: `/v3/projects/e61d05fbf2a344189ea05c81e878b299/users/3fb78235c2f44b52be421b3282885237/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:27.168163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61d05fbf2a344189ea05c81e878b299, user_id=3fb78235c2f44b52be421b3282885237, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:27.171332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:27.183488 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4401/8825] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:30:27 2022] PUT /identity/v3/projects/e61d05fbf2a344189ea05c81e878b299/users/3fb78235c2f44b52be421b3282885237/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:27.187910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:27.198335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d666f-16c6-4b13-8baa-8d8238d09288 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:27.254397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb936b-b763-45da-a8b4-4d4fe91d9c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:27.255100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb936b-b763-45da-a8b4-4d4fe91d9c81 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:27.255386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb936b-b763-45da-a8b4-4d4fe91d9c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:27.255664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb936b-b763-45da-a8b4-4d4fe91d9c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:27.256381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb936b-b763-45da-a8b4-4d4fe91d9c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:27.257996 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb936b-b763-45da-a8b4-4d4fe91d9c81 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:27.267348 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4425/8826] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:30:27.271429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:27.281438 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8cef4-e822-40d5-975b-c3bead5d9ced admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:27.286045 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:27.286945 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:27.287228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:27.287503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] PATH_INFO: `/v3/projects/e61d05fbf2a344189ea05c81e878b299/users/3fb78235c2f44b52be421b3282885237/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:27.289502 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61d05fbf2a344189ea05c81e878b299, user_id=3fb78235c2f44b52be421b3282885237, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:27.292493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:27.303201 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4402/8827] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:30:27 2022] PUT /identity/v3/projects/e61d05fbf2a344189ea05c81e878b299/users/3fb78235c2f44b52be421b3282885237/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:30:32.148274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa391e-6443-4787-a830-fb3d324ae2a7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:32.148834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa391e-6443-4787-a830-fb3d324ae2a7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:32.148834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa391e-6443-4787-a830-fb3d324ae2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:32.179741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b6fa391e-6443-4787-a830-fb3d324ae2a7 None None] MFA Rules not processed for user `3fb78235c2f44b52be421b3282885237`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:32.181201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b6fa391e-6443-4787-a830-fb3d324ae2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:32.259823 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4426/8828] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:32.292679 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:32.294567 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:32.379498 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8527ab2-8ef1-4403-9ff1-920872d1e920 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:32.383170 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:32.383831 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:32.384112 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:32.384385 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:32.442218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:32.443719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:32.453512 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4403/8829] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:30:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:30:32.574487 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fe13e-95c7-4626-aa9a-b7d54e377e40 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:32.574840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fe13e-95c7-4626-aa9a-b7d54e377e40 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:32.575668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fe13e-95c7-4626-aa9a-b7d54e377e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:32.635226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0c3fe13e-95c7-4626-aa9a-b7d54e377e40 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:32.636458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0c3fe13e-95c7-4626-aa9a-b7d54e377e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:32.700142 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4427/8830] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:30:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:32.755226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:32.756634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:32.845505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f41067-2463-4793-9be4-9308c57fea6a service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:32.850543 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca0ef4-0d42-4ee5-92e7-e8dd6c65fafd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:32.851298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca0ef4-0d42-4ee5-92e7-e8dd6c65fafd service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:32.851584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca0ef4-0d42-4ee5-92e7-e8dd6c65fafd service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:32.851861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca0ef4-0d42-4ee5-92e7-e8dd6c65fafd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:32.860465 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca0ef4-0d42-4ee5-92e7-e8dd6c65fafd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:32.862054 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca0ef4-0d42-4ee5-92e7-e8dd6c65fafd service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:32.870029 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4404/8831] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:30:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:30:41.599641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c45a-e5f2-4bcf-a6a2-f71ac91f69b8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:41.600239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c45a-e5f2-4bcf-a6a2-f71ac91f69b8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:41.600239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c45a-e5f2-4bcf-a6a2-f71ac91f69b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:41.619024 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c246c45a-e5f2-4bcf-a6a2-f71ac91f69b8 None None] MFA Rules not processed for user `96de17f60f6047f2a1886aa8e80354c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:41.620224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c246c45a-e5f2-4bcf-a6a2-f71ac91f69b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:41.627177 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4428/8832] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:30:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:43.275395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:43.275973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:43.275973 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:43.298159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:30:43.299124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:43.306587 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4405/8833] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:30:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:30:43.321044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c45a-e5f2-4bcf-a6a2-f71ac91f69b8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:43.338129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c45a-e5f2-4bcf-a6a2-f71ac91f69b8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:43.343274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:43.343943 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:43.344196 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:43.344475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:43.353078 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:43.355246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:43.366346 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4429/8834] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:30:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:30:59.595843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:30:59.597222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:59.675203 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe055c6-35b6-4355-9577-2bd2744d56b8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:30:59.678885 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf4eae7f407e44ecbe525049b262e3a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:30:59.679531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:30:59.679814 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:30:59.680090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:30:59.681855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:30:59.751187 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:30:59.752580 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:30:59.766446 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4406/8835] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:30:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:31:02.280992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:31:02.336402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01704c3-8b84-44a1-830f-fd0e5a06e363 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:31:02.340015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5665c8-da95-434e-82ed-79ce30cdc0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:31:02.340682 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5665c8-da95-434e-82ed-79ce30cdc0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:31:02.340969 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5665c8-da95-434e-82ed-79ce30cdc0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:31:02.341248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5665c8-da95-434e-82ed-79ce30cdc0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:31:02.343046 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4d5665c8-da95-434e-82ed-79ce30cdc0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:31:02.358597 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5665c8-da95-434e-82ed-79ce30cdc0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:31:02.360588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5665c8-da95-434e-82ed-79ce30cdc0d0 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:31:02.373895 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4430/8836] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:31:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:31:02.499041 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:31:02.511431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26646f-e5f4-4a43-9bb0-80d8d37c1ee2 service cinder] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:31:02.515111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:31:02.515807 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:31:02.516092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:31:02.516371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:31:02.525557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:31:02.527100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:31:02.536814 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4407/8837] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:31:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:32:27.229001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951c428-8c48-44f5-a627-46808753f53e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:27.229551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951c428-8c48-44f5-a627-46808753f53e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:27.229551 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951c428-8c48-44f5-a627-46808753f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:27.246885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b951c428-8c48-44f5-a627-46808753f53e None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:32:27.248086 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b951c428-8c48-44f5-a627-46808753f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:27.255860 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4431/8838] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:32:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:32:27.295858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:27.310336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec4ed0-63d7-423d-b33f-56acb2980bfc service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:27.316012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:27.316652 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:27.316936 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:27.317215 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:27.325227 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:27.326841 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:27.334734 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4408/8839] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:32:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:32:34.275245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951c428-8c48-44f5-a627-46808753f53e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:34.345091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951c428-8c48-44f5-a627-46808753f53e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:34.349964 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:34.350859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:34.351143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:34.351417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] PATH_INFO: `/v3/users/96de17f60f6047f2a1886aa8e80354c8` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:34.352603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96de17f60f6047f2a1886aa8e80354c8)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:34.354541 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:34.399185 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96de17f60f6047f2a1886aa8e80354c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.399824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96de17f60f6047f2a1886aa8e80354c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.406408 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96de17f60f6047f2a1886aa8e80354c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.407064 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96de17f60f6047f2a1886aa8e80354c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.414402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96de17f60f6047f2a1886aa8e80354c8'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.431339 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4432/8840] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:32:34 2022] DELETE /identity/v3/users/96de17f60f6047f2a1886aa8e80354c8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:32:34.604990 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:34.616426 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628afd-3419-4b5f-a987-86fe4ba5c916 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:34.672085 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:34.672952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:34.673235 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:34.673512 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] PATH_INFO: `/v3/projects/42b928f3be814de2bf73bded06b23fd4` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:34.675261 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b928f3be814de2bf73bded06b23fd4)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:34.677286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:34.721663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b928f3be814de2bf73bded06b23fd4', 'request_id': 'req-f1eff67e-d005-4465-9953-f6ec2a5cf681'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.727614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b928f3be814de2bf73bded06b23fd4', 'request_id': 'req-f1eff67e-d005-4465-9953-f6ec2a5cf681'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.734463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b928f3be814de2bf73bded06b23fd4', 'request_id': 'req-f1eff67e-d005-4465-9953-f6ec2a5cf681'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.745012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] The token cache is being invalidate because project 42b928f3be814de2bf73bded06b23fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:32:34.745317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.745929 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.747504 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4409/8841] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:32:34 2022] DELETE /identity/v3/projects/42b928f3be814de2bf73bded06b23fd4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:32:34.751432 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:34.753363 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:34.766268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da870c5-a910-4140-8610-f530e0383295 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:34.822040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:34.822949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:34.823235 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:34.823509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] PATH_INFO: `/v3/users/3fb78235c2f44b52be421b3282885237` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:34.824704 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb78235c2f44b52be421b3282885237)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:34.826671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:34.871339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb78235c2f44b52be421b3282885237'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.871984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb78235c2f44b52be421b3282885237'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.878806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb78235c2f44b52be421b3282885237'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.879688 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb78235c2f44b52be421b3282885237'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.886429 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-7a958f13-5667-422a-9775-2da0b85a961b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb78235c2f44b52be421b3282885237'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:34.902661 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4433/8842] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:32:34 2022] DELETE /identity/v3/users/3fb78235c2f44b52be421b3282885237 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:32:35.074983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.076596 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:35.089701 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eff67e-d005-4465-9953-f6ec2a5cf681 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.145335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.146213 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.146495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.146765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] PATH_INFO: `/v3/projects/e61d05fbf2a344189ea05c81e878b299` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.147950 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61d05fbf2a344189ea05c81e878b299)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.149867 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.195352 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61d05fbf2a344189ea05c81e878b299', 'request_id': 'req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:35.201557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61d05fbf2a344189ea05c81e878b299', 'request_id': 'req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:35.209550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61d05fbf2a344189ea05c81e878b299', 'request_id': 'req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:35.220587 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] The token cache is being invalidate because project e61d05fbf2a344189ea05c81e878b299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:32:35.220875 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:35.222309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-19952bc9-f0c8-4b3b-85e2-9d6e1d5d9dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:32:35.223953 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4410/8843] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:32:35 2022] DELETE /identity/v3/projects/e61d05fbf2a344189ea05c81e878b299 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:32:35.229019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c0e2-bb6e-4608-800c-5d5c01db6f02 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.229382 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c0e2-bb6e-4608-800c-5d5c01db6f02 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.229673 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297c0e2-bb6e-4608-800c-5d5c01db6f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.246789 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1297c0e2-bb6e-4608-800c-5d5c01db6f02 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:32:35.248005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1297c0e2-bb6e-4608-800c-5d5c01db6f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:35.305576 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4434/8844] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:32:35.313402 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc3a9-4143-4ceb-b507-76f7f57f3bc5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.313689 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc3a9-4143-4ceb-b507-76f7f57f3bc5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.313967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cc3a9-4143-4ceb-b507-76f7f57f3bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.332608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e74cc3a9-4143-4ceb-b507-76f7f57f3bc5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:32:35.333798 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e74cc3a9-4143-4ceb-b507-76f7f57f3bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:35.341598 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4411/8845] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:32:35.345710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297c0e2-bb6e-4608-800c-5d5c01db6f02 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.356041 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297c0e2-bb6e-4608-800c-5d5c01db6f02 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.360618 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.361293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.361577 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.361879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.362598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:32:35.362946 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.364568 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.375770 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4435/8846] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:32:35.380086 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc3a9-4143-4ceb-b507-76f7f57f3bc5 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.389204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cc3a9-4143-4ceb-b507-76f7f57f3bc5 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.394333 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.394996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.395277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.395548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.396231 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.398119 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.423557 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4412/8847] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:32:35 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:32:35.427585 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.437259 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95759ff-8fa5-400e-ab75-4b713b51bac7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.492353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.493096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.493404 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.493685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.494374 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.496340 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.519230 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4436/8848] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:32:35 2022] POST /identity/v3/users => generated 297 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:32:35.520408 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.530650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea3a5-78e4-466d-a0f4-5065762bac70 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.535955 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.536606 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.536889 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.537163 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.537877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.539519 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.550027 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4413/8849] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:32:35.553740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.563615 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2d6e8-f455-43b4-89d1-1170d889961e admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.568215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72820fe-5a88-4d9b-a086-9a7f09ebeccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.568869 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72820fe-5a88-4d9b-a086-9a7f09ebeccb admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.569676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72820fe-5a88-4d9b-a086-9a7f09ebeccb admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.569676 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72820fe-5a88-4d9b-a086-9a7f09ebeccb admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.570137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72820fe-5a88-4d9b-a086-9a7f09ebeccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.571776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72820fe-5a88-4d9b-a086-9a7f09ebeccb admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.583230 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4437/8850] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:32:35.587584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.598755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cdc3e-a5c2-49d2-ac34-e36c5cfb125f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.603531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.604420 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.604699 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.604969 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] PATH_INFO: `/v3/projects/f3dc672b922b4f86869d8b6108240e0a/users/374a4fe2efa9420fab9cc8370bc56810/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.620859 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3dc672b922b4f86869d8b6108240e0a, user_id=374a4fe2efa9420fab9cc8370bc56810, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.623601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.637993 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4414/8851] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:32:35 2022] PUT /identity/v3/projects/f3dc672b922b4f86869d8b6108240e0a/users/374a4fe2efa9420fab9cc8370bc56810/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:32:35.650710 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed249702-22a1-4e29-af6a-b7403782dc06 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.651054 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed249702-22a1-4e29-af6a-b7403782dc06 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.651335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed249702-22a1-4e29-af6a-b7403782dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.678750 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ed249702-22a1-4e29-af6a-b7403782dc06 None None] MFA Rules not processed for user `374a4fe2efa9420fab9cc8370bc56810`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:32:35.680052 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ed249702-22a1-4e29-af6a-b7403782dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:35.742532 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4438/8852] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:32:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:32:35.747129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.807110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c669533-9a39-4072-b401-c22558c8b02c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.811907 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.812586 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.812876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.813160 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.813897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.816335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.841545 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4415/8853] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:32:35 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:32:35.845671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed249702-22a1-4e29-af6a-b7403782dc06 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.856123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed249702-22a1-4e29-af6a-b7403782dc06 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.910948 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.911612 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.911904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.912201 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] PATH_INFO: `/v3/users` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.912873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.914837 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.933853 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4439/8854] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:32:35 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:32:35.937883 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.948614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350277b-4dca-4475-a038-a36775d3fde4 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.953226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.953878 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.954162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.954439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:35.955186 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:35.957421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:35.968254 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4416/8855] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:32:35.971931 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:35.982324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e438-6ab8-42c8-b6f7-a1a0b5ccfa39 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:35.987569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:35.988442 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:35.988728 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:35.989007 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] PATH_INFO: `/v3/projects/c932efe3b64947af87b9370ed91b63ab/users/a63a961191744b65a9df49f805cafbbb/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:36.003992 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c932efe3b64947af87b9370ed91b63ab, user_id=a63a961191744b65a9df49f805cafbbb, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:36.006978 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:36.020228 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4440/8856] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:32:35 2022] PUT /identity/v3/projects/c932efe3b64947af87b9370ed91b63ab/users/a63a961191744b65a9df49f805cafbbb/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:32:36.024219 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:36.034012 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa429b4-5f8c-4d34-bb63-47412c402f80 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:36.089216 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece826b-152a-4472-bba6-2616e84bef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:36.089812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece826b-152a-4472-bba6-2616e84bef12 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:36.090117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece826b-152a-4472-bba6-2616e84bef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:36.090370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece826b-152a-4472-bba6-2616e84bef12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:36.091226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece826b-152a-4472-bba6-2616e84bef12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:36.092821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece826b-152a-4472-bba6-2616e84bef12 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:36.102090 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4417/8857] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:32:36.106271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:36.117175 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c52a5-f6d5-44b2-80f6-07423a392258 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:36.121766 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:36.122628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:36.122941 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:36.123216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] PATH_INFO: `/v3/projects/c932efe3b64947af87b9370ed91b63ab/users/a63a961191744b65a9df49f805cafbbb/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:36.125192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c932efe3b64947af87b9370ed91b63ab, user_id=a63a961191744b65a9df49f805cafbbb, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:36.128504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:36.138338 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4441/8858] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:32:36 2022] PUT /identity/v3/projects/c932efe3b64947af87b9370ed91b63ab/users/a63a961191744b65a9df49f805cafbbb/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:32:36.147794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:36.148092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:36.148468 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:36.174152 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] MFA Rules not processed for user `a63a961191744b65a9df49f805cafbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:32:36.175892 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:36.241513 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4418/8859] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:32:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:32:36.252410 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:36.254735 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:36.327183 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a150e-85be-4c64-81b1-4eefe7bf3ae6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:36.332999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec113b4-bf64-41a2-87b8-e4a5ef2f2b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:36.333680 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec113b4-bf64-41a2-87b8-e4a5ef2f2b01 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:36.333968 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec113b4-bf64-41a2-87b8-e4a5ef2f2b01 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:36.334282 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec113b4-bf64-41a2-87b8-e4a5ef2f2b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:36.390726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec113b4-bf64-41a2-87b8-e4a5ef2f2b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:36.392314 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec113b4-bf64-41a2-87b8-e4a5ef2f2b01 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:36.401293 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4442/8860] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:32:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:32:39.559573 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:39.561107 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:39.622321 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d0796-eb70-4f38-8ea2-64167fba18a4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:39.625986 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:39.626635 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:39.626947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:39.627221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:39.636378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:39.637806 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:39.647376 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4419/8861] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:32:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:32:42.356474 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f923d-77b1-4566-901c-2c5c09a891a7 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:42.356999 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f923d-77b1-4566-901c-2c5c09a891a7 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:42.357124 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f923d-77b1-4566-901c-2c5c09a891a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:42.381248 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-833f923d-77b1-4566-901c-2c5c09a891a7 None None] MFA Rules not processed for user `374a4fe2efa9420fab9cc8370bc56810`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:32:42.382503 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-833f923d-77b1-4566-901c-2c5c09a891a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:42.389851 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4443/8862] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:32:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:32:42.725584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:42.727572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:42.743957 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84affc0-0cce-48e3-a681-bd7b6c450dda service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:42.748552 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debaf02-f570-492e-9946-862f60d594c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:42.749248 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debaf02-f570-492e-9946-862f60d594c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:42.749530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debaf02-f570-492e-9946-862f60d594c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:42.750890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debaf02-f570-492e-9946-862f60d594c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:42.753356 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1debaf02-f570-492e-9946-862f60d594c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:42.767297 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debaf02-f570-492e-9946-862f60d594c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:42.768801 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debaf02-f570-492e-9946-862f60d594c4 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:42.781355 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4420/8863] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:32:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:32:44.876535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f923d-77b1-4566-901c-2c5c09a891a7 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:32:44.897860 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f923d-77b1-4566-901c-2c5c09a891a7 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:32:44.902554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:32:44.903573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:32:44.903942 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:32:44.904484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:32:44.906891 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:32:44.922683 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:32:44.924297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:32:44.945321 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4444/8864] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:32:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:33:46.759267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b059f0-9c04-438f-b894-6dde2f14f290 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:33:46.759845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b059f0-9c04-438f-b894-6dde2f14f290 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:33:46.759845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b059f0-9c04-438f-b894-6dde2f14f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:33:46.778257 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f0b059f0-9c04-438f-b894-6dde2f14f290 None None] MFA Rules not processed for user `374a4fe2efa9420fab9cc8370bc56810`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:33:46.779755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f0b059f0-9c04-438f-b894-6dde2f14f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:46.787108 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4421/8865] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:33:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:33:47.532561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:33:47.533994 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:47.617617 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00e8c2-8f6d-4c1c-832c-7ec8f7c8eb77 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:33:47.623353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:33:47.624004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:33:47.624291 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:33:47.624554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:33:47.626413 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:47.647034 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:33:47.649302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:33:47.667574 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4445/8866] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:33:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:33:49.534517 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:33:49.535074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:33:49.535312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:33:49.582234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:33:49.583447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:49.591473 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4422/8867] 10.222.0.32 () {58 vars in 1061 bytes} [Sat May 7 22:33:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:33:49.597973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:33:49.613809 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f32a14-4c3f-4894-8bf3-9d6ae277ef5c service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:33:49.618824 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:33:49.619742 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:33:49.620518 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:33:49.621166 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:33:49.623406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:49.645595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:33:49.647414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:33:49.664539 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4446/8868] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:33:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:33:50.331569 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:33:50.333337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:50.354142 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9672a-6926-4723-b6bf-3b45486086f0 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:33:50.361113 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:33:50.362035 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:33:50.362388 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:33:50.362739 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:33:50.369116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:50.387447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:33:50.389220 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:33:50.406527 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4423/8869] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:33:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:33:54.828230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:33:54.845268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402570e9-5626-4c52-b7de-1306e110f637 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:33:54.851616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:33:54.852262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:33:54.852546 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:33:54.852825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:33:54.854621 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:33:54.869505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:33:54.871262 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:33:54.884499 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4447/8870] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:33:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:34:16.305873 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:34:16.307326 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:34:16.327246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46da9f3-bb3e-420f-8349-545ef5d2658b service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:34:16.332531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be36e84-65fd-488d-a372-f21456a3cc4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:34:16.333206 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36e84-65fd-488d-a372-f21456a3cc4c service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:34:16.334093 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36e84-65fd-488d-a372-f21456a3cc4c service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:34:16.334338 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be36e84-65fd-488d-a372-f21456a3cc4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:34:16.336266 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1be36e84-65fd-488d-a372-f21456a3cc4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:34:16.350901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be36e84-65fd-488d-a372-f21456a3cc4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:34:16.352503 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be36e84-65fd-488d-a372-f21456a3cc4c service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:34:16.365805 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4424/8871] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:34:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:35:14.673786 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:35:14.687588 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b846f-4ff3-4f53-94f2-657822c7ac2a service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:35:14.692896 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c0bbd-59f5-4e69-80a8-d7604d2b0e87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:35:14.693544 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0bbd-59f5-4e69-80a8-d7604d2b0e87 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:35:14.693834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0bbd-59f5-4e69-80a8-d7604d2b0e87 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:35:14.694118 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0bbd-59f5-4e69-80a8-d7604d2b0e87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:35:14.695973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-718c0bbd-59f5-4e69-80a8-d7604d2b0e87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:35:14.710481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c0bbd-59f5-4e69-80a8-d7604d2b0e87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:35:14.712097 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c0bbd-59f5-4e69-80a8-d7604d2b0e87 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:35:14.725104 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4448/8872] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:35:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:35:32.684639 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269272c4-8cdd-4f17-bd6e-8d7a78ca1103 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:35:32.685727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269272c4-8cdd-4f17-bd6e-8d7a78ca1103 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:35:32.685727 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269272c4-8cdd-4f17-bd6e-8d7a78ca1103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:35:32.705217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-269272c4-8cdd-4f17-bd6e-8d7a78ca1103 None None] MFA Rules not processed for user `374a4fe2efa9420fab9cc8370bc56810`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:35:32.706462 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-269272c4-8cdd-4f17-bd6e-8d7a78ca1103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:35:32.713772 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4425/8873] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:35:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:35:34.376882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e977-aa5e-414e-835b-eb81d30660fe None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:35:34.377422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e977-aa5e-414e-835b-eb81d30660fe None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:35:34.377422 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c90e977-aa5e-414e-835b-eb81d30660fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:35:34.398337 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1c90e977-aa5e-414e-835b-eb81d30660fe None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:35:34.399582 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1c90e977-aa5e-414e-835b-eb81d30660fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:35:34.408125 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4449/8874] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:35:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:35:34.421291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269272c4-8cdd-4f17-bd6e-8d7a78ca1103 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:35:34.437116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269272c4-8cdd-4f17-bd6e-8d7a78ca1103 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:35:34.442284 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2a9be-d128-4193-9f04-89128908e12a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:35:34.442967 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a9be-d128-4193-9f04-89128908e12a service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:35:34.443255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a9be-d128-4193-9f04-89128908e12a service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:35:34.443529 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2a9be-d128-4193-9f04-89128908e12a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:35:34.453108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a9be-d128-4193-9f04-89128908e12a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:35:34.454735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2a9be-d128-4193-9f04-89128908e12a service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:35:34.471863 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4426/8875] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:35:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:35:39.758644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e977-aa5e-414e-835b-eb81d30660fe None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:35:39.780339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c90e977-aa5e-414e-835b-eb81d30660fe None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:35:39.786000 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:35:39.786711 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:35:39.787035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:35:39.787312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:35:39.789334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:35:39.806098 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:35:39.807933 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:35:39.823866 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4450/8876] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:35:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:36:21.816457 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b6d15-67e0-4ff7-aa3c-aa8a695462f8 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:21.817063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b6d15-67e0-4ff7-aa3c-aa8a695462f8 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:21.817063 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b6d15-67e0-4ff7-aa3c-aa8a695462f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:21.843700 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-139b6d15-67e0-4ff7-aa3c-aa8a695462f8 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:36:21.844879 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-139b6d15-67e0-4ff7-aa3c-aa8a695462f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:21.880996 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4427/8877] 10.222.0.32 () {58 vars in 1061 bytes} [Sat May 7 22:36:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:36:21.886879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:36:21.906708 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee91a3-1a84-411f-8308-1ccf8d14f22b service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:36:21.916093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:36:21.919148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:21.919451 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:21.919727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:21.923079 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:21.937694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:36:21.939132 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:36:21.949583 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4451/8878] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:36:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:36:22.084131 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b6d15-67e0-4ff7-aa3c-aa8a695462f8 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:36:22.093361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b6d15-67e0-4ff7-aa3c-aa8a695462f8 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:36:22.097120 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41038d5e-cc8a-466e-91a0-58aa8b821462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:36:22.097842 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038d5e-cc8a-466e-91a0-58aa8b821462 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.098140 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038d5e-cc8a-466e-91a0-58aa8b821462 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.098470 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038d5e-cc8a-466e-91a0-58aa8b821462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.099256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:36:22.100286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-41038d5e-cc8a-466e-91a0-58aa8b821462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:22.107571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c885d6f-e3da-4d5d-a7ad-c4c121ee9c3c service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:36:22.111370 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295341a-1c7e-4842-91fd-81d013277824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:36:22.112003 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295341a-1c7e-4842-91fd-81d013277824 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.112283 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295341a-1c7e-4842-91fd-81d013277824 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.112554 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295341a-1c7e-4842-91fd-81d013277824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.112677 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41038d5e-cc8a-466e-91a0-58aa8b821462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:36:22.114150 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41038d5e-cc8a-466e-91a0-58aa8b821462 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:36:22.114322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4295341a-1c7e-4842-91fd-81d013277824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:22.125453 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4428/8879] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:36:22.151490 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295341a-1c7e-4842-91fd-81d013277824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:36:22.152938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295341a-1c7e-4842-91fd-81d013277824 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:36:22.178564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4452/8880] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:36:22.219776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c499f0f-de22-4c43-a510-b79c7a7e517d None None] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.219776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c499f0f-de22-4c43-a510-b79c7a7e517d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.219776 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c499f0f-de22-4c43-a510-b79c7a7e517d None None] PATH_INFO: `/` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.219776 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4429/8881] 10.222.0.32 () {54 vars in 921 bytes} [Sat May 7 22:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 07 22:36:22.225096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d86d9-2a5b-4a03-96d6-16cb98addf8b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.225390 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d86d9-2a5b-4a03-96d6-16cb98addf8b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.225668 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d86d9-2a5b-4a03-96d6-16cb98addf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.250240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-cf6d86d9-2a5b-4a03-96d6-16cb98addf8b None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:36:22.251514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cf6d86d9-2a5b-4a03-96d6-16cb98addf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:22.260474 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4453/8882] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:36:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:36:22.282193 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c499f0f-de22-4c43-a510-b79c7a7e517d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:36:22.299080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c499f0f-de22-4c43-a510-b79c7a7e517d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:36:22.304424 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523de1-373f-4942-8304-3cf172c00de4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:36:22.305074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523de1-373f-4942-8304-3cf172c00de4 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.305359 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523de1-373f-4942-8304-3cf172c00de4 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.305666 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523de1-373f-4942-8304-3cf172c00de4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.314487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523de1-373f-4942-8304-3cf172c00de4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:36:22.316124 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523de1-373f-4942-8304-3cf172c00de4 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:36:22.325739 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4430/8883] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:36:22.481077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d86d9-2a5b-4a03-96d6-16cb98addf8b None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:36:22.490312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d86d9-2a5b-4a03-96d6-16cb98addf8b None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:36:22.494009 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:36:22.494845 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.495158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.495492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.497687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:22.518514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:36:22.520220 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:36:22.537240 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4454/8884] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:36:22.601077 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c8ba-94f4-4dfa-a953-b67e1f2cdb30 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.601369 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c8ba-94f4-4dfa-a953-b67e1f2cdb30 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.601650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598c8ba-94f4-4dfa-a953-b67e1f2cdb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.619129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8598c8ba-94f4-4dfa-a953-b67e1f2cdb30 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:36:22.620361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8598c8ba-94f4-4dfa-a953-b67e1f2cdb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:22.629504 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4431/8885] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:36:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:36:22.641323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:36:22.655092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bdf51-f32e-42d6-8cdd-a32642e0d9db service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:36:22.660122 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80971aad-5996-4b53-9d06-4225c797de91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:36:22.660734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971aad-5996-4b53-9d06-4225c797de91 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:22.661016 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971aad-5996-4b53-9d06-4225c797de91 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:22.661293 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80971aad-5996-4b53-9d06-4225c797de91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:22.669707 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971aad-5996-4b53-9d06-4225c797de91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:36:22.671365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80971aad-5996-4b53-9d06-4225c797de91 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:36:22.681049 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4455/8886] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:36:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:36:23.364531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c8ba-94f4-4dfa-a953-b67e1f2cdb30 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:36:23.376335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598c8ba-94f4-4dfa-a953-b67e1f2cdb30 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:36:23.380769 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:36:23.381931 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:36:23.382217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:36:23.382673 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:36:23.384550 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:36:23.401582 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:36:23.403065 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:36:23.421796 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4432/8887] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:36:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:37:28.840008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232836-cd69-4a83-a1f6-78fdfdef8eb9 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:37:28.840613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232836-cd69-4a83-a1f6-78fdfdef8eb9 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:37:28.840613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31232836-cd69-4a83-a1f6-78fdfdef8eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:37:28.859200 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-31232836-cd69-4a83-a1f6-78fdfdef8eb9 None None] MFA Rules not processed for user `374a4fe2efa9420fab9cc8370bc56810`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:37:28.860420 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-31232836-cd69-4a83-a1f6-78fdfdef8eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:37:28.868595 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4456/8888] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:37:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:37:36.617522 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:37:36.631850 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b9808-72cd-4b16-ad16-99e71e07c060 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:37:36.637451 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:37:36.638097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:37:36.638383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:37:36.638659 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:37:36.647000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:37:36.648594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:37:36.657309 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4433/8889] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:37:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:37:39.334131 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232836-cd69-4a83-a1f6-78fdfdef8eb9 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:37:39.343527 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31232836-cd69-4a83-a1f6-78fdfdef8eb9 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:37:39.347636 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:37:39.348274 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:37:39.348561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:37:39.348841 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:37:39.357646 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:37:39.359135 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:37:39.369308 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4457/8890] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:37:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:38:19.141074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:38:19.150137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b38a1-7d7d-4c86-9f59-06b741d0122b service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:38:19.153708 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fd1d-bfc7-41e6-8b4e-f07ab2c48a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:38:19.154341 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fd1d-bfc7-41e6-8b4e-f07ab2c48a33 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:38:19.154628 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fd1d-bfc7-41e6-8b4e-f07ab2c48a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:38:19.154954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fd1d-bfc7-41e6-8b4e-f07ab2c48a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:38:19.165310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3fd1d-bfc7-41e6-8b4e-f07ab2c48a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:38:19.166741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3fd1d-bfc7-41e6-8b4e-f07ab2c48a33 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:38:19.177554 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4434/8891] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:38:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:39:03.472747 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:39:03.497022 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a71933-daa3-4d30-9db3-b53b709901ac service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:39:03.503470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:39:03.504703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:39:03.505353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:39:03.505867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:39:03.519472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:39:03.521468 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:39:03.537026 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4458/8892] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:39:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:39:16.661777 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f2cbe-69c8-4acd-b219-685ad5121ea7 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:39:16.663101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f2cbe-69c8-4acd-b219-685ad5121ea7 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:39:16.663636 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f2cbe-69c8-4acd-b219-685ad5121ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:39:16.682762 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c26f2cbe-69c8-4acd-b219-685ad5121ea7 None None] MFA Rules not processed for user `374a4fe2efa9420fab9cc8370bc56810`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:39:16.684460 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c26f2cbe-69c8-4acd-b219-685ad5121ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:39:16.699266 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4435/8893] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:39:20.299773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:39:20.323372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02d571-ded5-428a-9708-321451ba1bec service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:39:20.328395 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:39:20.329030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:39:20.329313 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:39:20.329595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:39:20.340557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:39:20.342145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:39:20.355179 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4459/8894] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:39:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:39:23.133019 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f2cbe-69c8-4acd-b219-685ad5121ea7 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:39:23.142891 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f2cbe-69c8-4acd-b219-685ad5121ea7 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:39:23.146863 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:39:23.147559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:39:23.147829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:39:23.148601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:39:23.159482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:39:23.161023 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:39:23.173454 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4436/8895] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:39:28.365385 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:39:28.381438 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86abe87-cc82-4dcf-8017-c2160f1c5896 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:39:28.387598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43105-2d12-4a0f-a55f-76edacc958b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:39:28.388245 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43105-2d12-4a0f-a55f-76edacc958b6 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:39:28.388528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43105-2d12-4a0f-a55f-76edacc958b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:39:28.388804 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43105-2d12-4a0f-a55f-76edacc958b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:39:28.400571 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43105-2d12-4a0f-a55f-76edacc958b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:39:28.402219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43105-2d12-4a0f-a55f-76edacc958b6 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:39:28.415899 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4460/8896] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:39:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:40:14.459204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:14.539655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff56f2-143b-4b9e-bf8d-ec59343b118e service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:14.544614 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:14.545749 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:14.546036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:14.546318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] PATH_INFO: `/v3/users/374a4fe2efa9420fab9cc8370bc56810` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:14.547574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=374a4fe2efa9420fab9cc8370bc56810)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:14.549527 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:14.601162 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374a4fe2efa9420fab9cc8370bc56810'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:14.608416 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374a4fe2efa9420fab9cc8370bc56810'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:14.609080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374a4fe2efa9420fab9cc8370bc56810'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:14.609684 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374a4fe2efa9420fab9cc8370bc56810'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:14.618489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374a4fe2efa9420fab9cc8370bc56810'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:14.635747 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4437/8897] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:40:14 2022] DELETE /identity/v3/users/374a4fe2efa9420fab9cc8370bc56810 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:40:14.640284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:14.640798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:14.640922 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:14.678737 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:40:14.679984 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:14.736780 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4461/8898] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:40:14.746481 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:14.747924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:14.815301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648e7bc-750a-46ba-98bb-5713529fe2ce admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:14.818940 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:14.819585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:14.819872 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:14.820178 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:14.829064 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:14.830505 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:14.840469 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4438/8899] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:40:15.005414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:15.007323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:15.021921 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689043e-7e13-426c-8399-d9bc38b0adfd None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:15.027867 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:15.028929 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.029341 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.029738 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] PATH_INFO: `/v3/projects/f3dc672b922b4f86869d8b6108240e0a` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.031218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3dc672b922b4f86869d8b6108240e0a)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:15.033623 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:15.079443 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3dc672b922b4f86869d8b6108240e0a', 'request_id': 'req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.085493 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3dc672b922b4f86869d8b6108240e0a', 'request_id': 'req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.093464 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3dc672b922b4f86869d8b6108240e0a', 'request_id': 'req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.103806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] The token cache is being invalidate because project f3dc672b922b4f86869d8b6108240e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:40:15.104092 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.104716 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.106274 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4462/8900] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:40:15 2022] DELETE /identity/v3/projects/f3dc672b922b4f86869d8b6108240e0a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:40:15.110246 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:15.119898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e5ad-950c-4070-a6d0-0776a8f28154 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:15.174960 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:15.175821 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.176103 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.176379 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] PATH_INFO: `/v3/users/a63a961191744b65a9df49f805cafbbb` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.177570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63a961191744b65a9df49f805cafbbb)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:15.179555 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:15.224100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63a961191744b65a9df49f805cafbbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.230650 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63a961191744b65a9df49f805cafbbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.231339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63a961191744b65a9df49f805cafbbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.232081 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63a961191744b65a9df49f805cafbbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.238993 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-e58a05c5-346e-4f3a-bb15-8ab7b2387605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63a961191744b65a9df49f805cafbbb'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.255639 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4439/8901] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:40:15 2022] DELETE /identity/v3/users/a63a961191744b65a9df49f805cafbbb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:40:15.519008 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:15.520573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:15.535745 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc98aa-c7b6-40d7-8871-42c3c8ddc50a admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:15.592856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:15.593725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.593997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.594271 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] PATH_INFO: `/v3/projects/c932efe3b64947af87b9370ed91b63ab` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.595458 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c932efe3b64947af87b9370ed91b63ab)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:15.597430 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:15.641091 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c932efe3b64947af87b9370ed91b63ab', 'request_id': 'req-073d8a29-2d16-49c4-801b-b7aafa44a9c7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.647004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c932efe3b64947af87b9370ed91b63ab', 'request_id': 'req-073d8a29-2d16-49c4-801b-b7aafa44a9c7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.653939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c932efe3b64947af87b9370ed91b63ab', 'request_id': 'req-073d8a29-2d16-49c4-801b-b7aafa44a9c7'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.664121 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] The token cache is being invalidate because project c932efe3b64947af87b9370ed91b63ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:40:15.664409 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.665047 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-073d8a29-2d16-49c4-801b-b7aafa44a9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:40:15.666564 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4463/8902] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:40:15 2022] DELETE /identity/v3/projects/c932efe3b64947af87b9370ed91b63ab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:40:15.671843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1502510-f154-410d-bd91-bafdc74e50a2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.672430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1502510-f154-410d-bd91-bafdc74e50a2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.672430 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1502510-f154-410d-bd91-bafdc74e50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.719439 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d1502510-f154-410d-bd91-bafdc74e50a2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:40:15.720687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d1502510-f154-410d-bd91-bafdc74e50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:15.777326 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4440/8903] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:40:15.785339 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690fc68-d01b-4761-8b40-ba4ad3573758 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.785631 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690fc68-d01b-4761-8b40-ba4ad3573758 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.785908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690fc68-d01b-4761-8b40-ba4ad3573758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.804343 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1690fc68-d01b-4761-8b40-ba4ad3573758 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:40:15.806082 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1690fc68-d01b-4761-8b40-ba4ad3573758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:15.814038 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4464/8904] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:40:15.818116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1502510-f154-410d-bd91-bafdc74e50a2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:15.829076 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1502510-f154-410d-bd91-bafdc74e50a2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:15.833853 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:15.834513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.834826 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.835104 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.835855 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:40:15.836159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:15.837781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:15.849754 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4441/8905] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 07 22:40:15.854237 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690fc68-d01b-4761-8b40-ba4ad3573758 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:15.863392 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690fc68-d01b-4761-8b40-ba4ad3573758 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:15.868874 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:15.869530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.869815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.870120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.870846 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:15.872812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:15.906503 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4465/8906] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:40:15 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:40:15.910683 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:15.921332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927fa1-a86f-47ae-bc71-1138c4f76846 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:15.976016 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:15.977182 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:15.977466 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:15.977748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:15.978425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:15.980403 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:16.000480 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4442/8907] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:40:15 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:40:16.004639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:16.015093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf3d90-03b8-4e5a-9351-b019f457c3f1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:16.019949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:16.020605 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:16.020892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:16.021171 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:16.021919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:16.023599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:16.033210 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4466/8908] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:40:16.036965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:16.051482 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9724-7b80-4a61-90ee-67db37c7c7c9 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:16.056845 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31f1a5-0d03-4de3-a199-d98f38e02764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:16.057499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31f1a5-0d03-4de3-a199-d98f38e02764 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:16.057780 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31f1a5-0d03-4de3-a199-d98f38e02764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:16.058051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31f1a5-0d03-4de3-a199-d98f38e02764 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:16.058758 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31f1a5-0d03-4de3-a199-d98f38e02764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:16.060371 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31f1a5-0d03-4de3-a199-d98f38e02764 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:16.070088 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4443/8909] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:40:16.074240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:16.084165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524020c-4794-41b8-bea0-93bb7b0a5faf admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:16.088881 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:16.089748 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:16.090048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:16.090305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] PATH_INFO: `/v3/projects/2a375b5dd32e4b6eb61e9a9877c9a04c/users/6a81d6104e634bd7a6ae26dc51124c2d/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:16.105139 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a375b5dd32e4b6eb61e9a9877c9a04c, user_id=6a81d6104e634bd7a6ae26dc51124c2d, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:16.107800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:16.120948 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4467/8910] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:40:16 2022] PUT /identity/v3/projects/2a375b5dd32e4b6eb61e9a9877c9a04c/users/6a81d6104e634bd7a6ae26dc51124c2d/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:40:16.126011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b4fe-0449-4aa1-b1e7-4d1d2c45303b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:16.126302 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b4fe-0449-4aa1-b1e7-4d1d2c45303b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:16.126581 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524b4fe-0449-4aa1-b1e7-4d1d2c45303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:16.143584 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-8524b4fe-0449-4aa1-b1e7-4d1d2c45303b None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:40:16.144836 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-8524b4fe-0449-4aa1-b1e7-4d1d2c45303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:16.202572 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4444/8911] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:40:16.212613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:16.214387 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:16.269415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2580-9610-486b-81a5-f24095188df7 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:16.273734 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:16.274384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:16.274791 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:16.275096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:16.284110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:16.285550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:16.295828 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4468/8912] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:40:20.340121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88502360-8865-42d5-8081-bc72bab38171 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:20.340121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88502360-8865-42d5-8081-bc72bab38171 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:20.340121 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88502360-8865-42d5-8081-bc72bab38171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:20.369082 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-88502360-8865-42d5-8081-bc72bab38171 None None] MFA Rules not processed for user `6a81d6104e634bd7a6ae26dc51124c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:40:20.370303 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-88502360-8865-42d5-8081-bc72bab38171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:20.469805 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4445/8913] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:40:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:40:20.474342 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:20.484927 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cedfd-5df8-4ab0-b27a-505f090df958 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:20.489838 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:20.490510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:20.490835 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:20.491123 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:20.493232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:20.495879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:20.525218 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4469/8914] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:40:20 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 07 22:40:20.529092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88502360-8865-42d5-8081-bc72bab38171 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:20.541355 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88502360-8865-42d5-8081-bc72bab38171 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:20.604130 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:20.604810 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:20.605091 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:20.605361 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:20.606058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:20.608295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:20.634347 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4446/8915] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:40:20 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:40:20.635256 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:20.646176 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d436e-fd00-4c99-b9e1-3e4a0d933dd6 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:20.651272 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:20.651991 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:20.652403 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:20.652740 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:20.654125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:20.655806 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:20.668894 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4470/8916] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 07 22:40:20.673223 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:20.684497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dbe5a-0b48-4444-aa22-5146be8432a8 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:20.689221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:20.690116 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:20.690399 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:20.690674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] PATH_INFO: `/v3/projects/e5079706a95444c2b80c3cdf6bb5c894/users/da22eb86d6bc48d99132852d5a28c552/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:20.706937 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5079706a95444c2b80c3cdf6bb5c894, user_id=da22eb86d6bc48d99132852d5a28c552, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:20.709646 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:20.723569 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4447/8917] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:40:20 2022] PUT /identity/v3/projects/e5079706a95444c2b80c3cdf6bb5c894/users/da22eb86d6bc48d99132852d5a28c552/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:40:20.727749 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:20.738520 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1960-20ef-46b5-8c51-adf83d6b136d admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:20.803026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:20.803723 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:20.804006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:20.804286 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:20.805552 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:20.807288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:20.821683 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4471/8918] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:40:20.823029 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:20.833815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e4ffa-11da-4b05-9842-6d4ed903c821 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:20.839032 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55df5d4-14c5-4386-aa0e-ed7399491684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:20.839996 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55df5d4-14c5-4386-aa0e-ed7399491684 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:20.840283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55df5d4-14c5-4386-aa0e-ed7399491684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:20.840556 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55df5d4-14c5-4386-aa0e-ed7399491684 admin admin] PATH_INFO: `/v3/projects/e5079706a95444c2b80c3cdf6bb5c894/users/da22eb86d6bc48d99132852d5a28c552/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:20.842651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55df5d4-14c5-4386-aa0e-ed7399491684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5079706a95444c2b80c3cdf6bb5c894, user_id=da22eb86d6bc48d99132852d5a28c552, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:20.845422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55df5d4-14c5-4386-aa0e-ed7399491684 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:20.857444 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4448/8919] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:40:20 2022] PUT /identity/v3/projects/e5079706a95444c2b80c3cdf6bb5c894/users/da22eb86d6bc48d99132852d5a28c552/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:40:21.648622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:21.651213 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:21.761979 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03838a8e-1629-4b15-8785-38e15e07d984 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:21.851947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:21.863917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:21.864472 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:21.864781 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:21.866900 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:21.895224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:21.897198 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:21.918072 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4472/8920] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:40:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:40:25.529706 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80fac-7f35-4bdc-b138-5b16e11d88e6 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:25.530184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80fac-7f35-4bdc-b138-5b16e11d88e6 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:25.530309 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80fac-7f35-4bdc-b138-5b16e11d88e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:25.557704 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-a5e80fac-7f35-4bdc-b138-5b16e11d88e6 None None] MFA Rules not processed for user `da22eb86d6bc48d99132852d5a28c552`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:40:25.559007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-a5e80fac-7f35-4bdc-b138-5b16e11d88e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:25.627068 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4449/8921] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:40:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:40:25.638855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:25.640926 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:25.732834 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab6e91-4450-48b0-b109-5fabb50d029b service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:25.738414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:25.739094 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:25.739383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:25.739664 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:25.796836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:25.798440 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:25.807398 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4473/8922] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:40:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:40:27.079951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc25a-5e55-4703-bf24-e170ecd410e2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:27.080490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc25a-5e55-4703-bf24-e170ecd410e2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:27.080490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dc25a-5e55-4703-bf24-e170ecd410e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:27.098654 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-c32dc25a-5e55-4703-bf24-e170ecd410e2 None None] MFA Rules not processed for user `6a81d6104e634bd7a6ae26dc51124c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:40:27.099911 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-c32dc25a-5e55-4703-bf24-e170ecd410e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:27.108181 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4450/8923] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:40:27.434727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:27.491514 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18f81-98cb-49a2-900f-f71a7cb6eac1 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:27.496100 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4abe54-9297-4a5e-9212-93b7aefe65aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:27.496939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abe54-9297-4a5e-9212-93b7aefe65aa service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:27.497230 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abe54-9297-4a5e-9212-93b7aefe65aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:27.497509 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4abe54-9297-4a5e-9212-93b7aefe65aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:27.499372 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-cb4abe54-9297-4a5e-9212-93b7aefe65aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:40:27.513561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4abe54-9297-4a5e-9212-93b7aefe65aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:27.515246 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4abe54-9297-4a5e-9212-93b7aefe65aa service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:27.531568 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4474/8924] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:40:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:40:41.658440 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc25a-5e55-4703-bf24-e170ecd410e2 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:40:41.669097 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dc25a-5e55-4703-bf24-e170ecd410e2 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:40:41.672735 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6631d-8e59-4c56-8128-f4c986fc9a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:40:41.673445 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6631d-8e59-4c56-8128-f4c986fc9a1d service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:40:41.673770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6631d-8e59-4c56-8128-f4c986fc9a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:40:41.674058 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6631d-8e59-4c56-8128-f4c986fc9a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:40:41.683149 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6631d-8e59-4c56-8128-f4c986fc9a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:40:41.684597 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6631d-8e59-4c56-8128-f4c986fc9a1d service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:40:41.693910 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4451/8925] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:40:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:42:22.891426 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2808cd2-6132-4023-9525-04c54e067857 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:22.892084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2808cd2-6132-4023-9525-04c54e067857 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:22.892084 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2808cd2-6132-4023-9525-04c54e067857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:22.935302 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-b2808cd2-6132-4023-9525-04c54e067857 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:42:22.937002 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-b2808cd2-6132-4023-9525-04c54e067857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:22.945485 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4475/8926] 10.222.0.55 () {58 vars in 1015 bytes} [Sat May 7 22:42:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:42:22.958050 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cebb5-0da0-402f-a8bb-94824b86c143 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:22.958495 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cebb5-0da0-402f-a8bb-94824b86c143 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:22.958616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cebb5-0da0-402f-a8bb-94824b86c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:22.976376 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-d33cebb5-0da0-402f-a8bb-94824b86c143 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:42:22.977558 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-d33cebb5-0da0-402f-a8bb-94824b86c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:22.986129 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4452/8927] 10.222.0.32 () {58 vars in 1057 bytes} [Sat May 7 22:42:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:42:22.991910 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2808cd2-6132-4023-9525-04c54e067857 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:42:23.002607 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2808cd2-6132-4023-9525-04c54e067857 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:42:23.007726 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af067b8e-ad85-49ab-b48c-88586b2d6d96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:42:23.008355 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af067b8e-ad85-49ab-b48c-88586b2d6d96 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:23.008639 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af067b8e-ad85-49ab-b48c-88586b2d6d96 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:23.008915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af067b8e-ad85-49ab-b48c-88586b2d6d96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:23.017640 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af067b8e-ad85-49ab-b48c-88586b2d6d96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:42:23.019261 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af067b8e-ad85-49ab-b48c-88586b2d6d96 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:42:23.028921 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4476/8928] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:42:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:42:23.663277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b489a-4637-49c0-9383-f685314eecb4 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:23.663576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b489a-4637-49c0-9383-f685314eecb4 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:23.663858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b489a-4637-49c0-9383-f685314eecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:23.682051 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-0c6b489a-4637-49c0-9383-f685314eecb4 None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:42:23.683296 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0c6b489a-4637-49c0-9383-f685314eecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:23.691885 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4453/8929] 10.222.0.59 () {58 vars in 1015 bytes} [Sat May 7 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:42:23.704681 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119da19-aa01-4787-8326-02ddcab3e0ed None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:23.704971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119da19-aa01-4787-8326-02ddcab3e0ed None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:23.705252 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119da19-aa01-4787-8326-02ddcab3e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:23.725886 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-6119da19-aa01-4787-8326-02ddcab3e0ed None None] MFA Rules not processed for user `e834001baa424d24b5c9551a7cae7741`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:42:23.727298 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-6119da19-aa01-4787-8326-02ddcab3e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:23.736868 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4477/8930] 10.222.0.32 () {58 vars in 1057 bytes} [Sat May 7 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:42:23.743148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b489a-4637-49c0-9383-f685314eecb4 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:42:23.753629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b489a-4637-49c0-9383-f685314eecb4 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:42:23.758670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:42:23.759336 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:23.759616 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:23.759914 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:23.768877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:42:23.770452 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:42:23.780693 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4454/8931] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:42:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:42:38.867997 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346a2e-b0ea-4a5c-9f64-a4f5e4b31d48 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:38.868481 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346a2e-b0ea-4a5c-9f64-a4f5e4b31d48 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:38.868634 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346a2e-b0ea-4a5c-9f64-a4f5e4b31d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:38.915405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-33346a2e-b0ea-4a5c-9f64-a4f5e4b31d48 None None] MFA Rules not processed for user `0275c43e4d7744b4a556c30662b7e84f`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:42:38.916610 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-33346a2e-b0ea-4a5c-9f64-a4f5e4b31d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:38.975097 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4478/8932] 10.222.0.32 () {58 vars in 1059 bytes} [Sat May 7 22:42:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:42:38.981201 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:42:38.990691 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5474b-69cf-4534-9c5b-8124c743f301 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:42:38.994343 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f0808-6ea3-4a83-99b3-41409f1d40c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:42:38.995011 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0808-6ea3-4a83-99b3-41409f1d40c8 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:38.995294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0808-6ea3-4a83-99b3-41409f1d40c8 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:38.995568 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f0808-6ea3-4a83-99b3-41409f1d40c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:38.997335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bc0f0808-6ea3-4a83-99b3-41409f1d40c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:39.018209 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f0808-6ea3-4a83-99b3-41409f1d40c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:42:39.019613 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f0808-6ea3-4a83-99b3-41409f1d40c8 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:42:39.033785 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4455/8933] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:42:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:42:39.281193 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346a2e-b0ea-4a5c-9f64-a4f5e4b31d48 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:42:39.297889 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346a2e-b0ea-4a5c-9f64-a4f5e4b31d48 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:42:39.301510 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3671bd6-e953-4620-ae13-06407e2f0700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:42:39.302158 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3671bd6-e953-4620-ae13-06407e2f0700 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:39.302444 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3671bd6-e953-4620-ae13-06407e2f0700 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:39.302725 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3671bd6-e953-4620-ae13-06407e2f0700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:39.304550 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e3671bd6-e953-4620-ae13-06407e2f0700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:39.321459 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3671bd6-e953-4620-ae13-06407e2f0700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:42:39.322947 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3671bd6-e953-4620-ae13-06407e2f0700 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:42:39.337044 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4479/8934] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:42:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:42:51.985242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1a0a-c8c8-4615-90cd-81de47405b23 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:51.985748 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1a0a-c8c8-4615-90cd-81de47405b23 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:51.985874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c1a0a-c8c8-4615-90cd-81de47405b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:52.036513 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-406c1a0a-c8c8-4615-90cd-81de47405b23 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:42:52.037719 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-406c1a0a-c8c8-4615-90cd-81de47405b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:52.101074 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4456/8935] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:42:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:42:52.151872 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:52.152335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:52.152452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:52.201125 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] MFA Rules not processed for user `ddea6c1eb8764f1a9f0a310a78128460`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:42:52.202346 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:42:52.276122 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4480/8936] 10.222.0.32 () {58 vars in 1039 bytes} [Sat May 7 22:42:52 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:42:52.282588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c1a0a-c8c8-4615-90cd-81de47405b23 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:42:52.295339 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c1a0a-c8c8-4615-90cd-81de47405b23 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:42:52.301378 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:42:52.302046 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:42:52.302332 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:42:52.302629 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:42:52.311031 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:42:52.313242 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:42:52.321062 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4457/8937] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:42:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:43:04.196778 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:43:04.198211 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:04.209928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25c4db-9cca-42e9-bc28-4b5cb454c35e None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:43:04.213417 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:43:04.214048 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:04.214330 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:04.214603 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:04.216335 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:04.228294 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:43:04.229717 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:43:04.240545 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4481/8938] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:43:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:43:04.335301 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:43:04.344553 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906ab2-baf6-4b57-80de-7344eea48f8a service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:43:04.348488 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:43:04.349250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:04.349601 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:04.349970 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:04.351901 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:04.368951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:43:04.370483 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:43:04.385099 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4458/8939] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:43:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:43:04.455277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:43:04.464040 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1534a42-dcf8-4cef-8100-5affc7d0ab9a service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:43:04.468004 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:43:04.468963 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:04.469088 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:04.469356 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:04.471221 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:04.483674 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:43:04.485657 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:43:04.496032 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4482/8940] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:43:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:43:04.569234 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:43:04.578489 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ea0f9-d1b7-4a7c-89fa-3ae51dac2886 service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:43:04.582087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732870c6-401d-4af4-8003-20193d7268a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:43:04.582728 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732870c6-401d-4af4-8003-20193d7268a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:04.583042 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732870c6-401d-4af4-8003-20193d7268a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:04.583317 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732870c6-401d-4af4-8003-20193d7268a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:04.585127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-732870c6-401d-4af4-8003-20193d7268a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:04.601641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732870c6-401d-4af4-8003-20193d7268a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:43:04.603106 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732870c6-401d-4af4-8003-20193d7268a9 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:43:04.617331 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4459/8941] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:43:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:43:04.691626 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:43:04.705528 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721df7cc-4bcd-466f-8bee-8ea66c91e4f4 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:43:04.713030 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:43:04.713713 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:04.714001 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:04.714307 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:04.716155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:04.728771 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:43:04.730398 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:43:04.741586 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4483/8942] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:43:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:43:06.998843 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f1dae-f00d-4a93-908e-075eb9cafe47 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:06.999346 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f1dae-f00d-4a93-908e-075eb9cafe47 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:06.999497 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f1dae-f00d-4a93-908e-075eb9cafe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:07.018530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b89f1dae-f00d-4a93-908e-075eb9cafe47 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:43:07.019784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b89f1dae-f00d-4a93-908e-075eb9cafe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:07.027228 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4460/8943] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:43:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:43:07.040019 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:43:07.051113 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e7c0-c4b2-4e1e-a42e-38a39d029501 service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:43:07.056035 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:43:07.056671 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:07.056953 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:07.057227 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:07.065798 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:43:07.067436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:43:07.075483 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4484/8944] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:43:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:43:20.625350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c02a-8cb3-4a82-9c98-0e7ef02f977d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:20.625898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c02a-8cb3-4a82-9c98-0e7ef02f977d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:20.625898 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c02a-8cb3-4a82-9c98-0e7ef02f977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:20.643298 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-f1c8c02a-8cb3-4a82-9c98-0e7ef02f977d None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:43:20.653947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f1c8c02a-8cb3-4a82-9c98-0e7ef02f977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:43:20.661910 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4461/8945] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:43:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:43:20.674694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:43:20.685076 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107f272-575b-4139-a723-3cf8a153f367 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:43:20.690202 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:43:20.691277 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:43:20.691573 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:43:20.691857 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:43:20.700273 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:43:20.701908 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:43:20.710532 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4485/8946] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:44:25.900263 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7849-1247-4cc1-bf85-00916c430ee5 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:25.900888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7849-1247-4cc1-bf85-00916c430ee5 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:25.900888 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e7849-1247-4cc1-bf85-00916c430ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:25.935951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-941e7849-1247-4cc1-bf85-00916c430ee5 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:25.937148 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-941e7849-1247-4cc1-bf85-00916c430ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:25.944576 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4462/8947] 10.222.0.59 () {58 vars in 1015 bytes} [Sat May 7 22:44:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:25.956224 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:25.965218 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef663fbe-290c-4137-ac27-40b6399cca63 service swift] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:25.969323 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106eee-43eb-4fce-8dd1-dfda7a8a50ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:25.969955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106eee-43eb-4fce-8dd1-dfda7a8a50ad service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:25.970236 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106eee-43eb-4fce-8dd1-dfda7a8a50ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:25.970513 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106eee-43eb-4fce-8dd1-dfda7a8a50ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:25.977388 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab106eee-43eb-4fce-8dd1-dfda7a8a50ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:25.978840 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab106eee-43eb-4fce-8dd1-dfda7a8a50ad service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:25.987202 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4486/8948] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:31.956271 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94f15e-3e19-4eb3-b627-27c8b92be542 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:31.956782 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94f15e-3e19-4eb3-b627-27c8b92be542 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:31.957010 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94f15e-3e19-4eb3-b627-27c8b92be542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:31.995129 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-fe94f15e-3e19-4eb3-b627-27c8b92be542 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:31.996530 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-fe94f15e-3e19-4eb3-b627-27c8b92be542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:32.007380 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4463/8949] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:44:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:32.019879 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e2f2-1870-4038-89a9-c51b9d35b097 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:32.020433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e2f2-1870-4038-89a9-c51b9d35b097 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:32.020433 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93e2f2-1870-4038-89a9-c51b9d35b097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:32.043383 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fd93e2f2-1870-4038-89a9-c51b9d35b097 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:32.044616 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fd93e2f2-1870-4038-89a9-c51b9d35b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:32.055997 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4487/8950] 10.222.0.32 () {58 vars in 1058 bytes} [Sat May 7 22:44:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:32.062576 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94f15e-3e19-4eb3-b627-27c8b92be542 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:32.074487 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94f15e-3e19-4eb3-b627-27c8b92be542 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:32.080876 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c16bf2-5fdd-4f3b-a22d-395d22394c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:32.082731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c16bf2-5fdd-4f3b-a22d-395d22394c04 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:32.083060 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c16bf2-5fdd-4f3b-a22d-395d22394c04 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:32.083335 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c16bf2-5fdd-4f3b-a22d-395d22394c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:32.098647 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c16bf2-5fdd-4f3b-a22d-395d22394c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:32.100370 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c16bf2-5fdd-4f3b-a22d-395d22394c04 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:32.112236 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4464/8951] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:32.155589 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34573-e8a1-4bb4-ba57-431961d39cad None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:32.155955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34573-e8a1-4bb4-ba57-431961d39cad None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:32.156244 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34573-e8a1-4bb4-ba57-431961d39cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:32.176322 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-34b34573-e8a1-4bb4-ba57-431961d39cad None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:32.177529 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-34b34573-e8a1-4bb4-ba57-431961d39cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:32.186982 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4488/8952] 10.222.0.32 () {58 vars in 1058 bytes} [Sat May 7 22:44:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:32.193270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe03a9-1327-46be-8aa5-22fd9b15da35 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:32.193559 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe03a9-1327-46be-8aa5-22fd9b15da35 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:32.193837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe03a9-1327-46be-8aa5-22fd9b15da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:32.214511 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-09fe03a9-1327-46be-8aa5-22fd9b15da35 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:32.215812 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-09fe03a9-1327-46be-8aa5-22fd9b15da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:32.225866 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4465/8953] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:44:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:32.236701 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b34573-e8a1-4bb4-ba57-431961d39cad None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:32.246470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b34573-e8a1-4bb4-ba57-431961d39cad None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:32.250694 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:32.251376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:32.251665 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:32.251945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:32.262312 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:32.263782 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:32.275416 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4489/8954] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:33.447007 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19e984-0dc3-47db-9ad8-8be4b1839136 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:33.447602 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19e984-0dc3-47db-9ad8-8be4b1839136 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:33.447746 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19e984-0dc3-47db-9ad8-8be4b1839136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:33.465655 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-1f19e984-0dc3-47db-9ad8-8be4b1839136 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:33.466958 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-1f19e984-0dc3-47db-9ad8-8be4b1839136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:33.478577 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4466/8955] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:44:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:33.490763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:33.499215 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3ec7b-34b1-4bda-9237-7607c2ca54b8 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:33.502928 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068762ea-a3d3-4572-8e7b-fc447a472cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:33.503569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068762ea-a3d3-4572-8e7b-fc447a472cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:33.503855 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068762ea-a3d3-4572-8e7b-fc447a472cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:33.504240 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068762ea-a3d3-4572-8e7b-fc447a472cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:33.514628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068762ea-a3d3-4572-8e7b-fc447a472cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:33.516165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068762ea-a3d3-4572-8e7b-fc447a472cf9 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:33.526970 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4490/8956] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:36.432837 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871158ab-dcfd-42f9-9238-403e10ba5914 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:36.433350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871158ab-dcfd-42f9-9238-403e10ba5914 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:36.433473 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871158ab-dcfd-42f9-9238-403e10ba5914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:36.451005 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-871158ab-dcfd-42f9-9238-403e10ba5914 None None] MFA Rules not processed for user `6a81d6104e634bd7a6ae26dc51124c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:36.452204 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-871158ab-dcfd-42f9-9238-403e10ba5914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:36.459779 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4467/8957] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:44:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:39.263115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd400257-e8c3-4d5e-ba3f-2394fa4f1468 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:39.263677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd400257-e8c3-4d5e-ba3f-2394fa4f1468 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:39.263807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd400257-e8c3-4d5e-ba3f-2394fa4f1468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:39.281530 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-dd400257-e8c3-4d5e-ba3f-2394fa4f1468 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:39.282721 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-dd400257-e8c3-4d5e-ba3f-2394fa4f1468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:39.290036 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4491/8958] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:44:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:39.301486 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871158ab-dcfd-42f9-9238-403e10ba5914 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:39.310858 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871158ab-dcfd-42f9-9238-403e10ba5914 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:39.314421 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2148e89-28af-4e2d-9d19-68c4f1952581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:39.315095 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2148e89-28af-4e2d-9d19-68c4f1952581 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:39.315386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2148e89-28af-4e2d-9d19-68c4f1952581 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:39.315664 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2148e89-28af-4e2d-9d19-68c4f1952581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:39.322528 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2148e89-28af-4e2d-9d19-68c4f1952581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:39.324004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2148e89-28af-4e2d-9d19-68c4f1952581 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:39.332208 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4468/8959] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:41.780423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd400257-e8c3-4d5e-ba3f-2394fa4f1468 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:41.792904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd400257-e8c3-4d5e-ba3f-2394fa4f1468 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:41.798155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:41.798594 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:41.798917 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:41.799197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:41.800977 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:41.812378 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:41.813982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:41.827689 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4492/8960] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:46.475446 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d114f1-bac2-46f7-8690-42e9769f9aba None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:46.475999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d114f1-bac2-46f7-8690-42e9769f9aba None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:46.476368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d114f1-bac2-46f7-8690-42e9769f9aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:46.499546 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-90d114f1-bac2-46f7-8690-42e9769f9aba None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:46.500983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-90d114f1-bac2-46f7-8690-42e9769f9aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:46.508294 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4469/8961] 10.222.0.55 () {58 vars in 1015 bytes} [Sat May 7 22:44:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:46.520759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:46.530559 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba1f9d-2b89-4df5-ad4d-f1bc5451a4da service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:46.535815 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:46.536516 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:46.536833 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:46.537085 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:46.547818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:46.550062 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:46.567378 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4493/8962] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:47.201857 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba615f-1593-4031-9894-5cd54c1041b3 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:47.202419 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba615f-1593-4031-9894-5cd54c1041b3 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:47.202808 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba615f-1593-4031-9894-5cd54c1041b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:47.229800 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-85ba615f-1593-4031-9894-5cd54c1041b3 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:47.231318 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-85ba615f-1593-4031-9894-5cd54c1041b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:47.241128 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4470/8963] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:44:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:47.259275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:47.274376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51684bf-3f88-43e0-b740-a6ce5ce41e90 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:47.280439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:47.281498 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:47.281784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:47.282067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:47.292454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:47.294095 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:47.317367 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4494/8964] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:44:55.230176 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10244c-9c4e-4358-a430-8307fc031f1b None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:55.230675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10244c-9c4e-4358-a430-8307fc031f1b None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:55.230995 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10244c-9c4e-4358-a430-8307fc031f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:55.252548 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-7e10244c-9c4e-4358-a430-8307fc031f1b None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:44:55.254413 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7e10244c-9c4e-4358-a430-8307fc031f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:44:55.264111 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4471/8965] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:44:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:44:55.280758 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:44:55.292195 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9274b-9de3-4480-9cd5-7de9dee245d2 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:44:55.298587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407855f6-1176-406c-9a94-660488a1f6d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:44:55.298754 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407855f6-1176-406c-9a94-660488a1f6d9 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:44:55.299042 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407855f6-1176-406c-9a94-660488a1f6d9 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:44:55.299319 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407855f6-1176-406c-9a94-660488a1f6d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:44:55.309129 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407855f6-1176-406c-9a94-660488a1f6d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:44:55.310756 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407855f6-1176-406c-9a94-660488a1f6d9 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:44:55.321644 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4495/8966] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:47:03.565111 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10244c-9c4e-4358-a430-8307fc031f1b None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:47:03.621755 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10244c-9c4e-4358-a430-8307fc031f1b None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:47:03.627319 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:47:03.627951 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:47:03.628229 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:47:03.628499 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:47:03.636610 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:47:03.638174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:47:03.647328 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4472/8967] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:47:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:47:17.956569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09456501-8f7b-483c-b226-44973fd8d25e None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:47:17.957138 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09456501-8f7b-483c-b226-44973fd8d25e None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:47:17.957268 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09456501-8f7b-483c-b226-44973fd8d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:47:17.984635 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-09456501-8f7b-483c-b226-44973fd8d25e None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:47:17.986148 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-09456501-8f7b-483c-b226-44973fd8d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:47:18.003037 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4496/8968] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:47:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:47:18.017017 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:47:18.026171 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c3520-9e8f-4f5b-ba1e-1cbfeba943b3 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:47:18.029848 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:47:18.030491 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:47:18.030799 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:47:18.031080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:47:18.039135 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:47:18.039983 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:47:18.048391 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4473/8969] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:47:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:47:18.147397 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6db9a-09e1-4a1c-a01a-99715973c579 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:47:18.147687 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6db9a-09e1-4a1c-a01a-99715973c579 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:47:18.147967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6db9a-09e1-4a1c-a01a-99715973c579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:47:18.165982 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-91f6db9a-09e1-4a1c-a01a-99715973c579 None None] MFA Rules not processed for user `8643bb571c514f1fa358526b00ce47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:47:18.167225 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-91f6db9a-09e1-4a1c-a01a-99715973c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:47:18.177087 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4497/8970] 10.222.0.32 () {58 vars in 1018 bytes} [Sat May 7 22:47:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:47:18.186882 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:47:18.196156 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eae0d7-26d8-4f85-8038-989ebc23f5cb service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:47:18.199915 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:47:18.200641 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:47:18.200952 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:47:18.201226 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:47:18.211675 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:47:18.213137 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:47:18.223971 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4474/8971] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:47:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:47:28.642484 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6db9a-09e1-4a1c-a01a-99715973c579 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:47:28.655015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6db9a-09e1-4a1c-a01a-99715973c579 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:47:28.660727 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:47:28.661983 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:47:28.662305 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:47:28.662587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:47:28.671436 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:47:28.673066 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:47:28.684974 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4498/8972] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:47:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:47:30.281300 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:47:30.293322 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26f57-6001-4c91-99d9-428d00a7bd35 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:47:30.298398 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:47:30.299013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:47:30.299295 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:47:30.299566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:47:30.308742 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:47:30.310316 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:47:30.319733 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4475/8973] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:47:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:48:55.503251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:48:55.512455 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae6f88-f3b4-468b-8261-9dd7058e59ff service placement] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:48:55.516072 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:48:55.516736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:48:55.517029 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:48:55.517309 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:48:55.576939 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:48:55.578381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:48:55.588591 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4499/8974] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:49:02.214575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:02.229393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31805d85-ddcd-4419-9db2-0a84e5e5207c service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:02.242472 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:02.244591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:02.245100 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:02.245467 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] PATH_INFO: `/v3/users/6a81d6104e634bd7a6ae26dc51124c2d` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:02.247751 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a81d6104e634bd7a6ae26dc51124c2d)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:02.249733 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:02.306989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a81d6104e634bd7a6ae26dc51124c2d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.314651 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a81d6104e634bd7a6ae26dc51124c2d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.315431 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a81d6104e634bd7a6ae26dc51124c2d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.316049 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a81d6104e634bd7a6ae26dc51124c2d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.323997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a81d6104e634bd7a6ae26dc51124c2d'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.343464 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4476/8975] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:49:02 2022] DELETE /identity/v3/users/6a81d6104e634bd7a6ae26dc51124c2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:49:02.519873 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:02.533120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002be9c0-c490-47a5-b37c-542157634a8e service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:02.588376 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:02.589226 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:02.589505 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:02.589780 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] PATH_INFO: `/v3/projects/2a375b5dd32e4b6eb61e9a9877c9a04c` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:02.590971 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a375b5dd32e4b6eb61e9a9877c9a04c)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:02.592884 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:02.636093 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'request_id': 'req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.642649 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'request_id': 'req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.649381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a375b5dd32e4b6eb61e9a9877c9a04c', 'request_id': 'req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.660475 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] The token cache is being invalidate because project 2a375b5dd32e4b6eb61e9a9877c9a04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:49:02.660760 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.661379 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.662940 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4500/8976] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:49:02 2022] DELETE /identity/v3/projects/2a375b5dd32e4b6eb61e9a9877c9a04c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:49:02.667080 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:02.668518 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:02.681840 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c1f05-a5c8-4c69-be10-4bdde665cc6f admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:02.735127 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:02.736515 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:02.736794 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:02.737067 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] PATH_INFO: `/v3/users/da22eb86d6bc48d99132852d5a28c552` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:02.738260 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da22eb86d6bc48d99132852d5a28c552)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:02.740217 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:02.784307 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da22eb86d6bc48d99132852d5a28c552'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.790965 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da22eb86d6bc48d99132852d5a28c552'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.791623 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da22eb86d6bc48d99132852d5a28c552'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.792228 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da22eb86d6bc48d99132852d5a28c552'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.799479 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-71362ab2-e607-4cf4-8ef2-ad132dd18fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da22eb86d6bc48d99132852d5a28c552'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:02.821609 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4477/8977] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:49:02 2022] DELETE /identity/v3/users/da22eb86d6bc48d99132852d5a28c552 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:49:02.990955 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:02.992593 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:03.006081 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3b67b-1ef1-45a6-9f59-d93ec725b21b admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.064538 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.066006 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.066292 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.066567 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] PATH_INFO: `/v3/projects/e5079706a95444c2b80c3cdf6bb5c894` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.067812 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5079706a95444c2b80c3cdf6bb5c894)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.069801 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.113466 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5079706a95444c2b80c3cdf6bb5c894', 'request_id': 'req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:03.119418 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5079706a95444c2b80c3cdf6bb5c894', 'request_id': 'req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:03.126966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5079706a95444c2b80c3cdf6bb5c894', 'request_id': 'req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:03.137026 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] The token cache is being invalidate because project e5079706a95444c2b80c3cdf6bb5c894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:49:03.137310 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:03.137938 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-208dcd5b-bfdc-4e9a-9e17-d6df193b6de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:49:03.139518 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4501/8978] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:49:02 2022] DELETE /identity/v3/projects/e5079706a95444c2b80c3cdf6bb5c894 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:49:03.145146 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16841be0-d231-460e-83a8-cb2d9d78e987 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.145442 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16841be0-d231-460e-83a8-cb2d9d78e987 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.145723 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16841be0-d231-460e-83a8-cb2d9d78e987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.163663 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-16841be0-d231-460e-83a8-cb2d9d78e987 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:49:03.164865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-16841be0-d231-460e-83a8-cb2d9d78e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:03.222940 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4478/8979] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:49:03.231214 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98f22-2f08-41f2-aa78-3992e39bd5d5 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.231561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98f22-2f08-41f2-aa78-3992e39bd5d5 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.231850 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf98f22-2f08-41f2-aa78-3992e39bd5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.250882 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-0bf98f22-2f08-41f2-aa78-3992e39bd5d5 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:49:03.252145 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-0bf98f22-2f08-41f2-aa78-3992e39bd5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:03.260112 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4502/8980] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:49:03.264345 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16841be0-d231-460e-83a8-cb2d9d78e987 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:03.274004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16841be0-d231-460e-83a8-cb2d9d78e987 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.278611 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.279306 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.279595 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.279874 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] PATH_INFO: `/v3/domains` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.280591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 07 22:49:03.280904 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.283375 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.294735 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4479/8981] 10.222.0.32 () {58 vars in 1152 bytes} [Sat May 7 22:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 07 22:49:03.299412 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf98f22-2f08-41f2-aa78-3992e39bd5d5 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:03.308501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf98f22-2f08-41f2-aa78-3992e39bd5d5 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.313159 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.313818 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.314104 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.314401 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.315110 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.317068 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.342057 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4503/8982] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:49:03 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:49:03.346765 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:03.356924 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e875ad-732b-4019-b5bc-d02e24c2eeac admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.415036 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.415815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.416105 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.416383 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.417087 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.419071 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.437936 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4480/8983] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:49:03 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:49:03.442115 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:03.452454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20a734-2818-42fb-9f95-4f42f705d3fa admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.460463 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.461143 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.462564 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.462880 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.463602 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.465217 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.476186 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4504/8984] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:49:03.480290 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:03.493425 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a194f-0e6e-4bc5-9aee-239ff1edccaa admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.498123 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883739f-5e0b-4bae-b5f1-72f322f3d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.501255 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883739f-5e0b-4bae-b5f1-72f322f3d557 admin admin] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.501570 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883739f-5e0b-4bae-b5f1-72f322f3d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.501861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883739f-5e0b-4bae-b5f1-72f322f3d557 admin admin] PATH_INFO: `/v3/roles` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.503600 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883739f-5e0b-4bae-b5f1-72f322f3d557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.505214 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883739f-5e0b-4bae-b5f1-72f322f3d557 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.515216 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4481/8985] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:49:03.520232 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:03.534381 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe476-84b6-4d6b-a65c-5e15186eaab8 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.539522 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.540406 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.540690 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.540967 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] PATH_INFO: `/v3/projects/a16ae1c6eaad44359f6bac5eaef3d3a5/users/b44014561e8c455981cd814679935b11/roles/5f40f2a9333d485c8324a5707fc69ad2` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.558696 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16ae1c6eaad44359f6bac5eaef3d3a5, user_id=b44014561e8c455981cd814679935b11, role_id=5f40f2a9333d485c8324a5707fc69ad2)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.561414 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.574354 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4505/8986] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:49:03 2022] PUT /identity/v3/projects/a16ae1c6eaad44359f6bac5eaef3d3a5/users/b44014561e8c455981cd814679935b11/roles/5f40f2a9333d485c8324a5707fc69ad2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:49:03.579478 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589d98-7455-4539-8b17-9f8f8af5eaf2 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.579774 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589d98-7455-4539-8b17-9f8f8af5eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.580059 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb589d98-7455-4539-8b17-9f8f8af5eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.597340 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-bb589d98-7455-4539-8b17-9f8f8af5eaf2 None None] MFA Rules not processed for user `9c1ef8221c9c4d4fa45130c3a58da61e`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:49:03.598531 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-bb589d98-7455-4539-8b17-9f8f8af5eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:03.654426 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4482/8987] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:49:03.664526 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:03.666234 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:03.721643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986123b-3eaf-4dce-803c-b7fe3754c1e0 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:03.725275 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:03.725912 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:03.726197 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:03.726476 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:03.735915 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:03.737353 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:03.746624 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4506/8988] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:49:08.153785 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fda3d-285d-4888-9b5d-05ba0f845679 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:08.154247 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fda3d-285d-4888-9b5d-05ba0f845679 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:08.154337 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fda3d-285d-4888-9b5d-05ba0f845679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:08.186329 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-df2fda3d-285d-4888-9b5d-05ba0f845679 None None] MFA Rules not processed for user `b44014561e8c455981cd814679935b11`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:49:08.187784 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-df2fda3d-285d-4888-9b5d-05ba0f845679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:08.284175 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4483/8989] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:49:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:49:08.288643 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:08.298949 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660b2f-4646-42ae-bbc5-b58e41c23689 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:08.303904 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:08.304644 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:08.305005 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:08.305402 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:08.306164 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:08.308229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:08.342638 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4507/8990] 10.222.0.32 () {60 vars in 1152 bytes} [Sat May 7 22:49:08 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:49:08.344781 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fda3d-285d-4888-9b5d-05ba0f845679 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:08.356894 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fda3d-285d-4888-9b5d-05ba0f845679 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:08.418117 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:08.419052 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:08.419410 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:08.419757 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] PATH_INFO: `/v3/users` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:08.420524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:08.422897 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:08.445626 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4484/8991] 10.222.0.32 () {60 vars in 1143 bytes} [Sat May 7 22:49:08 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 07 22:49:08.449753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:08.462561 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414279d-0ce1-4d57-831e-e95f0abfc4e1 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:08.467470 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:08.468146 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:08.468598 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:08.468878 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:08.470147 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:08.471825 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:08.484438 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4508/8992] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:49:08.489043 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:08.499092 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918670-a3b4-4f4d-80ec-54de903aa565 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:08.505485 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:08.506386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:08.506671 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:08.507013 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] PATH_INFO: `/v3/projects/e9a20698141a441e9346f49b27703c2e/users/26f9210d47d14172888e1c7f06eb3e78/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:08.522987 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a20698141a441e9346f49b27703c2e, user_id=26f9210d47d14172888e1c7f06eb3e78, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:08.525707 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:08.541847 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4485/8993] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:49:08 2022] PUT /identity/v3/projects/e9a20698141a441e9346f49b27703c2e/users/26f9210d47d14172888e1c7f06eb3e78/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:49:08.546167 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:08.558859 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bb08f-2d45-404d-ac27-d854a53c7fe2 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:08.618919 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0efbe-da79-42f8-a7e8-5366c86787a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:08.619586 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0efbe-da79-42f8-a7e8-5366c86787a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:08.620142 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0efbe-da79-42f8-a7e8-5366c86787a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:08.620556 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0efbe-da79-42f8-a7e8-5366c86787a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:08.621425 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0efbe-da79-42f8-a7e8-5366c86787a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:08.623077 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0efbe-da79-42f8-a7e8-5366c86787a3 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:08.634613 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4509/8994] 10.222.0.32 () {58 vars in 1121 bytes} [Sat May 7 22:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 07 22:49:08.638579 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:08.650572 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc9adf-e119-4596-9951-6a467faba3ba admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:08.655926 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:08.657634 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] REQUEST_METHOD: `PUT` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:08.658084 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:08.658366 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] PATH_INFO: `/v3/projects/e9a20698141a441e9346f49b27703c2e/users/26f9210d47d14172888e1c7f06eb3e78/roles/c9eb15c85a974dd28e3374b8d701947e` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:08.660443 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a20698141a441e9346f49b27703c2e, user_id=26f9210d47d14172888e1c7f06eb3e78, role_id=c9eb15c85a974dd28e3374b8d701947e)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:08.663184 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:08.674492 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4486/8995] 10.222.0.32 () {60 vars in 1482 bytes} [Sat May 7 22:49:08 2022] PUT /identity/v3/projects/e9a20698141a441e9346f49b27703c2e/users/26f9210d47d14172888e1c7f06eb3e78/roles/c9eb15c85a974dd28e3374b8d701947e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 07 22:49:13.285120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961247-9d54-4916-808f-17eda556fee4 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:13.285574 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961247-9d54-4916-808f-17eda556fee4 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:13.285661 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0961247-9d54-4916-808f-17eda556fee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:13.312087 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-c0961247-9d54-4916-808f-17eda556fee4 None None] MFA Rules not processed for user `26f9210d47d14172888e1c7f06eb3e78`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:49:13.314140 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c0961247-9d54-4916-808f-17eda556fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:13.384121 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4510/8996] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:49:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:49:13.395731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:13.397448 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:13.484218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cdfa6-0a8a-43c4-bb32-aaa5ed6bf667 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:13.490299 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aafe9-915e-4f47-bd2a-df9d450dc48a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:13.490981 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aafe9-915e-4f47-bd2a-df9d450dc48a service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:13.491267 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aafe9-915e-4f47-bd2a-df9d450dc48a service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:13.491541 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aafe9-915e-4f47-bd2a-df9d450dc48a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:13.547944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aafe9-915e-4f47-bd2a-df9d450dc48a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:13.549566 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aafe9-915e-4f47-bd2a-df9d450dc48a service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:13.559114 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4487/8997] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:49:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 07 22:49:14.827120 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152236-91a4-459f-acb2-984d0caeb4a8 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:14.827543 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152236-91a4-459f-acb2-984d0caeb4a8 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:14.827685 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152236-91a4-459f-acb2-984d0caeb4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:14.846216 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-1a152236-91a4-459f-acb2-984d0caeb4a8 None None] MFA Rules not processed for user `b44014561e8c455981cd814679935b11`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:49:14.847562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1a152236-91a4-459f-acb2-984d0caeb4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:14.854487 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4511/8998] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:49:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:49:15.155954 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea93c-15b7-414f-8cce-6b4cd6aa2525 None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:15.156687 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea93c-15b7-414f-8cce-6b4cd6aa2525 None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:15.157293 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea93c-15b7-414f-8cce-6b4cd6aa2525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:15.175386 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-ff0ea93c-15b7-414f-8cce-6b4cd6aa2525 None None] MFA Rules not processed for user `a71ab917f46d4b419179eccc29a98e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:49:15.176591 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-ff0ea93c-15b7-414f-8cce-6b4cd6aa2525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:49:15.228442 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4488/8999] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:49:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:49:15.240303 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152236-91a4-459f-acb2-984d0caeb4a8 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:15.252375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152236-91a4-459f-acb2-984d0caeb4a8 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:15.256229 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:15.256885 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:15.257174 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:15.257452 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:15.265332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:15.267773 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:15.275921 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4512/9000] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:49:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:49:26.439818 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea93c-15b7-414f-8cce-6b4cd6aa2525 None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:49:26.448283 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea93c-15b7-414f-8cce-6b4cd6aa2525 None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:49:26.451947 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:49:26.452585 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:49:26.452871 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:49:26.453151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:49:26.462490 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:49:26.463999 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:49:26.473333 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4489/9001] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:49:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:50:31.044957 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:50:31.053537 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ad261-5388-4237-98ef-01e606b47bb5 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:50:31.057243 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0b88e-d0a5-4f7b-95e8-2728bff3508c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:50:31.057995 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b88e-d0a5-4f7b-95e8-2728bff3508c service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:50:31.058284 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b88e-d0a5-4f7b-95e8-2728bff3508c service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:50:31.058562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b88e-d0a5-4f7b-95e8-2728bff3508c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:50:31.060365 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-4ed0b88e-d0a5-4f7b-95e8-2728bff3508c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:50:31.082165 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0b88e-d0a5-4f7b-95e8-2728bff3508c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:50:31.083670 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0b88e-d0a5-4f7b-95e8-2728bff3508c service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:50:31.091435 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4513/9002] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:50:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:51:23.602310 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:23.603732 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:23.658393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5f2b-0424-4e37-aec5-346f6deb8668 service neutron] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:23.662509 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0275c43e4d7744b4a556c30662b7e84f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:23.663174 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:23.663453 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:23.663741 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:23.665463 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:23.689890 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:23.691428 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:23.702017 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4490/9003] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:51:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:51:27.633279 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:27.633736 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:27.633826 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:27.651599 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:51:27.652767 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:27.711186 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4514/9004] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:51:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:51:27.757434 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:27.758877 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:27.824294 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531e2df-62d8-465f-9718-2f86d11fc281 service glance] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:27.829291 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a31304-3823-4c39-ae9e-24c0b56b85e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:27.829962 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31304-3823-4c39-ae9e-24c0b56b85e2 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:27.830250 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31304-3823-4c39-ae9e-24c0b56b85e2 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:27.830524 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31304-3823-4c39-ae9e-24c0b56b85e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:27.839090 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a31304-3823-4c39-ae9e-24c0b56b85e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:27.840670 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a31304-3823-4c39-ae9e-24c0b56b85e2 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:27.848526 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4491/9005] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:51:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:51:29.061338 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:29.063488 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:29.080394 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1021fe-bc46-483c-b34b-61d7fe569e99 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:29.086288 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:29.087199 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:29.087584 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:29.087966 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:29.089909 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:29.103595 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:29.105317 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:29.117305 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4515/9006] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:51:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:51:37.419989 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] REQUEST_METHOD: `POST` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:37.420493 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:37.420594 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:37.438099 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.auth.core [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] MFA Rules not processed for user `b44014561e8c455981cd814679935b11`. Rule list: `[]` (Enabled: `True`). {{(pid=91075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:51:37.439327 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:37.446248 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4492/9007] 10.222.0.32 () {58 vars in 957 bytes} [Sat May 7 22:51:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:51:37.764836 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:37.766386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:37.777975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8d47-40e5-435c-96d1-3bc4fb529084 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:37.781808 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:37.782439 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:37.782722 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:37.783027 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:37.784703 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:37.794155 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:37.795637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:37.803327 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4516/9008] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:51:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:51:38.124593 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:38.125971 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:38.147961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:38.156386 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d91c6-1ffc-478e-baa3-3c33b19f6595 service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:38.160454 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057e626-d593-447f-a2be-b7d52237ec41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:38.161219 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e626-d593-447f-a2be-b7d52237ec41 service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:38.161557 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e626-d593-447f-a2be-b7d52237ec41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:38.161842 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e626-d593-447f-a2be-b7d52237ec41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:38.167803 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-9057e626-d593-447f-a2be-b7d52237ec41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:38.182266 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057e626-d593-447f-a2be-b7d52237ec41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:38.183757 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057e626-d593-447f-a2be-b7d52237ec41 service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:38.195343 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4517/9009] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:51:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:51:38.224324 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b52ea-17d5-4f76-b24f-7796b63a253d None None] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:38.229221 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:38.229868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:38.230151 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:38.230422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:38.232575 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:38.243868 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:38.245540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:38.256090 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4493/9010] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:51:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:51:39.336523 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93837cd9-f906-49a4-951d-89c39115f8f1 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:39.336945 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93837cd9-f906-49a4-951d-89c39115f8f1 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:39.337192 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93837cd9-f906-49a4-951d-89c39115f8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:39.356562 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-93837cd9-f906-49a4-951d-89c39115f8f1 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:51:39.357776 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-93837cd9-f906-49a4-951d-89c39115f8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:39.365191 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4518/9011] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:51:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 07 22:51:39.377740 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:39.388710 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6271ae-bf77-49cc-8b6d-c4e6f066c242 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:39.394218 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:39.394963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:39.395404 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:39.396268 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:39.405280 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:39.406934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:39.416502 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4494/9012] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:51:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:51:47.618989 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93837cd9-f906-49a4-951d-89c39115f8f1 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:47.628423 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93837cd9-f906-49a4-951d-89c39115f8f1 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:47.632853 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71ab917f46d4b419179eccc29a98e38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:47.633501 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:47.633784 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:47.634057 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:47.635895 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:47.645492 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:47.646965 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:47.655279 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4519/9013] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:51:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:51:48.349312 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:51:48.368395 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417239b2-e63c-429c-9cf2-182356b119ce service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:51:48.376259 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:51:48.377161 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:51:48.377450 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:51:48.377731 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:51:48.379702 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:51:48.394048 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:51:48.395734 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:51:48.414984 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4495/9014] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:52:33.647587 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:52:33.659849 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df8d7-27aa-413a-85c3-8fb04f7a397f service neutron] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:52:33.664930 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193b465-d0fe-454d-816e-e5c3d91c9d95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:52:33.665569 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b465-d0fe-454d-816e-e5c3d91c9d95 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:52:33.665856 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b465-d0fe-454d-816e-e5c3d91c9d95 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:52:33.666137 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193b465-d0fe-454d-816e-e5c3d91c9d95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:52:33.667925 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-1193b465-d0fe-454d-816e-e5c3d91c9d95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:52:33.679239 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b465-d0fe-454d-816e-e5c3d91c9d95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:52:33.680830 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193b465-d0fe-454d-816e-e5c3d91c9d95 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:52:33.690466 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4520/9015] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:52:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:52:35.916608 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:52:35.918000 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:52:35.932108 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e187f6-ef46-4a38-8085-55f8625da545 service nova] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:52:35.937072 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:52:35.937712 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:52:35.937997 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:52:35.938273 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:52:35.939963 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:52:35.950861 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:52:35.952447 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:52:35.961968 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4496/9016] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:52:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:53:30.320962 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde713ab-1624-4fc9-9c25-4ca12f3a8dba None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:30.321961 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde713ab-1624-4fc9-9c25-4ca12f3a8dba None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:30.322055 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde713ab-1624-4fc9-9c25-4ca12f3a8dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:30.380067 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-fde713ab-1624-4fc9-9c25-4ca12f3a8dba None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:53:30.381297 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-fde713ab-1624-4fc9-9c25-4ca12f3a8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:53:30.402307 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4521/9017] 10.222.0.32 () {58 vars in 1009 bytes} [Sat May 7 22:53:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:53:30.447934 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:30.479134 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135879-fde2-45bb-9cea-608c1fd566e7 service placement] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:30.486094 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:30.486574 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:30.486908 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:30.488564 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:30.498208 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:30.500004 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:30.509685 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4497/9018] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:53:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 07 22:53:39.846209 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef07c-9f7a-4302-b1ca-60ffd924fa3b None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:39.846733 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef07c-9f7a-4302-b1ca-60ffd924fa3b None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:39.846851 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef07c-9f7a-4302-b1ca-60ffd924fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:39.873699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-bd7ef07c-9f7a-4302-b1ca-60ffd924fa3b None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:53:39.881705 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-bd7ef07c-9f7a-4302-b1ca-60ffd924fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:53:39.888926 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4522/9019] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:53:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:53:39.900966 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:39.911393 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d466743-b2a4-41fe-af22-93d18654fbdb service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:39.917285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:39.918044 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:39.918277 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:39.918549 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:39.927350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:39.928930 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:39.937630 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4498/9020] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:53:44.804405 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12086b-dedd-4d8e-a07c-3611559b1530 None None] REQUEST_METHOD: `POST` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:44.804862 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12086b-dedd-4d8e-a07c-3611559b1530 None None] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:44.804973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12086b-dedd-4d8e-a07c-3611559b1530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:44.822415 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.auth.core [None req-ff12086b-dedd-4d8e-a07c-3611559b1530 None None] MFA Rules not processed for user `d5e959f3745040feb800a00c9c5e4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 07 22:53:44.823628 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-ff12086b-dedd-4d8e-a07c-3611559b1530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:53:44.830686 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4523/9021] 10.222.0.32 () {58 vars in 967 bytes} [Sat May 7 22:53:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 07 22:53:44.843270 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:44.854098 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0d97e-1dd7-442c-8cb1-a8c16c3f0921 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:44.859159 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddea6c1eb8764f1a9f0a310a78128460', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:44.859790 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:44.860074 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:44.860350 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:44.868172 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:44.869747 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:44.877689 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4499/9022] 10.222.0.32 () {60 vars in 1384 bytes} [Sat May 7 22:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 07 22:53:48.296462 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12086b-dedd-4d8e-a07c-3611559b1530 None None] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:48.314384 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12086b-dedd-4d8e-a07c-3611559b1530 None None] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:48.323354 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8643bb571c514f1fa358526b00ce47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:48.324609 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:48.325207 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:48.325800 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:48.328156 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:53:48.349504 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:48.353699 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:48.366898 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4524/9023] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:53:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:53:56.593500 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:56.681368 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ae178-10f4-4719-9483-f4decc0219d6 service swift] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:56.686101 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:56.687001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:56.687285 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:56.687557 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] PATH_INFO: `/v3/users/b44014561e8c455981cd814679935b11` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:56.688770 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44014561e8c455981cd814679935b11)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:56.691001 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:56.739028 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44014561e8c455981cd814679935b11'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:56.746367 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44014561e8c455981cd814679935b11'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:56.747070 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44014561e8c455981cd814679935b11'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:56.747674 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44014561e8c455981cd814679935b11'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:56.754645 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44014561e8c455981cd814679935b11'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:56.772269 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4500/9024] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:53:56 2022] DELETE /identity/v3/users/b44014561e8c455981cd814679935b11 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:53:56.946759 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:56.957393 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5bd97-6c1d-49a0-8a1e-f1e4dd6d72d9 service nova] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:57.012622 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:57.013483 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:57.013763 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:57.014038 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] PATH_INFO: `/v3/projects/a16ae1c6eaad44359f6bac5eaef3d3a5` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:57.015251 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16ae1c6eaad44359f6bac5eaef3d3a5)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:57.017184 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:57.061015 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'request_id': 'req-459b4179-8a61-4aa6-8142-484773ddfe40'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.066973 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'request_id': 'req-459b4179-8a61-4aa6-8142-484773ddfe40'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.073507 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16ae1c6eaad44359f6bac5eaef3d3a5', 'request_id': 'req-459b4179-8a61-4aa6-8142-484773ddfe40'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.095449 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] The token cache is being invalidate because project a16ae1c6eaad44359f6bac5eaef3d3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:53:57.095741 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.096375 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.097929 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4525/9025] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:53:56 2022] DELETE /identity/v3/projects/a16ae1c6eaad44359f6bac5eaef3d3a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:53:57.102380 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:57.103803 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:53:57.116627 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736be26-eb0e-43a3-b7b8-adfa168fb67c admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:57.172865 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:57.173662 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:57.173944 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:57.174222 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] PATH_INFO: `/v3/users/26f9210d47d14172888e1c7f06eb3e78` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:57.175459 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f9210d47d14172888e1c7f06eb3e78)` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:57.177429 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:57.223422 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f9210d47d14172888e1c7f06eb3e78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.230588 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f9210d47d14172888e1c7f06eb3e78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.231286 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f9210d47d14172888e1c7f06eb3e78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.231887 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f9210d47d14172888e1c7f06eb3e78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.239118 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.notifications [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f9210d47d14172888e1c7f06eb3e78'} {{(pid=91075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.256811 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4501/9026] 10.222.0.32 () {58 vars in 1223 bytes} [Sat May 7 22:53:57 2022] DELETE /identity/v3/users/26f9210d47d14172888e1c7f06eb3e78 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:53:57.427043 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:53:57.428519 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:53:57.442641 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b4179-8a61-4aa6-8142-484773ddfe40 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:53:57.504332 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c1ef8221c9c4d4fa45130c3a58da61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2f828af0706465883131e16cb564d05', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:53:57.505194 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:53:57.505479 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:53:57.505753 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] PATH_INFO: `/v3/projects/e9a20698141a441e9346f49b27703c2e` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:53:57.506975 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a20698141a441e9346f49b27703c2e)` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:53:57.509535 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:53:57.553572 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a20698141a441e9346f49b27703c2e', 'request_id': 'req-e423fdab-4422-44aa-9505-3117ccb39c63'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.560065 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a20698141a441e9346f49b27703c2e', 'request_id': 'req-e423fdab-4422-44aa-9505-3117ccb39c63'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.567049 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a20698141a441e9346f49b27703c2e', 'request_id': 'req-e423fdab-4422-44aa-9505-3117ccb39c63'} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.577731 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] The token cache is being invalidate because project e9a20698141a441e9346f49b27703c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91076) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 07 22:53:57.578017 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.578637 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.notifications [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 07 22:53:57.580206 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4526/9027] 10.222.0.32 () {58 vars in 1232 bytes} [Sat May 7 22:53:57 2022] DELETE /identity/v3/projects/e9a20698141a441e9346f49b27703c2e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 07 22:57:40.309815 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Authenticating user token {{(pid=91075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:57:40.311249 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:57:40.425540 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03305404-da68-4f54-b4c4-27a0479d0546 admin admin] Validating token access rules against request {{(pid=91075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:57:40.483185 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa93ce-a433-49c6-be09-0dae37e673c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:57:40.483829 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa93ce-a433-49c6-be09-0dae37e673c0 service placement] REQUEST_METHOD: `GET` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:57:40.484110 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa93ce-a433-49c6-be09-0dae37e673c0 service placement] SCRIPT_NAME: `/identity` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:57:40.484411 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa93ce-a433-49c6-be09-0dae37e673c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:57:40.486166 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.fernet_utils [None req-46aa93ce-a433-49c6-be09-0dae37e673c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:57:40.496804 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa93ce-a433-49c6-be09-0dae37e673c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:57:40.498401 ncdv-master-1 devstack@keystone.service[91075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa93ce-a433-49c6-be09-0dae37e673c0 service placement] RBAC: Authorization granted {{(pid=91075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:57:40.508137 ncdv-master-1 devstack@keystone.service[91075]: [pid: 91075|app: 0|req: 4502/9028] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:57:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 07 22:57:40.615044 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Authenticating user token {{(pid=91076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 07 22:57:40.621096 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:57:40.663581 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423fdab-4422-44aa-9505-3117ccb39c63 admin admin] Validating token access rules against request {{(pid=91076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 07 22:57:40.668677 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6333d03-622d-4e41-85db-1207662e61a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e834001baa424d24b5c9551a7cae7741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758d4dea899344b883971712aebe042f', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 07 22:57:40.669324 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333d03-622d-4e41-85db-1207662e61a6 service placement] REQUEST_METHOD: `GET` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 07 22:57:40.669613 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333d03-622d-4e41-85db-1207662e61a6 service placement] SCRIPT_NAME: `/identity` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 07 22:57:40.669892 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6333d03-622d-4e41-85db-1207662e61a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 07 22:57:40.671653 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.fernet_utils [None req-c6333d03-622d-4e41-85db-1207662e61a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 07 22:57:40.682807 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333d03-622d-4e41-85db-1207662e61a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 07 22:57:40.684334 ncdv-master-1 devstack@keystone.service[91076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6333d03-622d-4e41-85db-1207662e61a6 service placement] RBAC: Authorization granted {{(pid=91076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 07 22:57:40.694430 ncdv-master-1 devstack@keystone.service[91076]: [pid: 91076|app: 0|req: 4527/9029] 10.222.0.32 () {60 vars in 1365 bytes} [Sat May 7 22:57:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)